Remote · Remote

Software Development Engineer in Test - AI

Full-timePosted 2 Nov

Salary: Not disclosed
Experience: 0–1 yearsFreshers welcome
Eligible batches: 2024 · 2025 · 2026
Location: RemoteRemote

About the role

The position focuses on quality engineering for AI‑driven applications, building automated test frameworks, and ensuring reliability, safety, and performance of large‑language‑model based systems. Candidates will collaborate with engineering, AI/ML, product, and DevOps teams while working remotely from India.

Responsibilities

Design and execute testing strategies for AI agents, chat‑bots, RAG pipelines and LLM‑based workflows.
Develop evaluation frameworks for hallucination detection, bias, grounding, and response quality.
Create scalable UI/API automation suites using Python and tools such as Robot Framework, Playwright, Selenium or Cypress.
Integrate automated tests into CI/CD pipelines (GitHub Actions, Jenkins, Azure DevOps) and monitor results.
Validate vector‑search architectures, embeddings and AI‑agent orchestration using databases like Pinecone or Weaviate.
Collaborate on cloud‑based testing across AWS, Azure, GCP or OCI and ensure system resiliency.

Free interview prep

Prepare for the interview

All lists

Picked for this role's title and skills: the questions that come up most, each with a short answer to say out loud.

Machine learning interview questions40 questions · ≈ 18 min to revise

Asked most often · 19 of 40

Eligibility

Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML or a related discipline (preferred).
Strong hands‑on programming experience in Python.
Solid understanding of software testing principles and quality engineering.
Experience with API, micro‑service and UI automation testing.
Familiarity with CI/CD, Docker, Kubernetes and major cloud platforms.