SDET - I

15 Minutes ago • 2 Years +
Automation

Job Description

Mindtickle is a market-leading revenue productivity platform. This role involves designing, building, and maintaining scalable automation frameworks to ensure product quality pre- and post-release. You will develop comprehensive automated test suites, improve CI/CD pipelines, and work on test automation for AI-driven features, including LLM-based applications. Responsibilities also include building evaluation frameworks for AI systems, conducting robustness and adversarial testing, and collaborating with development and product teams to ensure reliability and performance.
Good To Have:
  • Experience in prompt engineering, embeddings, RAG, and LLM evaluation metrics.
  • Bachelor’s degree in Computer Science, Engineering, or related field.
  • Familiarity with LLMs, GenAI concepts.
  • Experience with LLM testing tools like MaximAI, OpenAI Evals, TruLens, LangSmith, or Promptfoo.
  • Experience in evaluating AI systems for bias, fairness, and AI safety principles.
  • Strong analytical mindset and structured problem-solving approach.
Must Have:
  • Design, build, and maintain scalable automation frameworks to qualify projects.
  • Develop comprehensive automated test suites and improve CI/CD pipelines.
  • Build scalable testing systems and generate test data.
  • Work on test automation frameworks to qualify AI-driven features.
  • Develop and test LLM-powered features, including prompt pipelines.
  • Build and maintain evaluation frameworks to measure quality, factual accuracy, relevance, bias, and hallucination rates.
  • Conduct robustness, safety, and adversarial testing for AI systems.
  • Improve quality engineering aspects and measure/improve Developer Experience (DevEx).
  • Collaborate closely with developers and product managers, participating in design discussions and code reviews.
  • 2+ years of experience as a Software Engineer or SDET, with a strong foundation in automation systems.
  • Proficiency in Go, Java, or Python.
  • Hands-on experience with LLM APIs and pipelines (OpenAI, Anthropic, Hugging Face).
  • Experience integrating automation into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI).
  • Strong skills in API testing, version control (Git), and containerization (Docker).
  • Familiarity with cloud platforms (AWS, GCP, Azure AI).
  • Clear communication and collaboration skills across engineering, ML, and product teams.
Perks:
  • Highly engaging and rewarding workplace.
  • Tons of awesome perks.
  • Many opportunities for growth.

Add these skills to join the top 1% applicants for this job

github
talent-acquisition
game-texts
test-suites
api-testing
regression-testing
gitlab
aws
azure
ci-cd
docker
git
python
github-actions
jenkins
java

Who we are

Mindtickle is the market-leading revenue productivity platform that combines on-the-job learning and deal execution to get more revenue per rep. Mindtickle is recognized as a market leader by top industry analysts and is ranked by G2 as the #1 sales onboarding and training product. We’re honoured to be recognized as a Leader in the first-ever Forrester Wave™: Revenue Enablement Platforms, Q3 2024!

What’s in it for you?

  • Design, build, and maintain scalable automation frameworks to qualify projects pre- and post-release, ensuring consistent product quality.
  • Develop comprehensive automated test suites (unit, integration, regression, and system-level) and improve CI/CD pipelines for reliable, repeatable releases.
  • Build scalable testing systems, generate test data, and ensure ongoing quality through automated regression and synthetic monitoring.
  • Work on test automation frameworks to qualify AI-driven features from LLM-based applications to agentic AI systems.
  • Develop and test LLM-powered features, including prompt pipelines, retrieval systems, and AI-assisted workflows.
  • Build and maintain evaluation frameworks to measure quality, factual accuracy, relevance, bias, and hallucination rates.
  • Conduct robustness, safety, and adversarial testing for AI systems, implementing prompt regression testing, embedding validation, and model reliability/performance tracking.
  • Improve quality engineering aspects (e.g., testability, shift-left practices) and measure/improve Developer Experience (DevEx).
  • Collaborate closely with developers and product managers, participating in design discussions and code reviews to ensure every feature and workflow delivers exceptional reliability and performance.

We’d love to hear from you, if you:

  • 2+ years of experience as a Software Engineer or SDET, with a strong foundation in automation systems.
  • Proficiency in Go, Java, or Python.
  • Hands-on experience with LLM APIs and pipelines (OpenAI, Anthropic, Hugging Face).
  • Experience integrating automation into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI).
  • Strong skills in API testing, version control (Git), and containerization (Docker).
  • Familiarity with cloud platforms (AWS, GCP, Azure AI).
  • Clear communication and collaboration skills across engineering, ML, and product teams.
  • Experience in prompt engineering, embeddings, RAG, and LLM evaluation metrics is preferred

Preferred Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or related field
  • Familiarity with LLMs, GenAI concepts.
  • Experience with LLM testing tools like MaximAI, OpenAI Evals, TruLens, LangSmith, or Promptfoo.
  • Experience in evaluating AI systems for bias, fairness, and AI safety principles
  • Strong analytical mindset and structured problem-solving approach.

Our culture & accolades

As an organization, it’s our priority to create a highly engaging and rewarding workplace. We offer tons of awesome perks and many opportunities for growth.

Our culture reflects our employee's globally diverse backgrounds along with our commitment to our customers, and each other, and a passion for excellence. We live up to our values, DAB, Delight your customers, Act as a Founder, and Better Together.

Mindtickle is proud to be an Equal Opportunity Employer.

All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, disability, protected veteran status, or any other characteristic protected by law.

Your Right to Work - In compliance with applicable laws, all persons hired will be required to verify identity and eligibility to work in the respective work locations and to complete the required employment eligibility verification document form upon hire.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Set alerts for more jobs like SDET - I
Set alerts for new jobs by Mindtickle
Set alerts for new Automation jobs in India
Set alerts for new jobs in India
Set alerts for Automation (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙