Senior Manual QA Engineer (Big Data)

7 Months ago • 3-6 Years

Job Description

This role involves designing and executing data validation tests in Azure Data Lake Storage, Azure Synapse, and Databricks. Responsibilities include verifying ETL/ELT processes in Azure Data Factory, validating data schemas and formats, conducting performance testing on data pipelines, optimizing query performance, and identifying and tracking defects in Jira. Collaboration with data engineers and business analysts is required to resolve inconsistencies. The ideal candidate will have 3-6 years of QA experience with a strong focus on big data testing in Azure cloud environments, proficiency in SQL, and experience with functional and system integration testing. Agile methodology experience is a must.
Good To Have:
  • Advanced Azure knowledge
  • Database administration and optimization
  • Big data technologies (Spark)
Must Have:
  • 3-6 years of QA experience in Big Data testing (Azure)
  • Proficient in Azure Data Factory, Synapse, Databricks
  • SQL proficiency for data validation and testing
  • Experience with data manipulation and transformation
  • Functional & System Integration Testing in big data
  • Agile methodologies and Jira experience
Perks:
  • Flexible working format
  • Competitive salary and benefits
  • Career growth opportunities
  • Professional development tools
  • Education reimbursement
  • Corporate events

Add these skills to join the top 1% applicants for this job

jira
spark
azure
sql
foundation
data-analytics
agile-development
quality-control
regression-testing
performance-testing
test-coverage

We are looking for a Senior Manual QA Engineer (Big Data) to join our team!

Client Overview:
Our client is involved in a large-scale Data Transformation project, with a focus on solidifying the foundation of their data operations. They are aiming to ensure that data is accurate, consistent, and available at critical times to support their business needs. 

Project Objectives:
The objective of this project is to enhance the QA processes through the implementation of automation within the Data landscape. This includes developing and maintaining regression testing suites, and creating test scripts and automation plans to improve the overall efficiency and quality of data testing practices.

Responsibilities:

  • Design and execute data validation tests to ensure completeness in Azure Data Lake Storage (ADLS), Azure Synapse, and Databricks.
  • Verify data ingestion, transformation, and loading (ETL/ELT) processes in Azure Data Factory (ADF).
  • Validate data schema, constraints, and format consistency across different storage layers
  • Conduct performance testing on data pipelines
  • Optimize query performance by working with data engineers
  • Identify, log, and track defects in JIRA.
  • Collaborate with Data Engineers and Business Analysts to resolve data inconsistencies.
  • Generate detailed test reports, dashboards, and documentation for stakeholders.

Requirements:

  • 3-6 years of QA experience with a strong focus on Big Data testing, particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics, and Databricks for big data processing and scaled data quality checks. 
  • Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
  • Working experience with data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with Functional & System Integration Testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
  • Knowledge and ability to design and execute test cases in a behavior-driven development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.

Nice to Have:

  • Advanced knowledge of public cloud platforms (Azure).
  • Familiarity with database administration and optimization techniques.
  • Experience with big data technologies  (Spark).

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Set alerts for new jobs by N-ix
Set alerts for new jobs in Ukraine
Contact Us
hello@outscal.com
Made in INDIA 💛💙