Senior Manual QA Engineer (Big Data)

We are looking for a Senior Manual QA Engineer (Big Data) to join our team!

Client Overview:
Our client is involved in a large-scale Data Transformation project, with a focus on solidifying the foundation of their data operations. They are aiming to ensure that data is accurate, consistent, and available at critical times to support their business needs. 

Project Objectives:
The objective of this project is to enhance the QA processes through the implementation of automation within the Data landscape. This includes developing and maintaining regression testing suites, and creating test scripts and automation plans to improve the overall efficiency and quality of data testing practices.

Responsibilities:

• Design and execute data validation tests to ensure completeness in Azure Data Lake Storage (ADLS), Azure Synapse, and Databricks.
• Verify data ingestion, transformation, and loading (ETL/ELT) processes in Azure Data Factory (ADF).
• Validate data schema, constraints, and format consistency across different storage layers
• Conduct performance testing on data pipelines
• Optimize query performance by working with data engineers
• Identify, log, and track defects in JIRA.
• Collaborate with Data Engineers and Business Analysts to resolve data inconsistencies.
• Generate detailed test reports, dashboards, and documentation for stakeholders.

Requirements:

• 3-6 years of QA experience with a strong focus on Big Data testing, particularly in Data Lake environments on Azure's cloud platform.
• Proficient in Azure Data Factory, Azure Synapse Analytics, and Databricks for big data processing and scaled data quality checks. 
• Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
• Working experience with data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
• Hands-on experience with Functional & System Integration Testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
• Knowledge and ability to design and execute test cases in a behavior-driven development environment.
• Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
• Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
• Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.

Nice to Have:

• Advanced knowledge of public cloud platforms (Azure).
• Familiarity with database administration and optimization techniques.
• Experience with big data technologies  (Spark).