Data QA Engineer

9 Months ago • 5 Years +

Quality Assurance

Job Description

The Data QA Engineer will be responsible for creating and maintaining an automation framework for data warehousing testing. This includes analyzing test data, performing functional and non-functional testing (smoke, integration, regression) across various Azure components (Azure Data Bricks, Notebooks, Functions, Data Factories), and collaborating with developers and business analysts. The role requires proficiency in SQL, Python, ETL concepts, and experience with data migration and BI reporting. The engineer will also contribute to continuous improvement of test quality and integrate with Atlassian tools (Jira, Confluence).

Good To Have:

Azure Data Factory experience
Azure Databricks & Notebooks experience
Cosmos DB experience
CI/CD experience (Azure DevOps, Docker)
ISTQB Certification
Finance industry experience

Must Have:

Bachelor's Degree in IT/related field
5+ years QA experience
Extensive ETL & Data Warehouse testing experience
Proficient in Python & complex SQL queries (Azure Data Bricks)
Experience with software test automation tools
Agile & Waterfall experience
Atlassian tools (Jira, Confluence)

Add these skills to join the top 1% applicants for this job

confluence

jira

ci-cd

azure

python

docker

sql

xml

azure-devops

waterfall

communication

functional-testing

regression-testing

test-automation-tools

presentation-skills

Project description

Working within the client's test and government framework, you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects.

Responsibilities

Analyse and document test data , results, and recommendations.

Perform functional and non-functional testing for data validation between source and target DBs as per the business requirements using relevant Azure components such as Azure bricks, Azure Notebooks, Azure functions and Azure data factories .

Conduct smoke, integration, regression, and other tests on products under development and released.

Collaborate with developers, business analysts, and users to understand testing needs and identify opportunities for automation and testing.

Ensure that automated test scripts are created, maintained, and executed to:

Meet all data Project deliverables and project testing requirements.

Create test and training data.

Support integrated testing.

Contribute to the continuous improvement of test quality by undertaking reviews and recommending improvements.

Skills

Must have

Bachelor’s Degree in IT, Business, Computer Science, or a related field

Software Quality Assurance professional with 5+ years' experience

Extensive experience with ETL concepts & technologies, Data migration testing, Data ware house testing and BI Reporting

Extensive experience in data automation using Python

High level of Proficiency in writing complex SQL queries in Azure data bricks from Business requirements to read data from source DB hosted in Azure and compare it with target DB

Proficiency in relational database models, SQL queries, XML data models

Extensive experience with software test automation tools and working in fast-paced Agile environments

Good knowledge of testing lifecycle processes

Experience with Atlassian tools (Jira and Confluence) and integrating them into automation testing frameworks

Good communication and presentation skills

Experience in Waterfall and Agile environments

Nice to have

Experience with Azure Data Factory for pipeline execution and analysis

Experience with Azure Databricks to access data from Azure Data Lakes

Experience with Azure Notebooks

Experience with Cosmos DB

Experience in creating end-to-end CI/CD solutions using tools such as Azure DevOps, Docker, and containerization tools