Senior QA Big Data

N-iX is a global software development company seeking a Senior QA Big Data professional for a large-scale Data Transformation project. The role involves designing and executing test strategies for real-time streaming workflows, validating data products in a microservices architecture, and performing API testing. The ideal candidate will implement observability checks, collaborate with DevOps teams on Kubernetes deployments, and ensure data governance compliance to support critical business needs.

Must Have

• Design and execute test strategies for real-time streaming workflows
• Validate data products transitioning from monolithic to microservices architecture
• Perform API testing for data services and orchestration layers
• Implement observability checks using Prometheus & Grafana
• Collaborate with DevOps teams to ensure Kubernetes-based deployments meet quality standards
• Conduct functional, integration, and performance testing for Azure Functions and orchestration workflows
• Ensure compliance with data governance and SLA optimization initiatives
• Document test cases, results, and maintain traceability in Jira/Confluence
• QA experience in data engineering or real-time data platforms
• Strong knowledge of streaming technologies (Structured Streaming, Kafka, Azure Event Hub)
• Hands-on experience with API testing (Postman, REST Assured)
• Familiarity with Kubernetes deployments and observability tools (Prometheus, Grafana)
• Proficiency in SQL and basic scripting (Python/PySpark preferred)
• Experience with Azure Cloud services (Azure Functions, ADF, Event Hub)
• Knowledge of orchestration frameworks (AirFlow preferably) and CI/CD pipelines

Good to Have

• Exposure to Iceberg and ClickHouse
• Understanding of Kappa Architecture and Data Mesh principles
• Experience with data product testing in microservices environments
• Familiarity with BI tools (Power BI, Qlik)

Perks & Benefits

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

N-iX is a global software development company founded in 2002, connecting over 2,400+ tech professionals across 40+ countries. We deliver innovative technology solutions in cloud computing, data analytics, AI, embedded software, IoT, and more to global industry leaders and Fortune 500 companies. Join us to create technology that drives real change for businesses and people across the world.

About the Client

Our client is involved in a large-scale Data Transformation project, with a focus on solidifying the foundation of their data operations. They are aiming to ensure that data is accurate, consistent, and available at critical times to support their business needs.

Key Responsibilities:

• Design and execute test strategies for real-time streaming workflows (Structured Streaming, Azure Event Hub, Topics & Queues).
• Validate data products transitioning from monolithic to microservices architecture.
• Perform API testing for data services and orchestration layers.
• Implement observability checks using Prometheus & Grafana for monitoring pipeline health and performance.
• Collaborate with DevOps teams to ensure Kubernetes-based deployments meet quality standards.
• Conduct functional, integration, and performance testing for Azure Functions and orchestration workflows.
• Ensure compliance with data governance and SLA optimization initiatives.
• Document test cases, results, and maintain traceability in tools like Jira/Confluence.

Requirements:

• QA experience in data engineering or real-time data platforms.
• Strong knowledge of streaming technologies (Structured Streaming, Kafka, Azure Event Hub).
• Hands-on experience with API testing (Postman, REST Assured).
• Familiarity with Kubernetes deployments and observability tools (Prometheus, Grafana).
• Proficiency in SQL and basic scripting (Python/PySpark preferred).
• Experience with Azure Cloud services (Azure Functions, ADF, Event Hub).
• Knowledge of orchestration frameworks (AirFlow preferably) and CI/CD pipelines.

Would be a plus:

• Exposure to Iceberg and ClickHouse.
• Understanding of Kappa Architecture and Data Mesh principles.
• Experience with data product testing in microservices environments.
• Familiarity with BI tools (Power BI, Qlik).

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers