BigQuery Migration and Data Governance Specialist

We are seeking a BigQuery Migration and Data Governance Specialist to join our team for a strategic initiative to migrate an existing Data Warehouse (DWH) from Azure Synapse to Google Cloud Platform (GCP), with BigQuery at its core. The critical aspect of this project is to resolve current data quality issues and establish comprehensive data governance functionalities, including data lineage tracking, a central data catalog, and enhanced security with fine-grained access controls and data masking.

Location 🌍 Remote position, working hours are in the UTC timezone.

Contract Type 📃  This role will be based on a B2B contract. The services provided will be on a fixed fee basis for a professional services engagement.

Project Length ⏱️ The project length is 7 months with the possibility of prolonging.

About Revolgy ☁️

Revolgy is a leading multinational company providing digital transformation services through online collaboration tools and cloud infrastructure operating on Google Cloud Platform and Amazon Web Services. We are a premier partner of Google and Amazon. We serve over 2000 customers around the globe.

What Will You Do? 🔧

• Leading the end-to-end migration of a Data Warehouse from Azure Synapse to Google Cloud Platform (GCP), with BigQuery as its central component.
• Designing and building the new GCP data platform foundation, which includes provisioning a secure GCP Landing Zone using Terraform, configuring the BigQuery dataset with a three-layered architecture (Ingestion, Staging, Analytical), and setting up Cloud Composer for orchestration.
• Developing custom migration tooling to analyze and translate stored procedures and views from Azure Synapse to BigQuery standard SQL and DBT models. You'll also execute the iterative migration of raw data and complex transformation logic into BigQuery using DBT models. 
• Implementing robust data governance using Dataplex, which involves establishing a searchable Data Catalog, setting up automated data quality rules within DBT and Dataplex, and ensuring data security through PII tagging, column-level security, and data masking in BigQuery.
• Ensuring a smooth transition through comprehensive documentation, operationalizing CI/CD pipelines for both infrastructure and data model changes, and providing training for the client's team.

What You Bring 🎯

• We are looking for a candidate with a pro-client approach and the following technical skills and experience:
• Must-Have Technical Skills:
  • BigQuery
  • Dataplex
    
  • Designing, implementing, testing, and migrating data warehouses
  • Implementing robust data governance frameworks
  • Dataflow
  • Cloud Composer
  • DBT (dbt Core)
• Experience with Azure Synapse is beneficial due to the migration context
• Familiarity with GCP best practices, Infrastructure as Code (IaC) (especially Terraform), robust security principles, and a modular approach to data management
• Understanding of CI/CD workflows for both infrastructure and data platform changes
• Experience with Kubernetes and Python is a plus, as Cloud Composer and DBT Core leverage these environments
  

Equal Opportunity Employer 🌈

Diversity and equal opportunity are important to us. We are happy about the interest of all candidates and strive to provide feedback as quickly as possible.