Senior Azure Databricks Data Engineer

Company description

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting, and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.

Overview

We are seeking a Senior Data Engineer with strong experience in data migration, Azure cloud services, and Databricks. This role is key to modernizing our data infrastructure, moving from legacy systems to scalable, high-performance platforms that enable advanced analytics across the organization. A core responsibility will be migrating a legacy solution into a modern AI-driven infrastructure leveraging technologies such as Monarch AI, Azure, and Databricks.

Your Impact:

• Lead and execute the migration of legacy file-based databases (CSV, Parquet, JSON, flat files) into relational SQL databases.
• Design, develop, and optimize data pipelines using Databricks and Azure-native tools (e.g., Data Factory, Synapse).
• Collaborate with data architects and analysts to ensure data models are efficient, scalable, and aligned with business needs.
• Guarantee data quality, integrity, and governance throughout the migration process.
• Monitor and optimize ETL/ELT workflows for performance and cost-effectiveness.
• Document solutions and support knowledge transfer to internal teams.

Qualifications

Skills & Experience

• 4+ years of experience as a Data Engineer or similar role.
• Proven track record in data migration projects, especially moving from file-based systems to SQL.
• Strong expertise in SQL and relational database design (Azure SQL, PostgreSQL, or similar).
• Hands-on experience with Azure Data Services (Data Factory, Synapse, Blob Storage, etc.).
• Proficiency in Databricks (Spark, Delta Lake, notebooks, workflows).
• Solid programming skills in Python or Scala for data processing.
• Familiarity with CI/CD workflows and version control (Git/GitHub).

Preferred Qualifications

• Experience with data lakehouse architectures.
• Knowledge of data governance frameworks and tools (e.g., Purview).
• Exposure to DevOps practices in data engineering.
• Certifications in Azure Data Engineering or Databricks.

Additional information

As part of our dedication to an inclusive and diverse workforce, Publicis Sapient is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at hiring@publicis.sapient.com