Lead Data Engineer

3 Months ago • 10 Years + • DevOps

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, advanced SQL knowledge, working with large volume data, and collaborating with onshore teams and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark , Python ,SQL , Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Understanding of CI/CD framework
  • Ability to interpret/write custom shell scripts. Python scripting is a plus.
Good to have:
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
  • Experience with Git / Azure DevOps

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

The Walt Disney Company - Senior Systems Engineer, Data Services [Database Administration]

The Walt Disney Company

Burbank, California, United States (On-Site)
1 Month ago
Mobileum - Senior Software Quality Engineer

Mobileum

Bengaluru, Karnataka, India (On-Site)
5 Months ago
BITSILICA - Python with Video Exposure

BITSILICA

Hyderabad, Telangana, India (On-Site)
5 Months ago
Fortis Games - DevOps Engineer II

Fortis Games

Portugal (On-Site)
3 Months ago
Epic Games - Machine Learning Ops Engineer

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
Ubisoft - DevOps Linux Administrator

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
3 Weeks ago
Omind - Senior DevOps Engineer

Omind

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Trend Micro - DevOps Engineer

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
18 Years ago
Nagarro - Staff Engineer

Nagarro

Portugal (Remote)
4 Months ago
Trend Micro - Sr. Engineer

Trend Micro

Taipei City, Taiwan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Transaction Network Services - Quality Assurance Engineer - Test Automation

Transaction Network Services

Coimbatore, Tamil Nadu, India (On-Site)
6 Months ago
Interactive Brokers - Senior Python Developer – Compliance Technology

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
4 Months ago
Surge Technology Solutions  Inc  - DevOps Engineer with AWS

Surge Technology Solutions Inc

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Riot Games - Principal Software Engineer - VALORANT, Foundations, Build Platforms

Riot Games

Los Angeles, California, United States (On-Site)
5 Months ago
CleverTap - Senior Backend Engineer - Platform

CleverTap

Mumbai, Maharashtra, India (Hybrid)
4 Months ago
Paypal - Lead Principal ML Engineer, AI Solutions

Paypal

San Jose, California, United States (On-Site)
4 Months ago
SSC Technologies - Sr Software QA Engineer

SSC Technologies

Toronto, Ontario, Canada (Hybrid)
4 Months ago
Meta - Software Engineer, Machine Learning

Meta

Mountain View, California, United States (On-Site)
3 Months ago
NVIDIA - Software Engineering Intern, Test Development - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Thumbtack - Director, Cybersecurity

Thumbtack

United States (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Grintack interactive solutions   - Social Media Marketing Manager

Grintack interactive solutions

Giridih, Jharkhand, India (On-Site)
4 Months ago
Studio Image Works - 2D Animator

Studio Image Works

Gurugram, Haryana, India (On-Site)
1 Year ago
PwC - IN-Manager_ Tech Project Manager _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago
CloudHire - Full Stack Developer - Angular & Node

CloudHire

Bengaluru, Karnataka, India (Remote)
4 Months ago
GoMotive - Technical Lead Manager, IoT-India

GoMotive

India (Remote)
6 Days ago
PwC - IN-Senior Manager-Program management-Markets -IFS-Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Omnissa - Staff Engineer (C++,MacOS Internals)

Omnissa

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Keywords Studios (Player Support) - Engineering Manager

Keywords Studios (Player Support)

Maharashtra, India (Hybrid)
1 Month ago
Google - Program Manager, Supply Chain Procurement and Planning

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Microsoft - ROP - Cloud Network Engineer

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Quizizz - Platform Engineer

Quizizz

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
ByteDance - Site Reliability Engineer, Traffic Platform

ByteDance

Singapore (On-Site)
1 Month ago
Guidewire Software - Site Reliability Engineer - Cloud Platform

Guidewire Software

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
BayOne Solutions - DevOps Engineer

BayOne Solutions

Gurugram, Haryana, India (Hybrid)
5 Months ago
Kaedim - DevOps Engineer

Kaedim

San Francisco, California, United States (On-Site)
5 Months ago
Granicus - Site Reliability Engineer 1

Granicus

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Microsoft - Technical Program Manager

Microsoft

Prague, Prague, Czechia (Remote)
1 Month ago
Interactive Brokers - Senior Systems Engineer- Microsoft M365/Active Directory

Interactive Brokers

Chicago, Illinois, United States (Hybrid)
4 Months ago
Playtech - Software Engineer

Playtech

Sofia, Sofia City Province, Bulgaria (On-Site)
4 Months ago
Warner Bros Games - Software Engineer II - Observability

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

United States (On-Site)

Washington, United States (On-Site)

London, England, United Kingdom (On-Site)

Indianapolis, Indiana, United States (On-Site)

Lansing, Michigan, United States (On-Site)

United States (On-Site)

Tennessee, United States (On-Site)

Lansing, Michigan, United States (On-Site)

Lansing, Michigan, United States (On-Site)

Pennsylvania, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Info Stretch

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug