Lead Data Engineer

2 Days ago • 10 Years +

About the job

SummaryBy Outscal

Lead Data Engineer with 10+ years of experience designing and implementing ETL processes using Pyspark, Azure Cloud, Databricks, and Azure Synapse. Must have advanced SQL skills, strong database fundamentals, and experience with large data warehouses. Experience with cloud platforms like Azure and AWS is desired.

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Karnataka, India (On-Site)

Tamil Nadu, India (On-Site)

Telangana, India (On-Site)

England, United Kingdom (On-Site)

Canada (On-Site)

United States (Remote)

United States (Remote)

England, United Kingdom (On-Site)

Pennsylvania, United States (On-Site)

View All Jobs

Similar Jobs

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Warner Bros. Games - Senior Data Engineer - MLG, Hyderabad

Telangana, India (Hybrid)

HP - Data Engineer 3

Karnataka, India (On-Site)

workco - Data Engineer (Contract)

United States (Remote)

Riot Games - Data Engineer II - Data & Analytics

California, United States (On-Site)

NBC universal - Staff Data Engineer

New Jersey, United States (Remote)

Similar Skill Jobs

King - Data Scientist | Candy Crush Soda Saga

Stockholm County, Sweden (Hybrid)

DraftKings - Product Manager I (Golf)

England, United Kingdom (On-Site)

Scientific Games  - Package Assembly Tech II

Georgia, United States (On-Site)

Tencent - Project Management Intern

Île-de-France, France (On-Site)

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Aristocrat Gaming - QA Manual (Pasino)

Masovian Voivodeship, Poland (Hybrid)

Aristocrat Gaming - QA Manual (Pasino)

Lesser Poland Voivodeship, Poland (Hybrid)

DraftKings - Software Engineering Manager

Massachusetts, United States (On-Site)

Jobs in Pune, Maharashtra, India

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Nasdaq - Lead - Project Product Owner

Karnataka, India (On-Site)

Nasdaq - Lead - Project Product Owner

Karnataka, India (On-Site)

paypal - Sr. Storage and Systems Engineer

Tamil Nadu, India (Hybrid)

paypal - Software Engineer (Fullstack)

Karnataka, India (Hybrid)

paypal - Data scientist - Payments

Tamil Nadu, India (Hybrid)

paypal - Lead Software Engineer

Karnataka, India (Hybrid)

Software Engineering Jobs

Aristocrat Gaming - Payout & Risk Operator

New Hampshire, United States (Hybrid)

Scientific Games  - Package Assembly Tech II

Georgia, United States (On-Site)

Activision - Lead Network Programmer

Masovian Voivodeship, Poland (On-Site)

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Aristocrat Gaming - QA Manual (Pasino)

Masovian Voivodeship, Poland (Hybrid)

Aristocrat Gaming - QA Manual (Pasino)

Lesser Poland Voivodeship, Poland (Hybrid)

DraftKings - Software Engineering Manager

Massachusetts, United States (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug