Lead Data Engineer

7 Months ago • 10 Years + • DevOps

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, advanced SQL knowledge, working with large volume data, and collaborating with onshore teams and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark , Python ,SQL , Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Understanding of CI/CD framework
  • Ability to interpret/write custom shell scripts. Python scripting is a plus.
Good to have:
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
  • Experience with Git / Azure DevOps

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Luxoft - Senior DevOps Engineer (Azure)

Luxoft

New Delhi, Delhi, India (Remote)
6 Months ago
IBKR External - Software Engineer

IBKR External

Hyderabad, Telangana, India (Hybrid)
3 Weeks ago
Ion - Technical Support Analyst, Jersey City - 9781

Ion

Jersey City, New Jersey, United States (On-Site)
7 Months ago
Qualcomm - Turing Design Verification Sr Lead Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
that game company - Technical Support Engineer - China

that game company

Shanghai, Shanghai, China (On-Site)
2 Months ago
easygo - Senior Machine Learning Operations Engineer

easygo

Melbourne, Victoria, Australia (On-Site)
1 Month ago
GoTo Group - Senior Software Engineer - Event Platform

GoTo Group

Gurugram, Haryana, India (On-Site)
7 Months ago
Rackspace Technology - Data Architect

Rackspace Technology

Vietnam (Remote)
2 Months ago
bytedance - Software Engineer, SRE - Platform Services

bytedance

Seattle, Washington, United States (On-Site)
4 Months ago
Playtech - DevOps Engineer

Playtech

Vienna, Vienna, Austria (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

bytedance - Research Scientist, Foundation Model, Speech & Audio

bytedance

San Jose, California, United States (On-Site)
7 Months ago
GreenWave™ Radios - Tech Lead, Design Verification

GreenWave™ Radios

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Ion - Senior Technical Support Analyst, Jersey City - 7537

Ion

Jersey City, New Jersey, United States (On-Site)
7 Months ago
Synechron - Oracle/SQL Developer with IICS (Informatica Intelligent Cloud Services)

Synechron

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Qualcomm - Physical Design Engineer

Qualcomm

San Diego, California, United States (On-Site)
2 Weeks ago
cold symmetry  - Senior Environment Artist

cold symmetry

(Remote)
4 Months ago
Qualcomm - CPU Emulation Engineer Multiple Levels

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
tatsu works - Senior Fullstack Engineer

tatsu works

Singapore (Remote)
6 Months ago
Google - Bluetooth Firmware Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Capgemini - Azure Integration Services

Capgemini

Kolkata, West Bengal, India (On-Site)
2 Months ago
warner bros games - Staff Software Engineer - AWS Architecture (Observability Team)

warner bros games

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Capgemini - Supply Planning Lead

Capgemini

Chennai, Tamil Nadu, India (On-Site)
3 Weeks ago
Accurate - Engineer 2, Applications

Accurate

Hyderabad, Telangana, India (Hybrid)
1 Month ago
PhonePe - Senior Associate, Enterprise Operations

PhonePe

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Alphawave Semi - Design Verification Manager - CPU - ARM Architecture

Alphawave Semi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
luxsoft - UI Developer with React

luxsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Pivotroots - Senior Executive - Earned Media

Pivotroots

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Capgemini - ESRI Manager

Capgemini

Mumbai, Maharashtra, India (On-Site)
1 Week ago
Granicus - Technical Support Representative

Granicus

Bengaluru, Karnataka, India (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

NVIDIA - Senior AI-HPC Storage Engineer

NVIDIA

Austin, Texas, United States (On-Site)
3 Months ago
Visa - Staff Data Engineer

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
Kaedim - DevOps Engineer

Kaedim

London, England, United Kingdom (On-Site)
9 Months ago
Ion - Site Reliability Engineer

Ion

Collecchio, Emilia-Romagna, Italy (Hybrid)
7 Months ago
bytedance - Cloud Site Reliability Engineer

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
Rackspace Technology - Senior GCP Cloud Engineer

Rackspace Technology

United States (Remote)
2 Months ago
Ion - Senior DevSecOps Engineer, Italy

Ion

London, England, United Kingdom (On-Site)
7 Months ago
warner bros games - Manager, Software Engineering

warner bros games

(Hybrid)
3 Months ago
Ubisoft - Linux DevOps System Administrator

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Indianapolis, Indiana, United States (On-Site)

Indianapolis, Indiana, United States (On-Site)

Lansing, Michigan, United States (Hybrid)

Sunderland, England, United Kingdom (Hybrid)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Poland (On-Site)

Krakow Am See, Mecklenburg-Vorpommern, Germany (On-Site)

Lansing, Michigan, United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Info Stretch

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug