Lead Data Engineer

8 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, advanced SQL knowledge, working with large volume data, and collaborating with onshore teams and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark , Python ,SQL , Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Understanding of CI/CD framework
  • Ability to interpret/write custom shell scripts. Python scripting is a plus.
Good to have:
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
  • Experience with Git / Azure DevOps

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Reality Games - Technical Artist for Mobile Game - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Months ago
Aeries technology - Sr. DevOps Engineer

Aeries technology

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Unity - Automation Infrastructure Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Survay Monkey - Senior Site Reliability Engineer II

Survay Monkey

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
panteon games - Playable Ads Developer

panteon games

Ankara, Ankara, Türkiye (On-Site)
8 Months ago
Rackspace Technology - Customer Data Engineer II

Rackspace Technology

India (Remote)
3 Months ago
PayPal - Manager, Data Science

PayPal

Chicago, Illinois, United States (Hybrid)
1 Month ago
Capgemini - Data Engineer

Capgemini

Kolkata, West Bengal, India (On-Site)
1 Month ago
Electronic Arts - Advanced Data Analyst, UGX

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
3 Months ago
Playtika - Business Analyst

Playtika

Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Motorola solutions - Functional Test Engineer

Motorola solutions

Cork, County Cork, Ireland (On-Site)
1 Month ago
Joyteractive - Lead UI/UX Designer

Joyteractive

Poland (Remote)
3 Months ago
Zelis  - Senior Snowflake Platform Engineer

Zelis

Atlanta, Georgia, United States (Hybrid)
1 Month ago
AI Fund - Senior AI Engineer (Generative AI)

AI Fund

California, United States (Remote)
3 Weeks ago
playrix  - Location Game Designer

playrix

Almaty, Almaty Region, Kazakhstan (Remote)
8 Months ago
sitetracker - Senior Software Project Manager

sitetracker

Bengaluru, Karnataka, India (Remote)
4 Weeks ago
Ness - Senior Java & React Engineer

Ness

Timișoara, Timiș, Romania (Remote)
4 Weeks ago
Krafton - Gameplay Programmer Lead

Krafton

Montreal, Quebec, Canada (On-Site)
6 Months ago
Likewize - Fullstack Developer

Likewize

Chennai, Tamil Nadu, India (On-Site)
9 Months ago
DraftKings - Senior Software Engineer, Sportsbook

DraftKings

Plovdiv, Plovdiv Province, Bulgaria (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Wind River - Technical Leader - DO178 V&V

Wind River

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Blinkhealth - Senior Software Engineer

Blinkhealth

India (On-Site)
1 Month ago
Accenture - Financial Plan & Analysis Analyst

Accenture

Gurugram, Haryana, India (On-Site)
2 Months ago
luxsoft - Senior Security Coordinator

luxsoft

Pune, Maharashtra, India (On-Site)
3 Weeks ago
ShyftLabs - Salesforce Marketing Cloud Architect

ShyftLabs

Noida, Uttar Pradesh, India (Hybrid)
3 Months ago
PwC - IN_Associate _ Internal Audit _Internal Audit Services_ Advisory_ Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Qualcomm - Staff Engineer - Perception Tools Development in XR Research

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Accenture - Procure to Pay Operations Associate

Accenture

Gurugram, Haryana, India (On-Site)
1 Month ago
DNEG - Tech Junior

DNEG

Mumbai, Maharashtra, India (On-Site)
11 Months ago
Paytm - Area Sales Manager

Paytm

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

London stock Exchange - Data Scientist

London stock Exchange

Bangkok, Thailand (On-Site)
3 Weeks ago
Anavation - Data Architect SME

Anavation

Colorado Springs, Colorado, United States (Remote)
2 Months ago
fuse games - Senior Data Analyst

fuse games

İstanbul, Türkiye (On-Site)
2 Months ago
PayPal - Senior Software Engineer - Big Data

PayPal

San Jose, California, United States (Hybrid)
1 Month ago
Rackspace Technology - Data Engineer III

Rackspace Technology

Vietnam (Remote)
3 Months ago
London stock Exchange - Data Analyst with French / Portuguese

London stock Exchange

Gdynia, Pomeranian Voivodeship, Poland (On-Site)
3 Weeks ago
Tesla - Data Analytics Internship

Tesla

North Brabant, Netherlands (On-Site)
4 Months ago
Rackspace Technology - Senior Data Architect - Big Data (AWS)

Rackspace Technology

Reston, Virginia, United States (Remote)
3 Months ago
PayPal - Data Scientist

PayPal

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago
Eneba Games - Business Intelligence Analyst, Payments

Eneba Games

Lithuania (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Houston, Texas, United States (On-Site)

Spring, Texas, United States (On-Site)

Baytown, Texas, United States (On-Site)

Houston, Texas, United States (On-Site)

Baytown, Texas, United States (On-Site)

Austin, Texas, United States (On-Site)

Houston, Texas, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

Reston, Virginia, United States (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apexon

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug