Lead Data Engineer

8 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, having advanced SQL knowledge, and being extremely well versed with handling large volume data. The role requires collaborating with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark, Python, SQL, Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Ability to interpret/write custom shell scripts.
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
Good to have:
  • Understanding of CI/CD framework
  • Python scripting

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

adglobal 360 - Flutter Engineer

adglobal 360

(Remote)
1 Month ago
The Walt Disney Company - Principal Machine Learning Engineer

The Walt Disney Company

New York, New York, United States (On-Site)
2 Months ago
Electronic Arts - Senior Software Engineer

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
luxsoft - DevOps Automation Engineer

luxsoft

India (Remote)
2 Weeks ago
Motorola solutions - Engineering Manager, Firmware

Motorola solutions

Culver City, California, United States (On-Site)
2 Months ago
Nasdaq - Senior Business Intelligence Analyst

Nasdaq

Taguig, Metro Manila, Philippines (Hybrid)
1 Month ago
Autodesk - Senior Data Engineer

Autodesk

Toronto, Ontario, Canada (Hybrid)
4 Weeks ago
Addepar - Sr. Software Engineer - Reference Data

Addepar

United States (Remote)
2 Months ago
Playtika - Senior Data/AI SRE Engineer

Playtika

Ukraine (On-Site)
8 Months ago
Capgemini - Data Analyst

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

luxsoft - Business Analyst with Custody and Settlements

luxsoft

Pune, Maharashtra, India (On-Site)
1 Week ago
Anthology  Inc  - Senior Software Engineer

Anthology Inc

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Accenture - Application Designer

Accenture

Navi Mumbai, Maharashtra, India (On-Site)
1 Month ago
Next Level Business Services - Java Script Developer (Sr UI Developer with very Strong Exp in Java Script )

Next Level Business Services

Dallas, Texas, United States (On-Site)
8 Months ago
Visa - Full Stack Developer

Visa

Auckland, Auckland, New Zealand (Hybrid)
3 Weeks ago
Gravity CO  - Integrated Platform Developer

Gravity CO

Seoul, South Korea (On-Site)
1 Month ago
USE Insider - Front-end Developer

USE Insider

Istanbul, İstanbul, Türkiye (Remote)
5 Months ago
Infosys - Java fullstack AWS Developer

Infosys

Juno Beach, Florida, United States (On-Site)
1 Month ago
Qualcomm - Associate Engineer- Debug

Qualcomm

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
Autodesk - Principal Software Engineer

Autodesk

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

Nagarro - Associate Principal Engineer, Java Fullstack

Nagarro

India (Remote)
8 Months ago
Nagarro - Staff Engineer ,Mobile Developer (React Native)

Nagarro

Hyderabad, Telangana, India (On-Site)
8 Months ago
Capgemini - Packaging Engineer

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Hitachi - MS-D365 CRM Technical Consultant

Hitachi

Pune, Maharashtra, India (Remote)
8 Months ago
London stock Exchange - Software Development Engineer in Test (SDET)

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Bestex Research - Execution Services / Algorithmic Trading Analyst

Bestex Research

Bengaluru, Karnataka, India (On-Site)
2 Years ago
PwC - IN Manager | Project Manager | Advisory Corporate

PwC

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
zeta - Manager/Senior Manager - Communications & Media Relations

zeta

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ion - Software Architect - User Experience (UX)

Ion

Pune, Maharashtra, India (On-Site)
8 Months ago
eBay - GCX Commercial Teammate 1

eBay

India (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Marsh McLennan - Data Scientist

Marsh McLennan

Mexico City, Mexico (Hybrid)
3 Weeks ago
endava - Senior Business Analyst

endava

Brașov, Brașov, Romania (On-Site)
1 Month ago
Car Gurus - Product Manager, Data Science & Machine Learning

Car Gurus

Boston, Massachusetts, United States (Hybrid)
1 Month ago
WebMD - Senior Data Engineer

WebMD

Madison, Wisconsin, United States (On-Site)
3 Months ago
Rackspace Technology - Data Architect

Rackspace Technology

Vietnam (Remote)
5 Months ago
Coherent corp. - Senior Engineer - Manufacturing Data Systems

Coherent corp.

Sherman, Texas, United States (On-Site)
1 Month ago
GameChanger - Data Platform Engineer

GameChanger

United States (Remote)
3 Months ago
Roblox - Senior Data Science Manager, Marketplace

Roblox

San Mateo, California, United States (On-Site)
2 Weeks ago
Capgemini - Data Scientist

Capgemini

Kolkata, West Bengal, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Houston, Texas, United States (On-Site)

Spring, Texas, United States (On-Site)

Baytown, Texas, United States (On-Site)

Houston, Texas, United States (On-Site)

Baytown, Texas, United States (On-Site)

Austin, Texas, United States (On-Site)

Houston, Texas, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

New York, New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apexon

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug