Lead Data Engineer

8 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, advanced SQL knowledge, handling large volume data, and working with onshore teams, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark , Python ,SQL , Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Ability to interpret/write custom shell scripts.
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
Good to have:
  • Understanding of CI/CD framework
  • Python scripting

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Mozilla - Staff Software Engineer

Mozilla

Spain (Remote)
1 Month ago
Bosch Group India - Senior ML Engineer Lead - Time Series

Bosch Group India

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ISS Stoxx - Senior Software Engineer in Python and AWS

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
22 Hours ago
Blackbird Interactive - Associate UI Software Engineer (Unreal Engine 5)

Blackbird Interactive

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
WebFX - Junior Back-End Software Engineer

WebFX

Ann Arbor, Michigan, United States (On-Site)
4 Months ago
Accenture - Business Advisory Analyst

Accenture

Bengaluru, Karnataka, India (On-Site)
1 Month ago
blend - Lead Data Scientist

blend

Montevideo, Montevideo Department, Uruguay (Remote)
1 Week ago
WebMD - Junior Business Analyst

WebMD

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
3 Months ago
endava - Senior Data Engineer

endava

Montevideo, Montevideo Department, Uruguay (On-Site)
2 Weeks ago
Addepar - Product Data Analyst

Addepar

United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Next Level Business Services - Full Stack Developer

Next Level Business Services

Boston, Massachusetts, United States (On-Site)
8 Months ago
Capgemini - Selenium Robot Framework

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
In labs - Ionic Framework - Hybrid Mobile Developer

In labs

Bogotá, Bogota, Colombia (Hybrid)
2 Months ago
Paytm - DevOps Engineer/Senior DevOps-Paytm Money

Paytm

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Visa - Senior Software Engineer - Backend

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
8 Months ago
foxi ventures - Unity Programmer

foxi ventures

Adelaide, South Australia, Australia (On-Site)
1 Month ago
London stock Exchange - Senior Software Engineer (Java Developer)

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ion - Lead Software Engineer, Italy

Ion

Pisa, Tuscany, Italy (On-Site)
8 Months ago
Crowd Strick - Platform Security Operations Engineer III

Crowd Strick

Bucharest, Bucharest, Romania (Hybrid)
1 Month ago
playrix  - Senior Release Support Engineer

playrix

Montenegro (Remote)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

ShyftLabs - EDI Engineer

ShyftLabs

Noida, Uttar Pradesh, India (Hybrid)
4 Days ago
Guardian - Senior QA Engineer - IT

Guardian

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
Paytm - Key Account Manager

Paytm

Patna, Bihar, India (On-Site)
2 Weeks ago
ShyftLabs - Senior Oracle Fusion Cloud Integration Developer

ShyftLabs

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
Magna International - Full-Stack Developer

Magna International

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Dynamic next - Senior Game Tester (QA)

Dynamic next

India (On-Site)
1 Month ago
WebMD - Senior Site Reliability Engineer

WebMD

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Roblox - Senior People Generalist

Roblox

Gurugram, Haryana, India (On-Site)
1 Week ago
dun bradstreet - Credit Research (Intern)

dun bradstreet

Navi Mumbai, Maharashtra, India (On-Site)
2 Weeks ago
Buckman - Lead Digital Software Engineer – Back End

Buckman

Chennai, Tamil Nadu, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

STOXX - Data Engineer

STOXX

Maharashtra, India (Hybrid)
8 Months ago
bytedance - Data Analyst - Corporate Information System

bytedance

Singapore (On-Site)
2 Months ago
zoox - Data Engineer

zoox

Foster City, California, United States (Hybrid)
6 Years ago
InMobiInMobi - Senior Analyst – Business Analytics & Insights

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
ARHS - Mid Business Analyst (Banking Sector)

ARHS

Athens, Greece (On-Site)
1 Month ago
bytedance - Site Reliability Engineer - Data Infrastructure (Seattle)

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
HCL Tech - Lead Business Analyst with data analysis

HCL Tech

New Jersey, United States (On-Site)
1 Month ago
Apple - Data Scientist - Apple Ads

Apple

Cupertino, California, United States (On-Site)
4 Weeks ago
CyberArk - Data Engineer

CyberArk

Israel (Hybrid)
1 Month ago
bytedance - Risk Data Analytics Business Partner

bytedance

Singapore (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Houston, Texas, United States (On-Site)

Baytown, Texas, United States (On-Site)

Austin, Texas, United States (On-Site)

Houston, Texas, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

New York, New York, United States (On-Site)

London, England, United Kingdom (Hybrid)

Reston, Virginia, United States (On-Site)

Towson, Maryland, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apexon

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug