Lead Data Engineer

8 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing, and implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, demonstrating advanced SQL knowledge, writing optimized queries for faster data work flows, handling large volume data and working using different tools to derive the required solution, collaborating with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark, Python, SQL, Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Understanding of CI/CD framework
  • Ability to interpret/write custom shell scripts.
Good to have:
  • Python scripting
  • Experience with any cloud (Azure platform and Synapse/ AWS).
  • Experience with Git / Azure DevOps

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Regent craft - Senior Software Infrastructure Engineer

Regent craft

North Kingstown, Rhode Island, United States (On-Site)
2 Weeks ago
Veeam Software - Middle/Senior C++ Developer (macOS&Linux)

Veeam Software

Poland (Remote)
1 Month ago
Ansys - Lead R&D Engineer

Ansys

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
Thatgamecompany - Full Stack Engineer

Thatgamecompany

United States (Remote)
2 Months ago
Zazz - Java Developer

Zazz

(Remote)
4 Months ago
dYdX - Growth & Marketing Data Scientist Lead

dYdX

New York, United States (On-Site)
1 Month ago
Krafton - Data Engineer

Krafton

Seoul, South Korea (On-Site)
2 Weeks ago
WireWheel - Data Engineer

WireWheel

United States (Remote)
1 Month ago
plana technologies - Business Analyst

plana technologies

Cartago Province, Costa Rica (Remote)
3 Weeks ago
Trend Micro - (Sr.) Data Engineer/AI Trainer

Trend Micro

Taipei City, Taiwan (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Capgemini - Azure Devops + Terraform

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago
Match Group - Machine Learning Engineer (Contents Understanding)

Match Group

Seoul, South Korea (Hybrid)
1 Week ago
paxie games - Marketing Artist

paxie games

Istanbul, İstanbul, Türkiye (On-Site)
2 Weeks ago
Thales - Fullstack Developer Java & Angular (French speaker)

Thales

Bucharest, Bucharest, Romania (Hybrid)
1 Month ago
TransUnion - Senior Software Developer

TransUnion

Heredia, Costa Rica (Remote)
1 Month ago
Nexon - Dev Ops Engineer

Nexon

El Segundo, California, United States (Hybrid)
3 Weeks ago
Gametion - Senior Unity Game Developer

Gametion

Navi Mumbai, Maharashtra, India (On-Site)
4 Months ago
playrix  - Senior Release Support Engineer

playrix

Ukraine (Remote)
8 Months ago
Philips - Intern Interoperability Standardization

Philips

Shanghai, China (On-Site)
1 Month ago
ansira - Support Engineer II

ansira

Noida, Uttar Pradesh, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

Stage - Creative Content Manager - Series

Stage

Noida, Uttar Pradesh, India (On-Site)
9 Months ago
Qualcomm - SOC Design/Integration -Sr Lead

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Capgemini - Principal Senior Apriso Engineer

Capgemini

Hyderabad, Telangana, India (On-Site)
4 Weeks ago
warner bros games - Staff Engineer - LIVE Team

warner bros games

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Qualcomm - Engineer - Power Thermal

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Autodesk - Senior Data Engineer

Autodesk

Pune, Maharashtra, India (On-Site)
2 Weeks ago
Rackspace Technology - Service Delivery/Engagement Manager

Rackspace Technology

Gurugram, Haryana, India (Remote)
2 Months ago
high radius - Senior Software Engineer - Java

high radius

Hyderabad, Telangana, India (On-Site)
1 Month ago
Alpha Sense - Senior Cloud Security Engineer

Alpha Sense

India (On-Site)
1 Month ago
Dream Sports - Manager/Senior Manager - CoE (Procurement)

Dream Sports

Mumbai, Maharashtra, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Codeway Studios - Jr. Data Analyst

Codeway Studios

Istanbul, İstanbul, Türkiye (On-Site)
1 Month ago
London stock Exchange - Senior Data Analyst

London stock Exchange

Bucharest, Bucharest, Romania (On-Site)
2 Weeks ago
Notion - Software Engineer, Data Platform

Notion

San Francisco, California, United States (On-Site)
8 Months ago
YouGov - Senior Data Scientist

YouGov

United States (Remote)
3 Weeks ago
zoox - Data Scientist - Autonomy

zoox

Foster City, California, United States (Hybrid)
3 Weeks ago
version 1 - Pre Sales Data Architect

version 1

London, England, United Kingdom (On-Site)
3 Weeks ago
Illumina - Staff Business Process Analyst, Source to Pay Process Excellence (SAP)

Illumina

San Diego, California, United States (On-Site)
1 Month ago
Marsh McLennan - IT Business Analyst

Marsh McLennan

Mexico City, Mexico (Hybrid)
1 Month ago
Brillio - Senior Data Scientist

Brillio

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
playrix  - Data QA Engineer

playrix

Armenia (Remote)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Houston, Texas, United States (On-Site)

Baytown, Texas, United States (On-Site)

Austin, Texas, United States (On-Site)

Houston, Texas, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

Baltimore, Maryland, United States (On-Site)

New York, New York, United States (On-Site)

London, England, United Kingdom (Hybrid)

Reston, Virginia, United States (On-Site)

Towson, Maryland, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apexon

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug