Lead Data Engineer

5 Months ago • 10 Years + • DevOps

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, having advanced SQL knowledge, and being extremely well versed with handling large volume data. The role requires collaborating with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark, Python, SQL, Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Ability to interpret/write custom shell scripts.
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
Good to have:
  • Understanding of CI/CD framework
  • Python scripting

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Corsair - Automation Engineer

Corsair

Vietnam (On-Site)
1 Month ago
Epic Games - Build Engineer, Fortnite

Epic Games

(On-Site)
2 Months ago
ByteDance - Software Engineer, ML System Architecture

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Software Engineer, ML System Architecture

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
NVIDIA - Senior SWQA Test Development Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Google - Staff Software Engineer, Site Reliability Engineering

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Google - Customer Engineer, Financial Services, Google Cloud

Google

Melbourne, Victoria, Australia (On-Site)
6 Days ago
NVIDIA - Senior Site Reliability Engineer - AI Research Clusters

NVIDIA

Austin, Texas, United States (Hybrid)
1 Month ago
Luxoft - Senior .Net developer with AWS

Luxoft

Poland, Ohio, United States (Remote)
5 Months ago
Luxoft - Senior ETL Developer

Luxoft

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Cloud Technical Solutions Engineer, Infrastructure Compute

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Samsung Semiconductor - Staff Engineer, QA Performance

Samsung Semiconductor

San Jose, California, United States (On-Site)
2 Weeks ago
Samsung Semiconductor - Staff Software Engineer – Platform

Samsung Semiconductor

San Jose, California, United States (Hybrid)
1 Month ago
Info Stretch - Lead Data Engineer

Info Stretch

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ByteDance - Cloud Site Reliability Engineer

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Tencent - SRE Intern

Tencent

(On-Site)
1 Month ago
Feld Entertainment - Body Refurb Technician

Feld Entertainment

Ellenton, Florida, United States (On-Site)
6 Months ago
Cold Symmetry - Technical Artist

Cold Symmetry

(Remote)
3 Weeks ago
Next Level Business Services - SDE Web Developer

Next Level Business Services

Redmond, Washington, United States (On-Site)
6 Months ago
Google - Senior Bluetooth Firmware Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Chennai, Tamil Nadu, India

STAGE - Social Media Executive

STAGE

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Google - Silicon RTL Design Engineer, TPU

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Internkaksha IT Solutions - Data Analyst

Internkaksha IT Solutions

India (Remote)
6 Months ago
PwC - IN_Senior Associate_Full Stack Developer_Data & Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Assystems - Manager / Senior Manager - Project (Kolkata)

Assystems

Kolkata, West Bengal, India (On-Site)
5 Months ago
Dream Sports - SDE 2 - ML & Data Platform

Dream Sports

Mumbai, Maharashtra, India (On-Site)
7 Months ago
PwC - Associate

PwC

Hyderabad, Telangana, India (On-Site)
5 Months ago
Seedify - AI Product Manager

Seedify

India (Remote)
3 Months ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
9 Months ago
Outscal - Youtube Content Creator

Outscal

Delhi, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Equivalent Jobs - MLOPS ENGINEER

Equivalent Jobs

(Remote)
5 Months ago
Google - Customer Engineer Apprenticeship, Cloud Sales

Google

Paris, Île-de-France, France (On-Site)
1 Week ago
Luxoft - Orchestrade - Azure infrastructure cloud Senior engineer

Luxoft

Poland, Ohio, United States (Remote)
5 Months ago
Luxoft - Lead Integration and Release Engineer

Luxoft

Bucharest, Bucharest, Romania (On-Site)
5 Months ago
N-iX - DevOps/SRE Engineer

N-iX

Poland (Remote)
1 Month ago
SmileGate - Platform Engineering Manager

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago
Flying Bark Productions - DevOps Engineer

Flying Bark Productions

New South Wales, Australia (Hybrid)
2 Months ago
NVIDIA - Senior Site Reliability Engineer - GPU Cloud

NVIDIA

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Luxoft - Senior Software Support Engineer

Luxoft

Poland, Ohio, United States (Remote)
5 Months ago
Tencent - Tencent Cloud Solution Architect Intern (Indonesia Market)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

United States (Remote)

Lansing, Michigan, United States (Remote)

Indianapolis, Indiana, United States (On-Site)

Indianapolis, Indiana, United States (On-Site)

Lansing, Michigan, United States (Hybrid)

Mechanicsburg, Pennsylvania, United States (On-Site)

Sunderland, England, United Kingdom (Hybrid)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Poland (On-Site)

View All Jobs

Get notified when new jobs are added by Info Stretch

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug