Lead Data Engineer

5 Months ago • 10 Years + • DevOps

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing, and implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, demonstrating advanced SQL knowledge, writing optimized queries for faster data work flows, handling large volume data and working using different tools to derive the required solution, collaborating with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark, Python, SQL, Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Understanding of CI/CD framework
  • Ability to interpret/write custom shell scripts.
Good to have:
  • Python scripting
  • Experience with any cloud (Azure platform and Synapse/ AWS).
  • Experience with Git / Azure DevOps

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Altair - QA Engineer

Altair

Bengaluru, Karnataka, India (On-Site)
7 Months ago
BrightEdge - Devops Engineer

BrightEdge

Hyderabad, Telangana, India (On-Site)
6 Months ago
ION - IT System Administrator

ION

Italy (Hybrid)
6 Months ago
NVIDIA - Physical Design CAD Team Manager

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Week ago
NVIDIA - Principal Software Engineer

NVIDIA

California, United States (Hybrid)
2 Weeks ago
Luxoft - Murex Technical Developer - Lead

Luxoft

Toronto, Ontario, Canada (On-Site)
5 Months ago
Meta - Production Engineer

Meta

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
Wipro - Release Manager

Wipro

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Google - Software Engineer III, Site Reliability Engineering, Network Management

Google

Dublin, County Dublin, Ireland (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NXP - Junior Developer of Systems Testing Infrastructure

NXP

Brno, South Moravian Region, Czechia (On-Site)
7 Months ago
NVIDIA - Enterprise Software Test Development Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
3 Weeks ago
ByteDance - Network Resource Management Specialist

ByteDance

Singapore (On-Site)
5 Months ago
Bigpoint - Associate DevOps Engineer (m/f/d) - #5720

Bigpoint

Hamburg, Hamburg, Germany (Remote)
8 Months ago
ByteDance - Cloud Site Reliability Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Google - Database Engineer

Google

Fremont, California, United States (On-Site)
4 Days ago
Google - Cloud Technical Solutions Engineer, Networking

Google

Tokyo, Japan (On-Site)
1 Week ago
Oriserve - Senior DevOps Engineer (4+ Yrs exp)

Oriserve

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
ByteDance - Production System Engineer, Infrastructure Engineering Intern

ByteDance

Singapore (On-Site)
1 Month ago
ByteDance - Cloud Technical Support

ByteDance

Singapore (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

Nagarro - Senior Staff Engineer, Delivery ETIL

Nagarro

India (Remote)
6 Months ago
Headout - Senior UX Writer

Headout

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Vigaet - Internship - UI/UX Designer

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Gallagher - Sr. QA Analyst

Gallagher

Chandigarh, Chandigarh, India (On-Site)
5 Months ago
Blissclub - Creative Director

Blissclub

Bengaluru, Karnataka, India (On-Site)
7 Months ago
PwC - Associate - Kolkata Y-14 - Technology Consulting

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Maersk Careers - Software Engineer- BRIM CI

Maersk Careers

Bengaluru, Karnataka, India (On-Site)
196 Years ago
PhonePe - Site Reliability Engineer

PhonePe

Bengaluru, Karnataka, India (On-Site)
5 Months ago
PwC - IN-Manager – D365 Scm -Ms Dynamics– Advisory  - Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Google - Software Engineering III, Embedded

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Knack Studios - Power Automate Developers

Knack Studios

Chennai, Tamil Nadu, India (On-Site)
10 Months ago
Egnyte - Software Engineer

Egnyte

India (Remote)
2 Months ago
Rackspace Technology - Azure Cloud Architect

Rackspace Technology

Gurugram, Haryana, India (Remote)
1 Week ago
Hitachi - Azure Infra Consultant

Hitachi

Pune, Maharashtra, India (Remote)
6 Months ago
Evolution - Software Developer in Data Science Team

Evolution

Riga, Latvia (On-Site)
1 Day ago
Google - Site Reliability Engineer, Databases

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
UXBERT Labs - Senior Solution Architect (IoT/Bluetooth Integration)

UXBERT Labs

Riyadh, Riyadh Province, Saudi Arabia (Hybrid)
3 Months ago
Epic Games - Build Programmer, Fortnite

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

United States (Remote)

Lansing, Michigan, United States (Remote)

Indianapolis, Indiana, United States (On-Site)

Indianapolis, Indiana, United States (On-Site)

Lansing, Michigan, United States (Hybrid)

Mechanicsburg, Pennsylvania, United States (On-Site)

Sunderland, England, United Kingdom (Hybrid)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Poland (On-Site)

View All Jobs

Get notified when new jobs are added by Info Stretch

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug