Lead Data Engineer

5 Months ago • 10 Years + • DevOps

Job Summary

Job Description

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes. Responsibilities include designing, developing & implementing ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse, advanced SQL knowledge, handling large volume data, and working with onshore teams, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices.
Must have:
  • Bachelor's Degree or master’s degree in Computer Science.
  • 10+ years of hands-on software engineering experience.
  • Proven work experience in Spark , Python ,SQL , Any RDBMS.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
  • Strong database fundamentals including SQL, performance and schema design.
  • Ability to interpret/write custom shell scripts.
  • Experience with any cloud is desired (Azure platform and Synapse/ AWS).
Good to have:
  • Understanding of CI/CD framework
  • Python scripting

Job Details

Description

Position at Apexon

Company Description: Apexon is a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 17 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.


 
Responsibilities

·         Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse

·         Advanced SQL knowledge, capable to write optimized queries for faster data work flows.

·         Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.

·         Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices

Requirements

·         Bachelor's Degree or master’s degree in Computer Science.

·         10+ years of hands-on software engineering experience.

·         Proven work experience in Spark , Python ,SQL , Any RDBMS.

·         Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS

·         Strong database fundamentals including SQL, performance and schema design.

·         Understanding of CI/CD framework is an added advantage.

·         Ability to interpret/write custom shell scripts. Python scripting is a plus.

·         Experience with any cloud is desired (Azure platform and Synapse/ AWS).

·         Experience with Git / Azure DevOps

  • To be able to work in a fast-paced agile development environment.

If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.

Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.

Similar Jobs

Google - CPU Design Verification Engineer

Google

Mountain View, California, United States (On-Site)
6 Days ago
NVIDIA - Senior SWQA Test Development Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Easybrain - Senior Data Engineer

Easybrain

Cyprus (On-Site)
9 Months ago
Patreon - Site Reliability Engineer

Patreon

United States (Remote)
4 Weeks ago
Google - Staff Software Engineer, Site Reliability Engineering

Google

Pittsburgh, Pennsylvania, United States (On-Site)
6 Days ago
Tencent - Senior Technical Account Manager

Tencent

Frankfurt, Hessen, Germany (On-Site)
1 Week ago
Rockstar Games - Senior DevOps Engineer

Rockstar Games

Edinburgh, Scotland, United Kingdom (On-Site)
7 Months ago
The Walt Disney Company - Build & Release Engineer

The Walt Disney Company

Emeryville, California, United States (On-Site)
4 Weeks ago
NVIDIA - Solutions Architect, Data Center Infrastructure

NVIDIA

Texas, United States (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Fluence - Controls Software Engineer-II(m/f/d)

Fluence

Erlangen, Bavaria, Germany (Hybrid)
6 Months ago
Google - Hardware Performance Test Engineer

Google

Sunnyvale, California, United States (On-Site)
6 Days ago
CloudLinux - Senior Go Developer for Imunify360

CloudLinux

Masovian Voivodeship, Poland (Remote)
4 Weeks ago
Google - CPU Design Verification Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Days ago
The Walt Disney Company - Chief Officer

The Walt Disney Company

(On-Site)
2 Months ago
Microsoft - Member of Technical Staff – Windows Engineer

Microsoft

(Hybrid)
1 Week ago
Saviynt - Consultant, Professional Services, IAM/IGA

Saviynt

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Cold Symmetry - Technical Artist

Cold Symmetry

(Remote)
3 Weeks ago
PwC - Senior Associate

PwC

Gurugram, Haryana, India (On-Site)
6 Months ago
ByteDance - Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

PhonePe - Linguist - Telugu

PhonePe

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Company3 Method Studios - Billing Associate

Company3 Method Studios

Pune, Maharashtra, India (Remote)
3 Months ago
Google - Technical Program Manager, Google Play

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
ION - Debt Restructuring Analyst

ION

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Aristocrat Gaming - Sr. Tech Artist I

Aristocrat Gaming

Gurugram, Haryana, India (Hybrid)
1 Month ago
Edify by Winuall - Social Media Manager

Edify by Winuall

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Cricketpedia - Backend Engineer - PHP only

Cricketpedia

Gurugram, Haryana, India (Remote)
2 Years ago
Quickplay - Senior Software Engineer (React Native-Android UI Development)

Quickplay

Chennai, Tamil Nadu, India (Hybrid)
9 Months ago
Nagarro - Associate Staff Engineer, Frontend React

Nagarro

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - ASIC SoC Design Engineer

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Rackspace Technology - AI/ML Architect

Rackspace Technology

Vietnam (Remote)
1 Month ago
Quizizz - Software Engineer - Infrastructure

Quizizz

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Equivalent Jobs - Technical Product Owner

Equivalent Jobs

(Remote)
2 Months ago
Google - Customer Engineer, Machine Learning, Google Cloud

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Days ago
Rackspace Technology - Google Cloud Engineer IV

Rackspace Technology

United States (Remote)
3 Months ago
Rackspace Technology - AWS Service Delivery Manager

Rackspace Technology

India (Remote)
4 Weeks ago
Ubisoft - Monitoring Specialist - Golang Developer

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
1 Week ago
Paytm - Devops - Senior DevOps Engineer

Paytm

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
Google - Principal Architect, Google Cloud

Google

Tennessee, United States (On-Site)
4 Days ago
NVIDIA - Senior Systems Software Engineer, Containers and Kubernetes

NVIDIA

California, United States (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

United States (Remote)

Lansing, Michigan, United States (Remote)

Indianapolis, Indiana, United States (On-Site)

Indianapolis, Indiana, United States (On-Site)

Lansing, Michigan, United States (Hybrid)

Mechanicsburg, Pennsylvania, United States (On-Site)

Sunderland, England, United Kingdom (Hybrid)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Poland (On-Site)

View All Jobs

Get notified when new jobs are added by Info Stretch

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug