Senior Data Engineer

3 Weeks ago • 5 Years + • Data Analyst

About the job

Job Description

Senior Azure Data Engineer needed to design, implement, and test cloud computing solutions using ADF, ADB, ADL, and Snowflake. Responsibilities include creating, monitoring, and optimizing ETL/ELT processes; migrating on-premises solutions to the cloud; designing features for identity and access management; solving performance and scalability issues; building, monitoring, and optimizing ETL/ELT processes; data integration with third-party tools; and managing data models and architecture. Requires 5+ years of experience with Azure Data Lake, Snowflake, Azure Databricks, ETL, Azure Data Factory, SQL, data modeling, and various ETL tools. Experience with Hadoop, Spark, and other warehousing tools is a plus.
Must have:
  • 5+ years experience
  • Azure Data Lake, Snowflake, Databricks, ADF
  • ETL/ELT process optimization
  • SQL, Data Modeling
  • Cloud migration experience
  • Performance tuning
  • Third-party tool integration
Good to have:
  • Hadoop
  • Oracle
  • Python, Java, JavaScript
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.
Project description

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.
Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities

Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

Design and implement features for identity and access management

Create authorization frameworks for better access control

Solve performance issues and scalability issues in the system

Transaction management with distributed data processing algorithms

Possess ownership right from start to finish

Build, monitor, and optimize ETL and ELT processes with data models

Migrate solutions from on-premises setup to cloud-based platforms

Understand and implement the latest delivery approaches based on data architecture

Project documentation and tracking based on understanding user requirements

Perform data integration with third-party tools including architecting, designing, coding, and testing phases

Manage documentation of data models, architecture, and maintenance processes

Continually review and audit data models for enhancement

Maintenance of ideal data pipeline based on ETL tools.

Coordination with BI experts and analysts for customized data models and integration

Code updates, new code development, and reverse engineering

Performance tuning, user acceptance training, and application support

Maintain confidentiality of data

Risk assessment, management, and mitigation plans

Regular engagement with teams for status reporting and routine activities

Migration activities from one database to another or on-premises to cloud

Skills

Must have

5+ years of experience Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

Snowflake modeling

roles, databases, schemas

SQL performance measuring, query tuning, and database tuning

ETL tools with cloud-driven skills

Integration with third-party tools

Ability to build analytical solutions and models.

Coding in languages like Python, Java, JavaScript

Root cause analysis of models with solutions

Hadoop, Spark, and other warehousing tools

Managing sets of XML, JSON, and CSV from disparate sources

SQL-based databases like Oracle SQL Server, Teradata, etc.

Snowflake warehousing, architecture, processing, administration

Data ingestion into Snowflake

Enterprise-level technical exposure to Snowflake applications

Nice to have

Hadoop, Oracle

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.

Poland, Ohio, United States (Remote)

Brazil, Indiana, United States (Remote)

Brazil, Indiana, United States (Remote)

Mexico City, Mexico City, Mexico (Remote)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

Singapore, Singapore (On-Site)

Pune, Maharashtra, India (On-Site)

Poland, Ohio, United States (Remote)

Ukrainka, Kyiv Oblast, Ukraine (Remote)

View All Jobs

Get notified when new jobs are added by Luxoft

Similar Jobs

Applike Group - Tech Lead - Backend Services (Go) (f/m/d)

Applike Group, Germany (Hybrid)

Ajmera Infotech - Senior DevOps Engineer - AWS

Ajmera Infotech, United States (On-Site)

ARHS - Tester

ARHS, Sweden (On-Site)

Intel Corporation - IDC (Intel Developer Cloud) Service Desk Engineer

Intel Corporation, Costa Rica (Hybrid)

Romero Games - Online Programmer

Romero Games, Ireland (Remote)

Warner Bros Discovery - Corporate Data Architect

Warner Bros Discovery, (Hybrid)

Hitachi - Customer Insights (CDP) Consultant

Hitachi, India (Remote)

Luxoft - Senior PySpark Data Engineer

Luxoft, United States (Remote)

Twitch - Business Intelligence Engineer (Contract)

Twitch, United States (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ness Digital - Java_ShellScript_DB_Production_Engineer

Ness Digital, Canada (Hybrid)

Xsolla - Junior Data Scientist

Xsolla, Armenia (On-Site)

Coupa Software - Software Engineer in Test

Coupa Software, Colombia (Hybrid)

The Walt Disney Company - Lead Software Engineer

The Walt Disney Company, United States (On-Site)

Info Stretch - Lead Data Engineer

Info Stretch, India (On-Site)

Stonewall Collision & Auto Painting - Lead Data Scientist

Stonewall Collision & Auto Painting, India (On-Site)

Varonis  - DevSecOps Engineer

Varonis , Israel (Hybrid)

TIBCO - Senior QA Engineer

TIBCO, India (On-Site)

NinjaVan - Senior Full Stack Engineer

NinjaVan, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Rackspace Technology - Senior Big Data Engineer

Rackspace Technology, Egypt (Remote)

Egnyte - Senior Analytics Engineer

Egnyte, Poland (Remote)

N-iX - Senior Data Modeler (#2471)

N-iX, Ukraine (Remote)

Liven - Senior Data Product Manager

Liven, India (Remote)

Appier - Business Analyst (Partnership)

Appier, Taiwan (On-Site)

Token Metrics - Senior Crypto Data Engineer (Remote-Astra)

Token Metrics, Indonesia (Remote)

Warner Bros Discovery - Customer Data Manager - Digital/ VOD

Warner Bros Discovery, (Hybrid)

Get notifed when new similar jobs are uploaded