Data Engineer III/IV

2 Months ago • 10 Years + • Data Analysis

Job Summary

Job Description

The Data Engineer is responsible for managing and operating Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, and PowerBI/Tableau. This role involves working closely with customers and the team to manage and operate the cloud data platform. Key responsibilities include leading operational coverage, resolving pipeline issues, proactive monitoring of sensitive batches, conducting root cause analysis and retrospection of issues, and documenting defects. The engineer will design, build, test, and deploy fixes to non-production environments for customer testing, and work with customers to deploy fixes to production upon acceptance. Additionally, the role involves cost/performance optimization, audit/security management, troubleshooting incidents, creating/updating runbooks, and monitoring configuration changes. Communication and change management are also crucial aspects of this position, acting as a point of contact for customers and coordinating with stakeholders.
Must have:
  • Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau
  • SQL and stored procedures
  • Configuring, managing, and troubleshooting
  • Analytical and problem-solving skills
  • Excellent written and verbal communication
Good to have:
  • Experience with Databricks and Tableau environment

Job Details

Data Engineer III/ IV - IN (Operation/ Supports)

Work Location - Remote 
Shift: Rotation Shifts
Experience: 10 years

Job Description

Summary

The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer and team to manage and operate cloud data platform. 


Job Description

  • Leads Level 4 operational coverage: Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.
  • Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix.
  • Cost / Performance optimization and Audit / Security including any associated infrastructure changes
  • Troubleshooting incident/problem, includes collecting logs, cross-checking against known issues, investigate common root causes (for example failed batches, infra related items such as connectivity to source, network issues etc.)
  • Knowledge Management: Create/update runbooks as needed .
  • Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources.
  • Communication: Lead and act as a POC for customer from off-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
  • Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
  • Request Management: Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
  • Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed.

Skill

  • Good hands-on  Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau
  • Ability to read and write sql and stored procedures.
  • Good hands-on experience in configuring, managing and troubleshooting along with general analytical and problem-solving skills.
  • Excellent written and verbal communication skills.
  • Ability to communicate technical info and ideas so others will understand. Ability to successfully work and promote inclusiveness in small groups.

Experience/Education

  • Requires a Bachelor’s degree in computer science or other related field plus 10+ years of hands-on experience in configuring and managing AWS/tableau and databricks solutions.
  • Experience with Databricks and tableau environment is desired.

JOb Complexity

  • This role requires extensive problem-solving skills and the ability to research an issue, determine the root cause, and implement the resolution;
  • research of various sources such as databricks/AWS/tableau documentation that may be required to identify and resolve issues.
  • Must have the ability to prioritize issues and multi-task.

Similar Jobs

Paradox Interactive - Engine Graphics Programmer

Paradox Interactive

Sitges, Catalonia, Spain (On-Site)
3 Months ago
bytedance - Site Reliability Engineer, Compute Platform

bytedance

San Jose, California, United States (On-Site)
9 Months ago
adglobal 360 - Business Development Manager (Digital Marketing)

adglobal 360

Chennai, Tamil Nadu, India (On-Site)
3 Months ago
Side - Part Time German Player Support Advocate

Side

Poland (Remote)
1 Month ago
Jane Street - AV Engineer

Jane Street

New York, United States (On-Site)
3 Months ago
ISS Stoxx - Junior Data Analyst - Market Intelligence BrightScope Team

ISS Stoxx

Makati City, Metro Manila, Philippines (Hybrid)
1 Month ago
Remote - Senior Product Data Analyst

Remote

Netherlands (Remote)
1 Month ago
Next Level Business Services - Big Data Architect with IBM Big Insights

Next Level Business Services

St. Louis, Missouri, United States (Hybrid)
10 Months ago
Tencent - Game Operations (Data Analysis Direction)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
2 Months ago
MURKA - Marketing Data Analyst

MURKA

Poland (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

fuse games - Handling Designer

fuse games

Guildford, England, United Kingdom (Hybrid)
1 Month ago
Bungie - Marathon Senior Software Engineer - Commerce

Bungie

(Hybrid)
8 Months ago
Crunchyroll - Senior Software Engineering Manager, Memberships

Crunchyroll

San Francisco, California, United States (Hybrid)
3 Months ago
Abridge - Business Value Analysis Director

Abridge

Chicago, Illinois, United States (Hybrid)
1 Month ago
Hawkeye Innovations - Match Operations Assistant - Košice

Hawkeye Innovations

Košice, Košice Region, Slovakia (On-Site)
4 Months ago
Lorikeet - Solutions Engineer

Lorikeet

London, England, United Kingdom (On-Site)
1 Month ago
frozenbyte games - Game Developer

frozenbyte games

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago
Interactive Brokers - Global Client Associate - English and Italian/French/Russian speaking

Interactive Brokers

Tallinn, Harju County, Estonia (On-Site)
10 Months ago
Condé Nast - Global Systems Operations Specialist

Condé Nast

London, England, United Kingdom (Hybrid)
1 Month ago
Abstraction Games - Office Manager (Part-Time & Hybrid)

Abstraction Games

Eindhoven, North Brabant, Netherlands (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Capgemini - Veeam Backup Admin

Capgemini

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Aeries technology - Financial Deal Desk Analyst

Aeries technology

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Palo Alto Networks - Partner Technical Enablement Manager

Palo Alto Networks

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Capgemini - DC

Capgemini

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Zinnia - Product Manager - SoR Team

Zinnia

Pune, Maharashtra, India (On-Site)
3 Months ago
Winzo - Information Security Lead

Winzo

India (On-Site)
1 Month ago
Unity - Lead, Credit Collections Specialist

Unity

Bengaluru, Karnataka, India (On-Site)
3 Months ago
eBay - Senior Manager Knowledge Science

eBay

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Accenture - Order to Cash Operations Senior Analyst

Accenture

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Motorola solutions - IT ServiceNow Administrator

Motorola solutions

Bengaluru, Karnataka, India (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

zeta - Senior Data Engineer

zeta

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Apple - Machine Learning Engineer - Strategic Data Solutions

Apple

Austin, Texas, United States (On-Site)
1 Month ago
Yahoo - Principal Data Engineer - Consumer Data AI / ML

Yahoo

United States (Hybrid)
1 Month ago
Razer - Senior Data Analyst

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
1 Month ago
NBC Universal - Data Product Manager, Product Analytics

NBC Universal

Brentford, England, United Kingdom (On-Site)
2 Months ago
cyara - Sales Operations Analyst – Data

cyara

Hyderabad, Telangana, India (Hybrid)
8 Months ago
Pomelo - Senior Software Engineer, Core Data

Pomelo

United States (Remote)
1 Month ago
NinjaVan - Data Analyst Executive (Express/Logistics)

NinjaVan

Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
Techland - Junior Data Engineer

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
binance - Data Scientist - Large Language Model

binance

Taipei City, Taiwan (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded