Data Engineer (AWS, Confluent & SnapLogic)

2 Months ago • 3 Years + • Data Analysis

Job Summary

Job Description

The Data Engineer will be responsible for integrating data from various Siemens organizations into the data factory, ensuring seamless data flow and real-time data fetching. They will implement and manage large-scale data processing solutions using AWS Glue, store and manage data in a large-scale data lake utilizing Iceberg tables in Snowflake, and apply various data transformations for analysis and reporting. The engineer will create and maintain data products, manage workflows using Apache Airflow, utilize Confluent Kafka for real-time data streaming, and design and implement ETL processes using SnapLogic. They will also use Splunk for monitoring and logging, ensuring system reliability and performance.
Must have:
  • Integrate data using AWS Glue and ensure seamless data flow
  • Manage data processing solutions using AWS Glue
  • Store and manage data in a data lake using Iceberg tables in Snowflake
  • Apply data transformations for analysis and reporting
  • Use Apache Airflow to orchestrate and automate data workflows
  • Utilize Confluent Kafka for real-time data streaming
  • Design and implement ETL processes using SnapLogic
  • Use Splunk for monitoring and logging data processes
  • Proficiency in Python, SQL and other relevant programming languages.
Good to have:
  • Meticulous attention to detail, ensuring data accuracy and quality
  • Excellent communication skills
  • Ability to adapt to changing technologies
  • Strong team player with a collaborative mindset
  • Eagerness to learn and stay updated with the latest trends.

Job Details

Hello Talented Techie!

We provide support in Project Services and Transformation, Digital Solutions and Delivery Management.

We offer joint operations and digitalization services for Global Business Services and work closely alongside the entire Shared Services organization. We make efficient use of the possibilities of new technologies such as Business Process Management (BPM) and Robotics as enablers for efficient and effective implementations.

We are looking for Data Engineer ( AWS, Confluent & Snaplogic )

  • Data Integration: Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
  • Data Processing: Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
  • Data Storage: Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
  • Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  • Data Products: Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
  • Workflow Management: Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
  • Real-time Data Streaming: Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
  • ETL Processes: Design and implement ETL processes using SnapLogic, ensuring efficient data extraction, transformation, and loading.
  • Monitoring and Logging: Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.

You’d describe yourself as:

  • Experience: 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.
  • Technical Skills:
    • Proficiency in AWS services, particularly AWS Glue.
    • Experience with Iceberg tables and Snowflake.
    • Knowledge of Confluent Kafka for real-time data streaming.
    • Familiarity with SnapLogic for ETL processes.
    • Experience with Apache Airflow for workflow management.
    • Understanding of Splunk for monitoring and logging.
  • Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.
  • Data Modeling: Experience with data modeling and database design.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.
 

Preferred Qualities:

  • Attention to Detail: Meticulous attention to detail, ensuring data accuracy and quality.
  • Communication Skills: Excellent communication skills, with the ability to collaborate effectively with cross-functional teams.
  • Adaptability: Ability to adapt to changing technologies and work in a fast-paced environment.
  • Team Player: Strong team player with a collaborative mindset.
  • Continuous Learning: Eagerness to learn and stay updated with the latest trends and technologies in data engineering.

Create a better #TomorrowWithUs!

This role, based in Bangalore, is an individual contributor position. You may be required to visit other locations within India and internationally. In return, you'll have the opportunity to work with teams shaping the future.

At Siemens, we are a collection of over 312,000 minds building the future, one day at a time, worldwide. We value your unique identity and perspective and are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society. Come bring your authentic self and create a better tomorrow with us.

Find out more about Siemens careers at: www.siemens.com/careers

Similar Jobs

Guardian - Sales Analyst, Premier Market

Guardian

Boston, Massachusetts, United States (Hybrid)
2 Months ago
endava - Senior Angular Developer

endava

Split, Split-Dalmatia County, Croatia (Remote)
1 Month ago
Granicus - Software Engineer 3

Granicus

Costa Rica (Remote)
2 Months ago
Ubisoft - Senior Analyst, Live Analytics

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
Zenoti - Manager - Professional Services Operations

Zenoti

Hyderabad, Telangana, India (On-Site)
2 Months ago
Hitachi - Azure Data Engineer (MS)

Hitachi

Pune, Maharashtra, India (Remote)
9 Months ago
Zones - Business Systems Analyst - Finance

Zones

Pakistan (On-Site)
5 Months ago
HCL Tech - Senior Business Analyst

HCL Tech

North Carolina, United States (On-Site)
1 Month ago
Workato - Senior Java Engineer (Data Integration Team)

Workato

Sofia, Sofia City Province, Bulgaria (On-Site)
2 Months ago
endava - Senior Data Engineer

endava

Montevideo, Montevideo Department, Uruguay (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

MURKA - Slot Game Designer

MURKA

(Remote)
5 Months ago
VGW - Account Executive

VGW

Toronto, Ontario, Canada (On-Site)
1 Month ago
The Walt Disney Company - Associate Disney Youth Programs Manager

The Walt Disney Company

Hong Kong (On-Site)
2 Months ago
Landor - Creative Strategist

Landor

New York, New York, United States (On-Site)
2 Months ago
Oliver Agency - Creative Content Strategist

Oliver Agency

Mumbai, Maharashtra, India (On-Site)
2 Months ago
PwC - Transaction Services Professional

PwC

Brussels, Brussels, Belgium (On-Site)
1 Month ago
Sporty - ZA Risk, Payments and Operations Senior Associate

Sporty

South Africa (Remote)
5 Months ago
Qualcomm - XR Systems Engineer

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Flying Bark - Senior Surfacing Artist

Flying Bark

Sydney, New South Wales, Australia (Hybrid)
4 Months ago
Survay Monkey - New Business Account Executive

Survay Monkey

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Mindtickle - Software Development Engineer 2

Mindtickle

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
InMobiInMobi - Product Manager - Central Data Repository & Data Platform AI

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Paytm - Business Analyst - Team Lead

Paytm

Greater Noida, Uttar Pradesh, India (On-Site)
1 Month ago
Krafton India  - Lead - Business Development Manager

Krafton India

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Philips - Business Impact Manager – Digital Solutions

Philips

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Intel  - EC Firmware Development Engineer

Intel

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Synechron - .NET Developer (Cloud, Front-End & Database Proficiency)

Synechron

Pune, Maharashtra, India (On-Site)
1 Month ago
Ethos Life - Policy Administration Associate

Ethos Life

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Capgemini - Analog Layout Engineer

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ubisoft - 3D Artist

Ubisoft

Pune, Maharashtra, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

kaizen gaming  - Data Scientist

kaizen gaming

Athens, Greece (Hybrid)
1 Month ago
luxsoft - Senior Business Analyst - Trade Finance

luxsoft

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
Illumina - Sr Financial Business Systems Analyst

Illumina

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Yodo1 - Data Engineer

Yodo1

(Remote)
10 Months ago
Enphase Energy - Sr Staff Data Analyst - Quality

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
11 Months ago
Brillio - Data Science Lead (ML/AI)

Brillio

Chicago, Illinois, United States (Hybrid)
1 Month ago
Ion - Senior Data Engineer, Risk Technology

Ion

Mexico City, Mexico (Hybrid)
1 Month ago
Silicon Labs - Senior Data Engineer

Silicon Labs

Budapest, Hungary (On-Site)
1 Month ago
Crowd Strick - Data & Automation Architect

Crowd Strick

(Remote)
2 Months ago
Flutter Entertainment - Lead Data Scientist

Flutter Entertainment

Hyderabad, Telangana, India (Hybrid)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Noida, Uttar Pradesh, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chennai, Tamil Nadu, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Amadora, Lisbon, Portugal (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Siemens

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug