Data Engineer (AWS, Confluent & SnapLogic)

1 Month ago • 3 Years + • Data Analysis

Job Summary

Job Description

The Data Engineer will be responsible for integrating data from various Siemens organizations into the data factory, ensuring seamless data flow and real-time data fetching. They will implement and manage large-scale data processing solutions using AWS Glue, store and manage data in a large-scale data lake utilizing Iceberg tables in Snowflake, and apply various data transformations for analysis and reporting. The engineer will create and maintain data products, manage workflows using Apache Airflow, utilize Confluent Kafka for real-time data streaming, and design and implement ETL processes using SnapLogic. They will also use Splunk for monitoring and logging, ensuring system reliability and performance.
Must have:
  • Integrate data using AWS Glue and ensure seamless data flow
  • Manage data processing solutions using AWS Glue
  • Store and manage data in a data lake using Iceberg tables in Snowflake
  • Apply data transformations for analysis and reporting
  • Use Apache Airflow to orchestrate and automate data workflows
  • Utilize Confluent Kafka for real-time data streaming
  • Design and implement ETL processes using SnapLogic
  • Use Splunk for monitoring and logging data processes
  • Proficiency in Python, SQL and other relevant programming languages.
Good to have:
  • Meticulous attention to detail, ensuring data accuracy and quality
  • Excellent communication skills
  • Ability to adapt to changing technologies
  • Strong team player with a collaborative mindset
  • Eagerness to learn and stay updated with the latest trends.

Job Details

Hello Talented Techie!

We provide support in Project Services and Transformation, Digital Solutions and Delivery Management.

We offer joint operations and digitalization services for Global Business Services and work closely alongside the entire Shared Services organization. We make efficient use of the possibilities of new technologies such as Business Process Management (BPM) and Robotics as enablers for efficient and effective implementations.

We are looking for Data Engineer ( AWS, Confluent & Snaplogic )

  • Data Integration: Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
  • Data Processing: Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
  • Data Storage: Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
  • Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  • Data Products: Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
  • Workflow Management: Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
  • Real-time Data Streaming: Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
  • ETL Processes: Design and implement ETL processes using SnapLogic, ensuring efficient data extraction, transformation, and loading.
  • Monitoring and Logging: Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.

You’d describe yourself as:

  • Experience: 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.
  • Technical Skills:
    • Proficiency in AWS services, particularly AWS Glue.
    • Experience with Iceberg tables and Snowflake.
    • Knowledge of Confluent Kafka for real-time data streaming.
    • Familiarity with SnapLogic for ETL processes.
    • Experience with Apache Airflow for workflow management.
    • Understanding of Splunk for monitoring and logging.
  • Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.
  • Data Modeling: Experience with data modeling and database design.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.
 

Preferred Qualities:

  • Attention to Detail: Meticulous attention to detail, ensuring data accuracy and quality.
  • Communication Skills: Excellent communication skills, with the ability to collaborate effectively with cross-functional teams.
  • Adaptability: Ability to adapt to changing technologies and work in a fast-paced environment.
  • Team Player: Strong team player with a collaborative mindset.
  • Continuous Learning: Eagerness to learn and stay updated with the latest trends and technologies in data engineering.

Create a better #TomorrowWithUs!

This role, based in Bangalore, is an individual contributor position. You may be required to visit other locations within India and internationally. In return, you'll have the opportunity to work with teams shaping the future.

At Siemens, we are a collection of over 312,000 minds building the future, one day at a time, worldwide. We value your unique identity and perspective and are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society. Come bring your authentic self and create a better tomorrow with us.

Find out more about Siemens careers at: www.siemens.com/careers

Similar Jobs

Ion - Research Editor

Ion

Mumbai, Maharashtra, India (On-Site)
3 Months ago
EveryMatrix - Trainee Incident Manager

EveryMatrix

Lviv, Lviv Oblast, Ukraine (Hybrid)
2 Months ago
PwC - Senior Associate - SAP APO/SNP - RDC

PwC

Kolkata, West Bengal, India (On-Site)
8 Months ago
PwC - Senior Associate  - Internal Audit

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
7 Months ago
Cineplex - Hourly Line Cook

Cineplex

London, Ontario, Canada (On-Site)
1 Week ago
Trend Micro - Data Scientist

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
16 Years ago
Experian - InfoSec Vulnerability Metrics & Data Analyst

Experian

United States (Remote)
1 Week ago
N-ix - Senior Data Engineer

N-ix

Poland (Hybrid)
2 Weeks ago
ARHS - Mid Business Analyst (Banking Sector)

ARHS

Athens, Greece (On-Site)
1 Month ago
JDA - Sr. Data Scientist I (ML, Python, Tensorflow)

JDA

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - Enterprise Architect

PwC

Toronto, Ontario, Canada (Hybrid)
2 Weeks ago
Capgemini - Mechanical & Physical Engineer

Capgemini

Hyderabad, Telangana, India (On-Site)
1 Week ago
Adyen - Learning and Development Business Partner

Adyen

San Francisco, California, United States (On-Site)
1 Month ago
Sony Music Career - Finance and Tax Manager

Sony Music Career

Jakarta, Indonesia (On-Site)
1 Month ago
tonies studios - Creative Director

tonies studios

Düsseldorf, North Rhine-Westphalia, Germany (Hybrid)
2 Months ago
Everi - Supply Chain Planning Center of Excellence Lead

Everi

London, England, United Kingdom (On-Site)
1 Week ago
Click Therapeutics - Senior Vice President, Clinical Development & Medical Affairs

Click Therapeutics

New York, United States (Hybrid)
1 Month ago
Pokemon - Project Coordinator - Design

Pokemon

Bellevue, Washington, United States (Hybrid)
2 Weeks ago
oportun - Senior Data Scientist

oportun

(Remote)
1 Month ago
Redhorse Corp - National Programs and Policy Support Subject Matter Expert

Redhorse Corp

Arlington, Virginia, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Adobe - Product Sales Specialist

Adobe

India (Remote)
1 Month ago
Jumio - Cloud Security Engineer

Jumio

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Hashlist - Principal Data Engineer

Hashlist

Chennai, Tamil Nadu, India (Hybrid)
7 Months ago
DMG - Software Development Engineer 4

DMG

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Qualcomm - Senior Engineer - Windows/Linux kernel & Driver Development

Qualcomm

Hyderabad, Telangana, India (On-Site)
4 Weeks ago
EXUSIA - Snowflake Data Engineer

EXUSIA

India (Remote)
2 Weeks ago
Code and Theory - Senior Engineer, Back-end

Code and Theory

Karnataka, India (Remote)
8 Months ago
Wolters Kluwer - Senior Product Software Engineer

Wolters Kluwer

Pune, Maharashtra, India (Hybrid)
2 Weeks ago
JDA - Sr. Data Scientist I (ML, Python, Tensorflow)

JDA

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Capgemini - Automation Testing Specialist

Capgemini

Pune, Maharashtra, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Thumbtack - Senior Data Engineer

Thumbtack

Ontario, Canada (Remote)
2 Weeks ago
NVIDIA - Senior Data Scientist and System Architect

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
ISS Stoxx - Data Analyst

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
4 Weeks ago
Marsh McLennan - Senior Analyst - Data Science

Marsh McLennan

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Week ago
kaizen gaming  - Senior Data Engineer, AI Applications

kaizen gaming

Lisbon, Lisbon, Portugal (Hybrid)
6 Days ago
Casumo - Senior Business Analyst

Casumo

Zagreb, Croatia (Hybrid)
2 Months ago
Dentsu - Lead Data Engineer

Dentsu

Mumbai, Maharashtra, India (On-Site)
3 Weeks ago
DWS Group - Data Scientist

DWS Group

Mumbai, Maharashtra, India (Hybrid)
7 Months ago
Capgemini - Data Engineer

Capgemini

Hyderabad, Telangana, India (On-Site)
1 Week ago
GoMotive - Data Scientist, People Analytics

GoMotive

Bengaluru, Karnataka, India (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chennai, Tamil Nadu, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Siemens

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug