Data Engineer (AWS, Confluent & SnapLogic)

3 Hours ago • 3 Years +

Job Summary

Job Description

The Data Engineer will be responsible for integrating data from various Siemens organizations into the data factory, ensuring seamless data flow and real-time data fetching. They will implement and manage large-scale data processing solutions using AWS Glue, store and manage data in a large-scale data lake utilizing Iceberg tables in Snowflake, and apply various data transformations for analysis and reporting. The engineer will create and maintain data products, manage workflows using Apache Airflow, utilize Confluent Kafka for real-time data streaming, and design and implement ETL processes using SnapLogic. They will also use Splunk for monitoring and logging, ensuring system reliability and performance.
Must have:
  • Integrate data using AWS Glue and ensure seamless data flow
  • Manage data processing solutions using AWS Glue
  • Store and manage data in a data lake using Iceberg tables in Snowflake
  • Apply data transformations for analysis and reporting
  • Use Apache Airflow to orchestrate and automate data workflows
  • Utilize Confluent Kafka for real-time data streaming
  • Design and implement ETL processes using SnapLogic
  • Use Splunk for monitoring and logging data processes
  • Proficiency in Python, SQL and other relevant programming languages.
Good to have:
  • Meticulous attention to detail, ensuring data accuracy and quality
  • Excellent communication skills
  • Ability to adapt to changing technologies
  • Strong team player with a collaborative mindset
  • Eagerness to learn and stay updated with the latest trends.

Job Details

Hello Talented Techie!

We provide support in Project Services and Transformation, Digital Solutions and Delivery Management.

We offer joint operations and digitalization services for Global Business Services and work closely alongside the entire Shared Services organization. We make efficient use of the possibilities of new technologies such as Business Process Management (BPM) and Robotics as enablers for efficient and effective implementations.

We are looking for Data Engineer ( AWS, Confluent & Snaplogic )

  • Data Integration: Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
  • Data Processing: Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
  • Data Storage: Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
  • Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  • Data Products: Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
  • Workflow Management: Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
  • Real-time Data Streaming: Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
  • ETL Processes: Design and implement ETL processes using SnapLogic, ensuring efficient data extraction, transformation, and loading.
  • Monitoring and Logging: Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.

You’d describe yourself as:

  • Experience: 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.
  • Technical Skills:
    • Proficiency in AWS services, particularly AWS Glue.
    • Experience with Iceberg tables and Snowflake.
    • Knowledge of Confluent Kafka for real-time data streaming.
    • Familiarity with SnapLogic for ETL processes.
    • Experience with Apache Airflow for workflow management.
    • Understanding of Splunk for monitoring and logging.
  • Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.
  • Data Modeling: Experience with data modeling and database design.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.
 

Preferred Qualities:

  • Attention to Detail: Meticulous attention to detail, ensuring data accuracy and quality.
  • Communication Skills: Excellent communication skills, with the ability to collaborate effectively with cross-functional teams.
  • Adaptability: Ability to adapt to changing technologies and work in a fast-paced environment.
  • Team Player: Strong team player with a collaborative mindset.
  • Continuous Learning: Eagerness to learn and stay updated with the latest trends and technologies in data engineering.

Create a better #TomorrowWithUs!

This role, based in Bangalore, is an individual contributor position. You may be required to visit other locations within India and internationally. In return, you'll have the opportunity to work with teams shaping the future.

At Siemens, we are a collection of over 312,000 minds building the future, one day at a time, worldwide. We value your unique identity and perspective and are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society. Come bring your authentic self and create a better tomorrow with us.

Find out more about Siemens careers at: www.siemens.com/careers

Similar Jobs

Fandom - Manager Software Engineering (AdTech)

Fandom

Poznań, Greater Poland Voivodeship, Poland (Remote)
3 Months ago
Zscaler - Principal Software Development Engineer

Zscaler

San Jose, California, United States (On-Site)
2 Weeks ago
Tala - Lead Cloud Infrastructure Engineer

Tala

(Remote)
2 Months ago
Britive - ENGINEERING MANAGER

Britive

Bengaluru, Karnataka, India (Remote)
6 Months ago
Ziff Davis - Software Developer

Ziff Davis

(Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Dialpad AI - Advanced Application Support Engineer

Dialpad AI

(Remote)
2 Weeks ago
Accurate - Senior Full Stack Software Engineer

Accurate

Hyderabad, Telangana, India (Hybrid)
1 Year ago
Experian - Lead of Engineering

Experian

Cyberjaya, Selangor, Malaysia (On-Site)
1 Month ago
Wildlife Studios - FinOps Planning Analyst

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
2 Months ago
GMS Services - Senior DevOps Developer

GMS Services

Berlin, Berlin, Germany (On-Site)
10 Years ago
Velotio Technologies - Lead Engineer (Java)

Velotio Technologies

Pune, Maharashtra, India (Remote)
1 Month ago
high radius - Lead Infrastructure Engineer

high radius

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Addepar - Sr. Software Data Engineer

Addepar

Pune, Maharashtra, India (Hybrid)
2 Weeks ago
Diligent - BT Developer

Diligent

Vancouver, British Columbia, Canada (On-Site)
3 Weeks ago
Conga - Sr. Software Engineer

Conga

Bengaluru, Karnataka, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Barracuda Networks  Inc  - Associate Account Executive (Cybersecurity, SMB, Mid-Market)

Barracuda Networks Inc

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Entrata - Group Director - Service Operations

Entrata

Pune, Maharashtra, India (Hybrid)
3 Weeks ago
Google - Data Science Manager, gTech Ads Solutions

Google

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
ION - Senior Credit Research Analyst - 271

ION

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Qualcomm - Staff Design Verification

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Aisera Jobs - Sustaining Engineer-Python

Aisera Jobs

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Educational Initiatives - Associate Manager- Design

Educational Initiatives

Karnataka, India (Hybrid)
7 Months ago
Nagarro - Senior Staff Engineer, Java Fullstack

Nagarro

India (Remote)
7 Months ago
Sporty Group - IN Associate - Customer Success (Gurugram)

Sporty Group

Delhi, India (On-Site)
9 Months ago
TransUnion - Rep I Chat Ops

TransUnion

Chennai, Tamil Nadu, India (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Siemens AG (Berlin and Munich) is a leading technology company focused on industry, infrastructure, transport, and healthcare. From more resource-efficient factories, resilient supply chains, and smarter buildings and grids, to cleaner and more comfortable transportation as well as advanced healthcare, the company creates technology with purpose adding real value for customers. By combining the real and the digital worlds, Siemens empowers its customers to transform their industries and markets, helping them to transform the everyday for billions of people. Siemens also owns a majority stake in the publicly listed company Siemens Healthineers, a globally leading medical technology provider shaping the future of healthcare. In fiscal 2023, which ended on September 30, 2023, the Siemens Group generated revenue of €77.8 billion and net income of €8.5 billion. As of September 30, 2023, the company employed around 320,000 people worldwide.

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Siemens

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug