Data Engineer ( AWS, Confluent & SnapLogic )

5 Hours ago • 3 Years +

Job Summary

Job Description

The Data Engineer will be responsible for integrating data from various Siemens organizations into the data factory. They will implement and manage large-scale data processing solutions using AWS Glue, store and manage data in a data lake utilizing Iceberg tables in Snowflake, and apply data transformations to prepare data for analysis and reporting. Furthermore, the engineer will create and maintain data products, use Apache Airflow for workflow management, Confluent Kafka for real-time data streaming, SnapLogic for ETL processes, and Splunk for monitoring and logging. This role requires a strong understanding of data engineering principles, including data integration, processing, storage, and transformation. The engineer will be working on ensuring data quality, consistency, and providing actionable insights for data-driven decision-making.
Must have:
  • Integrate data from various Siemens organizations.
  • Implement data processing solutions using AWS Glue.
  • Store and manage data in a data lake.
  • Apply data transformations.
  • Use Apache Airflow for workflow management.
  • Utilize Confluent Kafka for real-time data streaming.
  • Design and implement ETL processes using SnapLogic.
  • Use Splunk for monitoring and logging.
Good to have:
  • Meticulous attention to detail
  • Excellent communication skills
  • Adaptability to changing technologies
  • Strong team player.
  • Eagerness to learn and stay updated.

Job Details

Hello Talented Techie!

We provide support in Project Services and Transformation, Digital Solutions and Delivery Management.

We offer joint operations and digitalization services for Global Business Services and work closely alongside the entire Shared Services organization. We make efficient use of the possibilities of new technologies such as Business Process Management (BPM) and Robotics as enablers for efficient and effective implementations.

We are looking for Data Engineer ( AWS, Confluent & Snaplogic )

  • Data Integration: Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
  • Data Processing: Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
  • Data Storage: Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
  • Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  • Data Products: Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
  • Workflow Management: Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
  • Real-time Data Streaming: Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
  • ETL Processes: Design and implement ETL processes using SnapLogic, ensuring efficient data extraction, transformation, and loading.
  • Monitoring and Logging: Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.

You’d describe yourself as:

  • Experience: 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.
  • Technical Skills:
    • Proficiency in AWS services, particularly AWS Glue.
    • Experience with Iceberg tables and Snowflake.
    • Knowledge of Confluent Kafka for real-time data streaming.
    • Familiarity with SnapLogic for ETL processes.
    • Experience with Apache Airflow for workflow management.
    • Understanding of Splunk for monitoring and logging.
  • Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.
  • Data Modeling: Experience with data modeling and database design.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.
 

Preferred Qualities:

  • Attention to Detail: Meticulous attention to detail, ensuring data accuracy and quality.
  • Communication Skills: Excellent communication skills, with the ability to collaborate effectively with cross-functional teams.
  • Adaptability: Ability to adapt to changing technologies and work in a fast-paced environment.
  • Team Player: Strong team player with a collaborative mindset.
  • Continuous Learning: Eagerness to learn and stay updated with the latest trends and technologies in data engineering.

Create a better #TomorrowWithUs!

This role, based in Bangalore, is an individual contributor position. You may be required to visit other locations within India and internationally. In return, you'll have the opportunity to work with teams shaping the future.

At Siemens, we are a collection of over 312,000 minds building the future, one day at a time, worldwide. We value your unique identity and perspective and are fully committed to providing equitable opportunities and building a workplace that reflects the diversity of society. Come bring your authentic self and create a better tomorrow with us.

Find out more about Siemens careers at: www.siemens.com/careers


Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Bengaluru, Karnataka, India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Siemens AG (Berlin and Munich) is a leading technology company focused on industry, infrastructure, transport, and healthcare. From more resource-efficient factories, resilient supply chains, and smarter buildings and grids, to cleaner and more comfortable transportation as well as advanced healthcare, the company creates technology with purpose adding real value for customers. By combining the real and the digital worlds, Siemens empowers its customers to transform their industries and markets, helping them to transform the everyday for billions of people. Siemens also owns a majority stake in the publicly listed company Siemens Healthineers, a globally leading medical technology provider shaping the future of healthcare. In fiscal 2023, which ended on September 30, 2023, the Siemens Group generated revenue of €77.8 billion and net income of €8.5 billion. As of September 30, 2023, the company employed around 320,000 people worldwide.

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Noida, Uttar Pradesh, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Siemens

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug