Cloudera Developer

4 Months ago • 6-10 Years

Job Summary

Job Description

As a Sr Cloudera Developer (Data Engineer), you will be responsible for designing, developing, and implementing data solutions using Cloudera technologies like Hadoop, Spark, and Hive. You will collaborate with data engineers to optimize data pipelines and workflows, and work closely with data analysts and scientists to ensure data quality. You will troubleshoot issues and stay updated on the latest trends, participating in code reviews. Proficiency in Spark, ETL processes, and experience with Hadoop ecosystem tools are required, along with strong programming skills in Java, Scala, or Python. Excellent problem-solving and communication skills are also necessary.
Must have:
  • Proficiency in working with Spark
  • Experience in optimizing Spark execution plan
  • Skills in performing ETL processes using Spark
  • Strong knowledge of Python
  • Experience with data modeling and integration
  • Solid understanding of Cloudera technologies
Good to have:
  • Experience with integrating Spark Streaming with other technologies
  • Familiarity with the Hadoop ecosystem
  • Experience with deploying and managing Spark applications
  • Experience in GCP services

Job Details

Company Description

T-Systems Information and Communication Technology India Private Limited (T-Systems ICT India Pvt. Ltd.) is a proud recipient of the prestigious Great Place To Work® Certification™. As a wholly owned subsidiary of T-Systems International GmbH, T-Systems India operates across Pune, Bangalore, and Nagpur, boasting a dedicated team of 3500+ employees providing services to group customers. T-Systems offers integrated end-to-end IT solutions, driving the digital transformation of companies in all industries, including automotive, manufacturing, logistics, and transportation, as well as healthcare and the public sector. T-Systems develops vertical, company-specific software solutions for these sectors. T-Systems International GmbH is an information technology and digital transformation company with a presence in over 20 countries and a revenue of more than €4 billion. T-Systems is a world-leading provider of digital services and has over 20 years of experience in the transformation and management of IT systems. As a subsidiary of Deutsche Telekom and a market leader in Germany, T-Systems International offers secure, integrated information technology and digital solutions from a single source.

Job Description

Role : Sr Cloudera Developer (Data Engineer)

Exp : 6 to 10 Years

Location : Pune

 

Job Description :

  • Proficiency in working with Spark
  • Understanding of Spark s architecture and fault tolerance mechanisms
  • Proficiency in using Spark DataFrames and Spark SQL for querying structured data
  • Experience in optimizing Spark execution plan is a plus
  • Skills in performing Extract Transform and Load  ETL  processes using Spark
  • Experience with integrating Spark Streaming with other technologies like Kafka is an advantage
  • Familiarity with the Hadoop ecosystem including tools such as HDFS  Hive  Cloudera stack can be of advantage
  • Experience with deploying and managing Spark applications on a Hadoop cluster or on GCP Dataproc
  • Strong knowledge of Python experience with Java is beneficial as well
  • DevOps tools and practices CI CD  Docker
  • Hands on experience in GCP services Dataproc Cloud Function Cloud Run Pub Sub BigQuery
     

Responsibilities and Duties :

• Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive
• Collaborate with data engineers to optimize data pipelines and data processing workflows.
• Work closely with data analysts and data scientists to ensure data quality and integrity.
• Troubleshoot and resolve issues with data processing and data storage systems.
• Stay up-to-date on the latest trends and best practices in Cloudera development
• Participate in code reviews and provide feedback to team members.

Qualifications and Skills:
• Bachelor’s degree in computer science, Information Technology, or a related field
• Proven experience as a Cloudera Developer or similar role
• Solid understanding of Cloudera technologies such as Hadoop, Spark, and Hive
• Experience with data modeling, data warehousing, and data integration.
• Strong programming skills in Java, Scala, or Python
• Excellent problem-solving and communication skills
• Ability to work independently and as part of a team.

Similar Jobs

Zeeco, Inc. - Commissioning Engineer

Zeeco, Inc.

Mumbai, Maharashtra, India (On-Site)
8 Months ago
Mercury - Strategic Partnerships Manager

Mercury

San Francisco, California, United States (Remote)
1 Month ago
OAO India - MAGENTO/LARAVEL DEVELOPER

OAO India

Pune, Maharashtra, India (Remote)
2 Years ago
hogarth - Reward Manager

hogarth

London, England, United Kingdom (Hybrid)
2 Months ago
Salesforce - Named Account Executive

Salesforce

Zürich, Zurich, Switzerland (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Plug power - Field Service Technician

Plug power

Harrisonville, Missouri, United States (On-Site)
1 Year ago
The game - Junior Account Manager

The game

Munich, Bavaria, Germany (Hybrid)
4 Months ago
PwC - Tax NewLaw - Senior Associate

PwC

Singapore (On-Site)
9 Months ago
VI - VP Product

VI

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Tesla - Service Technician - Prague

Tesla

Central Bohemian Region, Czechia (On-Site)
5 Months ago
AdHouse - Sales Manager for High-Ticket Sales sought

AdHouse

Vienna, Vienna, Austria (Hybrid)
1 Week ago
Amanotes - Tech Generalist - Fresher/Intern

Amanotes

Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
Open Systems Technologies - Franchise Business Partner

Open Systems Technologies

Charlotte, North Carolina, United States (On-Site)
2 Weeks ago
USE Insider - Sales Development Representative

USE Insider

London, England, United Kingdom (Hybrid)
6 Months ago
Ziff Davis - Senior Mobile Software Developer

Ziff Davis

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Zinnia - Business Analyst

Zinnia

Noida, Uttar Pradesh, India (On-Site)
2 Weeks ago
Paytm - MICRO MARKET MANAGER : Nashik (QR Sales)

Paytm

Nashik, Maharashtra, India (On-Site)
9 Months ago
Paytm - Area Sales Manager

Paytm

Madurai, Tamil Nadu, India (On-Site)
1 Month ago
Paytm - Area Sales Manager-Goa (QR Sales)

Paytm

Goa, India (On-Site)
9 Months ago
Alp Consulting  - 3D Unreal Developer

Alp Consulting

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Qualcomm - Physical Design Methodology Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Paytm - Sales - Team Lead

Paytm

Bidar, Karnataka, India (On-Site)
4 Months ago
Haleon - Product Expert – SAP BASIS/TechOps

Haleon

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Grab - Marketing Operations and Employer Brand Partner

Grab

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Qualcomm - BSP Engineer, CE

Qualcomm

Hyderabad, Telangana, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by T systems

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug