Data Engineer - Technical Lead

4 Months ago • 6-10 Years • Data Analyst

Job Summary

Job Description

As a Data Engineer - Technical Lead at Paytm, you'll work on complex projects in a fast-paced environment, focusing on Hadoop and Spark technologies. Responsibilities include growing analytics capabilities, designing real-time data pipelines, developing efficient data transformation functions for the data lake, implementing new components within the Hadoop ecosystem, and diagnosing technical issues. You'll design and develop a real-time events pipeline for data ingestion and real-time dashboards. The role requires strong product design sense and collaboration with peers.
Must have:
  • 6-10 years Big Data experience
  • Hadoop, Spark, PySpark expertise
  • Python/Java/Scala programming skills
  • Data pipeline design & development
  • Data transformation & ingestion
Good to have:
  • NoSQL databases (Hbase, Cassandra)
  • SQL, Kafka, AWS, cloud technologies
  • Streaming applications (Spark Streaming, Flink)
  • Caching architectures (Redis)
  • Multithreaded application experience

Job Details

About Us:
Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. Paytm provides consumers with services like utility payments and money transfers, while empowering them to pay via Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm Fastag and Paytm Postpaid - Buy Now, Pay Later. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store.
Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners.  

About the Role:
This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment. For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies.

Requirements:
Minimum 6-10 years of experience in Big Data technologies.
The position Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.
Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability. Make changes to our diagnosing any problems across the entire technical stack. Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.
Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake.
Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects.
Be a brand ambassador for Paytm Stay Hungry, Stay Humble, Stay Relevant!
Preferred Qualification :
Bachelor's/Master's Degree in Computer Science or equivalent.
Skills that will help you succeed in this role:
Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.
Excellent programming/debugging skills in Python/Java/Scala.
Experience with any scripting language such as Python, Bash etc.
Good to have experience of working with noSQL databases like Hbase, Cassandra.
Hands-on programming experience with multithreaded applications.
Good to have experience in Database, SQL, messaging queues like Kafka.
Good to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm, etc.
Good to have experience with AWS and cloud technologies such as S3Experience with caching architectures like Redis etc.

Why join us:
      A collaborative output driven program that brings cohesiveness across businesses through technology
      Improve the average revenue per use by increasing the cross-sell opportunities
      A solid 360 feedbacks from your peer teams on your support of their goals
      Respect, that is earned, not demanded from your peers and manager
 

Compensation:
 If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 21 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it. India’s largest digital lending story is brewing here. It’s your opportunity to be a part of the story!
undefinedundefinedundefined

Similar Jobs

Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
6 Months ago
ION - Principal Software Engineer, Italy

ION

Milan, Lombardy, Italy (On-Site)
6 Months ago
Nagarro - Senior Staff Engineer, Java

Nagarro

Japan (Remote)
6 Months ago
SmileGate - Game Data Engineer (Platform Development)

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago
Meta - Software Engineer, Product

Meta

Los Angeles, California, United States (Remote)
2 Weeks ago
GoTo Group - Senior Software Engineer - Data Platform (Mercury)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Voodoo - Head of Data

Voodoo

Paris, Île-de-France, France (Hybrid)
1 Month ago
Ubisoft - Regional Project Intelligence Director (Nordics & Romania)

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
1 Month ago
N-iX - Senior HPC Data Engineer

N-iX

United Kingdom (Remote)
2 Months ago
Warner Bros Games - Senior Analytics Engineer

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, Corp Eng

Google

Hyderabad, Telangana, India (On-Site)
1 Day ago
ByteDance - Software Engineer, Data Security

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
The Walt Disney Company - Lead Software Engineer - iOS/Android

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago
Google - Software Engineer, Google Nest

Google

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Bytro - Quality Assurance / QA Specialist - Gaming (f/m/x)

Bytro

Hamburg, Hamburg, Germany (Hybrid)
8 Months ago
Nagarro - Staff Engineer, QA Automation

Nagarro

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
ByteDance - Software Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
N-iX - Senior Mobile Engineer

N-iX

Poland (Hybrid)
1 Week ago
Google - Customer Solutions Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Jobs in Noida, Uttar Pradesh, India

Zeta - Sr. Associate Process & Compliance

Zeta

Bengaluru, Karnataka, India (On-Site)
6 Months ago
PwC - IN-Manager_D365 Azure Integration Developer_MS Dynamics– Advisory  - Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Rackspace Technology - Sr Service Now Developer III-IN (R-20074)

Rackspace Technology

India (Remote)
6 Months ago
Red Panda Games studio - Sofware Developer for mobile games

Red Panda Games studio

Bengaluru, Karnataka, India (Remote)
8 Months ago
Highspot - Sr. Software Development Engineer

Highspot

Hyderabad, Telangana, India (Hybrid)
6 Months ago
HIR Expert - C++ Engineer

HIR Expert

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Nagarro - Senior Engineer, Java Fullstack

Nagarro

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Maersk Careers - Second Cook (SF)

Maersk Careers

Mumbai, Maharashtra, India (On-Site)
336 Years ago
ION - Analyst - Capital structure 918

ION

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Juego Studios - SEO Specialist - GCC Region

Juego Studios

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

ION - Data Engineer/Analyst - Graduate Development Program

ION

Pisa, Tuscany, Italy (On-Site)
6 Months ago
Google - Lead, YouTube Transparency and Compliance Data Science

Google

San Bruno, California, United States (On-Site)
1 Day ago
Luxoft - BI Developer (SSIS and SSAS)

Luxoft

Gurugram, Haryana, India (On-Site)
4 Months ago
Voodoo - Experienced Data Scientist - AdTech

Voodoo

Paris, Île-de-France, France (Hybrid)
6 Days ago
Luxoft - Data Engineer (financial/investment domain)

Luxoft

Singapore, Singapore (On-Site)
5 Months ago
Google - Data Engineering Lead, Google Trust and Safety

Google

Austin, Texas, United States (On-Site)
1 Day ago
Warner Bros Games - Senior Software Engineer - Data Validation

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Week ago
The Walt Disney Company - Lead Data Engineer - Identity and Device Data

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Week ago
GoMotive - Senior Strategic Analyst, Product Reliability

GoMotive

United States (Remote)
2 Months ago
GoTo Group - Associate Strategy & Planning (Demand)

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Noida, Uttar Pradesh, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Kerala, India (On-Site)

Hyderabad, Telangana, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Visakhapatnam, Andhra Pradesh, India (On-Site)

Andhra Pradesh, India (On-Site)

View All Jobs

Get notified when new jobs are added by Paytm

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug