Data Engineer - Technical Lead

7 Months ago • 6-10 Years • Data Analysis

Job Summary

Job Description

As a Data Engineer - Technical Lead at Paytm, you'll work on complex projects in a fast-paced environment, focusing on Hadoop and Spark technologies. Responsibilities include growing analytics capabilities, designing real-time data pipelines, developing efficient data transformation functions for the data lake, implementing new components within the Hadoop ecosystem, and diagnosing technical issues. You'll design and develop a real-time events pipeline for data ingestion and real-time dashboards. The role requires strong product design sense and collaboration with peers.
Must have:
  • 6-10 years Big Data experience
  • Hadoop, Spark, PySpark expertise
  • Python/Java/Scala programming skills
  • Data pipeline design & development
  • Data transformation & ingestion
Good to have:
  • NoSQL databases (Hbase, Cassandra)
  • SQL, Kafka, AWS, cloud technologies
  • Streaming applications (Spark Streaming, Flink)
  • Caching architectures (Redis)
  • Multithreaded application experience

Job Details

About Us:
Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. Paytm provides consumers with services like utility payments and money transfers, while empowering them to pay via Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm Fastag and Paytm Postpaid - Buy Now, Pay Later. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store.
Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners.  

About the Role:
This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment. For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies.

Requirements:
Minimum 6-10 years of experience in Big Data technologies.
The position Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.
Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability. Make changes to our diagnosing any problems across the entire technical stack. Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.
Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake.
Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects.
Be a brand ambassador for Paytm Stay Hungry, Stay Humble, Stay Relevant!
Preferred Qualification :
Bachelor's/Master's Degree in Computer Science or equivalent.
Skills that will help you succeed in this role:
Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.
Excellent programming/debugging skills in Python/Java/Scala.
Experience with any scripting language such as Python, Bash etc.
Good to have experience of working with noSQL databases like Hbase, Cassandra.
Hands-on programming experience with multithreaded applications.
Good to have experience in Database, SQL, messaging queues like Kafka.
Good to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm, etc.
Good to have experience with AWS and cloud technologies such as S3Experience with caching architectures like Redis etc.

Why join us:
      A collaborative output driven program that brings cohesiveness across businesses through technology
      Improve the average revenue per use by increasing the cross-sell opportunities
      A solid 360 feedbacks from your peer teams on your support of their goals
      Respect, that is earned, not demanded from your peers and manager
 

Compensation:
 If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 21 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it. India’s largest digital lending story is brewing here. It’s your opportunity to be a part of the story!
undefinedundefinedundefined

Similar Jobs

PwC - Associate Dot Net App Tech MS Engineer - Advisory

PwC

Kolkata, West Bengal, India (On-Site)
1 Year ago
Synechron - Senior Java Developer

Synechron

Weehawken Township, New Jersey, United States (On-Site)
1 Year ago
Qualcomm - IoT Multimedia Customer Engineer for Windows IBV/IHV

Qualcomm

Taipei City, Taiwan (On-Site)
1 Month ago
Super.com - Senior Full-Stack Software Engineer

Super.com

Canada (Remote)
8 Months ago
NVIDIA - Senior Physical Design Verification Layout Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
6 Months ago
Apple - Data Center Cluster Architect

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Rackner - Data Engineer

Rackner

Falls Church, Virginia, United States (Hybrid)
4 Weeks ago
Western Digital - Senior Engineer, Data Analyst Engineering (Master's Fresh Grad ONLY)

Western Digital

Bayan Lepas, Penang, Malaysia (On-Site)
3 Weeks ago
Razer - Data Analyst Intern

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Months ago
GoTo Group - Business Intelligence Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rolls-Royce - Manufacturing Services Engineer

Rolls-Royce

Singapore, Singapore (On-Site)
1 Month ago
Apple - GPU Performance Modeling Engineer, Platform Architecture

Apple

Austin, Texas, United States (On-Site)
2 Months ago
Krafton - Senior Gameplay Animator - Viewmodel

Krafton

Madison, Wisconsin, United States (On-Site)
1 Month ago
Techland - Junior Rendering Programmer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
2 Months ago
Varonis  - Low-level Engineer (Linux)

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
4 Months ago
bytedance - Payment Growth and Marketing Strategy Lead- Global Payment

bytedance

Jakarta, Jakarta, Indonesia (On-Site)
9 Months ago
Verizon - Digital Marketing-Manager

Verizon

Hyderabad, Telangana, India (Hybrid)
8 Months ago
Google - Software Engineering Manager II, Site Reliability Engineering

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
Visa - Sr. Manager - Site Reliability Engineer

Visa

Ashburn, Virginia, United States (Hybrid)
2 Months ago
Ubisoft - Intern Programmer

Ubisoft

Pune, Maharashtra, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Noida, Uttar Pradesh, India

level ai - Senior Machine Learning Engineer

level ai

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Aristocrat - Sr Tech Artist I

Aristocrat

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
zeta - Senior Information Developer/Technical Writer

zeta

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Aryaka - Data Engineer

Aryaka

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Qualcomm - BT Design Verification Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Accenture - Procurement Practice Associate Manager

Accenture

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Saviynt - Principal Engineer – SRE

Saviynt

Bengaluru, Karnataka, India (Hybrid)
1 Year ago
Qualcomm - Engineer, Senior Staff/Manager-Platform Software Architect

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Months ago
Zazz - IT Recruiter

Zazz

Hyderabad, Telangana, India (On-Site)
9 Months ago
Antarctica Global - Business Development Associate

Antarctica Global

Mumbai, Maharashtra, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

PrizePicks - Staff Data Science Engineer

PrizePicks

Atlanta, Georgia, United States (Remote)
3 Months ago
Nagarro - Associate Engineer, Data Science

Nagarro

(On-Site)
9 Months ago
bytedance - Research Scientist, Data Management and Security - Infrastructure System Lab

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Cognite - Senior Data Engineer

Cognite

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Remote)
2 Months ago
Capgemini - Data Scientist

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Stonewall Collision & Auto Painting - Senior Data Scientist

Stonewall Collision & Auto Painting

Vijayawada, Andhra Pradesh, India (On-Site)
10 Months ago
Unity - Senior Data Analyst

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Nintendo - Principal Business Systems Analyst

Nintendo

Redmond, Washington, United States (Hybrid)
1 Year ago
Redhorse Corp - Military Aircraft Data Analyst

Redhorse Corp

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Noida, Uttar Pradesh, India (On-Site)

Mumbai, Maharashtra, India (On-Site)

Salem, Tamil Nadu, India (On-Site)

Noida, Uttar Pradesh, India (On-Site)

Guntur, Andhra Pradesh, India (On-Site)

Jabalpur, Madhya Pradesh, India (On-Site)

Noida, Uttar Pradesh, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Paytm

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug