Data Engineering -Senior Data Engineer (CDP)

1 Month ago • 3 Years + • Data Analyst

Job Summary

Job Description

As a Senior Data Engineer at Paytm, you will build and maintain data pipelines for production systems, collaborating with engineers on backend services. You'll implement data schema improvements, provide KPI insights, and serve as a data infrastructure authority. Responsibilities include understanding user requirements, supporting continuous improvement, and maintaining live service. You'll ensure data architecture meets security and compliance standards. The role requires proficiency in Java/Scala, SQL, Airflow, Spark, Kafka, and experience with AWS/GCP. You'll design, develop, and maintain scalable data pipelines, ensuring data quality and integrity. You'll also collaborate with data scientists and analysts, optimize pipelines, and implement best practices for data management and security.
Must have:
  • Build scalable data pipelines
  • Proficient in Java/Scala, SQL
  • Experience with Spark, Kafka, Airflow
  • AWS/GCP expertise (4+ years)
  • Data quality and integrity
  • Data security and compliance
Good to have:
  • Experience with Apache Cassandra, MongoDB
  • Knowledge of Kubernetes, Docker
  • Microservices experience (Rest, Spring Boot, GRPC)

Job Details

About Us:
Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. Paytm provides consumers with services like utility payments and money transfers, while empowering them to pay via Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm FASTag and Paytm Postpaid - Buy Now, Pay Later. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store. Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners. 
Job Summary: Build systems for collection & transformation of complex data sets for use in production systems Collaborate with engineers on building & maintaining back-end services Implement data schema and data management improvements for scale and performance Provide insights into key performance indicators for the product and customer usage Serve as team's authority on data infrastructure, privacy controls and data security Collaborate with appropriate stakeholders to understand user requirements Support efforts for continuous improvement, metrics and test automation Maintain operations of live service as issues arise on a rotational, on-call basis Verify whether data architecture meets security and compliance requirements and expectations .Should be able to fast learn and quickly adapt at rapid pace. java/scala, SQL,
 Minimum Qualifications: Bachelor's degree in computer science, computer engineering or a related field, or equivalent experience 3+ years of progressive experience demonstrating strong architecture, programming and engineering skills. Firm grasp of data structures, algorithms with fluency in programming languages like Java, Python, Scala. Strong SQL language and should be able to write complex queries. Strong Airflow like orchestration tools. Demonstrated ability to lead, partner, and collaborate cross functionally across many engineering organizations Experience with streaming technologies such as Apache Spark, Kafka, Flink. Backend experience including Apache Cassandra, MongoDB and relational databases such as Oracle, PostgreSQL AWS/GCP solid hands on with 4+ years of experience. Strong communication and soft skills. Knowledge and/or experience with containerized environments, Kubernetes, docker. Experience in implementing and maintained highly scalable micro services in Rest, Spring Boot, GRPC. Appetite for trying new things and building rapid POCs"
Key Responsibilities :Design, develop, and maintain scalable data pipelines to support data ingestion, processing, and storage Implement data integration solutions to consolidate data from multiple sources into a centralized data warehouse or data lake Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications Ensure data quality and integrity by implementing robust data validation and cleansing processes Optimize data pipelines for performance, scalability, and reliability. Develop and maintain ETL (Extract, Transform, Load) processes using tools such as Apache Spark, Apache NiFi, or similar technologies .Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal downtimeImplement best practices for data management, security, and complianceDocument data engineering processes, workflows, and technical specificationsStay up-to-date with industry trends and emerging technologies in data engineering and big data.

Compensation: 
If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 25 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it.
India’s largest digital lending story is brewing here.
It’s your opportunity to be a part of the story!
undefinedundefinedundefined

Similar Jobs

bosh group india - Tacton CPQ Experts

bosh group india

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Scientific Games  - Technical Software Release Engineer

Scientific Games

Warwick, Rhode Island, United States (Hybrid)
2 Weeks ago
SSC Technologies - Associate Director - Java

SSC Technologies

Navi Mumbai, Maharashtra, India (On-Site)
4 Months ago
WebMD - Associate Software Developer

WebMD

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
2 Months ago
Canva - Senior Backend Software Engineer - Java - RPC (Remote across ANZ)

Canva

Sydney, New South Wales, Australia (Remote)
1 Month ago
Tesla - Data Scientist

Tesla

Brandenburg, Germany (On-Site)
1 Week ago
Sportskeeda - Data Analyst

Sportskeeda

India (Remote)
1 Week ago
Epic Games - Senior Data Scientist - Product Analytics

Epic Games

(On-Site)
1 Month ago
PwC - IN-Manager_ Tech Project Manager _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Canva - Engineering Manager (BE) - Platform Engineering

Canva

Perth, Western Australia, Australia (Remote)
6 Days ago
Playrix - Senior Engineering Manager

Playrix

Serbia (Remote)
3 Months ago
Sporty Group - LatAM Site Reliability Engineer

Sporty Group

(On-Site)
8 Months ago
Luxoft - Solutions Architect

Luxoft

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Futurum Technology  - Junior Java Developer

Futurum Technology

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
3 Weeks ago
Rackspace Technology - PreSales - AI- Data Architect (AWS) - Sydney

Rackspace Technology

Sydney, New South Wales, Australia (On-Site)
3 Months ago
Omnissa - Member of Technical staff - Android

Omnissa

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Nagarro - Principal Engineer, Java Fullstack

Nagarro

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Meta - Software Engineer, Infrastructure

Meta

Burlingame, California, United States (Remote)
3 Months ago
Salesforce - JAVA Developer - Affirmative Action Vacancy for Women

Salesforce

Mexico City, Mexico (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Noida, Uttar Pradesh, India

Sportskeeda - Content Manager - NBA & WNBA

Sportskeeda

India (Remote)
4 Weeks ago
PwC - RDC - SAP FICO - RTR Support

PwC

Kolkata, West Bengal, India (On-Site)
4 Months ago
HP - Financial Analyst 1

HP

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Maersk Careers - Inbound Manager

Maersk Careers

Farukh Nagar, Haryana, India (On-Site)
320 Years ago
Glean - Talent Sourcer

Glean

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Nagarro - Associate Staff Engineer, Java Fullstack

Nagarro

India (Remote)
3 Months ago
Veeva Systems - Software Engineer - Test Automation (Digital Events)

Veeva Systems

Hyderabad, Telangana, India (Hybrid)
4 Months ago
Trek - BI Report Developer

Trek

Haryana, India (Remote)
1 Week ago
Nielsen Holdings - Senior Software Engineer - Bigdata (Java/Scala , Spark, Python, AWS )

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
3 Months ago
GreedyGame - TECHNICAL RECRUITER

GreedyGame

Bengaluru, Karnataka, India (On-Site)
3 Years ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Unity - Scientifique de données sénior | Senior Data Scientist

Unity

Montreal, Quebec, Canada (On-Site)
2 Months ago
PwC - IN-Senior Associate_Data Engineer_One Cloud _Advisory_ Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
3 Months ago
Cognite - Senior Data Engineer

Cognite

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
OUTFIT7 - Global Head of Brand & Franchise Management

OUTFIT7

Limassol, Limassol, Cyprus (On-Site)
3 Months ago
ION - Data Operations ( Markets - Shared Services)

ION

Woking, England, United Kingdom (On-Site)
3 Months ago
Netflix - Data Engineer L5 - Security

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Weeks ago
Microsoft - Principal PM - Data Science - Bioinformatics

Microsoft

(On-Site)
1 Month ago
The Walt Disney Company - Senior Data Analyst

The Walt Disney Company

New York, New York, United States (On-Site)
3 Weeks ago
Aera Technology - Data Scientist (Tech Lead)

Aera Technology

Pune, Maharashtra, India (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Noida, Uttar Pradesh, India (Remote)

Noida, Uttar Pradesh, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Hyderabad, Telangana, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chandigarh, Punjab, India (On-Site)

Kerala, India (On-Site)

Jorhat, Assam, India (On-Site)

View All Jobs

Get notified when new jobs are added by Paytm

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug