Data Engineering - Data Engineer

2 Months ago • 3-6 Years • Data Analyst

Job Summary

Job Description

This role requires a Senior Software Engineer with strong product design sense and expertise in Hadoop and Spark technologies to work on complex technical projects within a fast-paced environment. Responsibilities include growing analytics capabilities, designing new platforms for efficient data access, diagnosing technical problems, developing real-time data ingestion pipelines, transforming raw data into components for a data lake, implementing new components within the Hadoop ecosystem, and executing various projects. The ideal candidate will have 3-6 years of experience in Big Data technologies and strong programming skills in Python/Java/Scala.
Must have:
  • 3-6 years Big Data experience
  • Hadoop, Spark, PySpark expertise
  • Python/Java/Scala programming
  • Data ingestion pipeline design
  • Data lake component development
Good to have:
  • NoSQL databases (Hbase, Cassandra)
  • Multithreaded application experience
  • SQL, Kafka experience
  • Spark Streaming, Flink experience
  • AWS and cloud technologies
  • Redis caching

Job Details

Data Engineering – Senior Software Engineer

About Us: Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. Paytm provides consumers with services like utility payments and money transfers, while empowering them to pay via Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm FASTag and Paytm Postpaid - Buy Now, Pay Later. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store. Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners. 

About the Role: 
This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment. For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies. 

Requirements: 
Minimum 3-6 years of experience in Big Data technologies.
The position Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day.
Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability.
Make changes to our diagnosing any problems across the entire technical stack.
Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake.
Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects.

Be a brand ambassador for Paytm – Stay Hungry, Stay Humble, Stay Relevant! 

Skills that will help you succeed in this role: 
Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.Excellent programming/debugging skills in Python/Java/Scala.
Experience with any scripting language such as Python, Bash etc.
Good to have experience of working with noSQL databases like Hbase, Cassandra.Hands-on programming experience with multithreaded applications.Good to have experience in Database, SQL, messaging queues like Kafka.
Good to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm, etc.Good to have experience with AWS and cloud technologies such as S3
Experience with caching architectures like Redis etc. 

Why join us: 
Because you get an opportunity to make a difference, and have a great time doing that.You are challenged and encouraged here to do stuff that is meaningful for you and for those we serve.You should work with us if you think seriously about what technology can do for people.We are successful, and our successes are rooted in our people's collective energy and unwavering focus on the customer, and that's how it will always be.

Compensation: 
If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 21 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it. India’s largest digital lending story is brewing here. It’s your opportunity to be a part of the story!
undefinedundefinedundefined

Similar Jobs

ByteDance - Senior Backend Software Engineer - Global E-Commerce Supply Chain

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Assystems - Backend Developer – ETL Integration

Assystems

Gurugram, Haryana, India (On-Site)
3 Months ago
Google - Software Engineering Manager (For Women in Tech Candidates)

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
3 Months ago
Ness Digital - Site Reliability Engineer

Ness Digital

Timișoara, Timiș, Romania (Hybrid)
1 Month ago
Warner Bros Discovery - Manager, BRIM Convergent Mediation Operations

Warner Bros Discovery

Mexico City, Mexico City, Mexico (On-Site)
3 Months ago
Epic Games - Principal Data Analyst, Ecosystem Economy & UGC

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Ciklum - Expert Data Scientist

Ciklum

Pune, Maharashtra, India (Hybrid)
4 Months ago
N-iX - Junior Business Analyst

N-iX

Ukraine (Remote)
3 Weeks ago
Coursera - Data Systems Analyst

Coursera

India (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - Full Stack Developer - Milano [IFS]

PwC

Milan, Lombardy, Italy (On-Site)
4 Months ago
NVIDIA - Senior Data Engineer, Site Reliability Engineering

NVIDIA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Netflix - Senior Software Engineer (L5) - Client Delivery Platform

Netflix

United States (Remote)
2 Weeks ago
Dentsu - Data & Analytics Consultant

Dentsu

Rotterdam, South Holland, Netherlands (On-Site)
4 Months ago
Nielsen Holdings - Software Developer - Informatica Power Center / AWS / Oracle

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
PwC - IN_Manager – Crm Technical -Ms Dynamics– Advisory  -Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Nagarro - Associate Staff Engineer, QA Automation

Nagarro

(On-Site)
3 Months ago
ION - Senior DevSecOps Engineer, Italy

ION

Collecchio, Emilia-Romagna, Italy (On-Site)
4 Months ago
Nium - Sr SDET

Nium

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Brillio - Enterprise Architect, Azure - R01535036

Brillio

Bengaluru, Karnataka, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Noida, Uttar Pradesh, India

Assystems - Senior Urban Planner

Assystems

Gurugram, Haryana, India (On-Site)
3 Months ago
Maersk Careers - Process Expert-7

Maersk Careers

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
Keywords Studios (Player Support) - Product Manager I

Keywords Studios (Player Support)

Maharashtra, India (Hybrid)
2 Months ago
GoTo Group - Lead Software Engineer - Engineering Platform

GoTo Group

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Amgen - Security System Manager

Amgen

Hyderabad, Telangana, India (On-Site)
3 Months ago
Sporty Group - IN Associate - Customer Success

Sporty Group

Mumbai, Maharashtra, India (Remote)
8 Months ago
PwC - IN_Manager_ Technology Partner _ Social_ Advisory_ Jaipur

PwC

Jaipur, Rajasthan, India (On-Site)
4 Months ago
Fish Welfare Initiative - Aquaculture Expert

Fish Welfare Initiative

Eluru, Andhra Pradesh, India (On-Site)
4 Months ago
Tesla - Order Operations Specialist

Tesla

Mumbai, Maharashtra, India (On-Site)
1 Week ago
ION - Software Architect - Java Multi-Tenant SAAS Cloud Native

ION

Pune, Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - IN_Senior Associate_Qlikview_D&A_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Varonis  - Data Engineer

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
1 Month ago
Next Level Business Services - PL/SQL Programmer

Next Level Business Services

San Francisco, California, United States (On-Site)
3 Months ago
Unity - Program Manager Customer Success Analytics

Unity

Copenhagen, Denmark (On-Site)
5 Months ago
Luxoft - Data Engineer for Market Data Projects (with Streamlit Expertise)

Luxoft

Delhi, India (On-Site)
3 Months ago
GoTo Group - Data Warehouse Engineer

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
4 Months ago
Onward Search - Mental Health Parity Analyst

Onward Search

Tempe, Arizona, United States (Remote)
5 Days ago
Epic Games - Principal Data Scientist

Epic Games

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Warner Bros Discovery - Customer Data Manager - Digital/ VOD

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Noida, Uttar Pradesh, India (Remote)

Noida, Uttar Pradesh, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Hyderabad, Telangana, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chandigarh, Punjab, India (On-Site)

Kerala, India (On-Site)

Jorhat, Assam, India (On-Site)

View All Jobs

Get notified when new jobs are added by Paytm

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug