Backend Developer - Data Platform

2 Months ago • 5 Years + • Backend Development

Job Summary

Job Description

As a Backend Developer - Data Platform at CRED, you will be responsible for designing and building robust and scalable components of the open-source data platform. This includes focusing on data ingestion, reconciliation, observability, and cost-aware compute using Spark on EKS and Delta/Iceberg lakes. You will engineer high-throughput, low-latency data ingestion systems across various data sources, and abstract complexity for data producers and consumers by building internal SDKs and developer tooling. You will also lead the design and rollout of AI copilots for data engineers and analysts, and ensure auditable and secure multi-tenant usage across subsidiaries. Collaboration with other teams will be essential to deliver platform capabilities that accelerate internal builds while enforcing governance. The role involves staying informed about evolving technologies and best practices and representing the organization in the tech community.
Must have:
  • Experience building large-scale distributed data systems.
  • Strong grasp of Spark, Iceberg/Delta Lake, and orchestration frameworks.
  • Hands-on experience with cloud-native environments like EKS or EMR.
  • Experience in data quality, auditability, and compliance.
  • Comfortable writing production-grade Python, Scala, or Java.
Perks:
  • In-house pantry with lunch and dinner provided.
  • Paid sick leaves.
  • Comprehensive health insurance.

Job Details

what is CRED?


CRED is an exclusive community for India’s most trustworthy and CREDitworthy individuals, where the members are rewarded for good financial behavior. CRED was born out of a need to bring back the focus on a long lost virtue, one of trust, the idea being to create a community centered around this virtue. a community that constantly strives to become more virtuous in this regard till they finally scale their behavior to create a utopia where being trustworthy is the norm and not the exception. to build a community like this requires a community of its own; a community special in its own way, working towards making this vision come true


here’s a thought experiment: what do you get when you put a group of incredibly passionate and driven people and entrust them with the complete freedom to chase down their goals in a completely uninhibited manner? answer: you get something close to what we have at CRED; CRED just has it better


at CRED, technology is the backbone that fuels problem-solving at speed and scale with smartness. we have a good share of left-brain/right-brain engineers who solve complex problems, yet at creative best in crafting great consumer experiences. engineers at CRED are highly empowered and are entrusted to own, understand, challenge, and create an upstream impact in Product and Business


if you are a go-getter, passionate about solving real problems, and enjoy the company and camaraderie of some of the best minds in the game, you should definitely explore CRED


here’s what will be in store for you at CRED once you join as a data engineer


what will you do?
  • apply fundamental principles to solve technological problems efficiently
  • design and build robust, scalable components of CRED's open-source-first data platform — focusing on ingestion, reconciliation, observability, and cost-aware compute using Spark on EKS and Delta/Iceberg lakes
  • engineer high-throughput, low-latency data ingestion systems across RDS, Kafka, DynamoDB, and more — powering 100+ TB of daily data flows across regulated domains (PCI, PII)
  • abstract complexity for data producers and consumers by building internal SDKs, self-serve orchestration, and smart developer tooling
  • lead the design and rollout of AI copilots for data engineers and analysts — including pipeline assistants, quality bots, and lineage-aware query editors
  • instrument observability, lineage, and access control as first-class features in the platform — ensuring auditable and secure multi-tenant usage across subsidiaries
  • collaborate with product, infra, compliance, and data science teams to deliver platform capabilities that accelerate internal builds while enforcing governance
  • drive open-source adoption by replacing legacy SaaS or monoliths with modular, community-aligned infrastructure
  • continuously profile and optimize infrastructure for petabytes of data scale and cost efficiency 
  • stay informed about evolving technologies and best practices in data engineering, contributing to the enhancement of data processes
  • communicate effectively with internal and external stakeholders, providing updates on the progress of key initiatives
  • represent the organization in the tech community, building a strong brand presence


you should apply if you :
  • have 5+ years of experience building large-scale distributed data systems with a strong grasp of Spark, Iceberg/Delta Lake, and orchestration frameworks (Airflow, Dagster, or similar)
  • prefer building platforms over pipelines — and enjoy solving challenges in multi-tenant architecture, developer experience, lineage, and cost attribution
  • have hands-on experience deploying open-source data frameworks on cloud-native environments like EKS or EMR, and automating deployments via IaC or CI/CD
  • have worked on systems where data quality, auditability, and compliance are critical — and have engineered observability into your platforms
  • are comfortable writing production-grade Python, Scala, or Java, and can design SDKs or frameworks to simplify engineering workflows
  • have a product mindset: you think of internal developers as customers and optimize for their velocity, safety, and trust
  • are excited by the potential of AI-augmented platforms — copilots for query suggestions, smart catalogs, lineage tools, and anomaly detection bots
  • thrive in ambiguous environments and want to define the architecture and tooling that powers a lot of engineers,analysts,operation and product folks
  • believe in open source, modularity, and solving infra problems for 10x scale
  • familiarity with SQL, basic database management systems, and an understanding of data warehousing concepts
  • effective communication skills, both written and verbal, with the ability to convey technical concepts to non-technical stakeholders
  • an ability to work independently and as part of a collaborative team in a dynamic environment
  • eagerness to learn and adapt, with an interest in data streaming technologies


how is life at CRED?


working at CRED would instantly make you realise one thing: you are working with the best talent around you. not just in the role you occupy, but everywhere you go. talk to someone around you; most likely you will be talking to a singer, standup comic, artist, writer, an athlete, maybe a magician. at CRED people always have talent up their sleeves. with the right company, even conversations can be rejuvenating. at CRED, we guarantee a good company


hard truths: pushing oneself comes with the role. and we realise pushing oneself is hard work. which is why CRED is in the continuous process of building an environment that helps the team rejuvenate oneself: included but not limited to a stacked, in-house pantry, with lunch and dinner provided for all the team members, paid sick leaves and a comprehensive health insurance


to make things smoother and to make sure you spend time and energy only on the most important things,  CRED strives to make every process transparent: there are no work timings because we do not believe in archaic methods of calculating productivity, your work should speak for you. there are no job designations because you will be expected to hold down roles that cannot be described in one word. since trust is a major virtue in the community we have built, we make it a point to highlight it in the community behind CRED: all our employees get their salaries before their joining date. a show of trust that speaks volumes because of the skin in the game


there are many more such eccentricities that make CRED what it is but that’s for one to discover. if you feel at home reading this, get in touch

Similar Jobs

zeta - Associate Director - Program Management

zeta

Hyderabad, Telangana, India (On-Site)
1 Week ago
Relax Gaming - Software Engineer II

Relax Gaming

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Contentstack - Senior Customer Success Manager

Contentstack

United States (Remote)
3 Weeks ago
Diligent Corporation - HR Business Partner

Diligent Corporation

London, England, United Kingdom (Hybrid)
1 Week ago
USE Insider - Customer Success Manager (Arabic Speaker)

USE Insider

Türkiye (Hybrid)
9 Months ago
LeoVegas - Senior Backend Engineer - Retention/Sports/iGaming

LeoVegas

Málaga, Andalusia, Spain (Hybrid)
9 Months ago
Hedra - Senior Backend Engineer

Hedra

San Francisco, California, United States (On-Site)
3 Months ago
Winzo - Backend Engineering

Winzo

New Delhi, Delhi, India (On-Site)
2 Months ago
Nagarro - Staff Engineer, NodeJS

Nagarro

India (Remote)
9 Months ago
Playtika - PHP Technical Lead

Playtika

Ukraine (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Zinnia - Business Solutions Architect

Zinnia

Alpharetta, Georgia, United States (Hybrid)
1 Month ago
Adyen - Enterprise Account Manager, Adyen for Platforms

Adyen

New York, United States (Hybrid)
2 Months ago
PwC - Senior AI Developer - Roma [DIG]

PwC

Rome, Lazio, Italy (On-Site)
9 Months ago
USE Insider - Customer Success Manager

USE Insider

Istanbul, İstanbul, Türkiye (On-Site)
9 Months ago
e2 open - Associate Trade Specialist - Bangalore (Chinese)

e2 open

Bengaluru, Karnataka, India (On-Site)
6 Days ago
London stock Exchange - Principal Engineer

London stock Exchange

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Dialpad AI - Account Executive, Mid-Market

Dialpad AI

Tempe, Arizona, United States (On-Site)
1 Month ago
Sonar Source - Sales Development Representative

Sonar Source

India (Remote)
3 Months ago
Tide - Director of Security Engineering

Tide

United Kingdom (Hybrid)
1 Month ago
Sprinkler - Senior Technical Support Engineer - CCaaS

Sprinkler

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Head Digital Works - Data Scientist - Retention

Head Digital Works

Hyderabad, Telangana, India (On-Site)
11 Months ago
Grab - Lead Product Analyst, Payments

Grab

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
Zuru - Technical Writer

Zuru

Kolkata, West Bengal, India (On-Site)
1 Month ago
Dream Sports - Engineering Manager

Dream Sports

Mumbai, Maharashtra, India (On-Site)
3 Months ago
PwC - Senior Associate-SAP FICO-RDC-Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
9 Months ago
Synechron - Full Stack Python Developer

Synechron

Pune, Maharashtra, India (On-Site)
1 Year ago
smarsh - Lead Security Operations Analyst

smarsh

India (Hybrid)
1 Month ago
version 1 - Senior Java AWS Developer

version 1

Bengaluru, Karnataka, India (On-Site)
6 Days ago
Sprinkler - Services Operations Analyst

Sprinkler

Bengaluru, Karnataka, India (Remote)
2 Weeks ago
bounteous - Lead Angular Ionic Developer

bounteous

Chennai, Tamil Nadu, India (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Wrike - Senior Backend Engineer

Wrike

Bengaluru, Karnataka, India (Hybrid)
1 Week ago
NVIDIA - Backend Engineer, Full Chip Layout

NVIDIA

Iași, Iași County, Romania (Remote)
4 Months ago
GoDaddy - Backend Senior Software Engineer- Commerce Risk

GoDaddy

Colombia (Remote)
1 Month ago
Axel springer - Expert / Senior Backend Software Engineer

Axel springer

Berlin, Berlin, Germany (On-Site)
4 Weeks ago
Sinozi - Back End Dev.

Sinozi

Bangkok, Thailand (On-Site)
2 Months ago
Vigaet - Internship-Backend Developer

Vigaet

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Nagarro - Principal Engineer, NodeJS

Nagarro

India (Remote)
9 Months ago
zeta - Software Development Engineer II (Backend - Credit SaaS)

zeta

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Nagarro - Principal Engineer, PHP Drupal

Nagarro

India (Remote)
9 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Cred

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug