Software Engineer - Distributed Data Systems

6 Minutes ago • 2 Years + • $180,000 PA - $440,000 PA
Software Development & Engineering

Job Description

As a Software Engineer for Distributed Data Systems at xAI, you will be a key contributor to the X product engineering team, delivering comprehensive data solutions for various stakeholders. This role involves leveraging AI, distributed computing, and hybrid storage technologies to process billions of events daily through hundreds of real-time and batch pipelines. You will rapidly prototype, build software to improve internal processes, transform large-scale data into meaningful value, and iterate quickly based on feedback, focusing on efficient, accurate, and reliable data solutions.
Must Have:
  • 2+ years of professional software engineering experience, ideally in data engineering or distributed systems
  • Hands-on expertise in Python, Rust, Scala, or Java, along with data pipeline tools and distributed systems
  • Knowledge of real-time and batch data processing tools such as Spark, Kafka, Flink, SQL, and various storage systems including RDBMS and NoSQL
  • Experience solving large-scale problems, with comfort in incremental quality improvements while building entirely new systems to enable future enhancements
  • Proven track record of translating product requirements into engineering implementation plans, and effectively communicating across groups
Perks:
  • equity
  • comprehensive medical coverage
  • vision coverage
  • dental coverage
  • access to a 401(k) retirement plan
  • short & long-term disability insurance
  • life insurance
  • various other discounts and perks

Add these skills to join the top 1% applicants for this job

communication
game-texts
prototyping
rust
nosql
spark
python
scala
sql
java
system-design

About xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

About the Role

As a Software Engineer for Distributed Data Systems on the X product engineering team, you will play a key role in delivering comprehensive data solutions that empower a wide range of stakeholders, from end-users to internal teams like Product, AI, Marketing, Ads, and Sales. Our work leverages AI, distributed computing, and hybrid storage technologies, while tackling challenges beyond pure data problems to unlock the full potential of data for our diverse user base. Ideal candidates are passionate about scalable systems, thrive in fast-paced environments, and are eager to drive innovation at the intersection of data and product impact.

Responsibilities

You will contribute to the distributed data system that manages hundreds of real-time and batch pipelines, processing billions of events daily. Our team operates like an internal startup, owning projects that fuel engineering innovation and experimentation. This includes:

  • Rapidly prototyping and building software to improve, automate, or accelerate various internal processes and products.
  • Passionately transforming large-scale data into meaningful value for users and the business.
  • Iterating quickly based on feedback, with a strong focus on delivering efficient, accurate, and reliable data solutions.
  • Adapting swiftly to different toolings, infrastructures, and environments, adjusting solutions as needed.

Required Qualifications

We are looking for an engineer with 2+ years of professional software engineering experience, ideally in data engineering or distributed systems.

  • Hands-on expertise in Python, Rust, Scala, or Java, along with data pipeline tools and distributed systems.
  • Knowledge of real-time and batch data processing tools such as Spark, Kafka, Flink, SQL, and various storage systems including RDBMS and NoSQL.
  • Experience solving large-scale problems, with comfort in incremental quality improvements while building entirely new systems to enable future enhancements.
  • Proven track record of translating product requirements into engineering implementation plans, and effectively communicating across groups (e.g., AI, product, marketing/sales, and engineering).

Interview Process

After submitting your application, the team will review your CV and statement of exceptional work. If selected, you'll proceed to a 15-minute initial interview ("phone interview") with basic questions from a team member. Clearing this leads to the main process:

1. 2-3 in-person technical interviews focused on coding and system design.

2. A meet-and-greet with the wider team.

Our goal is to complete the main process within one week.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer.

Set alerts for more jobs like Software Engineer - Distributed Data Systems
Set alerts for new jobs by xAI
Set alerts for new Software Development & Engineering jobs in United States
Set alerts for new jobs in United States
Set alerts for Software Development & Engineering (Remote) jobs
Contact Us
hello@outscal.com
Made in INDIA 💛💙