Senior Software Engineer, Data Systems & AI

49 Minutes ago • All levels
Data Analysis

Job Description

Scrunch AI is seeking a Senior Software Engineer for Data Systems & AI to process large volumes of data using LLMs and traditional analytics. This full-stack role involves building features for data pipelines, LLM usage, and analytics APIs, with some React work, notifications, and third-party connectors. The ideal candidate will contribute significantly to the product roadmap, delivering essential tools for customers in the AI era.
Good To Have:
  • Experience building API for external customers.
  • Experience with analytics packages like Pandas or Polars.
  • Experience with streaming analytics.
  • Experience building evals for LLM-based tools to assess and improve accuracy at these kinds of tasks.
Must Have:
  • Extensive experience building & using web APIs, including authentication, authorization, caching, rate limiting.
  • Experience with relational (transactional) databases, particularly PostgreSQL.
  • Experience with analytics tools and technologies, such as Analytical SQL.
  • Experience writing batch and streaming/interactive data processing pipelines.
  • Ability to quickly understand source data and validate output data quality.
  • Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers.

Add these skills to join the top 1% applicants for this job

data-analytics
game-texts
postgresql
react
spark
pandas
mean
sql

The Scrunch product involves acquiring and processing a lot of data, both using LLMs and more traditional analytics methods. In this role you will play a huge part in successfully delivering our roadmap and ultimately in giving our customers the tools they need to succeed in the AI era.Because we are a small organization, this is a full stack role. While most of your work will be focused on building features related to our data pipelines, usage of LLMs, analytics APIs, etc., you'll need to do whatever is necessary to deliver value to our customers. This can include some light React work but also work creating notifications, alert emails, scheduled reports, connectors into third party systems, etc.For this role, we'd like to see candidates that:* Have extensive experience building & using web APIs, including handling authentication, authorization, caching, rate limiting, etc.* Experience building API for external customers is a big plus.* Experience with relational (transactional) databases, particularly PostgreSQL.* Experience with analytics tools and technologies, such as:* Analytical SQL, maybe with a modern analytical data platform like Snowflake, Google BigQuery, DuckDB, Spark SQL, etc.* Experience with analytics packages like Pandas or Polars is a plus.* Experience with streaming analytics is a plus.* Experience writing batch and streaming/interactive data processing pipelines. This could mean any of:* Big data tools like Flink, Beam (GCP Dataflow), Spark, etc.* Job queues and task processing frameworks (Celery, Resque, or cloud-based options like Google Cloud Tasks)* Multi-step durable execution frameworks like Temporal or Inngest* In-house or home-rolled versions of any of the above you've used at previous companies.* The ability to quickly understand source data and validate output data quality* Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers, etc.* Not required but a big plus: experience building evals for LLM-based tools to assess and improve accuracy at these kinds of tasksScrunch AI is an equal opportunity employer. We welcome people of all backgrounds, experiences, perspectives, and identities. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Set alerts for more jobs like Senior Software Engineer, Data Systems & AI
Set alerts for new jobs by Scrunch AI
Set alerts for new Data Analysis jobs in Brazil
Set alerts for new jobs in Brazil
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙