Staff Software Engineer, AI Data Engineering

undefined ago • 8 Years + • Data Analysis

Job Summary

Job Description

As a Staff Software Engineer, you will take us beyond traditional monolithic SQL engines and batch pipelines. You will build the next generation of distributed data storage and processing systems that can scale indefinitely and surpass traditional query performance. Your interfaces will be simple, expressive, and cleanly abstracted, supporting a broad array of data consumers, from our web application to business analytics and artificial intelligence.
Must have:
  • Identify and develop scalable and performant solutions.
  • Work across discipline to shape product strategy and execution.
  • Develop the foundations of code architecture and quality.
  • Mentor and coach engineers.
  • Set and uphold the standard for engineering processes.
Good to have:
  • Highly scalable and reliable infrastructure (AI/ML focused)
  • Leading large cross-functional data initiatives
  • Building low latency data pipelines for ML and analytics
  • Data modeling
  • Optimization
  • Feature engineering for ML use cases
  • Building robust data lineage
  • Auditing
  • Data quality automation for AI/ML systems
  • In-depth knowledge of database systems
  • Data processing frameworks (Spark, Airflow)
  • Python
  • SQL
  • Database replication
  • Sharding
  • High availability of databases

Job Details

As a Staff Software Engineer, you will take us beyond traditional monolithic SQL engines and batch pipelines. You will build the next generation of distributed data storage and processing systems. You will build systems that can scale indefinitely, and surpass traditional query performance, while making the interfaces for that data simple, expressive, and cleanly abstracted. Your interfaces will support a broad array of data consumers, from our web application, to business analytics, and artificial intelligence.

Primary Duties:

  • Identify and develop scalable and performant solutions.
  • Work across discipline to shape product strategy and execution.
  • Develop the foundations of code architecture and quality.
  • Mentor and coach engineers.
  • Set and uphold the standard for engineering processes to support high-quality engineering.

Minimum Qualifications:

  • BS/BTech (or higher) in Computer Science, Engineering or a related field required.
  • 8+ years of production-level experience as an engineer building highly scalable systems.
  • 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
  • 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
  • Experience architecting, developing, and deploying large-scale distributed systems at scale.
  • Experience with cloud technologies, e.g., AWS, Azure, GCP.
  • Experience building continuous integration and continuous development (CI/CD) pipelines.
  • Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).

Preferred KSAs:

  • 8+ years of production-level experience as an engineer building highly scalable and reliable infrastructure with at least 3 years focused on AI/ML.
  • Experience leading large cross functional data initiatives from ideation to implementation , helping share data platform direction,aligning all the teams and driving broader impact across the organization.
  • Experience building low latency data pipelines that serve structured, semi structured and unstructured data for ML and analytics use cases.
  • Strong understanding of data modeling, optimization and feature engineering for ML use cases.
  • Experience building robust data lineage ,auditing, data quality automation standards for AI/ML related systems.
  • In-depth knowledge of database systems and expertise in data processing frameworks (e.g. Spark, Airflow) and strong python and SQL skills.
  • Familiarity with database replication, sharding and other techniques for scalability and high availability of databases.

Physical Requirements:

  • Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Arlington, Virginia, United States (Remote)

Augusta, Georgia, United States (Hybrid)

Bethesda, Maryland, United States (Remote)

Atlanta, Georgia, United States (Remote)

Rochester, New York, United States (Hybrid)

Arlington, Virginia, United States (Remote)

Bethesda, Maryland, United States (Remote)

View All Jobs

Get notified when new jobs are added by Aledade

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug