Data Scientist - AI Benchmark Architect

3 Months ago • All levels

Job Summary

Job Description

This is a career-defining opportunity to contribute significantly to a company revolutionizing autonomous systems, energy, and the built environment. As an AI Benchmark Architect, you will be pivotal in the Qortex team. Your primary responsibilities include designing performance metrics and analyzing data from deployed systems and simulations. You will also be involved in data collection, management, and analysis to identify patterns and insights that impact system performance. Furthermore, you'll design a contribution roadmap to open source, develop, and maintain datasets, create evaluation metrics, and communicate findings to various stakeholders.
Must have:
  • MS/PhD in relevant fields.
  • Strong statistical analysis and machine learning skills.
  • Proficiency in programming languages.
  • Exceptional communication skills.
  • Organized and strategic in planning deployments.
  • Collaborative mindset for teamwork.
  • Adaptability in a fast-paced startup.
  • Problem-solving skills.
Good to have:
  • Understanding of the built environment and cyber-physical systems.
  • Experience with validation frameworks for autonomous systems.
  • Proficiency in reasoning and inferencing.
  • Experience with relational databases.
  • Familiarity with building energy modeling software.
Perks:
  • Competitive compensation.
  • Generous equity share package.
  • Medical, dental and vision coverage.
  • Disability and life insurance options.
  • Flex PTO.
  • Team-building events.
  • Free catered lunch in the office Monday — Friday.
  • Free ski pass.
  • Free National Park pass.

Job Details

Are you looking for a career-defining challenge working on building AI and physic-inspired tools for autonomous control building solutions?

About PassiveLogic

PassiveLogic is the first fully autonomous platform for buildings. We’ve reinvented the fundamental principles of automation to democratize technology, optimize buildings, and reduce the world’s carbon footprint. We are a team of technologists, engineers, and creatives dedicated to making a sustainable impact through real-world solutions.

We are looking for team members who have a passion for technology and want to work on cutting-edge problems with real-world solutions. Our culture is built on bringing together the most talented engineers, thinkers, and creatives—backed by the world’s leading investors—working together to make the future a reality.

About the Role

This is a career-defining opportunity to play a crucial role in a hyper-scale AI company that is transforming the future of autonomous systems, energy, and the built environment.

As an AI Benchmark Architect, you will play a foundational role in our Qortex team, focusing on applying advanced analytics to identify best practices for various neural net and knowledge graph models that can improve our generative models and RAG algorithms for building performance, occupant comfort, and sensing algorithms.

What you’ll do

Performance Metrics Design and Analysis: Ability to define and interpret key performance indicators (KPIs) for autonomous systems, such as accuracy, latency, robustness, and efficiency. Expertise in designing meaningful benchmarks that evaluate real-world performance.

Data Collection and Management: Acquire and manage a variety of data including sensors and control data from PassiveLogic’s deployed Hive Controller systems, and virtual data from the simulation environment.

Data Analysis: Conduct an in-depth analysis of the collected data, identifying patterns, insights, and anomalies that can influence the system's performance. Collaborate with the Formal Methods team to provide refinement ideas to automate the physical and statistical-based testing of our systems and algorithms in simulated and deployed buildings.

Design a contribution roadmap to open source, develop, and maintain datasets: Create evaluation metrics that measure the performance and fairness of AI models across diverse tasks. They ensure that benchmarks are comprehensive, reproducible, and aligned with real-world applications while actively collaborating with the open-source community to promote transparency, inclusivity, and innovation.

Presentation of Findings: Communicate complex data findings to technical and non-technical stakeholders, including creating visualizations, reports, and presentations.

What you’ll bring

If your experience does not meet all our posted requirements below, we’d still love to hear from you. We are looking for practitioners who are passionate about understanding people, committed to lifelong learning, and driven by the love of what they do. If that’s you, please apply!

You must have

  • Proven experience:
  • MS/PhD in Data Science, Computer Science, Mechanical/Electrical Engineering, Civil Engineering, or equivalent experience.
  • Strong statistical analysis skills and experience with machine learning techniques
  • Proficiency in programming languages (Python, C++, Swift, Rust, etc)
  • Exceptional Communication Skills: Demonstrates the ability to effectively articulate complex technical concepts related to deploying autonomous systems and advanced programming in Swift. Excels at translating technical features into compelling narratives that resonate with both technical and non-technical audiences.
  • Organized and Strategic: Skilled in planning and executing the deployment of autonomous systems with precision, ensuring all aspects—from system integration to scalability—are managed with a high level of attention to detail.
  • Collaborative Mindset: Thrives in team environments, working closely across disciplines to align strategies for system deployment, programming, and sustainable design with overarching project and organizational goals.
  • Adaptability: Comfortable in a fast-paced startup environment, eager to learn, iterate, and innovate.
  • Problem solving: You own this role. When issues arise, be the empowered force that solves them, rolling-up.

You should have

  • Understanding of the built environment and cyber-physical systems: Demonstrate a strong knowledge of how physical infrastructure integrates with digital technologies, enabling the creation of intelligent and adaptive systems.
  • Experience with validation frameworks for autonomous systems: Proven ability to design and implement robust validation frameworks to ensure the reliability and performance of autonomous systems across diverse conditions.
  • Proficiency in reasoning and inferencing: Skilled in applying advanced reasoning and inferencing techniques to enhance decision-making processes and optimize system intelligence.
  • Experience with relational databases: Demonstrated experience in managing and optimizing relational databases like PostgreSQL and MySQL to efficiently store, retrieve, and analyze complex datasets.
  • Familiarity with building energy modeling software: Knowledgeable in tools such as EnergyPlus, Modelica, and IES, leveraging them to simulate and optimize building energy performance and sustainability.

It’s helpful to have

  • Experience in deploying autonomous systems: Demonstrated expertise in implementing and integrating autonomous systems, ensuring reliable performance, scalability, and seamless functionality across diverse environments.
  • Proficiency with Swift programming language: Skilled in utilizing Swift to design, develop, and optimize software applications, leveraging its advanced features to deliver efficient and scalable solutions.
  • Solid understanding of building physics and HVAC systems: Comprehensive knowledge of building physics, including heat transfer and HVAC systems, enabling the creation of energy-efficient and sustainable designs tailored to complex operational requirements.

We know there are candidates who might not fit everything we’ve described above, or who might have experience and skills we haven’t considered. PassiveLogic can sometimes be flexible enough to shift responsibilities to the right person, or otherwise identify open or upcoming roles that may better fit your professional background. Even if you don’t meet all the requirements above, we still want to hear from you.

Compensation, Benefits & Perks:

  • Competitive compensation
  • Generous equity share package
  • Medical, dental and vision coverage
  • Disability and life Insurance options
  • Flex PTO
  • Team-building events
  • Free catered lunch in the office Monday — Friday
  • Free ski pass (We are at the base of Big Cottonwood Canyon)
  • Free National Park pass

When applying, include:

  • A cover letter telling us why you're the perfect candidate for PassiveLogic 
  • A resume
  • Extra mile — include a description of a project (of any type) you personally created, devised, built, managed, organized, or designed that was of your own self-initiative

Diversity and inclusion 

Diversity, inclusion, and belonging is woven into our values and everything we do. We welcome all—come as you are and bring your whole self. We are proud to be an Equal Opportunity Employer. We celebrate diversity every day by maintaining a safe and inclusive environment for our employees at every stage of their careers.

Similar Jobs

PassiveLogic - Distributed Framework Engineer

PassiveLogic

Amsterdam, North Holland, Netherlands (On-Site)
2 Months ago
Zazz - Solutions Architect - Mobile App Development

Zazz

India (On-Site)
5 Months ago
Apple - Sr Software Engineer- Time Synchronization

Apple

Boulder, Colorado, United States (On-Site)
3 Weeks ago
AGBO - Senior Mobile Engineer

AGBO

Salt Lake City, Utah, United States (Remote)
1 Month ago
Trackman - Senior iOS Developer

Trackman

Hørsholm, Denmark (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Apple - Software Engineer - Apple Vision Pro

Apple

San Jose, California, United States (On-Site)
3 Weeks ago
OneLocal - Senior DevOps Engineer

OneLocal

(Remote)
2 Months ago
bytedance - LLM Global Data - LLM Coding Trainer Intern - 2025 Start

bytedance

Singapore (On-Site)
5 Months ago
Luxoft - Calypso Techno-Functional Consultant

Luxoft

New York, New York, United States (On-Site)
6 Months ago
Zenoti - Senior Software Engineer (Mobile)

Zenoti

Hyderabad, Telangana, India (On-Site)
2 Days ago
hogarth - Senior Supply Chain Manager

hogarth

Buenos Aires, Buenos Aires, Argentina (Hybrid)
2 Weeks ago
Yggdrasil Sandbox - Information Security and Data Protection Specialist

Yggdrasil Sandbox

St. Julian's, Malta (On-Site)
1 Week ago
Ello - Product Engineer (ML & Mobile)

Ello

San Francisco, California, United States (On-Site)
2 Months ago
Patreon - iOS Engineer

Patreon

San Francisco, California, United States (Hybrid)
2 Months ago
PassiveLogic - Embedded Database Systems Engineer

PassiveLogic

Salt Lake City, Utah, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Holladay, Utah, United States

Haptic - Lead Engine Software Engineer

Haptic

Dallas, Texas, United States (Remote)
5 Months ago
Take-Two Interactive - Senior Manager Data Governance

Take-Two Interactive

New York, United States (On-Site)
2 Weeks ago
Survios - UI/UX Designer

Survios

California, United States (Remote)
3 Months ago
Unity - Senior ML Infrastructure Engineer

Unity

San Francisco, California, United States (On-Site)
8 Months ago
bytedance - Machine Learning Scientist Graduate (Scaling AI for Biology (AI-for-Science))

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
Ion - Lead Python Engineer, New York

Ion

New York, New York, United States (Hybrid)
7 Months ago
Shipt - Software Engineer - Fraud

Shipt

Birmingham, Alabama, United States (Hybrid)
5 Days ago
The Walt Disney Company - Manager - NewsOne

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
bytedance - Payroll Specialist

bytedance

San Jose, California, United States (On-Site)
1 Month ago
bytedance - Mobile Software Engineer Graduate (Global E-commerce-US) - 2025 Start (BS/MS)

bytedance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

PassiveLogic enables autonomy for controlled systems and unlocks collaboration between teams to manage those systems. PassiveLogic has reimagined how we design, build, operate, maintain, and manage infrastructural robots, whose current technology has remained unchanged for decades. By using revolutionary physics-based Quantum digital twins and leveraging the world’s fastest AI compiler to simulate future-forward controls, PassiveLogic empowers users to easily create their own generative digital twins in minutes to launch autonomous control. This control optimizes for energy use, equipment longevity, and occupant comfort levels in real time for the system’s lifetime. Autonomous control lays the foundation for decarbonization at scale and enables truly smart, connected cities.

Holladay, Utah, United States (On-Site)

Salt Lake City, Utah, United States (On-Site)

Holladay, Utah, United States (On-Site)

Holladay, Utah, United States (On-Site)

Holladay, Utah, United States (On-Site)

Salt Lake City, Utah, United States (On-Site)

Amsterdam, North Holland, Netherlands (On-Site)

Holladay, Utah, United States (On-Site)

Holladay, Utah, United States (On-Site)

View All Jobs

Get notified when new jobs are added by PassiveLogic

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug