Senior Software Engineer, Security and Compliance

About Us:

Here at Fireworks, we’re building the future of generative AI infrastructure. Fireworks offers the generative AI platform with the highest-quality models and the fastest, most scalable inference. We’ve been independently benchmarked to have the fastest LLM inference and have been getting great traction with innovative research projects, like our own function calling and multi-modal models. Fireworks is funded by top investors, like Benchmark and Sequoia, and we’re an ambitious, fun team composed primarily of veterans from Pytorch and Google Vertex AI.

The Role:

As the Lead Software Engineer of Security and Compliance at Fireworks AI, you will be responsible for envisioning and implementing a world class security program from the ground up. Security is the foundation of trust in AI systems. As more organizations rely on large language models and cloud-native AI services, ensuring the confidentiality, integrity, and availability of data, models, and infrastructure is paramount. This role is critical to building that trust—by designing and embedding security into every layer of our technology stack.

Key Responsibilities:

• Design and develop security-focused software solutions to protect customer data, models, and services across our multi-cloud infrastructure.
• Lead the technical architecture of security and privacy features, including encryption, identity and access management, secure API gateways, secure model execution, and sandboxing strategies.
• Designing a scalable security program by leveraging automation wherever possible
• Implement and champion a Secure Software Development Lifecycle (SSDLC), including secure-by-default frameworks, build pipelines, and runtime enforcement.
• Perform security reviews of cloud-native architectures, including Kubernetes clusters, multi-cloud workloads, and distributed data stores.
• Develop and integrate tools for continuous security monitoring, anomaly detection, and automated response.
• Embed compliance and regulatory controls into infrastructure and product layers (e.g., SOC 2, ISO 27001, HIPAA, GDPR).
• Own and evolve internal developer security tooling—e.g., CI/CD integrations with scanners (e.g., Snyk, Semgrep), secrets detection, IaC security.
• Lead incident response efforts, red/blue team coordination, and post-mortem analysis.

Minimum qualifications:

• 5+ years of experience in software engineering with a strong focus on security, infrastructure, or cloud systems.
• Proficient in Python and/or Go with experience in designing production-grade systems.
• Deep understanding of cloud-native architectures using AWS, GCP, or Oracle Cloud, particularly in the area of authentication, authorization, encryption, data protection, and intrusion detection.
• Hands-on experience with Kubernetes, Docker, and containerized environments.
• Familiarity with security tooling in CI/CD environments (e.g., GitHub Actions, Jenkins, CircleCI).
• Comfort working in Linux environments and command-line tooling.
• Familiarity with modern identity and access controls (OAuth, OIDC, SSO, RBAC/ABAC).

Preferred qualifications:

• Experience designing secure multi-cloud deployments or zero trust architectures.
• Strong understanding of data protection techniques: encryption at rest/in transit, tokenization, secure enclaves.
• Experience integrating security into microservice architectures and service meshes.
• Hands-on experience securing LLM/ML platforms, model inference infrastructure, or data labeling pipelines.
• Proficiency with IaC tools like Terraform, and experience embedding policy-as-code (e.g., Open Policy Agent, Cloud Custodian, AWS Config).
• Experience managing EDR/XDR platforms, MDM tools, and corporate endpoint security.

Why Fireworks AI?

• Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
• Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
• Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
• Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.