Senior Cloud Engineer – AI Platform (LLM) (f/m/x)

9 Minutes ago • 5 Years +
Research Development

Job Description

At idealo, we are building a platform layer to power AI features for millions of users, connecting Large Language Models (LLMs) with e-commerce intelligence. This role focuses on making LLMs secure, observable, scalable, and cost-efficient in production. A key part of the generative AI infrastructure is the MCP Server, bridging product data with LLM-based applications. The Senior Cloud Engineer will establish infrastructure, tooling, and guardrails for product and ML teams to quickly deploy trusted AI features.
Good To Have:
  • Exposure to prompt/agent frameworks.
  • Exposure to e-commerce systems.
Must Have:
  • Build and operate Infrastructure as Code (CDK/Terraform/CloudFormation).
  • Provide platform primitives like model/endpoint gateway and feature flags.
  • Create and maintain RAG infrastructure with observability and SLOs.
  • Define and monitor SLOs, implement latency/cost controls.
  • Integrate Foundation Model providers and manage versioning.
  • Enable evaluation gates and quality signals into CI/CD.
  • Drive security, compliance, and monitoring.
  • 5+ years in cloud/platform engineering running production systems.
  • Design, build, and operate secure, observable, and cost-efficient infrastructure.
  • Expertise in AWS, IaC (CDK/Terraform), CI/CD, networking, security, observability.
  • Practical experience integrating LLM services and building RAG systems.
  • Knowledge of TypeScript (Node.js) and Python.
  • Comfortable with containerization, automation, and orchestration.
Perks:
  • 30 days of vacation, with an option to buy 15 additional days.
  • Personal development goals, idealo Learning Hub, eLearning (Udemy), coaching & mediation, additional learning and development budget.
  • Office in Berlin with free lunch, coffee, lemonades, after-work beer, foosball, and a rooftop terrace.
  • Job bike or Deutschlandticket for flexible and environmentally friendly commuting.
  • Relocation support for international applicants (visa process and relocation).
  • Fitness and sports options (Urban Sports or Gympass membership).

Add these skills to join the top 1% applicants for this job

budget-management
game-texts
networking
incident-response
aws
azure
terraform
node.js
ci-cd
python
typescript

At idealo, we’re building the platform layer that powers real AI features for millions of users. Our mission is to connect Large Language Models (LLMs) with e-commerce intelligence and make them secure, observable, scalable, and cost-efficient in production.

A central piece of our generative AI infrastructure is the MCP Server – a new interface bridging idealo’s product data with LLM-based applications. Your work will lay the foundation of infrastructure, tooling, and guardrails that enable product and ML teams to ship trusted AI features quickly.

About your new role

  • Build and operate Infrastructure as Code (CDK/Terraform/CloudFormation) for reproducible environments.
  • Provide platform primitives: model/endpoint gateway, prompt/agent registry, configuration & feature flags, rollout strategies (canary, A/B), rate limiting & quotas.
  • Create and maintain RAG infrastructure (vector stores, indexing pipelines, retrieval services) with observability & SLOs.
  • Define and monitor SLOs and implement latency/cost controls (caching, batching, routing).
  • Integrate Foundation Model providers (AWS Bedrock, OpenAI, Azure AI) and manage versioning/rollbacks.
  • Enable evaluation gates (with MLEs): wire up eval pipelines and quality signals (judges, test sets) into CI/CD.
  • Drive security, compliance, and monitoring (logs, traces, metrics, alerts, incident response).

Skills & Requirements

  • 5+ years of experience in cloud/platform engineering running production systems at scale.
  • Proven ability to design, build, and operate secure, observable, and cost-efficient infrastructure.
  • Expertise in AWS (or equivalent), IaC (CDK/Terraform), CI/CD, networking, security, and observability.
  • Practical experience integrating LLM services and building RAG systems (retrieval, embeddings, vector DBs).
  • Knowledge of TypeScript (Node.js) and Python (tooling, pipelines).
  • Comfortable with containerization, automation & orchestration (Airflow, Step Functions, SageMaker Pipelines or similar).
  • Mindset: evaluation-aware, data-driven, cost- & latency-conscious, up-to-date with fast-moving AI tech.
  • Nice to have: exposure to prompt/agent frameworks and e-commerce systems.

At idealo you can expect

  • You need vacation? We offer you 30 days of vacation. Not enough? You can "buy" an additional 15 days every year by converting your salary and it's seen as a positive thing.
  • You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.
  • And what about the office? Our office in the heart of Berlin offers excellent free lunch, as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of berlin where you can network with colleagues from our group of companies.
  • You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket - and it's environmentally friendly, too!
  • You don't live in Germany yet? We support you in the visa process and with your relocation.
  • Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.

About idealo

idealo is a Berlin success story: in 2000 we started out with the mission of helping consumers make the best purchasing decisions. Today, with ~2.5 million visits per day, ~50,000 shops, and more than ~500 million product offers, we are one of the most popular German e-commerce websites and one of the leading European shopping and comparison platforms. We are active as a price comparison platform in six countries (Austria, France, Germany, Great Britain, Italy, and Spain).

We are located in the heart of Berlin and offer a unique idealo spirit. Your ideas are the driving force that moves our business forward. Not only our product portfolio is diverse, but also the people who work on it. We want you just as you are! Origin, religion, gender, sexual orientation, or a degree of disability are irrelevant.

If you are passionate about improving the world of online shopping alongside ~700 idealos from ~60 nations, we are happy to receive your application!

Information for applicants with severe disabilities: As an applicant with a severe disability, you can get advice from our Representative Body for Severely Disabled People (SBV) during the application process. Please inform us regarding this topic.

For the inclusion of people with disabilities, our office is accessible without steps. When you start with us, we will see what else is needed!

#LI-MW1

Set alerts for more jobs like Senior Cloud Engineer – AI Platform (LLM) (f/m/x)
Set alerts for new jobs by Axel springer
Set alerts for new Research Development jobs in Germany
Set alerts for new jobs in Germany
Set alerts for Research Development (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙