Senior AI/ML Engineer – Generative AI & Autonomous Agents

20 Hours ago • 5 Years +

Job Summary

Job Description

The Senior AI/ML Engineer will be responsible for designing and implementing business logic for agent behavior, including decision-making workflows, and interaction policies. They will develop and refine LLM-driven agents using prompt engineering, RAG, and fine-tuning. The role involves understanding domain knowledge, applying traditional ML techniques, contributing to data engineering pipelines, and building modular AI components. Collaboration with other AI engineers, translating prototypes, and designing UX interactions are also key responsibilities. The engineer will need to stay updated on trends in LLM architectures and GenAI standards.

Must have:

5+ years of experience in ML/AI engineering
Strong knowledge of ML fundamentals and traditional ML models
Solid programming skills in Python and cloud-native microservices
Experience with LLM frameworks and vector databases
Familiarity with prompt engineering techniques
Strong understanding of RAG architectures

Good to have:

Experience with LLMOps tools or orchestration libraries
Familiarity with Docker and container-based development
Background in enterprise networking tools
Contributions to open-source AI or GenAI libraries

11 skills required

11 skills required for this role

Add these skills to join the top 1% applicants for this job

prototyping

microservices

azure

aws

python

docker

model-deployment

communication

networking

cross-functional

team-management

Job Details

Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.

Inclusion is one of our core values and in our DNA. We are committed to fostering an inclusive workplace that embraces our differences and creates an atmosphere where all our employees thrive because of their differences, not in spite of them.

Become part of Something big with Extreme! As a global networking leader, learn why there’s no better time to join the Extreme team.

Senior AI/ML Engineer – Generative AI & Autonomous Agents

Introduction

At Extreme Networks, we create effortless networking experiences that empower people and organizations to advance. As part of our growing AI Competence Center, we are seeking a Senior AI/ML Engineer with expertise in Generative AI, multi-agent systems, and LLM-based application development. In this role, you will help build the next generation of AI-native systems that combine traditional machine learning, generative models, and autonomous agents. Your work will power intelligent, real-time decisions for network design, optimization, security, and support.

Key Responsibilities:

Design and implement the business logic and modeling that governs agent behavior, including decision-making workflows, tool usage, and interaction policies.
Develop and refine LLM-driven agents using prompt engineering, retrieval-augmented generation (RAG), fine-tuning, or function calling.
Understand and model the domain knowledge behind each agent: engage with network engineers, learn the operational context, and encode this understanding into effective agent behavior.
Apply traditional ML modeling techniques (classification, regression, clustering, anomaly detection) to enrich agent capabilities.
Contribute to the data engineering pipeline that feeds agents, including data extraction, transformation, and semantic chunking.
Build modular, reusable AI components and integrate them with backend APIs, vector stores, and network telemetry pipelines.
Collaborate with other AI engineers to create multi-agent workflows, including planning, refinement, execution, and escalation steps.
Translate GenAI prototypes into production-grade, scalable, and testable services in collaboration with platform and engineering teams.
Work with frontend developers to design agent experiences and contribute to UX interactions with human-in-the-loop feedback.
Stay up to date on trends in LLM architectures, agent frameworks, evaluation strategies, and GenAI standards.

Qualifications:

Master’s or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related field.5+ years of experience in ML/AI engineering, including 2+ years working with transformer models or LLM systems.
Strong knowledge of ML fundamentals, with hands-on experience building and deploying traditional ML models.
Solid programming skills in Python, with experience integrating AI modules into cloud-native microservices.
Experience with LLM frameworks (e.g., LangChain, AutoGen, Semantic Kernel, Haystack), and vector databases (e.g., FAISS, Weaviate, Pinecone).
Familiarity with prompt engineering techniques for system design, memory management, instruction tuning, and tool-use chaining.
Strong understanding of RAG architectures, including semantic chunking, metadata design, and hybrid retrieval.
Hands-on experience with data preprocessing, ETL workflows, and embedding generation.
Proven ability to work with cloud platforms like AWS or Azure for model deployment, data storage, and orchestration.
Excellent collaboration and communication skills, including cross-functional work with product managers, network engineers, and backend teams.

Nice to Have:

Experience with LLMOps tools, open-source agent frameworks, or orchestration libraries.
Familiarity with Docker, Docker Compose, and container-based development environments.
Background in enterprise networking, SD-WAN, or network observability tools.Contributions to open-source AI or GenAI libraries.

Extreme Networks, Inc. (EXTR) creates effortless networking experiences that enable all of us to advance. We push the boundaries of technology leveraging the powers of machine learning, artificial intelligence, analytics, and automation. Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions and rely on our top-rated services and support to accelerate their digital transformation efforts and deliver progress like never before. For more information, visit Extreme's website or follow us on Twitter, LinkedIn, and Facebook.

We encourage people from underrepresented groups to apply. Come Advance with us! In keeping with our values, no employee or applicant will face discrimination/harassment based on: race, color, ancestry, national origin, religion, age, gender, marital domestic partner status, sexual orientation, gender identity, disability status, or veteran status. Above and beyond discrimination/harassment based on “protected categories,” Extreme Networks also strives to prevent other, subtler forms of inappropriate behavior (e.g., stereotyping) from ever gaining a foothold in our organization. Whether blatant or hidden, barriers to success have no place at Extreme Networks.