Engineer, Staff
Job Description
- Hands-on with EDA (Exploratory Data Analysis).
- Understanding of Quantization (AWQ) and knowledge on QAT.
- Knowledge of optimization techniques for training large models.
- Experience with Neural Architecture Search (NAS) techniques for optimizing model architectures.
- Hands-on experience with CUDA, CUDNN and Triton-lang.
- Familiarity with data version control tools.
- Optimize latest LLM and GenAI model architectures for NPUs, involving reimplementing basic building blocks of models for NPUs.
- Train and fine-tune Large Language Models (LLMs) from scratch and fine-tune existing LLMs on various datasets.
- Implement state-of-the-art LLM training techniques such as Reinforcement Learning from Human Feedback (RLHF), ZeRO, and Speculative Sampling.
- Handle large datasets effectively, ensuring data quality and integrity, and implement data cleaning and preprocessing techniques.
- Evaluate model performance using appropriate metrics and understand trade-offs between different evaluation metrics.
- Sound understanding of various LLM metrics like MMLU, Rouge, BLEU, Perplexity.
- Hands-on experience with PyTorch at a granular level, including tensor operations, automatic differentiation, and GPU acceleration.
- Strong understanding of Natural Language Processing (NLP) and experience working with LLMs.
- Proficiency in Python and experience with software development best practices.
- Work experience with Programming Language such as C, C++, Java.
- World-class health benefit options providing comprehensive coverage to employees and their eligible dependents.
- Programs designed to help employees build and prepare for a financially secure future.
- Self and family resources to help build emotional/mental strength and resilience and define purpose.
- Wellbeing programs and resources offering support to help employees Live+Well and Work+Well.
- Continuous learning and development programs.
- Tuition reimbursement.
- Mentorships.
Job Posting Date
2025-10-22
Job Area:
Engineering Group, Engineering Group > Software Engineering
General Summary:
Job Overview:
The Qualcomm Cloud AI team is developing hardware and software for Machine Learning solutions spanning the data center, edge, infrastructure, automotive market. We are seeking ambitious, bright, and innovative engineers with experience in machine learning framework development. Job activities span the whole product life cycle from early design to commercial deployment. The environment is fast-paced and requires cross-functional interaction daily so good communication, planning and execution skills are a must.
We are seeking a highly skilled and motivated Language Model Engineer to join our team. The primary role of the engineer will be to train Large Language Models (LLMs) from scratch and fine-tune existing LLMs on various datasets using state-of-the-art techniques.
Responsibilities:
Model architecture optimizations : optimize latest LLM and GenAI model architectures for NPUs, which involves reimplementing basic building blocks of models for NPUs
Model Training and Fine-tuning: Fine-tune pre-trained models on specific tasks or datasets to improve performance. Implement state-of-the-art LLM training techniques such as Reinforcement Learning from Human Feedback (RLHF), ZeRO (Zero Redundancy Optimizer), Speculative Sampling, and other speculative techniques.
Data Management: Handle large datasets effectively. Ensure data quality and integrity. Implement data cleaning and preprocessing techniques. Hands-on with EDA is a plus.
Model Evaluation: Evaluate model performance using appropriate metrics. Understand the trade-offs between different evaluation metrics.
LLM metrics: Sound understanding of various LLM metrics like MMLU, Rouge, BLEU, Perplexity etc.
AWQ: Understanding of Quantization is a plus. Knowledge on QAT will be a plus.
Research and Development: Stay up to date with the latest research in NLP and LLMs. Implement state-of-the-art techniques and contribute to research efforts.
Infrastructure development : For coming up with new optimization techniques to minimize ONNX memory footprint, export time optimizations.
Collaboration: Work closely with other teams to understand requirements and implement solutions.
Required Skills and Experience:
Deep Learning Frameworks: Hands-on experience with PyTorch at a granular level. Familiarity with tensor operations, automatic differentiation, and GPU acceleration in PyTorch.
NLP and LLMs: Strong understanding of Natural Language Processing (NLP) and experience working with LLMs.
Programming: Proficiency in Python and experience with software development best practices.
Data Handling: Experience working with large datasets. Familiarity with data version control tools is a plus.
Education: A degree in Computer Science, Machine Learning, AI, or related field. Advanced degree is a plus.
Communication: Excellent written and verbal communication skills.
Work experience : Open, 4 – 10 years of relevant experience.
Preferred Skills:
Exp - 9+ to 12 years
Optimization: Knowledge of optimization techniques for training large models.
Neural Architecture Search (NAS): Experience with NAS techniques for optimizing model architectures is a plus.
Hands-on experience with CUDA, CUDNN and Triton-lang is a plus.
Minimum Qualifications:
- Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.
OR
- Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Engineering or related work experience.
OR
- PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
- 2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.
Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).
To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.
If you would like more information about this role, please contact Qualcomm Careers.
Job Application Privacy Notice
Job Application Privacy Notice
Use of AI in the Application Process
Use of AI in the Application Process
Equal Employment Opportunity
"EEO is the Law" Poster Supplement
Pay Transparency Non-Discrimination Provision
Employee Polygraph Protection Act
Perks and Benefits
- Health
Qualcomm offers a world-class health benefit option providing world-class coverage to employees and their eligible dependents.
- Wealth
Our programs are designed to help employees build and prepare for a financially secure future.
- Self
Our self and family resources help you build emotional/mental strength and resilience, as well as define your purpose — in life and at work.
- Wellbeing
Qualcomm’s wellbeing programs and resources offer support to help employees Live+Well and Work+Well, so they can unlock their full potential at home, at work, and everywhere between.
Unlock Your Limitless Potential with Qualcomm
Whether you’re launching a new career or ready to explore what’s next in the evolution of your talent and expertise, you’re about to embark on a career growth journey like no other.
Bring out your best, with the best
Our employees make Qualcomm’s success possible. We hire the brightest minds and foster a supportive, inclusive culture where your ideas have the power to contribute to world-changing innovations and breakthrough technologies. To make that possible, we leverage the breadth and depth of our diverse expertise from around the world to answer the unasked, conquer the complex, and solve some of the biggest challenges only we can – together.
Innovate with technology experts
At Qualcomm, we are passionate about the limitless potential of your career. Only here can you work alongside some of the most respected, leading engineering and technology experts in the industry – helping you learn and grow professionally in ways you haven’t yet imagined.
Live well, work well
Additionally, you’ll have access to programs such as our continuous learning and development programs, tuition reimbursement, and mentorships to tap into your limitless potential – plus, opportunities to enhance your quality of life through our comprehensive, best-in-class benefits offerings.
The work we do at Qualcomm impacts lives around the globe – and you can be part of it. Apply today and unlock your full potential.
