Job Description:
CCE Client Customer Engineering is seeking a hands-on Software Engineer to lead the development of an AI-powered debug tool designed to analyze and optimize power and performance on client platforms by analyzing IT environments. This tool will leverage Large Language Models (LLMs) to assist users in diagnosing system-level issues, with support for both local inference (via OpenVINO, ONNX, or similar frameworks) and cloud-based execution.
This role is ideal for someone who thrives on solving complex technical challenges, shipping real products, and hacking together innovative solutions that work across diverse hardware and software environments. You'll work closely with OEMs, ISVs, and internal teams to build scalable, intelligent tools that enhance battery life, thermal efficiency, and system responsiveness.
Scope of work includes:
- Designing and developing LLM-powered debugging tools for power and performance analysis.
- Implementing local inference pipelines using frameworks like OpenVINO, ONNX Runtime, or TensorRT.
- Integrating telemetry data, system logs, and performance counters into intelligent diagnostics.
- Collaborating with customers to gather requirements, troubleshoot issues, and deliver tailored solutions.
- Building APIs, background services, and UI/UX components for interactive debugging workflows.
- Writing robust, testable, and maintainable code with clear documentation.
- Driving cross-functional alignment and execution across engineering and product teams.
- Staying current with emerging trends in AI/ML, edge inference, and system optimization.
The ideal candidate should exhibit the following professional traits:
- Comfortable working in ambiguous environments with a hacker mindset-you make things work.
- Excellent communication skills and a collaborative, customer-first attitude.
Qualifications:
Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering or related field and 8+ years of relevant industry experience.
OR Master degree in Computer Science, Computer Engineering, Software Engineering or related field and 5+ years of relevant industry experience.
OR PhD degree in Computer Science, Computer Engineering, Software Engineering or related field and 3+ years of relevant industry experience.
The experience must include:
- Experience shipping production-grade software tools or developer platforms.
- Programming skills in Go, Python, C# or C++.
- Understanding of LLMs, RAG architectures, and embedding techniques.
- Understanding of cloud-based AI services (e.g., Azure Open-AI, Hugging Face, etc.).
- Machine learning fundamentals, including classification, anomaly detection, and reinforcement learning.
- Experience developing Windows applications.
Preferred qualifications:
- Experience with power and performance debugging, battery life optimization, or thermal/power telemetry is a strong plus.
- Familiarity with local inference optimization using OpenVINO, ONNX, or similar.
- Ability to design modular, scalable systems that support multiple Software Vendor integrations.