Sr. System Software Engineer – LLM Framework

⚠️Important Notice – Read Before Applying This is not a model training or data science role. We are seeking a software engineer focused on AI framework development, not just using existing tools. ✅About the job Your primary responsibility will be to design and implement sophisticated APIs and runtime environments for our LPU hardware. This requires deep exploration of existing frameworks, coding complex integrations, and optimizing performance. If you are passionate about building the AI infrastructure that enables others to run models, this role is for you. We are looking for a highly skilled software engineer to design and optimize the LPU's AI software stack and runtime environment. ✅Key Responsibilities • Develop and optimize the LPU runtime and software stack, integrating with Hugging Face Transformers, llama.cpp, vllm, etc. • Design and implement APIs to enable efficient model execution on our hardware. • Explore and modify existing AI frameworks to ensure smooth adaptation for the LPU. • mprove runtime performance for heterogeneous computing environments. • Collaborate with hardware teams to optimize hardware-software interactions. • Contribute to the evolution of AI model deployment frameworks. ✅Qualifications • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related fields. • Strong proficiency in C++ and Python, with experience in performance-critical software. • Hands-on experience with AI frameworks (Hugging Face Transformers, llama.cpp, vllm), beyond just using them—modifying, extending, or integrating. • Understanding of runtime systems and heterogeneous computing. • Experience with low-level optimizations, memory management, and parallel execution. • Familiarity with software development tools (Docker, Git, CI/CD). • Analytical thinking and problem-solving skills. ✅Nice to have • 3+ years of experience in compiler technologies, runtime systems, or AI hardware acceleration. • Understanding of hardware-software co-design principles. • Experience with CUDA, ROCm, or other GPU programming frameworks. • Contributions to open-source AI/ML projects. ✅Any additions • Work on cutting-edge AI framework development. • Collaborative and high-caliber engineering team. • Competitive salary and benefits. • Career growth in AI software and system design. ✅How to Apply Send your resume and cover letter. If you have framework-related contributions (e.g., modifications to AI runtimes), please highlight them. Join us in building the AI infrastructure of the future.