Principal Software Engineer

Our client, a leader in the technology sector, is seeking a Principal Software Engineer to join their team. As a Principal Software Engineer, you will be part of the Software Engineering department supporting the OpenShift AI team. The ideal candidate will have strong communication skills, a collaborative mindset, and a passion for innovation which will align successfully in the organization.
Job Title: Principal Software Engineer - Model Inference
Location: Raleigh, NC or Boston, MA (Hybrid)
Salary Range: competitive
What's the Job?

• Develop and maintain a high-quality, high-performing ML inference runtime platform for multi-modal and distributed model serving.
• Contribute directly to upstream inference runtime communities such as vLLM, TGI, PyTorch, OpenVINO, and others.
• Maintain CI/CD build pipelines for container images that allow faster, more secure, reliable, and frequent releases.
• Coordinate and communicate with various stakeholders to ensure project alignment.
• Apply a growth mindset by staying up to date with AI and ML advancements.

What's Needed?

• Highly experienced with programming in Python and PyTorch.
• Familiarity with model parallelization, quantization, and memory optimization using vLLM, TGI, and other inference libraries.
• Experience with Python packaging such as PyPI libraries.
• Development experience with C++, especially with the CUDA APIs is a big plus.
• Solid understanding of the fundamentals of model inferencing architectures.

What's in it for me?

• Opportunity to work on cutting-edge AI and ML technologies.
• Collaborative and inclusive work environment.
• Chance to contribute to open-source development communities.
• Engage with a diverse team of talented engineers.
• Professional growth and development opportunities.

If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you! About ManpowerGroup, Parent Company of: ?Manpower, Experis, Talent Solutions, and Jefferson Wells
ManpowerGroup? (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands - Manpower, Experis, Talent Solutions, and Jefferson Wells - ?creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.