JobsUSASoftware Engineer, ML Infrastructure - Training Platform
Company : Scale AI, Inc.
Location : California, MO, 65018
Posted Date : 15 September 2025
Job Type : Other
Category : Software Development
Occupation : Software Engineer
Job Details
Scale is seeking an AI/ML Infrastructure Engineer to join our Machine Learning Infrastructure team to develop our Training Platform. In this role, you will collaborate closely with Machine Learning researchers to understand their needs and leverage your expertise and our compute resources to enhance experimentation throughput.
The ideal candidate should possess strong fundamentals in machine learning, backend system design, and prior experience in ML Infrastructure. Comfort with infrastructure, large-scale system design, and diagnosing model performance and system failures is essential.
You will:
- Build highly available, observable, performant, and cost-effective APIs for model training.
- Participate in our on-call process to ensure service availability.
- Manage projects end-to-end, from requirements and scoping to design and implementation, within a collaborative, cross-functional environment.
- Exercise good judgment in system and tool building, balancing build vs. buy decisions with cost considerations.
Ideally you'd have:
- 4+ years of experience with machine learning training pipelines or inference services in production.
- Experience with distributed training techniques such as DeepSpeed, FSDP, etc.
- Experience developing, deploying, and monitoring complex microservice architectures.
- Proficiency in Python, Docker, Kubernetes, and Infrastructure as Code (e.g., Terraform).
Nice to haves:
- Experience with LLM inference latency optimization techniques like kernel fusion, quantization, dynamic batching, etc.
- Experience working with cloud platforms such as AWS or GCP.
Compensation packages include base salary, equity, and benefits. The salary range varies by location and other factors. Benefits include health, dental, vision, retirement, learning stipends, and generous PTO. Additional benefits may include commuter stipends.
Location-specific salary range in San Francisco, New York, Seattle: $160,000 — $225,600 USD.
Note: Our policy requires a 90-day waiting period before reconsidering candidates for the same role.
About Us:
At Scale, we aim to accelerate the transition to AI across industries. Our products power advanced LLMs, generative models, and computer vision models, trusted by leading AI companies and organizations worldwide. We promote an inclusive workplace and are committed to equal opportunity employment. For accommodations during the application process, contact
We adhere to the US Department of Labor's Pay Transparency and privacy policies. Personal data collected is used solely for employment-related purposes and managed according to our privacy policy.
#J-18808-LjbffrRecently Posted Jobs
Citizens Banker (West Lebanon)
Citizens
West Lebanon, NH
Construction & Facilities Project Manager- Remodels
Cavender's
Tyler, TX
Regulatory Compliance Manager
Greenlife Healthcare Staffing
Columbus, OH
RN MED/SURG CONTRACT - Med Surg
Woodland Heights Medical Center
Lufkin, TX
Account Manager
Institute of Inspection , Cleaning and Restoration Certification
Albuquerque, NM
Caregiver - IHSS - Central Tucson
Sevita
Tucson, AZ
Home Health Physical Therapy Assistant - $68K+ per year
LHC Group, Inc.
Fort Wayne, IN
Operating Room Registered Nurse - Part Time
Mary Washington Healthcare
Alexandria, VA
Senior Flight Test Engineer - Active TS/SCI
Macpower Digital Assets Edge
Bedford, MA
General Manager
MCR Hotels
Dowell, MD
Shift Foreman
Constellation Energy
Aberdeen, MD
Restaurant Manager – Lead & Inspire Teams
Dunkin
Iron Mountain, MI
Inside Sales: Global Medical Staffing
CHG Healthcare
Salt Lake City, UT
Entry Level Early Intervention Autism Specialist
Action Behavior Centers
New Braunfels, TX
New Bern Home Health Nurse LPN/RN
Thrive Skilled Pediatric Care LLC
New Bern, NC
CDL A Delivery Truck Driver (Morrisville)
McLane Company
Morrisville, NC
RDH - Flexible Schedule - Earn From $59 per Hour
GoTu
Milwaukee, WI
Work-from-Home Market Research Panelist (Hiring Immediately)
Earn Haus
Guilford, CT
Poker Supervisor Full Time (Harrah's Pompano Beach)
Caesars Entertainment
Pompano Beach, FL
Network Engineer-Hybrid (Haverhill MA)
Beth Israel Lahey Health
Charlestown, MA
Other Jobs You May Like
Instrument & Controls Engineer - Aviation & Federal (Kansas City)
Company : Burns & McDonnell
Location : Kansas City, MO
Senior Electrical Engineer - Consumer Products (Kansas City/St. Louis)
Company : Burns & McDonnell
Location : Kansas City, MO
Assistant Electrical Engineer, Transmission & Distribution - Underground & Submarine Cables (Kansas City)
Company : Burns & McDonnell
Location : Kansas City, MO
Fueling Structural Engineer - Aviation & Federal (Kansas City)
Company : Burns & McDonnell
Location : Kansas City, MO
Electrical Engineer (Nuclear) - Power (Kansas City)
Company : Burns & McDonnell
Location : Kansas City, MO
HVAC/R Control Engineer - UH Truman Medical Center (7a - 3p)
Company : University Health
Location : Kansas City, MO
Lead Electrical Engineer - Energy & Industrial Group
Company : Sargent & Lundy
Location : St Louis, MO
Sr Cloud Security Engineer/Analyst - Exposure Management
Company : Edward Jones
Location : St Louis, MO
Top searches
Employment opportunities at Scale AI, Inc.
- Scale ai, inc. jobs near me California, MO
- Scale ai, inc. jobs hiring near me California, MO
- Scale ai, inc. jobs near California, MO
- Scale ai, inc. jobs hiring near me
- Scale ai, inc. openings near me
- Scale ai, inc. jobs near me in California, MO
- Scale ai, inc. jobs hiring in California, MO
- Employment opportunities near me
- Job openings near me
- Jobs hiring immediately
Trending Searches in California, MO
- Full time jobs near me California, MO
- Local job openings
- Places hiring near me
- Job vacancies near me
- Software engineer jobs near me California, MO
- Software engineer jobs hiring near me California, MO
- Software engineer jobs hiring near California, MO
- Software engineer jobs near California, MO
- Software engineer jobs near me in California, MO
- Software engineer jobs in California, MO
Top trending job titles hiring now
Popular Searches for Software Engineer