JobsUSASoftware Engineer, ML Infrastructure - Training Platform
Company : Scale AI, Inc.
Location : San Francisco, CA, 94199
Posted Date : 15 September 2025
Job Type : Other
Category : Software Development
Occupation : Software Engineer
Job Details
Scale is seeking an AI/ML Infrastructure Engineer to join our Machine Learning Infrastructure team to develop our Training Platform. In this role, you will collaborate closely with Machine Learning researchers to understand their needs and leverage your expertise and our compute resources to enhance experimentation throughput.
The ideal candidate should possess strong fundamentals in machine learning, backend system design, and prior experience in ML Infrastructure. Comfort with infrastructure, large-scale system design, and diagnosing model performance and system failures is essential.
You will:
- Build highly available, observable, performant, and cost-effective APIs for model training.
- Participate in our on-call process to ensure service availability.
- Manage projects end-to-end, from requirements and scoping to design and implementation, within a collaborative, cross-functional environment.
- Exercise good judgment in system and tool building, balancing build vs. buy decisions with cost considerations.
Ideally you'd have:
- 4+ years of experience with machine learning training pipelines or inference services in production.
- Experience with distributed training techniques such as DeepSpeed, FSDP, etc.
- Experience developing, deploying, and monitoring complex microservice architectures.
- Proficiency in Python, Docker, Kubernetes, and Infrastructure as Code (e.g., Terraform).
Nice to haves:
- Experience with LLM inference latency optimization techniques like kernel fusion, quantization, dynamic batching, etc.
- Experience working with cloud platforms such as AWS or GCP.
Compensation packages include base salary, equity, and benefits. The salary range varies by location and other factors. Benefits include health, dental, vision, retirement, learning stipends, and generous PTO. Additional benefits may include commuter stipends.
Location-specific salary range in San Francisco, New York, Seattle: $160,000 — $225,600 USD.
Note: Our policy requires a 90-day waiting period before reconsidering candidates for the same role.
About Us:
At Scale, we aim to accelerate the transition to AI across industries. Our products power advanced LLMs, generative models, and computer vision models, trusted by leading AI companies and organizations worldwide. We promote an inclusive workplace and are committed to equal opportunity employment. For accommodations during the application process, contact
We adhere to the US Department of Labor's Pay Transparency and privacy policies. Personal data collected is used solely for employment-related purposes and managed according to our privacy policy.
#J-18808-LjbffrRecently Posted Jobs
Entry Level Printer Specialist/Sign Designer
FastSigns
Atlanta, GA
Medical Assistant OB-GYN
Allina Health
Lakeville, MN
School-Based BT (Mon-Fri)
Amergis Healthcare Staffing
Upland, CA
Operations Compliance Analyst, Senior
Constellation Energy
Maryville, MO
Physician / ObGyn / Kentucky / Locum Tenens / OBGYN Laborist Physician Locums Job in Kentucky Beginning 9/15/2025 Job
Jackson and Coker
Lebanon, KY
Registered Nurse - RN - ICU Full Time Days - ICU - Intensive Care Unit
Orlando Health
Rockledge, FL
Housekeeper
Marvin
Roanoke, VA
Registered Nurse (RN) - Immunization Network
LCMC Health
New Orleans, LA
Travel Electrophysiology Technician - $2,389 per week
American Medical Staffing
Austin, TX
Principal Technical Architect, Site Reliability Engineering
Charles Schwab
Austin, TX
Registered Nurse - RN
IntelyCare
Garfield Heights, OH
Certified Wound Ostomy Nurse
Legacy Health
Portland, OR
Director of Civil Engineering
LVI Associates
Atlanta, GA
(RRT) Registered Respiratory Therapist (Full-Time/Night) Einstein Montgomery
Thomas Jefferson University Hospital
Montgomery, PA
Level III - Medical Lab Technician - $30-32 per hour
Keck Medicine of USC
Huntington Park, CA
Jr Sediment Remediation Engineer
CDM Smith
Rancho Cucamonga, CA
Catheter Development Engineer
Guidehouse
Bethesda, MD
Per Diem RN - Perinatal - Westwood
UCLA Health
Los Angeles, CA
Designated Technician Trainer
Waste Management
Key West, FL
Diesel Mechanic
Interstate Waste Services
Jersey City, NJ
Other Jobs You May Like
Senior Software Engineer, Platform Infrastructure, San Jose, CA
Company : Cisco
Location : San Jose, CA
Senior Software Engineer, Backend Development - Nexus Hyperfabric
Company : Cisco
Location : Milpitas, CA
Software Engineer - Forwarding Technologies and Programming NPUs
Company : Cisco
Location : Milpitas, CA
Principal DSP Engineer - Coherent Optical Transmission Systems - Acacia
Company : Cisco
Location : San Jose, CA
Senior AI Engineer - AI Incubation & Enablement - Hybrid
Company : Charles Schwab
Location : San Francisco, CA
Senior Applied AI Engineer - AI Transformation
Company : Charles Schwab
Location : San Francisco, CA
Python Software Engineer - Ubuntu Hardware Certification Team
Company : Canonical
Location : San Francisco, CA
Top searches
Employment opportunities at Scale AI, Inc.
- Scale ai, inc. jobs near me San Francisco, CA
- Scale ai, inc. jobs hiring near me San Francisco, CA
- Scale ai, inc. jobs near San Francisco, CA
- Scale ai, inc. jobs hiring near me
- Scale ai, inc. openings near me
- Scale ai, inc. jobs near me in San Francisco, CA
- Scale ai, inc. jobs hiring in San Francisco, CA
- Employment opportunities near me
- Job openings near me
- Jobs hiring immediately
Trending Searches in San Francisco, CA
- Full time jobs near me San Francisco, CA
- Local job openings
- Places hiring near me
- Job vacancies near me
- Software engineer jobs near me San Francisco, CA
- Software engineer jobs hiring near me San Francisco, CA
- Software engineer jobs hiring near San Francisco, CA
- Software engineer jobs near San Francisco, CA
- Software engineer jobs near me in San Francisco, CA
- Software engineer jobs in San Francisco, CA
Top trending job titles hiring now
Popular Searches for Software Engineer