Software Engineer- Inference Performance
Listing sourced from ashby on 10/6/2026. CVCraft does not host this job; clicking Apply redirects to the source.
Job Description
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE We're looking for inference performance engineers who want to make the world's most demanding AI workloads run faster and more efficiently. You'll work across the stack, from the inference engine and runtime through scheduling, serving, and routing. Along the way you'll apply techniques like prefill/decode disaggregation, speculative decoding, and KV-cache management. You'll
Salary Context for Software Engineer
The US national median for Software Engineer is $132,270.
Tailor your resume to this role before applying
75% of applicants get filtered by ATS before a human reads them. Run a free 60-second scan to see what keywords are missing from your resume.
Free ATS ScanSimilar Jobs
Employment Paralegal
Sr. Software Engineer(Java,React or angular JS ,AWS,SQL)
Embedded Software Development Engineer (4-6 Years)
PHP Developers
Assistant Technician, Drafting Support
Senior Software Engineer
Pass the ATS Filter Before Applying
Most resumes never reach a human. CVCraft scans your resume against this exact role's keywords in 60 seconds — free.
Scan My Resume Free