Software Engineer (ML Platform)
Anyscale
Software Engineering, Data Science
San Francisco, CA, USA
Posted on Friday, December 17, 2021
About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
We're a San Francisco based company, proud to be backed by $250+ million from top-tier investors like Andreessen Horowitz, NEA, and Addition.
About the role:
Anyscale is looking to hire strong engineers to build next generation high-performance machine learning serving systems (both our open source libraries and SaaS offering).
Much of the tooling used to serve ML models today is inherited from the previous generation of infrastructure, but emerging ML applications come with a new set of requirements: high compute requirements, the need for specialized hardware, and composing many different models along with business logic in a single request.
Our goal is provide a simple but powerful set of tools to make bringing complex ML applications to production a reality.
About the Platform team:
The Platform team’s mission is to build world class systems for serving ML models in production. Part of this work is building and maintaining the open source Ray Serve library, as well as contributing directly to the Anyscale platform used by our customers to run mission-critical applications.
Much of our work is user-facing: you’ll have the opportunity to collaborate with open source users and customers from small startups with lean ML engineering teams to industry-leading companies using Ray, such as Uber, Shopify, and ByteDance.
As part of this role, you will:
- Building a highly available service for ML model serving
- Improve Ray Serve and our other libraries to make authoring next-generation production ML applications as easy as possible
- Improve our autoscaling capabilities to drive performance improvements & cost savings
- Reduce latency and improve throughput for single- and multi-model serving
We'd love to hear from you if you have:
- Solid background in algorithms, data structures, system design
- Experience working with modern machine learning tooling (PyTorch, Tensorflow, JAX)
- At least 1+ year of relevant work experience
Bonus points!
- Experience building and maintaining an open source project
- Experience building and operating machine learning infrastructure in production
- Experience building highly available serving systems
Compensation
- At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.
- Stock Options
- Healthcare plans, with premiums covered by Anyscale at 99%
- 401k Retirement Plan
- Wellness stipend
- Education stipend
- Paid Parental Leave
- Paid Time Off
- Commute reimbursement
- 100% of in office meals covered
This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
See more open positions at Anyscale
Something looks off?