BentoML

BentoML Documenation

BentoML is an open-source platform for machine learning model serving.

What does BentoML do?

  • Turn your ML model into production API endpoint with just a few lines of code

  • Support all major machine learning training frameworks

  • High performance API serving system with adaptive micro-batching support

  • DevOps best practices baked in, simplify the transition from model development to production

  • Model management for teams, providing CLI and Web UI dashboard

  • Flexible model deployment orchestration with support for AWS Lambda, SageMaker, EC2, Docker, Kubernetes, KNative and more

👉 Join BentoML Slack community to hear about the latest development updates.