Model Serving

Kubeflow supports two model serving systems that allow multi-framework model serving: KFServing and Seldon Core. Alternatively, you can use a standalone model serving system. This page gives an overview of the options, so that you can choose the framework that best supports your model serving requirements.

https://www.kubeflow.org/docs/components/serving/overview/
https://github.com/kubeflow/kfserving
https://github.com/SeldonIO/seldon-core