Serdar Yegulalp
Senior Writer

Kubeflow 1.0 solves machine learning workflows with Kubernetes

news
Mar 3, 20202 mins

Google's machine learning toolkit for Kubernetes helps data scientists manage machine learning workflows and deploy and scale models in production

shortcut through a maze
Credit: Thinkstock

Kubeflow, Google’s solution for deploying machine learning stacks on Kubernetes, is now available as an official 1.0 release.

Kubeflow was built to address two major issues with machine learning projects: the need for integrated, end-to-end workflows, and the need to make deploments of machine learning systems simple, manageable, and scalable. Kubeflow allows data scientists to build machine learning workflows on Kubernetes and to deploy, manage, and scale machine learning models in production without learning the intricacies of Kubernetes or its components.

Kubeflow is designed to manage every phase of a machine learning project: writing the code, building the containers, allocating the Kubernetes resources to run them, training the models, and serving predictions from those models. The Kubeflow 1.0 release provides tools, such as Jupyter notebooks for working with data experiments and a web-based dashboard UI for general oversight, to help with each phase.

Google claims Kubeflow provides repeatability, isolation, scale, and resilience not just for model training and prediction serving, but also for development and research work. Jupyter notebooks running under Kubeflow can be resource-limited and process-limited, and can re-use configurations, access to secrets, and data sources.

Several Kubeflow components are still under development and will be rolled out in the near future. Pipelines allow complex workflows to be created using Python. Metadata provides a way to track details about individual models, data sets, training jobs, and prediction runs. Katib gives Kubeflow users a mechanism to perform hyperparameter tuning, an automated way to improve the accuracy of predictions from models.

Also by Serdar Yegulalp:

Serdar Yegulalp

Serdar Yegulalp is a senior writer at InfoWorld. A veteran technology journalist, Serdar has been writing about computers, operating systems, databases, programming, and other information technology topics for 30 years. Before joining InfoWorld in 2013, Serdar wrote for Windows Magazine, InformationWeek, Byte, and a slew of other publications. At InfoWorld, Serdar has covered software development, devops, containerization, machine learning, and artificial intelligence, winning several B2B journalism awards including a 2024 Neal Award and a 2025 Azbee Award for best instructional content and best how-to article, respectively. He currently focuses on software development tools and technologies and major programming languages including Python, Rust, Go, Zig, and Wasm. Tune into his weekly Dev with Serdar videos for programming tips and techniques and close looks at programming libraries and tools.

More from this author