Episode

Running Ray on Kubernetes with KubeRay

Podcast
Kubernetes Bytes
Published
Sep 5, 2024
Duration seconds
3186
Processing state
not_requested
Canonical source
https://zencastr.com/z/UGd7fnf_
Audio
https://redirect.zencastr.com/r/episode/66d9c68ea3e3d2045d5fdd4a/size/76516419/audio-files/60f9ac743534330029a39c99/6367555f-09d4-467e-b172-f722cc7aff8d.mp3
JSON
/v1/public/podcasts/kubernetes-bytes-5263358/episodes/running-ray-on-kubernetes-with-kuberay
Markdown
/podcast/kubernetes-bytes-5263358/running-ray-on-kubernetes-with-kuberay.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/kubernetes-bytes-5263358/episodes/running-ray-on-kubernetes-with-kuberay/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/kubernetes-bytes-5263358/running-ray-on-kubernetes-with-kuberay.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito * https://orca.security/resources/blog/kubernetes-testing-environment/ * https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available Show links: * Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ * KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html * Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) * KubeRay repository: https://github.com/ray-project/kuberay * Ray repository: https://github.com/ray-project/ray * Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform Timestamps: * 00:02:40 Cloud Native News * 00:07:20 Interview with Kai * 00:49:15 Key takeaways