PyTorch Distributed¶
The Kubeflow PyTorch plugin leverages the Kubeflow training operator to offer a highly streamlined interface for conducting distributed training using different PyTorch backends.
Install the plugin¶
To use the PyTorch plugin, run the following command:
pip install flytekitplugins-kfpytorch
To enable the plugin in the backend, follow instructions outlined in the Configure Kubernetes Plugins guide.
Run the example on the Flyte cluster¶
To run the provided examples on the Flyte cluster, use the following commands:
Distributed pytorch training:
pyflyte run --remote pytorch_mnist.py pytorch_training_wf
Pytorch lightning training:
pyflyte run --remote pytorch_lightning_mnist_autoencoder.py train_workflow