15
Jan
2020
/
Carey Phelps, Product Lead

Run your first sweep

It’s easy to start optimizing your models with hyperparameter sweeps. I’ll walk through the steps in this repo with a working example — you can open my W&B Dashboard. I'm using the code from this example repo, which trains a PyTorch convolutional neural network to classify images from the Fashion MNIST dataset.

1. Create a project

Run your first baseline run manually to check that W&B logging is working properly. You'll download this simple example model, train it for a few minutes, and see the example appear in the web dashboard.

View an example project page →

2. Create a sweep

From your project page, open the Sweep tab in the sidebar and click "Create Sweep".

The auto-generated config guesses values to sweep over based on the runs you've done already. Edit the config to specify what ranges of hyperparameters you want to try. When you launch the sweep, it starts a new process on our hosted W&B sweep server. This centralized service coordinates the agents— your machines that are running the training jobs.

3. Launch agents

Next, launch an agent locally. You can launch dozens of agents on different machines in parallel if you want to distribute the work and finish the sweep more quickly. The agent will print out the set of parameters it’s trying next.

That’s it! Now you're running a sweep. Here’s what the dashboard looks like as my example sweep gets started. View an example project page →

Join our mailing list to get the latest machine learning updates.