Share your work here ✅

Part 1 (2019)
1334

Hi, I create and put into Github two simple examples of monitors for fast.ai, one for Neptune.ml, and one for TensorBoard when you can use both in the Google Colab notebook. I hope that it’ll help use these two great tools.

The example of the Colab Notebook: https://colab.research.google.com/drive/1HEVbnOyKSLSIkMhpYLWO83Wut3hJrP42

List of saved parameters that are saved in the TensorBoard:

  • Scalars with all metrics and training loss for each batch
  • Images for top losses images
  • Graph for the model
  • Distribution and Histograms for each parameters in layers
  • Hyperparameter Text for learning rate (lr) , momentum (mom) , weight decay (wd) , and beta (beta)
  • Text for Model , Summary , Model save path , and Total Epochs

List of parameters that are saved in the Neptune.ml:

  • all metrics
  • last_loss batch
  • model.txt - info about the model
  • opt.txt - OptiWrapper
  • Properties for learning rate (lr) , momentum (mom) , weight decay (wd) , and beta (beta)
  • Use of CPU/GPU , RAM

Couple screenshots:

image
image.png941×387 35.6 KB

image
image.png509×920 28.2 KB

image
image.png866×640 70.4 KB

These files are straightforward, and you can modify for your purpose as you wish.

7 Likes