Fastbook chapter 5 - run performance way worse than documented

[Fabian (Fabian R)]

Hi,
I’m currently working through Fastbook.
What struck me, is that the performance when running the cells:

is way worse than the documented performance:

Is this normal and if not - why could this be the case?

[atticusmatticus (Atticus)]

I’m getting the same thing. My first error_rate from fine_tune() or fit_one_cycle() is ~0.3 and I can’t get it below ~0.19 no matter what I try.

python --version = 3.8.8
ipython --version = 7.21
fastai --version = 2.2.7

[jimmiemunyi]

Performance degradation between fastai 2.2.5 and 2.2.7

I’ve just upgraded fastai to 2.2.7 from 2.2.5 and noticed a huge change in performance. However, by looking at the changelog, nothing important has changed between the two versions. Here is a notebook showing the difference. But basically, the exact same code goes from 93% accuracy down to 47%. Have anyone noticed something similar ? @muellerzr any idea of what’s going on ?

is this related to this thread?

[Fabian (Fabian R)]

Yes, thank you.
I fixed the problem by using this (yet) unmerged pull request:

Updated to support adding transforms to multiple dataloaders

e.g.:
git clone https://github.com/fastai/fastai.git
git fetch origin pull/3268/head:dataloaders_fix
git checkout dataloaders_fix
pip install -e “fastai[dev]”

Just for me to clarify.
Is this a problem due to some fastbook imports or is the issue a general problem within the current fastai version (e.g.: dataloaders train & valid transformations are generally inconsistent)?

[jvenepally (jashwanth venepally)]

Hello, while I am getting the same accuracy, my runtimes are much longer (~40:00) than what’s shown in the lesson or here (~00:25). I am using Google Cloud Platform (GCP) AI notebook instance with a Nvidia Tesla K80 GPU, 4 CPUs & 26GB RAM. This is making my progress very slow.

Do someone have experience with GCP that can help me out?

Something else I find curious is, the GPU runs at 100%, even though I have just started the notebook or it’s idle.