I was thinking, perhaps we can create a new feature for the course notebooks that will automatically adjust the bs depending on the gpu RAM size the user has, so perhaps we could poll nvidia-smi and set the bs accordingly?
The problem is that if I want to get the latest changes, and git pull, I have to wipe off all my local overrides, otherwise it’s a hell of a merge operation. And then I need to remember to go and change them again - this is a huge waste of time. So it’d be nice if we could get the bs out of needing be changed manually (other than lesson 1 where it’s on purpose too big to demonstrate the point of bs to gpu ram correspondence).
So in the first few cells, there will be a call:
bs = set_bs_based_on_my_gpu_size('lesson1')
so we will need to have a db of memory requiremetns for each lesson and it’d magically sort it out.
Alternative idea, have each nb start with:
bs = 24 # 8GB
#bs = 48 #12GB
#bs = 100 #21GB
or a dict perhaps, and the user can choose manually quickly rather than re-running the nb again and again and guessing. but of course it can be automated from nvidia-smi info.
Thoughts?