General course chat

#326

Go check that thread. Some common issues already covered.

0 Likes

(Salil Mishra) #327

I was the one who has posted about the problem with metrics not working in create_cnn in that thread.

0 Likes

(EPHRAIM AYEMERE) #328

Hi @jeremy you mentioned in your fireside chat with @isamlambert that you can now have a sort of ‘plug n play’ access to fastai notebooks on GCP.

can you show me how-to in the forum pls? I spend quite tons of hours trying to access the notebook via gcp.

0 Likes

(Bharadwaj Krishnan) #329

I was watching some of the earlier lessons again…based on the image attached(screenshot from lesson 3). Just a random idea…probably already done


In such a scenario, I can imagine that i could have easily added even more epochs in my first attempt. Does it make sense to temporarily save the model after each epoch… so this way, if i end up overfitting, I can just load the model at an earlier epoch cycle instead of training the whole thing again? Wont this save a lot of time? Is this already done? Is it possible?

1 Like

(Jeremy Howard (Admin)) #331

Please refer to the etiquette section in the FAQ.

0 Likes

(Rick N) #332

I posted this in Part1 a few days ago because it fit a topic there:

but I still have no answer. Since Jeremy’s nb’s always have the input prompt numbers cleared, but the cell outputs still there, clearly there’s a way to do this! Somebody please let me in on the secret… :sunglasses:

0 Likes

#333

It’s all done by this script.

2 Likes

Jupyter Notebook Enhancements [Discussion]
(Shaheen Perveen) #334

@fabsta Were you able to resolve this? I am getting PermissionDenied error. I am loading data froma different location than the one in which I have my fastai installed and it is trying to use that folder location to serach for model

0 Likes

(Edward Ross) #335

It makes sense to me and is possible by adding a callback.

One thing to think about is because the learning rate for fit_one_cycle changes over the course of the training fitting 10 epochs and loading the result after 9 will give you a different result than fitting for 9 epochs. No idea which would work better if underfitting (and in fact maybe it’s just better to up the regularization slightly).

1 Like

(Akshay Bhardwaj) #336

Hey Edward,
I have been seeing this with my models and was not sure why this happens. Would you please elaborate on this? As in, if I train my model for 4 + 2 epochs, the training and validation error are quite different than just plainly training for 6 epochs (after seeding everything).

0 Likes

(Bharadwaj Krishnan) #337

good point! makes intuitive sense then to run extra epochs first cycle(overfit) and using saved epochs(using callbacks) for quick testing etc. but for getting lowest error rates(production etc), guess it would always make sense to re-run at / around the epoch cycles where error rates started increasing while overfitting. Is my understanding correct?

0 Likes

(Edward Ross) #338

After running a fit_one_cycle have a look at the learning rate:

one_cycle

It starts off small and goes up to lr_max and then drops quite low.

If you did e.g. 4+2 there would be two cycles like, one taking up the first two thirds of the x-axis and the other taking up the second third.

Now it doesn’t seem likely that’s a good idea as you’ll keep bouncing around, but if you drop the max_lr (so you get smaller and smaller waves) and/or increase the number of epochs you may find a better way to train the model.

1 Like

(Akshay Bhardwaj) #339

Thanks for the explanation. Now it makes some sense to me.

0 Likes

(Dalon Lobo) #340

Hi, Thanks fast.ai and Jeremy for Part 1 of this course. That was great information and inspiring, looking forward to understand it by going through the videos. One question, is there a timeline/tentative on when Part 2 is starting?

0 Likes

(Deena Blumenkrantz) #341

Are the powerpoint slides from each of the class lectures available for download anywhere?
I didn’t see them in the course-v3 repo.

0 Likes

(Chris Oosthuizen) #342

On fitting / training my models I am addicted to watching the bar move and seeing my loss values drop. Wasting so much time doing it. Thinking of starting a support group for other addicted students if anyone is interested. lol. need help.

4 Likes

(Pramoda Sahu) #343

why it is showing this error?

TypeError Traceback (most recent call last)
in ()
----> 1 data = (TabularList.from_df(df, path=path, cat_names=cat_vars, cont_names=cont_vars, procs=procs)
2 .split_by_idx(valid_idx)
3 .label_from_df(cols=dep_var, label_cls=FloatList, log=True)
4 .databunch())

/usr/local/lib/python3.6/dist-packages/fastai/tabular/data.py in from_df(cls, df, cat_names, cont_names, procs, **kwargs)
115 def from_df(cls, df:DataFrame, cat_names:OptStrList=None, cont_names:OptStrList=None, procs=None, **kwargs)->‘ItemList’:
116 “Get the list of inputs in the col of path/csv_name.”
–> 117 return cls(items=range(len(df)), cat_names=cat_names, cont_names=cont_names, procs=procs, xtra=df, **kwargs)
118
119 def get(self, o):

TypeError: object of type ‘method’ has no len()

0 Likes

(Ajay Arasanipalai) #344

Does anyone know when part 2 starts and how to sign up?

0 Likes

(Joseph Catanzarite) #345

Here is the schedule for Deep Learning Part 2:

1 Like

(Ajay Arasanipalai) #346

Oh, thanks. So since it’s starting only in March, the fast.ai live signup will probably begin only next year, right?

1 Like