You can also increase data augmentation. Mostly it helps, if that does not help I would consider looking at more data.
1 Like
Shravan Kumar:
Can this cleaning method to apply to only few images with where loss is higher? Becuase if we have million of images it is tedious to clean
There are other methods which employ coreset sampling methods, which identifies a sample of the most diverse data and use it for training.
(actually it adds features like tabs and new editors that weren’t available before lire R and markdown if I remember well)
but basically jupterlab is the new front of the jupyter server, and the notebook is the “format”.
1 Like
This aligns with the concept of data drift and model drift. Seldon has a nice library to identify this.
What do you think about Streamlit? I think they have some kind of cloud hosted dashboards as well. I use it quite often, but they didn’t have cloud until recently.
Personally I felt, Gradio had lesser learning curve than Streamlit, but streamlit has a lot more functionality than former.
2 Likes
Abhishek Sharma
Is it a pickle file? Pytorch is .pth? how is it different?
It has the weights(pth), vocabulary(classes used), and other things used by the learner.
I haven’t checked on this in years but I’m wondering if anyone has deployed their models to a mobile device recently. It used to be a PITA having to convert your pytorch file to ONNX and then to mlmodel.
In fastai is it possible to save model files in pth format rather than using the pickle format?
1 Like
Yes I am also frequent user of streamlit. For quick POVs in office work streamlit is good. Gradio is new to me . Is this gradio better than streamlit?
fastai.model will return a PyTorch model. So you can save it any way you want.
3 Likes
Jeremy spoke about this in the last iteration of the lesson. He recommends hosting the model on the server and accessing the model via api on the mobile device. Idea is the server will have more processing power, and this solution is feasible where internet connectivity is not an issue.
Yes, you can save the model weight seperately.
We use Streamlit in production to evaluate models. Combined with things like altair, matplotlib or bokeh, it becomes quite powerful. Also, I used it to make an app to preview huge DICOM images with sliding window approach. So it is definitely very flexible. At first glance, it feels that Gradio has similar functionality. But maybe more straightforward to use?
5 Likes
On default it will be pth. But you can specify that see learner.export docs here Learner, Metrics, and Basic Callbacks | fastai
2 Likes
The flags look different than those used in nbdev. I don’t remember seeing the pipe operator. Is that something new in nbdev?
5 Likes
I think Jeremy may be using a new version of nbdev which is under development right now…
3 Likes