Hi Everyone! Today I made a tutorial walkthrough on how to make a simple NumPy DataLoader (based on the same one from the article I wrote a mont ago). In it, I show how to preprocess with TabularPandas and then from there build a custom dataset and use the fastai
DataLoader to speed up and simplify grabbing the data!
Video and Notebook:
Now your first question may be if this worked, why not a PR? This is more advanced and presumes you know what you’re expecting to do with your data, we take the training wheels off!
Along with this, I decided to make this a general discussion thread on preparing at the
DataLoader level specifically and to give us all a general platform thread to discuss ideas!
Finally, if you all enjoyed this and found it useful, I can look into possibly doing something similar for a
TfmdDL for Vision or Text, let me know!