Hi, I’m currently working through the lecture series and I have finished with Lesson 2. As part of getting some practice I’ve been experimenting with the introductory Kaggle Titanic competition. This dataset is relatively small so loading data, processing and training does not take a lot of time but with larger datasets and complex problems this will become a bottleneck. What’s a good way to structure my files so that I can run these steps independently of each other with configurations being pulled from external files for better experimentation?
I’ve been following a structure similar to this one : GitHub - khuyentran1401/data-science-template: Template for a data science project, but I’m curious how everyone else in the community has structured their workspaces.