Hi,
I want to download a Kaggle dataset (RSNA) to Google Cloud. Both the Kaggle API and cget/wcurl result in premature terminated downloads at different points.
It seems like the connection with Google Cloud gets closed at arbitrary time points.
Any tips on how to keep the download going or resume from previous points? The total size is aprox 150 Gb.
Thanks
Other tips on working with ‘large’ datasets and Google Cloud are welcome of course!