This morning I’ve got invoice from google for around 100$ and I’ve almost fallen from my chair…
I’ve used regular instances because preemtibles are currently unusable (the shutdown so often that most of the time it takes 3 to 5 times to start one) and I can’t afford over 100$ per month, because I don’t earn in us dollars. Google predicted usage cost for this month for 400$
My last month usage was GPU for 47hr and 500GB of storage.
What is the most cost effective (cheap, but not really slow) option here? Are there any cloud operators that are affordable? Or is own GPU the only option?
I am thinking about buying 2070, because it is around 500$
If you buy expanded storage from Google Drive (so you have 500+ gb’s), and Colab premium, that should put you at give or take <$30/mo or so, which is what I recommend if you’re trying to stay on a budget
Collab looks like much hassle, I’m a developer I like to have access to terminal LOL
Thanks for your help very much.
I’ve also looked at prices in course docs and I will be using my partner google account for the free 300$ credits and try to setup DL box on my PC in the meantime. If I fail to do that then collab it is.
If it was only for fast.ai I’d be fine, but i’m trying to finish my sideproject which would probably take 72hrs+ to train and experiment.
That makes more sense I thought about the iNaturalist dataset, as it’s something I’d like to work with but with that large of a dataset I agree trying to figure out how to set it up best is rough. Full transparency: when I worked with it I did just use my own local box I built (I didn’t have a 2080, I had a 2060) but having it local let me run it for days on end and only having to worry about the god-awful electrical bill!
Mueller’s is right. Look at this I just ran my colab on my Android phone on the lesson2 fastaiv2. It shows I have P100. Remember, colab pro says if you often idle your colab too long without doing anything, you may have less chance to use p100! https://colab.research.google.com/drive/1Q9rv2JHPvPVry5V3OtlyUyOOsCSUMwFj
How much would you estimate your electricity bill raised? Anything above 50$? And how much epochs did you use? I’m only learning on Plants, but it takes a lot of time anyway.
At this time of this writing you can get an AWS Spot Instance for ~$0.16 per hour for a Nvida T4.
For the $500 that you are looking at spending you can get 3125 hours and that’s 130 days of 24/7 runtime. That spend amount could last a lot longer if you turn off the instance while not using it.
I think that a spot instance might be the way to go being that we are all waiting for an announcement from Nvida to release the next gen. card.
That’s huge numbers on that bill. Is your compute engine online all the time?
Since most of the time I spend in the notebooks I work on code, preparing data, etc. I disable the Compute Engine for my VM (VM->edit, scroll down). Also when uploading data to the VM. I really only enable the CE when running the model. Since the preemptible vm is really cheap, that saves a lot of money.
I thought about the iNaturalist dataset, as it’s something I’d like to work with but with that large of a dataset I agree trying to figure out how to set it up best is rough. Full transparency: when I worked with it I did just use my own local box I built (I didn’t have a 2080, I had a 2060) but having it local let me run it for days on end and only having to worry about the god-awful electrical bill!