I noticed @jeremy had a suggestion to buy an cheap (ish) GPU on amazon for 130 dollars. Just curious how the speed of a GPU in this range would compare to one we are getting with the p2 instances?
And, with respect to high-end GPU’s like the Titan X, are they like, twice as fast? 10x as fast?
Is it true that pretty much any decent modern GPU, will beat a modern CPU?
Great question. If you get an Nvidia GPU made in the last 4 years that has at least 4GB of RAM, you’ll be at least 10x faster than a current CPU. And yes, a Titan X is likely to be around twice as fast as a $200 GPU. Although it has much more memory (12GB), so that can mean you can pump much bigger batches through at a time.