Build your deep learning box: wiki thread

congrats :grinning::grinning::grinning:

Thanks, this looks like a great build!
I’m curious if you’re fully utilizing the features of your MSI Godlike Motherboard? The MSI M5 gaming model looks good for a single video card, I’m considering the tradeoff between cost and future-proofing.

For those of you comfortable waiting on a backordered product, I see 1080ti’s on B&H at pre-crypto-craze prices (750 usd).

Use a 1000W PS for two GTX 1080 GPUs.

I hate cross-posters too, but since this topic is all about building you own machine, learn from my mistake. I built a box with two GTX-1080s that worked fine if you ran each separately with a 750W Platinum PS. But when I ran with pytorch nn.Dataparallel to use both at the same time, my machine crashed and tracking down why it crashed was no fun. Now I know better and you do too, use a 1000W PS if you have two GPUs in your box to avoid these problems.

4 Likes

With command like ‘sudo nvidia-smi -pl 200’, you can limit the power consumption of GPU.
(Actually performance doesn’t drop that much with power-limitation.)
I’m not sure whether this can actually fix the issue, but I guess it’s worth trying.

2 Likes

Not acording to ASUS, see this post of mine in a different topic here

1 Like

Wow, thanks!!

Would suggest buying components in the US and bringing to India. Its much cheaper that way. I was able to build my computer rig for 1.1lac (which would have been 1.6lac had I purchased in India)

Write up on the components and prices - https://medium.com/@Stormblessed/building-my-own-deep-learning-rig-for-under-1-lac-in-india-4ade685b8c56

1 Like

The threadripper pcie errors in Linux are fixed by adding pcie_aspm=off to grub. See here PCIe errors

My threadripper system has been 24/7 stable for months, and I am completely satisfied. The platform simply offers a lot more for the money (cores, pcie lanes). The extra CPU cores are not necessary for DL, however they are very useful for other applications (compiling code, simulations, etc…)

With that said, if this is your first build I think you are better off with Intel. As a relatively new platform threadripper requires more tweaks and planning:

  1. Zen v1 is pickier with memory than intel, so I would only buy RAM from the QVL list
  2. If installing Ubuntu 16.04 LTS, you should upgrade to a more modern kernel (4.16) as there are many new drivers and tweaks for the zen platform
  3. The TR4 socket can be a PITA to physically Install

Ryzen v2 was just released and supposedly deals with a lot of the memory issues. Threadripper v2 will be released in August, and is expected to have similar stability and~10% performance improvements.

After getting pretty distracted by a ‘new’ build and looking into watercooling, I’ve written a post here. Soon I’ll be done with the Xeon build and will be able to focus again on some DL work.

With that particular gpu, make sure that you wont need to get a waterblock down the track as you cant seem to get one for this evga gpu (i couldn’t find one)

EVGA has a block for that - https://www.evga.com/products/product.aspx?pn=400-HC-5599-B1 as well as an AIO unit https://www.evga.com/products/product.aspx?pn=400-HY-5598-B1

Or the GPU with AIO https://www.evga.com/products/product.aspx?pn=11G-P4-6598-KR

Good find, I saw that you could get AIO’s but didn’t see that waterblock. The other cards that are a little cheaper than others (at least here in Australia) are the Galax GTX1080ti/1080 EXOC. A bitcoin miner I was speaking to preferred these to Gigabyte GTX1080ti Gaming OC’s as he found the Galax cards run a bit cooler, quieter and have a metal backplate.

Just looking to upgrade my GTX 970, and stumbled across the Zotact GTX 1080 Ti Mini on the Nvidia website. Is there any difference between this and a normal 1080 TI?

Its a 1080ti so just as capable (without overclocking), there are some reviews out there. Just going to be a bit hotter/noisier due to having a smaller surface area for cooling.

I’ve got zotac 1080ti mini, in mini-atx case: works perfectly and the performance is really good. As I understand there’s no performance difference compared to standard 1080ti

Hello, what was you experience with only 6GB of GPU memory?

I am going to order these components:

Any recommendations?

I’m pretty new to this, but what’s the difference between the gigabyte video card on your list and the 1070ti from nvidia’s website/ why is it almost $400 more?

https://www.nvidia.com/en-us/geforce/products/10series/geforce-gtx-1070-ti/

I would make following trade-off:
instead of DDR-3000, buy DDR-2400, you save 200usd
instead of 1070Ti, buy 1080Ti, pay 200usd more

total sum remains the same.

4 Likes