Personal DL box


#86

The newest thread on windows that jeremy did recently should be pretty mature. I tried to help a bit with it.
Keep in mind that there are some CPU with integrated graphics. You could always use the integrated graphics for display. My setup does not have integrated graphics.

I think NVME helps alot. I created this thread in the hope people would add to it with their setups. While not apples to apples, the ubuntu (on NVME) setup performed much faster than windows(SSD nand?) with all other hardware being equal. It also shows what a 1060 can do with 16GB of system RAM. Quite a bit slower…


(Nikhil B ) #87

Thanks, I’ll keep this forum posted.


(Carlo Mazzaferro) #88

Starting from scratch and this is the setup I’m looking at: https://pcpartpicker.com/list/ZFkRBb

Anyone care to chime in with suggestions? I suppose the first thing would be switching the 1070 TI for 1080 TI but with the current state of GPU prices that will be hard.

The mobo/cpu combo seems a bit pricey too but I couldn’t find a solid motherboard that has 3+ x16 PCIe lanes.


#89

That’s an expensive mobo! NVME ssd would be a great addition. I would probably go for an AMD cpu and would not care much about the GPU lanes. I haven’t done any multi gpu training just yet but if I were assembling a box myself I would go for a single 1080TI (assuming it was within my budget) and maybe add a weaker GPU sometime down the road for experimenting while my main GPU is working on something. And the secondary one would probably be something very small / cheap.


#90

You won’t see 3x16 with your spec’d 28lane CPU, or even with the 40lane cpu. even if you could physically fit the cards in, and they ran full 16, there will still be a bottleneck between the cpu and the pci controller. you will probably be running 2x8 with that setup anyway.


(Carlo Mazzaferro) #91

Well noticed. I suppose focusing on a single higher-end GPU will be much less of a hassle, and given another 8 free PCIe lanes I could still add another one later (seems that the consensus is that 16 vs 8 lanes doesn’t make much of a difference).

Wondering if getting mobos with 2-3 SLI’s would make any difference?


#92

I would go for a single GPU and increase the available RAM. For a new desktop 16gb can be a restriction for some preprocessing / data manipulation tasks. 32 gb would be more “future proof”.


(Robert Salita) #93

Here’s my DL build. I’m delighted with having a dedicated GPU with 11GB. I use the system as a cloud computer using TeamViewer and ngrok. If you’re in USA, France or UK, consider using shadow.tech instead of buying your own system. Their service is, as of now, glitchy but is arguably a better value than buying a $1500+ system.

8700K, 1080Ti, micro-ATX, silent build

My build uses a Intel 900p Optane SSD but I’m frankly unimpressed with the value. An NVME SSD is all you need.


#94

I just started looking into making my own setup. I’ve been doing everything on a mac.

Is the way to go building a box and then accessing it remotely with a laptop? I’m looking to build something close to the little over $500 range Jeremy mentioned. This is the closest I’ve found: https://towardsdatascience.com/build-a-deep-learning-rig-for-800-4434e21a424f
https://pcpartpicker.com/list/dk6RCy
https://pcpartpicker.com/list/xQJVRG

Not sure about the laptop.

Any recommendations?


(Andrea de Luca) #95

I recommend ECC memory, preferably registered, and at least 40 lanes.

No need to spend a fortune. You can buy all the necessary hardware on ebay. Look for Xeon E5 first or second generation.

Useful resource:

My rig:


#96

Ok thanks for the feedback and resources. What about the os for the box and laptop? Do I want to dual boot windows and Ubuntu on the box? And then does the os for the laptop matter?

It sounds like the laptop doesn’t have to be anything special and I can just access the box remotely through ssh or Jupyter and run everything through the box. Is that right?


(adrian) #97

You dont need windows at all unless you need it for a non dl reason. Once you install ubuntu on both laptop and tower, you can use vnc to talk between them, i use tigervnc as it was easiest for me to get working on my setup, tightvnc is popular accros this forum. On the tower you run vncserver to which runs a service on port 5900:0 from memory, then you run a gui on the laptop to display a screen for the tower.

Or as you mention you can run jupyter without vnc too.

I have found rsync super handy for syncing data between two machines.

Another option for your build is second hand.


#98

Ok cool thank you. Just to clarify, the laptop also needs Ubuntu correct? And is second hand just referring to buying used?


(adrian) #99

You could run a windows vnc client to view your ‘server’ linux desktop, so youve got 3 options there (linux/win/dual boot).

Im running linux on all my machines, pretty much only thing i miss is excel plotting (libre office ok but not as good).

Yes used, i wrote a post here (which i linked to somewhere else hidden away in this forum, please forgive the cross-post) with a bit more info on budget builds at the end of the post.


(Andrea de Luca) #100

If you have time to spare, let us know how you managed to use *vnc securely across the internet. Did you do a vpn? Thanks!


#101

ok so this is where I’m at (let me know if it sounds right or wrong):

Desktop:
cpu- i5 or Xenon E5
motherboard- https://www.newegg.com/Product/Product.aspx?Item=N82E16813130978&cm_re=motherboards_for_i7--13-130-978--Product
(not sure how many lanes it has)
gpu- 1060 or 1070 or ti’s
ram- min. 8gb hopefully 16 or 32 with ECC
power- min. 500 watts
storage- small SSD, large HDD

Laptop for remote access:
not sure if it needs any sort of requirements

os:
lets say I dual boot both the desktop and laptop with windows and ubuntu (could a mac with ubuntu work?)

and I can use ssh, jupyter notebook, or a vnc client to access the desktop remotely with the laptop and run all of the deep learning through the desktop

any thoughts/changes/recommendations?


#102

this is what ive found:

i havent looked for anything used yet except for some i5’s on newegg: https://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100007671%20600030234%20600030236%20600005685%20600005686%204017%204025%204026%204027%20601295136%20601295121%20601295120%20600005579&IsNodeId=1&Description=intel&bop=And&Order=PRICE&PageSize=96

not sure if theyre worth getting instead. any thoughts?


(adrian) #103

I wouldn’t put together a xeon based build for a first dl box unless you’ve built some machines before, - unless you find a workstation that is ridiculously cheap. Takes a bit (or a lot) more research and less people using them, plus xeon motherboards can be non ATX form factor and may not fit in a standard case.

I’m no expert but the MB you mention above looks decent - PCI Express lanes are listed by your CPU and will be a max of 24 for Z270 chipset, The motherboard you mention then can utilize these lanes in following config.: 1 GPU at x16 PCIe 3 mode or 2 GPU’s at x8 PCIe 3 mode.

Something worth doing is use pcpartpicker and look at DL builds at a reasonable price and copy the builds that have commonalities.

Use pcpartpicker to give you an indication of power consumption of the build then add 100W for safety, I’d err on the side of caution and have some spare power capacity to draw up - I think I read somewhere PSU’s are more efficient at <80% load but not 100% sure on this. I just saw above you found a 650W PSU for a great price.

ECC ram may be trickier to find a MB that allows this, if you are doing research/commercial products and need <<1% RAM failure rate and really want reproducability of your experiments/stability then go for it - most home Deep Learning builds I’ve seen (me included) just use standard consumer RAM which is easier to come by and I think cheaper.


#104

i spoke with someone from nvidia today and told them what i was trying to do. they recommended that motherboard for the 1070 and said to have minimum 500w for the PSU. pcparts says the setup is a little over 300w. nvidia also gave me this link: https://www.geforce.com/hardware/desktop-gpus/geforce-gtx-1070/specifications
it looks like it has a lot of specifics about their gpu’s and tech.


(adrian) #105

I was thinking about this while making a cup of tea and have revised, my post, mid range PSU’s are relatively cheap, may as well just get one big enough so as not to worry about it. Have fun with the build.

Just a thought, but why do you need the laptop as well, will the desktop be located in a difficult/sub optimal place to work at?