Making your own server


#538

i have the 6850 with an X99 msi motherboard, pcpartpicker gave me the same warning, but I did not have an issue.

I would recommend an NVME drive over the SSD you have.
I would also recommend a 1080ti over the Xp.

The HD recommendation is based on my setup. I think the nvme helps alot with file read/write operations. A 1080ti should be cheaper in theory than an Xp and may perform faster. Refer to this thread.


(Andrea de Luca) #539

I think you won’t have any issues, but check “supported CPUs” on MSI website. If you are short on budget, consider a corsair cx850, cheaper than the one you selected, but still a quality product.

If you want to run two 12Gb cards, you’ll need more memory. I recommend 64Gb, but as already recommended, nvme drives will help with swap operations in case you prefer to stick with 32Gb.

You may want to consider Xeon CPUs and ECC registered memory. For a slightly higher price, you get greater stability and not to worry about data corruption over long timespans, not to mention higher density per module, which will give you more room for future updrades.
Finally, Xeon CPUs consume way less power than their core equivalents, despite having the same official TDP.


(kanishkd4@gmail.com) #540

Hi,

To all the members who have configured their own servers,

I’m getting a deep learning desktop but am trying to be cheap and get out of buying a monitor to set it up since I’ll try to use ssh through my laptop for all the work

Does anyone have experience with this sort of a set up or would it just be easier to buy a cheap monitor to manage it? I won’t be assembing it myself since a pre-assembled is the cheapest thing I can find with current GPU prices. I have linux on my laptop and a spare old laptop with windows lying around I can try to use to configure the desktop

thanks!


(RobG) #541

Yes just install openssh-server and you can terminal in remotely.

You will probably need some monitor to set up the machine (and ssh) in the first place, unless you can manage to create a configured image with ssh on the box at the outset. So check out the card’s ports and any monitor you currently have, so you can get the right adapters.

Similar story for wifi, if your box will have it, you may need to connect via ethernet first to set up wifi.


(Cynosure) #542

Not sure what you mean. if the new machine has already Ubuntu/Linux setup so then you can connect via ssh and would not need a monitor for the DL box most of the time.

I have a similar system too with monitor which i use rarely. in the beginning i need it definitely to setup the stuff.


(kanishkd4@gmail.com) #543

It comes with a trial version of windows I’ll have to remove and install Ubuntu. I gave in and got a cheap monitor
Thanks


(Matthijs) #544

You can probably use your TV for this (if you have one), using the HDMI output on your GPU.


(pommier) #545

Did you need to buy a specific dell PSU?


(Christina Young) #546

No, I bought mine 875W unit from KDMPOWER on eBay: http://stores.ebay.com/KDMPOWER
Looks like they are on vacation or something – If you aren’t sure, send them a message went they reopen on 3/19 and ask about your specific machine. My 875W is still going strong! :slight_smile:


#547

An item of interest the latest in Deep Learning boxes in the UK. I guess you have similar where you are :slight_smile:

https://www.scan.co.uk/3xs/info/nvidia-dgx-1

The entry level box can be yours for around £86,000, $120150 no pennies or cents here.
Or you can hire by the week, month, or year in the cloud


(Jon Gold) #548

Considering selling my rig - I built it in Oct 2017, but since then I’ve been doing most of my experiments on work resources + there’s not too much point having a great setup gathering dust when someone else could be using it.

https://pcpartpicker.com/b/dtQZxr / $1900 / Bay Area only


#549

@taewoo

I have real estate to host, available power, and a fiber optic connection on the East Coast United States.

Cost of Electricity is relatively low

We are building our own deep learning rigs and we are mining. We currently have around 40 - 1080Ti GPUs among others. We charge around $95 per kW per month to our mining clients, and I am sure that we can work out something similar for any of your machines. OR we could build you a machine to spec.

Please DM me for more information if you would like to discuss further.


(Pawel) #550

I have serious question - why to build your own PC if you could use cloud serwer?
You have to spend $2000+ for decent build + cost of electricity ~$400/year (in CA) so total cost is around $2500 for hardware that might be outdated next year and you wish to upgrade again = spend more $$$ and time on it.

For $2500 you can get 6250h = 260days of computing power at paperspace or 2777h = 155days on AWS if you choose cheapest options and for bigger tasks you can always hire bigger GPUs.

I am seriously thinking about DL but somehow so far I cannot find any economical reason for building my own server except that great urge in the back of my head: “MINE, ALL IS MINE! LOOK AT ME, I DID IT MYSELF!” :wink:

I will appreciate honest answer.


#551

I will appreciate honest answer.

From renting, you get nothing in the end. From buying, you can still resell your rig after six months - one year - eighteen months for, say, 3/4 - 2/3 - 1/2 of the original cost, all the components still within the 24 months warranty we get in the EU. The consumer market for GPUs has plateaued, in the last couple of years, the best pound-for-pound GPU is still the GTX 1070 with 8 GB RAM, which is and will be more than enough for learning purposes and applied domains usage.


So you want to build a Deep Learning AI computer system?
(Pawel) #552

Thank you for the answer, but if you want to sell it why to buy it at all? Isn’t it better to use dedicated server? In the worst case scenario you will spend the same amount of money on it, ant the most probably much less…

I honestly don’t understand what could be economical reason for building your own DL PL… Since I moved my paperspace to P4000 it is working really smooth.


#553

With $2500 you can build a high end rig with a 1080Ti, so we are looking at a P6000 instead of a P4000, which brings you to 2777h(155days) computing power for $2500. It really depends on your needs, if you’re doing it as a profession, for the long run, your investment starts paying off past the 155th day.

Besides, your own personal DL box gives flexibility of adding more GPU and RAM which is very beneficial where I sometimes run multiple tasks on different GPUs. Plus, judging from experience, moving files between the cloud and your local machine is a daunting process. Not that it’s hard, but it’s not as convenient as I like it do be.


(Andrea de Luca) #554

You can build it with much, much less.

For example, I built mine for less than 500 bucks, plus the cost of the 1080 ti:


(Andrea de Luca) #555

It is a valuable skill by itself. You got to build it to be functional, efficient, having a good price-per-teraflop ratio, and reasonably fault tolerant.

Moreover, you will have total control about what happens inside.


(Pawel) #556

I have build my first PC 20 years ago, so it is nothing new for me…
Actually knowing how much time it can take I decided that it is better to spend this time on self learning and focus on the course instead spending hours on searching for the best possible money/performance build.

Thank you for all the answers!


(Ilie Diacov) #557

I am offering free 1080Ti GPU instances for deep learning.

Sign up at https://dashboard.tensorpad.com/signup

  • The instances have 16GB RAM, 4 CPUs cores and one 1080Ti GPU and you can run multiple instances in parallel.
  • Instances run on JupyterLab
  • You can access the command line and use it as a dedicated server for training
    If you are having any issues launching the free instance, here are the additional instructions: https://www.dropbox.com/s/i5bgpx9g6jfubm7/Guide.pdf?dl=0

Feel free to contact me at diacovilie@gmail.com

Sincerely,
Ilie Diacov