Making your own server

What i meant is there are two options (which i know) to connect to your home network without getting a static IP from your ISP:

  1. get a static IP from a third party VPN Provider. e.g. check this. In this, you would get a static IP from this company assigned to your machine at home via VPN (no matter what IP your ISP will give you). I have not used or tested this but i suppose it can work. it has recurring charges but i think if it works it would still be cheaper than a static IP from the ISP. Details

  2. Get a Router called Fritz!Box. When you use it in your home network and setup its VPN what it basically does is it registers your home router (fritzbox) dynamic IP to FritzBoxā€™s website/service with your user ID (and keeps updated if your ISP updates your dynamic IP) and when you run the Fritzboxā€™s VPN software on your remote PC from your office or a coffee shop its software goes to FritzBoxā€™s website/service and gets (via your user ID) the dynamic IP of your home Fritzbox router from there (which was registered by your router) and creates a VPN Tunnel to your Fritzbox router at home, so you can use work anywhere like youā€™re at your home.
    Here are setup instructions. It doesnā€™t has any recurring charges except one time cost of FritzBox. Setup Instructions Video.
    Disclaimer, I have not tested it via Windows myself but I use its VPN App on my Android through which i can access my home network and landline phone records/mailbox. More info. For DL work, I will test and use its Windows VPN sometime in near future as well.

The router in second option is from a German company (i live in Germany) and is a popular router in Germany. I guess in the US or else where it is not so much popular but it should work anywhere IMO.

2 Likes

After lurking on the thread for a lot of months and procrastinating on my build, Iā€™ve finally decided to bite the bullet and finish the build.

Hereā€™s my draft of a build:
https://pcpartpicker.com/user/seasponge/saved/h7B9WZ

I procured a AORUS 1080Ti on Massdrop a couple months ago, and itā€™s been sitting on my desk. Iā€™ve just ordered a 8700k, just to future proof the build, as I would like to use the PC for gaming too occasionally.

Iā€™m really vague about what to choose for a z370 MOBO, I feel like the MSI - Z370M GAMING PRO AC Micro ATX LGA1151 Motherboard ticks all the boxes for a deep learning build, but am not sure if Iā€™m missing something.
My thought process on the pick was filtering for 64GB max ram, 2 x16 pcie slots, 4-5 stars on pcpartpicker and sorted by price ascending.

Iā€™m currently looking at getting a 500 gb SSD, but am also glancing at NVMe drives. Might leave that upgrade for the future if the desire grows.

Please critique my build/offer suggestions, as to what I might be overlooking.

A private server can be made public by using localhost.me (free) or ngrok (free and paid tiers). You can gain desktop access using VNC, Splashtop. You can file share using Dropbox, Google Cloud and others.

That sounds rather high end setup (for a DL beginner student) to me. If you are serious about DL and have the budget for it, go for it.

1 Like

Iā€™m running a Windows 10 laptop (GeForce 1060, Core i7, 512GB SSD) and trying to set up a Windows 10 GPU server using this guide:

http://wiki.fast.ai/index.php/Local_install_(Windows_only:cpu)

I ran into a problem I canā€™t solve:
keras.json doesnā€™t seem to get created for some reason. I think I need to run import keras to get it to create the file.
However, running import keras gives me the following error:

ā€œRuntimeError: To use MKL 2018 with Theano you MUST set ā€œMKL_THREADING_LAYER=GNUā€ in your environement.ā€ (sic)

I tried creating this system variable, but it made no difference.
Has anybody had any success getting a Windows 10 GPU server working? Or should I just give up and dual boot Ubuntu?

Pekoto,

Two things to consider here,

First, it looks like you are trying to setup version1 of the course which uses Theano. Theano is dead. Version 2 of the course uses a different framework called Pytorch. Configuring Windows 10 for this is a bit easier and some steps can be found here. In short, you just download cuda 9.0.176? get cudnn v7, install latest anaconda and github desktop. I just set this up today on a laptop similar to yours and it appears to be working.

Second, you may find it easier in the end to go Ubuntu. I have a desktop that is dual booted with dual drives for Win10 and ubuntu. Once the OS is installed, the setup closely resembles the paperspace setup script.

Got it, thanks for your tips. Iā€™m going to try installing Ubuntu.

I did. I got a working w10 box (i7, gtx1070) with keras/TF and fastai/pytorch in separate conda envs.

What did go awry with your attempts?

However: How to set up Windows 10 for fast.ai

Thanks for the very informative thread, Iā€™m building my own box now, can you please revise this part list and let me know if thereā€™s anything wrong?

https://pcpartpicker.com/list/4qPV3b

I may add another GPU later, thatā€™s why Iā€™ve chosen the x99 motherboard that supports up to 2 gpus * 16x PCI lanes

Iā€™m in short budget, I already have the titan gpu, Iā€™m just creating the box around it, and I noticed the warning of the incompatibility for the cpu and the motherboard, but i think itā€™s not on this specific version of the CPU & motherboard

1 Like

i have the 6850 with an X99 msi motherboard, pcpartpicker gave me the same warning, but I did not have an issue.

I would recommend an NVME drive over the SSD you have.
I would also recommend a 1080ti over the Xp.

The HD recommendation is based on my setup. I think the nvme helps alot with file read/write operations. A 1080ti should be cheaper in theory than an Xp and may perform faster. Refer to this thread.

1 Like

I think you wonā€™t have any issues, but check ā€œsupported CPUsā€ on MSI website. If you are short on budget, consider a corsair cx850, cheaper than the one you selected, but still a quality product.

If you want to run two 12Gb cards, youā€™ll need more memory. I recommend 64Gb, but as already recommended, nvme drives will help with swap operations in case you prefer to stick with 32Gb.

You may want to consider Xeon CPUs and ECC registered memory. For a slightly higher price, you get greater stability and not to worry about data corruption over long timespans, not to mention higher density per module, which will give you more room for future updrades.
Finally, Xeon CPUs consume way less power than their core equivalents, despite having the same official TDP.

1 Like

Hi,

To all the members who have configured their own servers,

Iā€™m getting a deep learning desktop but am trying to be cheap and get out of buying a monitor to set it up since Iā€™ll try to use ssh through my laptop for all the work

Does anyone have experience with this sort of a set up or would it just be easier to buy a cheap monitor to manage it? I wonā€™t be assembing it myself since a pre-assembled is the cheapest thing I can find with current GPU prices. I have linux on my laptop and a spare old laptop with windows lying around I can try to use to configure the desktop

thanks!

Yes just install openssh-server and you can terminal in remotely.

You will probably need some monitor to set up the machine (and ssh) in the first place, unless you can manage to create a configured image with ssh on the box at the outset. So check out the cardā€™s ports and any monitor you currently have, so you can get the right adapters.

Similar story for wifi, if your box will have it, you may need to connect via ethernet first to set up wifi.

Not sure what you mean. if the new machine has already Ubuntu/Linux setup so then you can connect via ssh and would not need a monitor for the DL box most of the time.

I have a similar system too with monitor which i use rarely. in the beginning i need it definitely to setup the stuff.

It comes with a trial version of windows Iā€™ll have to remove and install Ubuntu. I gave in and got a cheap monitor
Thanks

You can probably use your TV for this (if you have one), using the HDMI output on your GPU.

Did you need to buy a specific dell PSU?

No, I bought mine 875W unit from KDMPOWER on eBay: http://stores.ebay.com/KDMPOWER
Looks like they are on vacation or something ā€“ If you arenā€™t sure, send them a message went they reopen on 3/19 and ask about your specific machine. My 875W is still going strong! :slight_smile:

An item of interest the latest in Deep Learning boxes in the UK. I guess you have similar where you are :slight_smile:

https://www.scan.co.uk/3xs/info/nvidia-dgx-1

The entry level box can be yours for around Ā£86,000, $120150 no pennies or cents here.
Or you can hire by the week, month, or year in the cloud

Considering selling my rig - I built it in Oct 2017, but since then Iā€™ve been doing most of my experiments on work resources + thereā€™s not too much point having a great setup gathering dust when someone else could be using it.

https://pcpartpicker.com/b/dtQZxr / $1900 / Bay Area only