Recommendations on new 2 x RTX 3090 setup

Deep Learning
490

Asus X299 Sage pro ii supports 256gb ram (same as TRX40). I am just more worried about the heat it would dissipate when not using many cores as well ? [Do you think 256gb is also not sufficient ?]? [TR pro 5955 is 280w vs i9 10980xe is 170w, and i9 is on discount for $700 vs 5955 for $1300, but sage pro ii is same as asus creator or wifi]…In case if i decide to go for Threadripper pro 5955 which motherboard would you suggest ?

  1. ASUS WRX80E-SAGE Pro WS SE WIFI AMD sWRX8 eATX Motherboard - Micro Center ($1000)

vs
2) ASRock WRX80 Creator R2.0 AMD sWRX8 eATX Motherboard - Micro Center ($900)

with Threadripper 5955wx ($1300), which one is a better option ?

And how do we use dual supply with 4 gpu (say 2 rtx 4090 and 2 rtx a6000/rtx 6000 ada) which is total 4502+3002+300+100(mobo) = 1900watts [so lets say dual supply of 1500w, will that work ?]?..Bizone does that so i guess its doable ? [ * 4 GPU-Ready for 4x A6000 (advanced case, dual 1200W power supply)][BIZON X4000 Gen3 – AMD Ryzen Threadripper Pro Processors – Export optimized, 8K+ Video Editing, 3D Modeling, Rendering Workstation PC up to 64 Cores | Best Workstation Computer for video editing]

491

Why ECC is a big deal, at-least for research purpose (say on transformer or such deep learning model) ?

492

Or limiting dual rtx 4090 to 300w each with dual rtx a600 work with threadripper pro with 1650w supply ?

493

Have you checked PyTorch2? They did put a lot of new features on the roadmap + encapsulated the best of the older ones into it.

494

@matdmiller , @balnazzar

Any suggestion for the dual power supply (as we have only 120v power supply in USA households). Amazon.com …This guy also talks about how the oc link feature works for dual psu [4x Nvidia RTX 3090 + Threadripper 3960x Build | 15 LAKH PC BUILD | Custom Water Cooling | theMVP - YouTube]…Any comments or suggestions using this for 4 rtx 4090 or 2 rtx 4090 (and 2 rtx a6000) with threadripper 5955 ?

495

Long story short, ECC is a big deal if you want stability. It’s not particularly pertinent to DL. Moreover, registered (buffered) dimms are required if you want >32Gb per module.

As for you other questions, what do you want to do with that machine you plan to build?
Are you aware of the challenges posed by a multi-gpu workstation, particularly if liquid-cooled?
If you have enough money to spend, I think you will be better served by a professionally built solution (e.g. Comino, Lambda, Puget, Byzon, …).

496

There are rumours of a new Titan series card, which will allegedly have 48GB VRAM. If it does get released I assume the overall system cost, whilst high, will be cheaper than 2x4090s and it will be much easier to cool/power etc. Training will be slower though… More info here:

497

Old Thread but I have a question. I have a ASUS ROG Zenith II Extreme Alpha TRX40 as well. I have one FE 3090 in there now. I just purchased a second one. Your GPUs in the photos are installed in the 1st and 4th slots correct? If so, that would require the 4 slot NVLIN bridge, correct?

Thanks

498

Hi Matt, just wanted to quickly come back say to thanks!

Your response helped guide my search for the ideal setup for me. I went for a 13900k, 2x3090 and a Asus z790 proart motherboard. All watercooled with 2x420mm radiators and 1x360mm, just to ensure silence under heavy load. For the case, I’m still waiting for the ideal one that can fit all the rads, but for now using a modded fractal torrent, until lian-li finally start selling the o11d-evoXL. All thats left now is finding the right size nvlink bridge for my board (god knows if i need 3 or 4 slot), and getting up to speed on proxmox and VMs.

Again, thanks for your thorough response, was very much appreciated.

1 Like