V100 or RTX A6000

Hi,
I wanted to train a model with fastai for a somehow long time, and I have two options Nvidia V100 and RTX A6000. I wanted to use RTX A6000 because it has higher memory, and I wanted to train my model with a larger batch size. Also, RTX A6000 is much cheaper. But I was worried about performance and supporting FP16 training.
I am no hardware expert, so I wanted the opinion of you guys.

Thanks :slightly_smiling_face:

Here are some deep learning benchmarks that might be helpful for you:

1 Like

Thank you so much for this post @ilovescience
Sorry if this is somehow a newbie question, but I wanted to use 1A6000.10V instance, and I had some worries about installing packages like fastai and transformer since it uses AMD cpus. Do you think that would be a problem or not.
Also, does A6000 support FP16 for training because As I went through your post, I didn’t notice that.

I found a benchmark that shows fp16 training performance as well:

Using AMD CPUs shouldn’t be a challenge, many people do use AMD CPUs actually. Using AMD GPUs is there more challenging situation since it’s not using CUDA (which is NVIDIA-specific).

1 Like

The latest cards like A100 works well with AMD CPUs as they are the only ones currently supporting the PCIE-4 bus. Intel was also working on something, but it is not publicly available.

1 Like

When it comes to GPU selection, I keep a close eye on this blog post. Detailed advice and regular updates:

1 Like