For those who run their own AI box, or want to

[mike.moloch (github:aeamaea)]

Thanks @falmerbid , I posted some of my fp16 numbers in this thread below:

Local Server GPU Benchmarks

And just in case anyone’s interested, here are the numbers for a Xeon E5-2665 8C/16t @ 2.40GHz + 64GB DDR3 + 1070ti (Dell T3600). BTW, It did not complain about to_fp16() even though it’s a 1070ti. EDIT: fixed the earlier version with finetune (thanks @FourMoBro !) and added numbers for IMDB. [Screen Shot 2022-04-19 at 3.45.36 PM] [Screen Shot 2022-04-19 at 3.46.07 PM]