Are there benchmarks comparing Tgi performance on gpus like the rts 2080ti and amd 6800xt ?

[phoenixtomcat]

I was wondering since there may be small companies that can't get their hands on something as major as the NVidia A100, for example. Has mid-tier to high-tier consumer gpus been tested on this ?

*I'm assuming that the 4090 would be the ideal but not necessarily the most consumer friendly, considering the pricing, PSU requirements, the heat dissipation due to power consumption, etc. As I speak, the cheapest 4090 is out of stock around me and is priced at almost 150% markup because I'm assuming they are toning down to start production of the 5090.