The Register on MSN6mon
Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousandsAs a GPU, the RTX 3090 isn't a bad card for running LLMs ... Backprop's testing was done using relatively short prompts and a ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback