UBB Store

Nvidia CMP-50hx 10GB    local LLM inference card
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
Nvidia CMP-50hx 10GB local LLM inference card
Price: AU $187.64
They were mined on, as exclusive mining GPU’s generally are. But the bearings are all good, replaced fans/bearings on some, so they are all dead quiet. All have been tested under load and perform well.They make a beast of a budget AI machine, I personally run two of these for local inference and get around 30t/s on quen 3.8 27b and 80t/s on quen 3.6 35B A3B. They DO have tensor cores, despite what some people will say online, there’s a lot of mixed information out there, but I can confirm that they in fact do.Happy to send over details on my (heavily optimised for these specific cards) stack, along with all of the information I have found through research and testing of them, it’s quite a fun project.Also happy to answer any questions.

Buy Now