New PCIe AI accelerator promises massive enterprise language models
www.techradar.com
This tiny 240-watt AI card claims hyperscale GPU clusters are suddenly unnecessary for running giant language models

Original Reddit post

Skymizer has unveiled a PCIe AI accelerator that challenges both AMD and Nvidia … using old technology. The HTX301 card can run language models with up to 700 billion parameters on a single device while consuming only 240 watts of power … using older 28-nanometer chips and standard LPDDR4 and LPDDR5 memory instead of expensive HBM or GDDR solutions. submitted by /u/Bob_Spud

Originally posted by u/Bob_Spud on r/ArtificialInteligence