The path to ubiquitous AI | Taalas
taalas.com
By Ljubisa Bajic Many believe AI is the real deal. In narrow domains, it already surpasses human performance. Used well, it is an unprecedented amplifier of human ingenuity and productivity. Its widespread adoption is hindered by two key barriers: high latency and astronomical cost. Interactions with language models lag far...

Original Reddit post

So basically this is a Application Specific Circuit with a hardcoded Llama 3.1 8B on it. It comes with a demo, and it is actually scary fast: https://chatjimmy.ai/ Llama 3.1 is somewhat old now but it probably took some while to design and produce the circuit. submitted by /u/Additional-Bee1379

Originally posted by u/Additional-Bee1379 on r/ArtificialInteligence