Small LLMs Running on CPU 🤖 Tested `Fijik1.5 2.6B A380M` and `SmallThinker 4B ...

... A600B` recently. For now SmallThinker gives way better results and is mostly coherent for its size, even at Q4 compression. #technology #stemgeeks #stem #lolz

Posted via D.Buzz