Go talk to Jimmy

I keep on thinking, almost daily too, about how this whole AI craze is going to wind down.

I say wind down, not because I believe AI is going away, but more because things are running hot, and a cycle is a cycle.

In truth, there are plenty of possible scenarios, some more worrying than others, but long term, I think something very close to how the dotcom era matured is how this all works out.

That means, of course, that once again us mortals will eventually be able to afford storage and RAM.

Another reason to keep a positive mind.

With all that said, I keep thinking that AI labs, and more so the ones working on frontier models, are about to make some interesting changes. Some tight turns.

It's common knowledge that local AI models have, until quite recently, been lagging significantly in performance and intelligence, if you will. But that is beginning to shift as well.

Today, however, I found myself watching in awe at someone, a crazy person, I think, who decided to take a really tight turn. A deep adjustment in the course.

You see, most companies are releasing AI computers that cost more than my car.

But this one company decided to flip the whole idea on its head.

What if we put the LLM in the chip?

That's the idea.

That is the question, I'm assuming, the founder must have posed to his friends while sipping his beer.

It would not be upgradable, of course.

But what if that doesn't matter?

What if the performance boost is so brutal that it doesn't matter at all?

The video intrigued me so much that I ended up going to talk to Jimmy.

And you know, when you are done reading this odd post of mine, you should talk to Jimmy too.

Jimmy lives here, and he is running on one of these cards, apparently.

It's basically instant.

I asked it a question about the difference between a tiger and a lion, and it took me longer to press enter than it did for Jimmy to respond correctly.

I'll grant you, it's not a frontier model. It's more of a proof of concept.

But keep in mind the speed.

And then think about the possibilities here.

Obviously, I'm not the only one salivating a bit, since I've also come across a video announcing AMD acquiring this little company.

Seems to me that Taalas is either about to eat everyone's lunch, or someone is going to pull the handbrake on them before they do.

But hey, don't trust my words.

Go talk to Jimmy.

MenO