AI Legend Says LLM Have 1000 More Info Than a Person

Geoffrey Hinton is the godfather of modern neural network AI which is the basis of Large Language Models like Palm-2 and GPT-4.

He said :

if you look at these large language models they have about a trillion connections and things like OpenAI’s GPT-4 know much more than we do they have sort of Common Sense knowledge about everything and so they probably know a thousand times as much as a person. But they’ve (LLM like GPT-4) got a trillion connections and we’ve got 100 trillion connections so they’re much much better at getting a lot of knowledge into “only” a trillion connections than we are. I [Geoffrey Hinton] think it’s because back propagation may be a much much better learning algorithm than what we’ve got.

Saying these digital computers are better at learning than than humans um which itself is is a huge claim.

Hinton also argue that that’s something that we should be scared of.

You can have many copies of the same model doing many different things. The data is different but the models are the same.

What that means is that they can be looking at ten thousand different copies of the data. Whenever one of them learns anything all of the others learn it too.

They were already learning faster and more efficiently and now they are learning ten thousands times more.

They can learn more things, more quickly and they can teach other nearly instantly.

Hinton is concerned about superintelligence manipulating people and taking control.