The Royal Institution released a recent talk about AI on their YouTube channel. Their world-famous science lectures are aimed at a general audience.
[Neural language models] are all predicated on actually making guesses about
what is going to come next. And that’s why sometimes they fail because they
predict the most likely answer whereas you want a less likely one. But, this
is how they train. They train to come up with what is most likely.