For anyone browsing Links Beat, here is a clear starting point on the subject.
A large language model is a program trained on a very large collection of text to predict which word is likely to come next. By repeating that prediction many times it can write paragraphs, answer questions and summarise documents. It does not look facts up the way a search engine does unless it is connected to one, which is why it can sound confident and still be wrong.