Large Language Models, Demystified

💻 Computers & the Internet · Lesson 40 of 50 · about 8 minutes

Advertisement

← Akademi · 💻 Computers & the Internet · Lesson 40 of 50 · about 8 min

A large language model is a neural network trained to predict the next piece of text — it reads a prompt as context and outputs, token by token, a continuation shaped by everything it ever saw during training. “Token” is a fragment of word; training means nudging hundreds of billions of connection weights so statistical patterns of language (grammar, facts, styles, structure) end up encoded as numbers. That is the whole recipe: no lookup table, no live internet, no database of answers — a machine that has read so much text it can imitate its shape, and the imitation is often the real thing.

The consequences are predictable and honest to state. Strengths follow from the shape of language: summarising, translating, drafting, explaining, coding — tasks where knowing “what typically comes next in excellent text” is the actual skill. Weaknesses follow too: the model has no fact-checker inside, only probability, so it produces confident nonsense (“hallucination”) when the likeliest-sounding continuation happens to be wrong; it does not know yesterday’s news if it was not in the training data or search tools; and arithmetic is pattern-matching, not a calculator. RAG — retrieval-augmented generation, fetching real documents and feeding them in as context — is how good systems (including this site’s AI Sembang and search answers) bolt grounding onto the generator.

Practical use is a skill called prompting: state the goal, the format and the constraints, give an example when the style matters, and split big asks into steps — the model improves dramatically when told what “good” means. The judgment rule: treat fluent output as a draft from a fast, well-read intern, never a verdict from an oracle; anything checkable should be checked, and this site keeps a search box for exactly that reason.

Key takeaways

  • LLMs predict next tokens from trained patterns — they store style and statistics, not a database
  • Hallucination is probability without a fact-checker; retrieval grounding fixes much of it
  • Prompting = describing “good”; verification stays human

Check yourself

Why can an LLM state a plausible-but-wrong “fact” with total confidence?

Go deeper

Advertisement
Advertisement