Skip to content
sjdhome
Posts Tags Categories RSS

Tag: llm

1 post in this tag.

LLMs and Information Entropy

June 13, 2026 · thoughts

A perspective on LLMs through the lens of information theory: compression, transcription, completion, hallucination, and why feedback loops matter more than stronger generation.

  • llm
  • information-theory
  • context-engineering
  • agents
  • hallucination

© 2023–2026 sjdhome. Content is licensed under CC BY-NC-SA 4.0.