Notes on technology, consciousness, and the space between.https://sjdhome.com/https://sjdhome.com/posts/llms-and-information-entropy/https://sjdhome.com/posts/llms-and-information-entropy/A perspective on LLMs through the lens of information theory: compression, transcription, completion, hallucination, and why feedback loops matter more than stronger generation.Sat, 13 Jun 2026 00:00:00 GMTllminformation-theorycontext-engineeringagentshallucination