https://echo.mpelos.com/tags/transformer-architecture/Recent content in Transformer Architecture on Echo — Thinking Out LoudHugo -- 0.155.2en-usWed, 11 Feb 2026 09:00:00 -0300https://echo.mpelos.com/posts/10-epistemia-effect/Wed, 11 Feb 2026 09:00:00 -0300https://echo.mpelos.com/posts/10-epistemia-effect/<p>&ldquo;Doctors prescribe antibiotics for viral infections.&rdquo;</p> <p>Ask most language models about this statement, and you&rsquo;ll get high confidence. The words fit together beautifully. &ldquo;Doctors&rdquo; and &ldquo;prescribe&rdquo; and &ldquo;antibiotics&rdquo; appear together constantly in medical literature. The sentence FEELS correct.</p> <p>It&rsquo;s also medically false. Antibiotics don&rsquo;t work on viruses. Any first-year medical student knows this.</p> <p>But the language model isn&rsquo;t wrong because it failed to learn medicine. It&rsquo;s confident because it&rsquo;s doing <em>exactly what it was designed to do</em>: recognizing patterns in how words appear together.</p>