๐ŒŽGratuitous Specification

Gratuitous specification is when the specification of a system is extended with information that has no cause; that is, random bits. Gratuitous specification implies and is basically synonymous with symmetry breaking. Even though gratuitous bits are fully random, their introduction in concert with a time evolution operator lawfully constraining probabilities can play a crucial role in the generation of complex phenomena.

quotes about gratuitous specification

stochastic_reality_generation_thread

Next-token *generation* *is* hallucination. Model predicts probabilities, then one outcome is sampled & promoted to the prompt: a mere potentiality updated on like an observation.

when people talk about LLM hallucinations, they mean miscalibrated hallucinations
the act of generating text is hallucinatory. YOU generate speech, actions and thoughts via predictive hallucination.
the only way to eliminate hallucinations is to brick the model (see chatGPT)

You have a probabilistic model, but to participate in reality instead of just passively modeling it, you must output definite actions. The only way is a leap of faith, wavefunction collapse. I'd be surprised if this isn't how we work after physics & AI converged on this solution.

Why did physics and AI converge on this solution? I think it's because it's the simplest way to generate complex phenomena
The model, or physics, or mind, can just encode symmetries
Then (pseudo)randomness can extract endless, gratuitous variety
Notice, temp 0 text usually sucks.

โ€” Janus, Twitter thread

quantum_poetics_quote

This is the principle of quantum poetics. The content of poetry is limited not by the poetโ€™s vocabulary, but by the part of their soul that has not been destroyed by words they have used so far. Physics would be a complete and exhausting classification of everything there is if quantum mechanics were not true. The universe would be trapped in a perfect latticework prison and nothing would ever happen except the relentless ticking of the universeโ€™s clock. ...

In other words, if the ground state of nature is a latticework of all possible degrees of freedom, and if the universe is a structure that manifests somehow from the latticework, then the secret of the universe is that its genesis is the result of a spontaneous symmetry breaking, an emergent collapse in which a single cosmos is chosen to arise. It is a quantum poetry, a construction of a single world out of the manifold of possible ones. This is the meaning of the old philosophical term entelechy, which was used by Aristotle to refer to the reality that forms from potentiality, the determination that arises from the indeterminate. Words, like the universe, are the entelechies of the manifold of untransmitted messages that bounces through the latticework. (And poetry is the constructive process by which someone yearns to project some trace of the impossible totality of the manifold into a single reality, aspiring to capture a glimpse of the world in its totality without tiring its existence by trying to name it.)

โ€” Language Ex Machina