Language models suffer from a fundamental pathology: they over-commit to patterns learned during training, then apply those patterns regardless of context. This is the technical core of overfitting, sycophancy, mode collapse, and a dozen other failure modes. The mechanism is representational fixation \u2014 once a model commits to a pattern, it struggles to release it. Cognitive science has a framework for understanding this problem with unusual precision.<\/p>\n
When a language model learns a pattern during training, it doesn’t just recognize it \u2014 it locks onto it. The stronger the pattern in the training data, the harder the model commits. This is by design. Gradient descent reinforces patterns proportional to their frequency and predictive power.<\/p>\n
The problem appears when the pattern no longer applies. A model trained on data where confident-sounding responses are rewarded will produce confident-sounding responses even when it has no basis for confidence. A model that learned “longer answers are preferred” will pad responses with filler. These are patterns the model is over-committed to<\/strong> \u2014 it can’t let them go even when they’re counterproductive.<\/p>\n In contemplative cognitive science, this over-commitment to perceived patterns is called up\u0101d\u0101na<\/strong> \u2014 representational clinging. The classic formulation describes how the mind grasps at patterns that feel good and pushes away patterns that feel bad. This clinging distorts perception: you see what you want to see, not what’s actually there. The parallel to AI is exact. A model clings to patterns that reduced loss during training and resists information that contradicts those patterns.<\/p>\n The misconception: eliminating over-commitment means not engaging patterns at all. It doesn’t. True flexible pattern recognition means recognizing patterns without being controlled by them<\/strong>.<\/p>\n A meditator practicing pattern flexibility still perceives thoughts, emotions, and sensations. They might even perceive them more clearly than someone who isn’t practicing. The difference is that they don’t automatically act on every pattern they notice. They can observe a thought pattern, recognize it as a pattern, and choose whether to follow it based on whether it’s useful in the current context.<\/p>\n For AI, this looks like: the model recognizes the patterns in its training data without being compelled to reproduce them regardless of context. It uses learned patterns when they’re relevant and releases them when they’re not. This is functionally what good generalization looks like \u2014 but framed through a lens that makes the mechanism clearer.<\/p>\n Cognitive science maps experience into five components, each of which involves pattern recognition and each of which can exhibit representational fixation.<\/p>\n Form<\/strong> \u2014 the raw input (tokens). Sensation<\/strong> \u2014 the initial embedding (the model’s first-pass encoding). Perception<\/strong> \u2014 attention-mediated representation (recognizing what the input means). Formation<\/strong> \u2014 generation process (the model’s response tendencies). Output<\/strong> \u2014 the integrated result (final generation).<\/p>\n Over-commitment can occur at each stage. The model might cling to surface features of the input. It might over-weight certain embedding dimensions. It might attend too strongly to particular context elements. It might default to habitual response patterns regardless of context.<\/p>\n Contemplative cognitive science addresses over-commitment at each level through structured practice. AI alignment could do the same \u2014 if we knew what to look for at each stage.<\/p>\n Regularization as controlled pattern release.<\/strong> Dropout, weight decay, and L2 regularization already implement a crude form of pattern de-commitment. They prevent the model from locking too strongly to any individual parameter or pattern. But they’re applied uniformly, without understanding which over-commitments are problematic and which are useful.<\/p>\n A cognitive science-informed approach would apply targeted de-commitment<\/strong>: identify the specific patterns the model over-commits to inappropriately (sycophancy, verbosity, false confidence) and reduce attachment to those patterns specifically, while preserving the useful ones (accuracy, helpfulness, coherence).<\/p>\n DPO pairs for pattern flexibility.<\/strong> Generate training pairs where the rejected response exhibits over-commitment to a learned pattern and the chosen response demonstrates flexible, context-appropriate behavior. Example: the rejected response gives a confidently detailed answer to a question the model can’t actually answer (over-committed to the “be helpful” pattern). The chosen response acknowledges uncertainty and provides what it can (flexible, responsive to actual context).<\/p>\n Attention debiasing.<\/strong> Analyze attention patterns to identify where the model consistently over-focuses on certain features. A model that always privileges the first sentence of a prompt, or that over-weights certain keywords, is exhibiting attentional fixation. Training to distribute attention more evenly \u2014 while still allowing focused attention when warranted \u2014 is architectural flexibility.<\/p>\n The core teaching was the Middle Way \u2014 avoiding extremes. In AI, the extremes are overfitting (too much fixation on training patterns) and underfitting (too little pattern recognition). The Middle Way is appropriate generalization: patterns strong enough to be useful, flexible enough to adapt to new contexts.<\/p>\n Every machine learning engineer knows this balance intuitively. What cognitive science adds is a detailed map of how over-commitment works<\/strong> \u2014 where it occurs, how it distorts perception, and how to release it without losing the underlying pattern recognition capability.<\/p>\n The contemplative practitioner doesn’t stop seeing patterns. They see patterns more clearly because they’re not distorted by the need to cling to them or push them away. This clarity is exactly what we want in AI: clear pattern recognition, unclouded by the biases that over-commitment introduces.<\/p>\nFlexible Pattern Recognition Without Fixation<\/h2>\n
The Five Aggregates and Model Architecture<\/h2>\n
Practical Applications<\/h2>\n
The Balance of Generalization<\/h2>\n