Beyond the "Brute Force Beauty": A Modular, Brain-Inspired LLM Architecture (Thoughts on grand models: Part 2)

Beyond the "Brute Force Beauty": A Modular, Brain-Inspired LLM Architecture — Notes on an attempt to disentangle "intelligence" I. What's the Problem? Current Transformer-based LLMs are powerful, but something feels fundamentally off: Bloated: Hundreds of billions of parameters. Training costs tens of millions of dollars. Not accessible to ordinary people. Black box: Change one parameter and you might affect grammar, semantics, facts, style… no one knows what's happening inside. Context fail...