Architecture

2026-10-22 / 26 words

• Mixture-of-Experts (MoE) LLMs
• Attention Wasn't All We Needed
• The Big LLM Architecture Comparison
• From GPT-2 to gpt-oss: Analyzing the Architectural Advances
• Beyond Standard LLMs
• Spotlight Memory