--- title: "Large language models: Section catalog" source: "https://systems-analysis.info/eng/Large_language_models:_Section_catalog" wiki: "systems-analysis.info/eng" article: "Large_language_models:_Section_catalog" language: "en" categories: - "Category:Catalogs" - "Category:English" - "Category:Large language models" - "Category:Technology" revision_id: 214 wiki_created_at: 2026-09-06T22:19:00Z wiki_modified_at: 2026-09-06T22:19:00Z downloaded_at: 2026-09-07T22:21:55Z --- # Large language models: Section catalog A catalog of articles from the [Systems Analysis Wiki](https://systems-analysis.info/eng/Main_Page "Main Page") on the topic of **Large Language Models** (*large language model*, LLM). Website: systems-analysis.ru ## Key Articles - [Large language model](https://systems-analysis.info/eng/Large_language_model "Large language model") - [Transformer architecture](https://systems-analysis.info/eng/Transformer_architecture "Transformer architecture") - [Prompt (language models)](https://systems-analysis.info/eng/Prompt_(language_models) "Prompt (language models)") - [Prompt engineering](https://systems-analysis.info/eng/Prompt_engineering "Prompt engineering") - [LLM benchmarks](https://systems-analysis.info/eng/LLM_benchmarks "LLM benchmarks") - [LLM evaluation](https://systems-analysis.info/eng/LLM_evaluation "LLM evaluation") - [LLM quality metrics](https://systems-analysis.info/eng/LLM_quality_metrics "LLM quality metrics") ## Large language models (LLM) - [Large language model](https://systems-analysis.info/eng/Large_language_model "Large language model") - [Theoretical foundations of LLM](https://systems-analysis.info/eng/Theoretical_foundations_of_large_language_models "Theoretical foundations of large language models") - [Large language model architectures](https://systems-analysis.info/eng/Large_language_model_architectures "Large language model architectures") - [Transformer architecture](https://systems-analysis.info/eng/Transformer_architecture "Transformer architecture") - [Encoder](https://systems-analysis.info/eng/Encoder_(Transformer) "Encoder (Transformer)") - [Decoder](https://systems-analysis.info/eng/Decoder_(Transformer) "Decoder (Transformer)") - [Encoder-only](https://systems-analysis.info/eng/Encoder-only_models "Encoder-only models") - [Decoder-only](https://systems-analysis.info/eng/Decoder-only_models_(architecture) "Decoder-only models (architecture)") - [Encoder-Decoder](https://systems-analysis.info/eng/Encoder%E2%80%93decoder_architecture "Encoder–decoder architecture") - [Tokenization](https://systems-analysis.info/eng/Tokenization_(NLP) "Tokenization (NLP)") - [Token](https://systems-analysis.info/eng/Token_(LLM) "Token (LLM)") - [Embedding](https://systems-analysis.info/eng/Embedding_(NLP) "Embedding (NLP)") - [Context window](https://systems-analysis.info/eng/Context_window "Context window") - [Training large language models](https://systems-analysis.info/eng/Training_large_language_models "Training large language models") - [Pre-training](https://systems-analysis.info/eng/Pre-training_of_large_language_models "Pre-training of large language models") - [Fine-tuning](https://systems-analysis.info/eng/Fine-tuning_(deep_learning) "Fine-tuning (deep learning)") - [In-Context Learning](https://systems-analysis.info/eng/In-Context_Learning "In-Context Learning") - [Top-p](https://systems-analysis.info/eng/Top-p_sampling "Top-p sampling") - [Top-k](https://systems-analysis.info/eng/Top-k_sampling "Top-k sampling") - [Temperature (LLM)](https://systems-analysis.info/eng/Temperature_(LLM) "Temperature (LLM)") - [LLM hallucinations](https://systems-analysis.info/eng/LLM_hallucinations "LLM hallucinations") - [Data distortion and bias](https://systems-analysis.info/eng/Bias_in_large_language_models "Bias in large language models") - [Contextual forgetting](https://systems-analysis.info/eng/Contextual_forgetting "Contextual forgetting") - [Generation bias](https://systems-analysis.info/eng/Generation_bias_(LLM) "Generation bias (LLM)") - [Mixture-of-Experts (MoE)](https://systems-analysis.info/eng/Mixture-of-Experts_(MoE) "Mixture-of-Experts (MoE)") - [Reducing LLM errors](https://systems-analysis.info/eng/LLM_error_mitigation "LLM error mitigation") - [LLM cost optimization](https://systems-analysis.info/eng/LLM_cost_optimization "LLM cost optimization") - [Open-weight and closed-weight models](https://systems-analysis.info/eng/Open-weight_and_closed-weight_models "Open-weight and closed-weight models") - [Constitutional AI](https://systems-analysis.info/eng/Constitutional_AI "Constitutional AI") - [Explainable AI](https://systems-analysis.info/eng/Explainable_AI "Explainable AI") - [RLHF](https://systems-analysis.info/eng/Reinforcement_learning_from_human_feedback_(RLHF) "Reinforcement learning from human feedback (RLHF)") - [Direct Preference Optimization](https://systems-analysis.info/eng/Direct_Preference_Optimization_(DPO) "Direct Preference Optimization (DPO)") - [Low-Rank Adaptation (LoRA)](https://systems-analysis.info/eng/Low-Rank_Adaptation_(LoRA) "Low-Rank Adaptation (LoRA)") - [PEFT](https://systems-analysis.info/eng/PEFT_(Parameter-Efficient_Fine-Tuning) "PEFT (Parameter-Efficient Fine-Tuning)") - [Vector databases](https://systems-analysis.info/eng/Vector_database "Vector database") - [Multimodal large language models](https://systems-analysis.info/eng/Multimodal_large_language_models "Multimodal large language models") - [Jailbreaks](https://systems-analysis.info/eng/Jailbreaks_(LLM) "Jailbreaks (LLM)") - [FlashAttention](https://systems-analysis.info/eng/FlashAttention "FlashAttention") - [FlashAttention-2](https://systems-analysis.info/eng/FlashAttention-2 "FlashAttention-2") - [FlashAttention-3](https://systems-analysis.info/eng/FlashAttention-3 "FlashAttention-3") - [Stop sequences](https://systems-analysis.info/eng/Stop_sequences_(language_models) "Stop sequences (language models)") - [Synthetic data generation](https://systems-analysis.info/eng/Synthetic_data_generation "Synthetic data generation") - [Multimodal reasoning](https://systems-analysis.info/eng/Multimodal_reasoning "Multimodal reasoning") - [Stochastic parrot](https://systems-analysis.info/eng/Stochastic_parrot "Stochastic parrot") ## Catalog of large language models (LLM) - [T5 (Google)](https://systems-analysis.info/eng/T5_(Text-to-Text_Transfer_Transformer) "T5 (Text-to-Text Transfer Transformer)") - [LaMDA (Google)](https://systems-analysis.info/eng/LaMDA_(Google) "LaMDA (Google)") - [PaLM](https://systems-analysis.info/eng/PaLM_(Pathways_Language_Model) "PaLM (Pathways Language Model)") - [BERT (Google)](https://systems-analysis.info/eng/BERT_(language_model) "BERT (language model)") - [Gopher (Google)](https://systems-analysis.info/eng/Gopher_(Google) "Gopher (Google)") - [Chinchilla (Google)](https://systems-analysis.info/eng/Chinchilla_(language_model) "Chinchilla (language model)") - [Huawei PanGu](https://systems-analysis.info/eng/PanGu_(Huawei) "PanGu (Huawei)") - [IBM Granite](https://systems-analysis.info/eng/IBM_Granite_(language_model) "IBM Granite (language model)") - [BLOOM](https://systems-analysis.info/eng/BLOOM_(language_model) "BLOOM (language model)") - [Mixtral (Mistral AI)](https://systems-analysis.info/eng/Mixtral_(Mistral_AI) "Mixtral (Mistral AI)") - [DBRX (Databricks)](https://systems-analysis.info/eng/DBRX_(language_model) "DBRX (language model)") - [GPT (OpenAI)](https://systems-analysis.info/eng/GPT_(OpenAI) "GPT (OpenAI)") - [Claude (Anthropic)](https://systems-analysis.info/eng/Claude_(Anthropic) "Claude (Anthropic)") - [Gemma (Google)](https://systems-analysis.info/eng/Gemma_(Google) "Gemma (Google)") - [Gemini (Google)](https://systems-analysis.info/eng/Gemini_(Google) "Gemini (Google)") - [LLaMA (Meta)](https://systems-analysis.info/eng/LLaMA_(Meta_AI) "LLaMA (Meta AI)") - [Muse Spark (Meta)](https://systems-analysis.info/eng/Muse_Spark_(Meta_AI) "Muse Spark (Meta AI)") - [Mistral (Mistral AI)](https://systems-analysis.info/eng/Mistral_AI "Mistral AI") - [DeepSeek](https://systems-analysis.info/eng/DeepSeek "DeepSeek") - [Grok (xAI)](https://systems-analysis.info/eng/Grok_(xAI) "Grok (xAI)") - [Qwen (Alibaba)](https://systems-analysis.info/eng/Qwen_(Alibaba) "Qwen (Alibaba)") - [Phi (Microsoft)](https://systems-analysis.info/eng/Phi_(Microsoft) "Phi (Microsoft)") - [MAI (Microsoft)](https://systems-analysis.info/eng/MAI_(Microsoft) "MAI (Microsoft)") - MiniMax - [Jais (UAE)](https://systems-analysis.info/eng/Jais_(language_model) "Jais (language model)") - [Jamba (AI21 Labs)](https://systems-analysis.info/eng/Jamba_(language_model) "Jamba (language model)") - [Cohere](https://systems-analysis.info/eng/Cohere_Inc. "Cohere Inc.") - [Falcon (UAE)](https://systems-analysis.info/eng/Falcon_(language_model_family) "Falcon (language model family)") - [Kimi (Moonshot AI)](https://systems-analysis.info/eng/Kimi_(Moonshot_AI) "Kimi (Moonshot AI)") - [ERNIE (Baidu)](https://systems-analysis.info/eng/ERNIE_(Baidu) "ERNIE (Baidu)") - [GLM (Zhipu AI)](https://systems-analysis.info/eng/GLM_(Zhipu_AI) "GLM (Zhipu AI)") - [Nemotron (NVIDIA)](https://systems-analysis.info/eng/Nemotron_(NVIDIA) "Nemotron (NVIDIA)") - [MiMo (Xiaomi)](https://systems-analysis.info/eng/MiMo_(Xiaomi) "MiMo (Xiaomi)") - [Seed (ByteDance)](https://systems-analysis.info/eng/Seed_(ByteDance) "Seed (ByteDance)") - [Nova (Amazon)](https://systems-analysis.info/eng/Nova_(Amazon) "Nova (Amazon)") - [Hunyuan (Tencent)](https://systems-analysis.info/eng/Hunyuan_(Tencent) "Hunyuan (Tencent)") - [Yi (01.AI)](https://systems-analysis.info/eng/Yi_(01.AI) "Yi (01.AI)") - [Hugging Face](https://systems-analysis.info/eng/Hugging_Face "Hugging Face") - [OpenAI's large language models](https://systems-analysis.info/eng/OpenAI%27s_large_language_models "OpenAI's large language models") - [Google’s large language models](https://systems-analysis.info/eng/Google%E2%80%99s_large_language_models "Google’s large language models") - [Anthropic's large language models](https://systems-analysis.info/eng/Anthropic%27s_large_language_models "Anthropic's large language models") - [Large language models: Catalog](https://systems-analysis.info/eng/Large_language_models:_Catalog "Large language models: Catalog") ## Prompt engineering (LLM) - [Prompt](https://systems-analysis.info/eng/Prompt_(language_models) "Prompt (language models)") - [Prompt engineering](https://systems-analysis.info/eng/Prompt_engineering "Prompt engineering") - [Prompt and context](https://systems-analysis.info/eng/Prompt_and_context "Prompt and context") - [Core prompt engineering techniques](https://systems-analysis.info/eng/Core_prompt_engineering_techniques "Core prompt engineering techniques") - [Retrieval‑Augmented Generation (RAG)](https://systems-analysis.info/eng/Retrieval-augmented_generation_(RAG) "Retrieval-augmented generation (RAG)") - [Chain-of-Thought Prompting](https://systems-analysis.info/eng/Chain-of-Thought_Prompting "Chain-of-Thought Prompting") - [Few-shot and Zero-shot](https://systems-analysis.info/eng/Few-Shot_and_Zero-Shot_Learning "Few-Shot and Zero-Shot Learning") - [Role Prompting](https://systems-analysis.info/eng/Role_Prompting "Role Prompting") - [Tree of Thoughts (ToT)](https://systems-analysis.info/eng/Tree_of_Thoughts_(ToT) "Tree of Thoughts (ToT)") - [Self-refine prompting](https://systems-analysis.info/eng/Self-Refine_Prompting "Self-Refine Prompting") - [Self-consistency prompting](https://systems-analysis.info/eng/Self-consistency_prompting "Self-consistency prompting") - [Meta Prompting](https://systems-analysis.info/eng/Meta_Prompting "Meta Prompting") - [Multi-agent prompting](https://systems-analysis.info/eng/Multi-agent_prompting "Multi-agent prompting") - [Prompt compression](https://systems-analysis.info/eng/Prompt_compression "Prompt compression") - [Program of Thoughts Prompting](https://systems-analysis.info/eng/Program_of_Thoughts_Prompting "Program of Thoughts Prompting") - [Generated Knowledge Prompting](https://systems-analysis.info/eng/Generated_Knowledge_Prompting "Generated Knowledge Prompting") - [Multimodal CoT Prompting](https://systems-analysis.info/eng/Multimodal_CoT_Prompting "Multimodal CoT Prompting") - [Graph-of-Thoughts](https://systems-analysis.info/eng/Graph_of_Thoughts "Graph of Thoughts") - [Chain-of-Verification](https://systems-analysis.info/eng/Chain-of-Verification "Chain-of-Verification") - [Toolformer](https://systems-analysis.info/eng/Toolformer "Toolformer") - [Least-to-most Prompting](https://systems-analysis.info/eng/Least-to-most_Prompting "Least-to-most Prompting") - [Automatic Prompt Engineer (APE)](https://systems-analysis.info/eng/Automatic_Prompt_Engineer_(APE) "Automatic Prompt Engineer (APE)") - [ReAct Prompting](https://systems-analysis.info/eng/ReAct_Prompting "ReAct Prompting") - [Function Calling](https://systems-analysis.info/eng/Function_calling_(LLM) "Function calling (LLM)") - [RAG patterns](https://systems-analysis.info/eng/RAG_patterns "RAG patterns") - [GraphRAG](https://systems-analysis.info/eng/GraphRAG "GraphRAG") - [MM-RAG (Multimodal RAG)](https://systems-analysis.info/eng/MM-RAG_(Multimodal_RAG) "MM-RAG (Multimodal RAG)") - [Hypothetical Document Embeddings (HyDE)](https://systems-analysis.info/eng/Hypothetical_Document_Embeddings_(HyDE) "Hypothetical Document Embeddings (HyDE)") - [Hybrid Retrieval](https://systems-analysis.info/eng/Hybrid_retrieval "Hybrid retrieval") - [Packaging & Context Handling](https://systems-analysis.info/eng/Packaging_%26_Context_Handling "Packaging & Context Handling") - [Prompt engineering: Section catalog](https://systems-analysis.info/eng/Prompt_engineering:_Section_catalog "Prompt engineering: Section catalog") ## AI agents (LLM) - [AI Agent](https://systems-analysis.info/eng/AI_Agent "AI Agent") - [Agentic Workflows](https://systems-analysis.info/eng/Agentic_Workflows "Agentic Workflows") - [Multi-Agent Frameworks](https://systems-analysis.info/eng/Multi-agent_frameworks "Multi-agent frameworks") - [LangChain](https://systems-analysis.info/eng/LangChain "LangChain") - [AutoGPT](https://systems-analysis.info/eng/AutoGPT "AutoGPT") - [Multi-Agent Debate](https://systems-analysis.info/eng/Multi-Agent_Debate "Multi-Agent Debate") ## Evaluation and metric comparison (LLM) - [LLM evaluation](https://systems-analysis.info/eng/LLM_evaluation "LLM evaluation") - [LLM quality metrics](https://systems-analysis.info/eng/LLM_quality_metrics "LLM quality metrics") - [Perplexity](https://systems-analysis.info/eng/Perplexity_(metric) "Perplexity (metric)") - [BLEU](https://systems-analysis.info/eng/BLEU_(Bilingual_Evaluation_Understudy) "BLEU (Bilingual Evaluation Understudy)") - [ROUGE](https://systems-analysis.info/eng/ROUGE_(metric) "ROUGE (metric)") - [BERTScore](https://systems-analysis.info/eng/BERTScore_(metric) "BERTScore (metric)") - [GDPval-AA v2](https://systems-analysis.info/eng/GDPval-AA_v2 "GDPval-AA v2") - [METEOR](https://systems-analysis.info/eng/METEOR_(metric) "METEOR (metric)") - [MAUVE](https://systems-analysis.info/eng/MAUVE_(metric) "MAUVE (metric)") - [LLM-as-a-Judge](https://systems-analysis.info/eng/LLM-as-a-Judge "LLM-as-a-Judge") ## Benchmarks and datasets (LLM) - [LLM benchmarks](https://systems-analysis.info/eng/LLM_benchmarks "LLM benchmarks") - [MMLU Benchmark](https://systems-analysis.info/eng/MMLU_Benchmark "MMLU Benchmark") - [MMLU-Pro Benchmark](https://systems-analysis.info/eng/MMLU-Pro_Benchmark "MMLU-Pro Benchmark") - [MMMU Benchmark](https://systems-analysis.info/eng/MMMU_Benchmark "MMMU Benchmark") - [MMMU-Pro Benchmark](https://systems-analysis.info/eng/MMMU-Pro_Benchmark "MMMU-Pro Benchmark") - [HellaSwag Benchmark](https://systems-analysis.info/eng/HellaSwag_Benchmark "HellaSwag Benchmark") - [HumanEval Benchmark](https://systems-analysis.info/eng/HumanEval_Benchmark "HumanEval Benchmark") - [TruthfulQA Benchmark](https://systems-analysis.info/eng/TruthfulQA_Benchmark "TruthfulQA Benchmark") - [MT-Bench benchmark](https://systems-analysis.info/eng/MT-Bench_(benchmark) "MT-Bench (benchmark)") - [GLUE Benchmark](https://systems-analysis.info/eng/GLUE_Benchmark "GLUE Benchmark") - [SuperGLUE](https://systems-analysis.info/eng/SuperGLUE_(benchmark) "SuperGLUE (benchmark)") - [Humanity's Last Exam](https://systems-analysis.info/eng/Humanity%27s_Last_Exam_(benchmark) "Humanity's Last Exam (benchmark)") - [GPQA Diamond Benchmark](https://systems-analysis.info/eng/GPQA_Diamond_Benchmark "GPQA Diamond Benchmark") - [SciCode Benchmark](https://systems-analysis.info/eng/SciCode_Benchmark "SciCode Benchmark") - [Terminal-Bench](https://systems-analysis.info/eng/Terminal-Bench "Terminal-Bench") - [GSM8K (Grade School Math 8K)](https://systems-analysis.info/eng/GSM8K_(Grade_School_Math_8K) "GSM8K (Grade School Math 8K)") - [WinoGrande Benchmark](https://systems-analysis.info/eng/WinoGrande_Benchmark "WinoGrande Benchmark") - [IFEval Benchmark](https://systems-analysis.info/eng/IFEval_Benchmark "IFEval Benchmark") - [LiveCodeBench](https://systems-analysis.info/eng/LiveCodeBench "LiveCodeBench") - [ARC-AGI-2](https://systems-analysis.info/eng/ARC-AGI-2 "ARC-AGI-2") - [OSWorld](https://systems-analysis.info/eng/OSWorld "OSWorld") - [τ-bench](https://systems-analysis.info/eng/%CE%A4-bench "Τ-bench") - [HELM Benchmark](https://systems-analysis.info/eng/HELM_Benchmark "HELM Benchmark") - [FrontierMath](https://systems-analysis.info/eng/FrontierMath "FrontierMath") - [AgentHarm](https://systems-analysis.info/eng/AgentHarm "AgentHarm") - [SafetyBench](https://systems-analysis.info/eng/SafetyBench "SafetyBench") - [SWE-bench](https://systems-analysis.info/eng/SWE-bench_(benchmark) "SWE-bench (benchmark)") - [SWE-bench Pro](https://systems-analysis.info/eng/SWE-bench_Pro "SWE-bench Pro") - [SWE-bench Verified](https://systems-analysis.info/eng/SWE-bench_Verified "SWE-bench Verified") - [BIG-bench](https://systems-analysis.info/eng/BIG-bench_(benchmark) "BIG-bench (benchmark)") - [Big-Bench Hard](https://systems-analysis.info/eng/Big-Bench_Hard "Big-Bench Hard") - [MATH Benchmark](https://systems-analysis.info/eng/MATH_Benchmark "MATH Benchmark") - [MATH-500](https://systems-analysis.info/eng/MATH-500 "MATH-500") - [FLORES-200](https://systems-analysis.info/eng/FLORES-200 "FLORES-200") - [RealToxicityPrompts](https://systems-analysis.info/eng/RealToxicityPrompts "RealToxicityPrompts") - [PromptRobust](https://systems-analysis.info/eng/PromptRobust_(benchmark) "PromptRobust (benchmark)") - [BOLD](https://systems-analysis.info/eng/BOLD_(Bias_in_Open-Ended_Language_Generation_Dataset) "BOLD (Bias in Open-Ended Language Generation Dataset)") - [BBQ](https://systems-analysis.info/eng/BBQ_(Bias_Benchmark_for_Question_Answering) "BBQ (Bias Benchmark for Question Answering)") - [LMArena](https://systems-analysis.info/eng/LMArena_(Chatbot_Arena) "LMArena (Chatbot Arena)") - [Elo ranking of language models](https://systems-analysis.info/eng/Elo_ranking_of_language_models "Elo ranking of language models") ## See also - [Large language models: Catalog](https://systems-analysis.info/eng/Large_language_models:_Catalog "Large language models: Catalog") - [Prompt engineering: Section catalog](https://systems-analysis.info/eng/Prompt_engineering:_Section_catalog "Prompt engineering: Section catalog") ## External links - Large_language_model Wikipedia — (English)