This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
start [2024/12/02 05:43] – brad | start [2024/12/13 18:26] (current) – brad | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ===== Large Language Model (LLM) Agents | + | ===== AgentWiki |
- | Welcome to the LLM Agents Wiki, your comprehensive resource for understanding and leveraging Large Language | + | Welcome to the **AgentWiki**, a comprehensive resource for understanding and leveraging Large Language |
+ | Catch up on the latest developments, | ||
==== Introduction ==== | ==== Introduction ==== | ||
- | Large Language Model (LLM) Agents | + | 🤖 Large Language Model (LLM) Agents |
+ | By comprehending | ||
+ | They are capable of planning, executing, and adapting | ||
- | ==== High-Level Topics | + | ==== Agent System Overview |
- | Explore | + | 🧠 In an LLM-powered autonomous agent system, |
- | Planning | + | * **[[planning|Planning]]** |
- | Strategies for task decomposition, | + | * Task Decomposition |
+ | * Self-Reflection | ||
- | Memory | + | * **[[memory|Memory]]** |
- | Hierarchical | + | |
+ | * Efficient Retrieval Mechanisms | ||
- | Tool Use | + | * **[[tool_use|Tool Use]]** |
- | Integration | + | * External API Integration |
+ | * Dynamic Tool Selection | ||
- | Types of LLM Agents | + | * **[[structured_outputs|Structured Outputs]]** |
- | Various agent architectures and their applications. | + | * Grammars |
+ | * Constrained Outputs | ||
- | Design Patterns for LLM Agents | + | 🚀 These components enable the agent to: |
- | Best practices and architectural patterns for building robust agents. | + | |
- | Libraries | + | * **Plan** complex tasks through decomposition |
- | Tools and platforms for developing LLM agents. | + | * **Remember** past interactions using advanced memory architectures. |
+ | * **Utilize | ||
- | Applications | + | ==== Key Features |
- | Real-world use cases across different domains. | + | |
- | Case Studies | + | 🌀 **[[advanced_reasoning_planning|Advanced Reasoning and Planning]]**: |
- | In-depth analyses of specific | + | Employ sophisticated reasoning strategies to analyze complex tasks, devise multi-step plans, and sequence actions to achieve |
- | Challenges | + | 🔧 **[[tool_utilization|Tool Utilization and API Interaction]]**: |
- | Current limitations | + | Interface with external tools, APIs, databases, and services to perform actions such as web searches, code execution, |
- | Recent Developments | + | 📚 **[[hierarchical_memory|Hierarchical Memory and Context Management]]**: |
- | Latest advancements | + | Use multi-level memory architectures to maintain extensive context over interactions, |
- | Getting Started | + | 💡 **[[natural_language_understanding|Natural Language Understanding and Generation]]**: |
- | Resources | + | Interpret and generate human-like text, facilitating effective communication |
- | ==== Tags ==== | + | 🔄 **[[autonomy|Autonomy and Adaptive Behavior]]**: |
+ | Operate independently, | ||
+ | |||
+ | ==== Workflows | ||
+ | |||
+ | Workflows in LLM Agent systems streamline the design, implementation, | ||
+ | |||
+ | 🌊 **Key Workflow Tools** | ||
+ | * **[[flowise|Flowise]]**: | ||
+ | * **[[promptflow|PromptFlow]]**: | ||
+ | |||
+ | These tools enhance the modularity and reusability of task definitions, | ||
+ | |||
+ | ==== Components of LLM Agents ==== | ||
+ | |||
+ | === Planning === | ||
+ | |||
+ | 🧩 Planning involves the strategic breakdown of complex tasks into manageable sub-tasks, devising algorithms, and sequencing actions based on logical reasoning and predicted outcomes. | ||
+ | |||
+ | == Task Decomposition == | ||
+ | |||
+ | 🌳 **[[chain_of_thought|Chain-of-Thought (CoT) Reasoning]]** | ||
+ | 🌲 **[[tree_of_thoughts|Tree of Thoughts]]** | ||
+ | ⚙️ **[[llm_with_planning|LLM+P (LLM with Classical Planning)]]** | ||
+ | |||
+ | == Self-Reflection == | ||
+ | |||
+ | 🔍 **[[react_framework|ReAct (Reasoning and Acting)]]** | ||
+ | 🔄 **[[reflexion_framework|Reflexion Framework]]** | ||
+ | 🪞 **[[chain_of_hindsight|Chain of Hindsight (CoH)]]** | ||
+ | 📉 **[[algorithm_distillation|Algorithm Distillation (AD)]]** | ||
+ | |||
+ | === Memory === | ||
+ | |||
+ | 📦 Memory mechanisms allow agents to retain, retrieve, and utilize information over extended periods, significantly enhancing their ability to maintain context, learn from past experiences, | ||
+ | |||
+ | == Hierarchical Memory Systems == | ||
+ | |||
+ | 🕒 **[[sensory_memory|Sensory Memory]]** | ||
+ | ⏳ **[[short_term_memory|Short-Term Memory (Working Memory)]]** | ||
+ | 📜 **[[long_term_memory|Long-Term Memory (Persistent Memory)]]** | ||
+ | * 📂 **[[explicit_memory|Explicit/ | ||
+ | * 🤫 **[[implicit_memory|Implicit/ | ||
+ | |||
+ | == Efficient Retrieval Mechanisms == | ||
+ | |||
+ | 🔎 **[[maximum_inner_product_search|Maximum Inner Product Search (MIPS)]]** | ||
+ | * 🧮 **[[locality_sensitive_hashing|Locality-Sensitive Hashing (LSH)]]** | ||
+ | * 📊 **[[approximate_nearest_neighbors|Approximate Nearest Neighbors (ANNOY)]]** | ||
+ | * 🗺️ **[[hnsw_graphs|Hierarchical Navigable Small World (HNSW) Graphs]]** | ||
+ | * 🔍 **[[faiss|Facebook AI Similarity Search (FAISS)]]** | ||
+ | * 📈 **[[scann|Scalable Nearest Neighbors (ScaNN)]]** | ||
+ | |||
+ | === Tool Use === | ||
+ | |||
+ | 🔧 Tool use extends the agent' | ||
+ | |||
+ | * 🧰 **[[mrkl_systems|MRKL Systems (Modular Reasoning, Knowledge, and Language)]]** | ||
+ | * 🛠️ **[[tool_augmented_language_models|Tool-Augmented Language Models (TALM)]]** | ||
+ | * 🤖 **[[toolformer|Toolformer]]** | ||
+ | |||
+ | == API Integration == | ||
+ | |||
+ | 🔗 **[[openai_function_calling|OpenAI Function Calling and ChatGPT Plugins]]** | ||
+ | 🔗 **[[hugginggpt|HuggingGPT]]** | ||
+ | 🗂️ **[[api_bank_benchmark|API-Bank Benchmark]]** | ||
+ | |||
+ | ==== Types of LLM Agents ==== | ||
+ | |||
+ | 🧠 **[[chain_of_thought_agents|Chain-of-Thought Agents]]** | ||
+ | 🔄 **[[react_agents|ReAct Agents]]** | ||
+ | 🤖 **[[autonomous_agents|Autonomous Agents]]** | ||
+ | * 🤖 **[[autogpt|AutoGPT]]** | ||
+ | * 🤖 **[[babyagi|BabyAGI]]** | ||
+ | * 🤖 **[[agentgpt|AgentGPT]]** | ||
+ | 📋 **[[plan_and_execute_agents|Plan-and-Execute Agents]]** | ||
+ | 💬 **[[conversational_agents|Conversational Agents]]** | ||
+ | 🔧 **[[tool_using_agents|Tool-Using Agents]]** | ||
+ | |||
+ | ==== Design Patterns for LLM Agents ==== | ||
+ | |||
+ | 🔗 **[[prompt_chaining|Prompt Chaining and Orchestration]]** | ||
+ | 📈 **[[rlhf|Reinforcement Learning from Human Feedback (RLHF)]]** | ||
+ | 🔄 **[[agent_loop|Agent Loop (Perception-Thought-Action Cycle)]]** | ||
+ | 🗂️ **[[context_window_management|Context Window Management]]** | ||
+ | 🔧 **[[tool_integration_patterns|Tool Integration Patterns]]** | ||
+ | 📂 **[[memory_augmentation_strategies|Memory Augmentation Strategies]]** | ||
+ | 🏗️ **[[modular_architectures|Modular and Layered Architectures]]** | ||
+ | |||
+ | ==== Libraries and Frameworks ==== | ||
+ | |||
+ | Explore a range of tools and platforms for developing LLM agents: | ||
+ | |||
+ | **Frameworks & Platforms** | ||
+ | |||
+ | ⚙️ **[[agent_protocol|Agent Protocol]]** | ||
+ | 🤖 **[[anthropic_context_protocol|Anthropic Model Context Protocol]]** | ||
+ | 💻 **[[chatdev|ChatDev]]** | ||
+ | ⚡ **[[bolt_new|Bolt.new]]** | ||
+ | 🔗 **[[flowise|Flowise]]** | ||
+ | 📋 **[[instructor_framework|Instructor]]** | ||
+ | 🔎 **[[llamaindex|LlamaIndex]]** | ||
+ | 🧠 **[[autogpt|AutoGPT]]** | ||
+ | 🤖 **[[babyagi|BabyAGI]]** | ||
+ | 🔗 **[[langroid|Langroid]]** | ||
+ | 📊 **[[microsoft_graphrag|Microsoft GraphRAG]]** | ||
+ | 🌟 **[[lite_llm|LiteLLM]]** | ||
- | {{tag> |