This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
start [2024/12/05 15:13] – brad | start [2024/12/13 18:26] (current) – brad | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ===== Large Language Model (LLM) Agents | + | ===== AgentWiki |
- | Welcome to the **LLM Agents Wiki**, a comprehensive resource for understanding and leveraging Large Language | + | Welcome to the **AgentWiki**, a comprehensive resource for understanding and leveraging Large Language |
+ | Catch up on the latest developments, | ||
==== Introduction ==== | ==== Introduction ==== | ||
- | Large Language Model (LLM) Agents are sophisticated AI systems that utilize large-scale neural language models to perform tasks autonomously. By comprehending natural language, reasoning through complex problems, and interacting with external tools and environments, | + | 🤖 Large Language Model (LLM) Agents are sophisticated AI systems that utilize large-scale neural language models to perform tasks autonomously. |
+ | By comprehending natural language, reasoning through complex problems, and interacting with external tools and environments, | ||
+ | They are capable of planning, executing, and adapting their actions based on given objectives and feedback from their environment. | ||
==== Agent System Overview ==== | ==== Agent System Overview ==== | ||
- | In an LLM-powered autonomous agent system, the LLM functions as the agent' | + | 🧠 In an LLM-powered autonomous agent system, the LLM functions as the agent' |
* **[[planning|Planning]]** | * **[[planning|Planning]]** | ||
- | * Task Decomposition | + | * Task Decomposition |
- | * Self-Reflection | + | * Self-Reflection |
* **[[memory|Memory]]** | * **[[memory|Memory]]** | ||
- | * Hierarchical Memory Systems | + | * Hierarchical Memory Systems |
- | * Efficient Retrieval Mechanisms | + | * Efficient Retrieval Mechanisms |
* **[[tool_use|Tool Use]]** | * **[[tool_use|Tool Use]]** | ||
- | * External API Integration | + | * External API Integration |
- | * Dynamic Tool Selection | + | * Dynamic Tool Selection |
- | These components enable the agent to: | + | * **[[structured_outputs|Structured Outputs]]** |
+ | * Grammars | ||
+ | * Constrained Outputs | ||
- | | + | 🚀 These components enable the agent to: |
- | * **Remember** past interactions using advanced memory architectures. | + | |
+ | | ||
+ | * **Remember** past interactions using advanced memory architectures. | ||
* **Utilize Tools** to extend capabilities beyond text generation. | * **Utilize Tools** to extend capabilities beyond text generation. | ||
==== Key Features of LLM Agents ==== | ==== Key Features of LLM Agents ==== | ||
- | * **[[advanced_reasoning_planning|Advanced Reasoning and Planning]]**: | + | 🌀 **[[advanced_reasoning_planning|Advanced Reasoning and Planning]]**: |
- | | + | Employ sophisticated reasoning strategies to analyze complex tasks, devise multi-step plans, and sequence actions to achieve specific goals. |
- | | + | |
- | | + | 🔧 **[[tool_utilization|Tool Utilization and API Interaction]]**: |
- | | + | Interface with external tools, APIs, databases, and services to perform actions such as web searches, code execution, and data manipulation. |
+ | |||
+ | 📚 **[[hierarchical_memory|Hierarchical Memory and Context Management]]**: | ||
+ | Use multi-level memory architectures to maintain extensive context over interactions, | ||
+ | |||
+ | 💡 **[[natural_language_understanding|Natural Language Understanding and Generation]]**: | ||
+ | Interpret and generate human-like text, facilitating effective communication and instruction following. | ||
+ | |||
+ | 🔄 **[[autonomy|Autonomy and Adaptive Behavior]]**: | ||
+ | Operate independently, | ||
+ | |||
+ | ==== Workflows ==== | ||
+ | |||
+ | Workflows in LLM Agent systems streamline the design, implementation, | ||
+ | |||
+ | 🌊 **Key Workflow Tools** | ||
+ | * **[[flowise|Flowise]]**: | ||
+ | * **[[promptflow|PromptFlow]]**: | ||
+ | |||
+ | These tools enhance the modularity and reusability of task definitions, | ||
==== Components of LLM Agents ==== | ==== Components of LLM Agents ==== | ||
Line 39: | Line 67: | ||
=== Planning === | === Planning === | ||
- | Planning involves the strategic breakdown of complex tasks into manageable sub-tasks, devising algorithms, and sequencing actions based on logical reasoning and predicted outcomes. | + | 🧩 Planning involves the strategic breakdown of complex tasks into manageable sub-tasks, devising algorithms, and sequencing actions based on logical reasoning and predicted outcomes. |
== Task Decomposition == | == Task Decomposition == | ||
- | * **[[chain_of_thought|Chain-of-Thought (CoT) Reasoning]]** | + | 🌳 **[[chain_of_thought|Chain-of-Thought (CoT) Reasoning]]** |
- | | + | 🌲 **[[tree_of_thoughts|Tree of Thoughts]]** |
- | | + | ⚙️ |
== Self-Reflection == | == Self-Reflection == | ||
- | * **[[react_framework|ReAct (Reasoning and Acting)]]** | + | 🔍 **[[react_framework|ReAct (Reasoning and Acting)]]** |
- | * **[[reflexion_framework|Reflexion Framework]]** | + | 🔄 **[[reflexion_framework|Reflexion Framework]]** |
- | | + | 🪞 **[[chain_of_hindsight|Chain of Hindsight (CoH)]]** |
- | | + | 📉 **[[algorithm_distillation|Algorithm Distillation (AD)]]** |
=== Memory === | === Memory === | ||
- | Memory mechanisms allow agents to retain, retrieve, and utilize information over extended periods, significantly enhancing their ability to maintain context, learn from past experiences, | + | 📦 Memory mechanisms allow agents to retain, retrieve, and utilize information over extended periods, significantly enhancing their ability to maintain context, learn from past experiences, |
== Hierarchical Memory Systems == | == Hierarchical Memory Systems == | ||
- | * **[[sensory_memory|Sensory Memory]]** | + | 🕒 **[[sensory_memory|Sensory Memory]]** |
- | | + | ⏳ **[[short_term_memory|Short-Term Memory (Working Memory)]]** |
- | | + | 📜 **[[long_term_memory|Long-Term Memory (Persistent Memory)]]** |
- | * **[[explicit_memory|Explicit/ | + | * 📂 **[[explicit_memory|Explicit/ |
- | * **[[implicit_memory|Implicit/ | + | * 🤫 **[[implicit_memory|Implicit/ |
== Efficient Retrieval Mechanisms == | == Efficient Retrieval Mechanisms == | ||
- | * **[[maximum_inner_product_search|Maximum Inner Product Search (MIPS)]]** | + | 🔎 **[[maximum_inner_product_search|Maximum Inner Product Search (MIPS)]]** |
- | * **[[locality_sensitive_hashing|Locality-Sensitive Hashing (LSH)]]** | + | * 🧮 **[[locality_sensitive_hashing|Locality-Sensitive Hashing (LSH)]]** |
- | * **[[approximate_nearest_neighbors|Approximate Nearest Neighbors (ANNOY)]]** | + | * 📊 **[[approximate_nearest_neighbors|Approximate Nearest Neighbors (ANNOY)]]** |
- | * **[[hnsw_graphs|Hierarchical Navigable Small World (HNSW) Graphs]]** | + | * 🗺️ |
- | * **[[faiss|Facebook AI Similarity Search (FAISS)]]** | + | * 🔍 **[[faiss|Facebook AI Similarity Search (FAISS)]]** |
- | * **[[scann|Scalable Nearest Neighbors (ScaNN)]]** | + | * 📈 **[[scann|Scalable Nearest Neighbors (ScaNN)]]** |
=== Tool Use === | === Tool Use === | ||
- | Tool use extends the agent' | + | 🔧 Tool use extends the agent' |
- | * **[[mrkl_systems|MRKL Systems (Modular Reasoning, Knowledge, and Language)]]** | + | * 🧰 **[[mrkl_systems|MRKL Systems (Modular Reasoning, Knowledge, and Language)]]** |
- | * **[[tool_augmented_language_models|Tool-Augmented Language Models (TALM)]]** | + | * 🛠️ |
- | * **[[toolformer|Toolformer]]** | + | * 🤖 **[[toolformer|Toolformer]]** |
== API Integration == | == API Integration == | ||
- | * **[[openai_function_calling|OpenAI Function Calling and ChatGPT Plugins]]** | + | 🔗 **[[openai_function_calling|OpenAI Function Calling and ChatGPT Plugins]]** |
- | | + | 🔗 **[[hugginggpt|HuggingGPT]]** |
- | | + | 🗂️ |
==== Types of LLM Agents ==== | ==== Types of LLM Agents ==== | ||
- | * **[[chain_of_thought_agents|Chain-of-Thought Agents]]** | + | 🧠 **[[chain_of_thought_agents|Chain-of-Thought Agents]]** |
- | | + | 🔄 **[[react_agents|ReAct Agents]]** |
- | | + | 🤖 **[[autonomous_agents|Autonomous Agents]]** |
- | * **[[autogpt|AutoGPT]]** | + | * 🤖 **[[autogpt|AutoGPT]]** |
- | * **[[babyagi|BabyAGI]]** | + | * 🤖 **[[babyagi|BabyAGI]]** |
- | * **[[agentgpt|AgentGPT]]** | + | * 🤖 **[[agentgpt|AgentGPT]]** |
- | * **[[plan_and_execute_agents|Plan-and-Execute Agents]]** | + | 📋 **[[plan_and_execute_agents|Plan-and-Execute Agents]]** |
- | | + | 💬 **[[conversational_agents|Conversational Agents]]** |
- | | + | 🔧 **[[tool_using_agents|Tool-Using Agents]]** |
==== Design Patterns for LLM Agents ==== | ==== Design Patterns for LLM Agents ==== | ||
- | * **[[prompt_chaining|Prompt Chaining and Orchestration]]** | + | 🔗 **[[prompt_chaining|Prompt Chaining and Orchestration]]** |
- | | + | 📈 **[[rlhf|Reinforcement Learning from Human Feedback (RLHF)]]** |
- | | + | 🔄 **[[agent_loop|Agent Loop (Perception-Thought-Action Cycle)]]** |
- | | + | 🗂️ |
- | | + | 🔧 **[[tool_integration_patterns|Tool Integration Patterns]]** |
- | | + | 📂 **[[memory_augmentation_strategies|Memory Augmentation Strategies]]** |
- | | + | 🏗️ |
==== Libraries and Frameworks ==== | ==== Libraries and Frameworks ==== | ||
Line 117: | Line 145: | ||
**Frameworks & Platforms** | **Frameworks & Platforms** | ||
- | * **[[agent_protocol|Agent Protocol]]** | + | ⚙️ |
- | | + | 🤖 **[[anthropic_context_protocol|Anthropic Model Context Protocol]]** |
- | * **[[chatdev|ChatDev]]** | + | 💻 **[[chatdev|ChatDev]]** |
- | | + | ⚡ **[[bolt_new|Bolt.new]]** |
- | | + | 🔗 **[[flowise|Flowise]]** |
- | | + | 📋 **[[instructor_framework|Instructor]]** |
- | | + | 🔎 **[[llamaindex|LlamaIndex]]** |
- | | + | 🧠 **[[autogpt|AutoGPT]]** |
- | * **[[babyagi|BabyAGI]]** | + | 🤖 **[[babyagi|BabyAGI]]** |
- | | + | 🔗 **[[langroid|Langroid]]** |
- | | + | 📊 **[[microsoft_graphrag|Microsoft GraphRAG]]** |
- | | + | 🌟 **[[lite_llm|LiteLLM]]** |
- | + | ||