This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
start [2024/11/26 22:48] – brad | start [2024/12/13 18:26] (current) – brad | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ===== Large Language Model (LLM) Agents | + | ===== AgentWiki |
- | Welcome to the LLM Agents Wiki, a Wikipedia | + | Welcome to the **AgentWiki**, a comprehensive resource |
+ | Catch up on the latest | ||
==== Introduction ==== | ==== Introduction ==== | ||
- | Large Language Model (LLM) Agents are AI systems that utilize large language models to perform tasks autonomously. By understanding | + | 🤖 Large Language Model (LLM) Agents are sophisticated |
+ | By comprehending | ||
+ | They are capable of planning, executing, and adapting their actions based on given objectives and feedback from their environment. | ||
==== Agent System Overview ==== | ==== Agent System Overview ==== | ||
- | In an LLM-powered autonomous agent system, the LLM functions as the agent’s brain, complemented by several key components: | + | 🧠 In an LLM-powered autonomous agent system, the LLM functions as the agent's central processing unit, complemented by several key components: |
- | * **Planning** | + | * **[[planning|Planning]]** |
- | * Task Decomposition | + | * Task Decomposition |
- | * Self-Reflection | + | * Self-Reflection |
- | * **Memory** | + | |
- | * Types of Memory | + | |
- | * Maximum Inner Product Search (MIPS) | + | |
- | * **Tool Use** | + | |
- | These components enable the agent to plan complex tasks, remember past interactions, | + | * **[[memory|Memory]]** |
+ | * Hierarchical Memory Systems | ||
+ | * Efficient Retrieval Mechanisms | ||
- | ==== Key Features of LLM Agents ==== | + | * **[[tool_use|Tool Use]]** |
+ | * External API Integration | ||
+ | * Dynamic Tool Selection | ||
- | * **Reasoning and Planning**: LLM Agents analyze complex tasks, devise strategies, and plan sequences of actions to achieve specific goals. | + | * **[[structured_outputs|Structured Outputs]]** |
- | * **Tool Utilization**: | + | * Grammars |
- | * **Memory and Context Management**: | + | * Constrained Outputs |
- | * **Natural Language Understanding**: | + | |
- | * **Autonomy and Adaptability**: | + | |
- | ==== Components of LLM Agents ==== | + | 🚀 These components enable the agent to: |
- | === Planning === | + | * **Plan** complex tasks through decomposition and strategic reasoning. |
+ | * **Remember** past interactions using advanced memory architectures. | ||
+ | * **Utilize Tools** to extend capabilities beyond text generation. | ||
- | Planning involves breaking down complex tasks into manageable subgoals, devising strategies, and sequencing actions. | + | ==== Key Features of LLM Agents ==== |
- | | + | 🌀 **[[advanced_reasoning_planning|Advanced |
- | * Chain-of-Thought (CoT) Reasoning | + | Employ sophisticated reasoning strategies to analyze complex tasks, devise multi-step plans, |
- | | + | |
- | | + | |
- | * **Self-Reflection** | + | |
- | * ReAct (Reasoning | + | |
- | * Reflexion | + | |
- | * Chain of Hindsight (CoH) | + | |
- | * Algorithm Distillation (AD) | + | |
- | === Memory === | + | 🔧 **[[tool_utilization|Tool Utilization and API Interaction]]**: |
+ | Interface with external tools, APIs, databases, and services to perform actions such as web searches, code execution, and data manipulation. | ||
- | Memory | + | 📚 **[[hierarchical_memory|Hierarchical |
+ | Use multi-level memory architectures | ||
- | | + | 💡 **[[natural_language_understanding|Natural Language Understanding and Generation]]**: |
- | * Sensory Memory | + | Interpret and generate human-like text, facilitating effective communication and instruction following. |
- | * Short-Term Memory (STM) or Working Memory | + | |
- | * Long-Term Memory (LTM) | + | |
- | * Explicit/ | + | |
- | * Implicit/ | + | |
- | * **Maximum Inner Product Search (MIPS)** | + | |
- | * Locality-Sensitive Hashing (LSH) | + | |
- | * ANNOY (Approximate Nearest Neighbors Oh Yeah) | + | |
- | * Hierarchical Navigable Small World (HNSW) | + | |
- | * FAISS (Facebook AI Similarity Search) | + | |
- | * ScaNN (Scalable Nearest Neighbors) | + | |
- | === Tool Use === | + | 🔄 **[[autonomy|Autonomy and Adaptive Behavior]]**: |
+ | Operate independently, | ||
- | Tool use extends the agent' | + | ==== Workflows ==== |
- | * **MRKL Systems** | + | Workflows in LLM Agent systems streamline the design, implementation, |
- | * **Tool Augmented Language Models (TALM)** | + | |
- | * **Toolformer** | + | |
- | * **ChatGPT Plugins | + | |
- | * **HuggingGPT** | + | |
- | * **API-Bank** | + | |
- | ==== Types of LLM Agents ==== | + | 🌊 **Key Workflow Tools** |
+ | * **[[flowise|Flowise]]**: | ||
+ | * **[[promptflow|PromptFlow]]**: | ||
- | * **Chain-of-Thought (CoT) Reasoning** | + | These tools enhance the modularity |
- | * **ReAct (Reasoning | + | |
- | * **AutoGPT** | + | |
- | * **BabyAGI** | + | |
- | * **AgentGPT** | + | |
- | * **Plan-and-Execute Agents** | + | |
- | * **Conversational Agents** | + | |
- | * **Tool-Using Agents** | + | |
- | ==== Design Patterns for LLM Agents ==== | + | ==== Components of LLM Agents ==== |
- | * **Prompt Chaining** | + | === Planning === |
- | * **Reinforcement Learning from Human Feedback (RLHF)** | + | |
- | * **Agent Loop (Perception-Thought-Action Cycle)** | + | |
- | * **Context Window Management** | + | |
- | * **Tool Integration Patterns** | + | |
- | * **Memory Augmentation** | + | |
- | * **Modular Architecture** | + | |
- | ==== Libraries | + | 🧩 Planning involves the strategic breakdown of complex tasks into manageable sub-tasks, devising algorithms, |
- | * **LangChain** | + | == Task Decomposition == |
- | * **LlamaIndex (GPT Index)** | + | |
- | * **Hugging Face Transformers** | + | |
- | * **OpenAI API** | + | |
- | * **Microsoft Guidance** | + | |
- | * **AutoGPT and BabyAGI Implementations** | + | |
- | * **Haystack** | + | |
- | ==== Applications | + | 🌳 **[[chain_of_thought|Chain-of-Thought (CoT) Reasoning]]** |
+ | 🌲 **[[tree_of_thoughts|Tree of Thoughts]]** | ||
+ | ⚙️ **[[llm_with_planning|LLM+P (LLM with Classical Planning)]]** | ||
- | * **Autonomous Task Execution** | + | == Self-Reflection == |
- | * **Customer Support and Virtual Assistants** | + | |
- | * **Research Assistance** | + | |
- | * **Education and Tutoring** | + | |
- | * **Content Creation** | + | |
- | * **Software Development Assistance** | + | |
- | * **Data Retrieval and Processing** | + | |
- | ==== Case Studies ==== | + | 🔍 **[[react_framework|ReAct (Reasoning and Acting)]]** |
+ | 🔄 **[[reflexion_framework|Reflexion Framework]]** | ||
+ | 🪞 **[[chain_of_hindsight|Chain of Hindsight (CoH)]]** | ||
+ | 📉 **[[algorithm_distillation|Algorithm Distillation (AD)]]** | ||
- | === Scientific Discovery Agents | + | === Memory |
- | * **ChemCrow** | + | 📦 Memory mechanisms allow agents to retain, retrieve, and utilize information over extended periods, significantly enhancing their ability to maintain context, learn from past experiences, |
- | * **Autonomous Scientific Research Agents** | + | |
- | === Generative Agents Simulation === | + | == Hierarchical Memory Systems |
- | | + | 🕒 **[[sensory_memory|Sensory Memory]]** |
+ | ⏳ **[[short_term_memory|Short-Term Memory | ||
+ | 📜 **[[long_term_memory|Long-Term Memory (Persistent Memory)]]** | ||
+ | * 📂 **[[explicit_memory|Explicit/ | ||
+ | * 🤫 **[[implicit_memory|Implicit/ | ||
- | === Proof-of-Concept Examples === | + | == Efficient Retrieval Mechanisms |
- | | + | 🔎 **[[maximum_inner_product_search|Maximum Inner Product Search (MIPS)]]** |
- | * **GPT-Engineer** | + | |
+ | * 📊 **[[approximate_nearest_neighbors|Approximate Nearest Neighbors (ANNOY)]]** | ||
+ | | ||
+ | * 🔍 **[[faiss|Facebook AI Similarity Search (FAISS)]]** | ||
+ | * 📈 **[[scann|Scalable Nearest Neighbors (ScaNN)]]** | ||
- | ==== Challenges ==== | + | === Tool Use === |
- | * **Finite Context Length** | + | 🔧 Tool use extends the agent' |
- | * **Long-Term Planning | + | |
- | * **Reliability of Natural Language Interface** | + | |
- | ==== Recent Developments ==== | + | * 🧰 **[[mrkl_systems|MRKL Systems (Modular Reasoning, Knowledge, and Language)]]** |
+ | * 🛠️ **[[tool_augmented_language_models|Tool-Augmented Language Models (TALM)]]** | ||
+ | * 🤖 **[[toolformer|Toolformer]]** | ||
- | The field of LLM Agents is rapidly evolving, with significant advancements including: | + | == API Integration == |
- | | + | 🔗 **[[openai_function_calling|OpenAI Function Calling and ChatGPT Plugins]]** |
- | * **Tool Use Integration** | + | 🔗 **[[hugginggpt|HuggingGPT]]** |
- | * **Memory and Retrieval Augmented Models** | + | 🗂️ |
- | * **Ethical and Safe AI Practices** | + | |
- | | + | |
- | ==== Getting Started | + | ==== Types of LLM Agents |
- | Embark on your journey with LLM Agents | + | 🧠 **[[chain_of_thought_agents|Chain-of-Thought |
+ | 🔄 **[[react_agents|ReAct Agents]]** | ||
+ | 🤖 **[[autonomous_agents|Autonomous Agents]]** | ||
+ | * 🤖 **[[autogpt|AutoGPT]]** | ||
+ | * 🤖 **[[babyagi|BabyAGI]]** | ||
+ | * 🤖 **[[agentgpt|AgentGPT]]** | ||
+ | 📋 **[[plan_and_execute_agents|Plan-and-Execute Agents]]** | ||
+ | 💬 **[[conversational_agents|Conversational Agents]]** | ||
+ | 🔧 **[[tool_using_agents|Tool-Using Agents]]** | ||
- | * **Introduction to LLM Agents** | + | ==== Design Patterns for LLM Agents |
- | * **LangChain Documentation** | + | |
- | * **OpenAI API Reference** | + | |
- | * **AutoGPT GitHub Repository** | + | |
- | * **ReAct Framework** | + | |
- | * **Hugging Face Transformers** | + | |
- | ==== Join the Community ==== | + | 🔗 **[[prompt_chaining|Prompt Chaining and Orchestration]]** |
+ | 📈 **[[rlhf|Reinforcement Learning from Human Feedback (RLHF)]]** | ||
+ | 🔄 **[[agent_loop|Agent Loop (Perception-Thought-Action Cycle)]]** | ||
+ | 🗂️ **[[context_window_management|Context Window Management]]** | ||
+ | 🔧 **[[tool_integration_patterns|Tool Integration Patterns]]** | ||
+ | 📂 **[[memory_augmentation_strategies|Memory Augmentation Strategies]]** | ||
+ | 🏗️ **[[modular_architectures|Modular and Layered Architectures]]** | ||
- | Stay updated with the latest trends, research, | + | ==== Libraries |
- | + | ||
- | * **Discussion Forums** | + | |
- | * **Contribute to Open-Source Projects** | + | |
- | * **Attend Workshops and Webinars** | + | |
- | Explore. Learn. Innovate. Unlock the transformative potential | + | Explore |
- | ==== Tags ==== | + | **Frameworks & Platforms** |
- | {{tag> | + | ⚙️ **[[agent_protocol|Agent Protocol]]** |
+ | 🤖 **[[anthropic_context_protocol|Anthropic Model Context Protocol]]** | ||
+ | 💻 **[[chatdev|ChatDev]]** | ||
+ | ⚡ **[[bolt_new|Bolt.new]]** | ||
+ | 🔗 **[[flowise|Flowise]]** | ||
+ | 📋 **[[instructor_framework|Instructor]]** | ||
+ | 🔎 **[[llamaindex|LlamaIndex]]** | ||
+ | 🧠 **[[autogpt|AutoGPT]]** | ||
+ | 🤖 **[[babyagi|BabyAGI]]** | ||
+ | 🔗 **[[langroid|Langroid]]** | ||
+ | 📊 **[[microsoft_graphrag|Microsoft GraphRAG]]** | ||
+ | 🌟 **[[lite_llm|LiteLLM]]** | ||