AI Agent Knowledge Base

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Instruction Following Evaluation ======

Instruction following is a fundamental capability of large language models, requiring generated outputs to satisfy multiple constraints imposed by input instructions. IF-CRITIC (arXiv:2511.01014) by Wen et al. from Tsinghua University's CoAI Group and Zhipu AI introduces a fine-grained LLM critic that provides efficient, reliable assessment of constraint adherence. The system decomposes complex instructions into checklists, trains a specialized critic model via constraint-level preference optimization, and achieves evaluation performance surpassing strong baselines including o4-mini and Gemini-3-Pro.

===== The Instruction Following Problem =====

Modern LLMs must follow complex, multi-constraint instructions such as "Write a 500-word essay about climate change in formal tone, using exactly 3 sections, without mentioning specific politicians." Each constraint (word count, tone, structure, content restriction) must be independently verified. Existing approaches using LLM-as-a-Judge are costly, unreliable, and fail to provide fine-grained feedback at the constraint level.

===== IF-CRITIC Architecture =====

The IF-CRITIC pipeline operates in three stages:

**1. Checklist Generation**: A dedicated checklist generator decomposes each instruction into a structured list of individual constraints. Each constraint is explicitly defined with verification criteria.

**2. Multi-Stage Critique Filtering**: High-quality training data is constructed through a rigorous filtering pipeline:
  * DeepSeek-R1 generates N expert critiques per constraint using the checklist as guidance
  * Cross-model verification ensures consistency across different LLM evaluators
  * Rule-augmented verification handles mechanical constraints (e.g., counting) using Qwen2.5-72B-Instruct
  * Self-consistency majority voting determines final judgments
  * Best explanation selection picks the most informative rationale

**3. Constraint-Level Preference Optimization**: IF-CRITIC is trained using filtered critiques as expert data, applying DPO and GRPO adapted to optimize at the individual constraint level rather than overall scores.

<code python>
# Illustration of IF-CRITIC checklist-based evaluation
class IFCritic:
    def __init__(self, checklist_generator, critic_model):
        self.generator = checklist_generator
        self.critic = critic_model

    def evaluate(self, instruction: str, response: str) -> dict:
        # Decompose instruction into constraint checklist
        checklist = self.generator.decompose(instruction)
        results = {}
        for constraint in checklist:
            # Evaluate each constraint independently
            judgment = self.critic.assess(
                constraint=constraint,
                response=response,
                return_explanation=True
            )
            results[constraint.id] = {
                "satisfied": judgment.passed,
                "explanation": judgment.rationale,
                "confidence": judgment.score
            }
        return {
            "overall": all(r["satisfied"] for r in results.values()),
            "constraints": results,
            "score": sum(r["satisfied"] for r in results.values()) / len(results)
        }
</code>

===== Benchmarks: IFEval and M-IFEval =====

IF-CRITIC is evaluated on two primary benchmarks:

  * **IFEval**: A benchmark measuring whether LLMs follow verifiable instructions with specific constraints (format, length, keyword inclusion, etc.)
  * **M-IFEval**: A multi-turn extension of IFEval that tests constraint adherence across multi-turn conversations, where constraints may accumulate or conflict across turns

===== Evaluation Performance =====

IF-CRITIC demonstrates superior evaluation capabilities:

^ Baseline ^ Win Rate Difference ^
| QwQ-32B | IF-CRITIC wins by +9.3% |
| DeepSeek-R1 | IF-CRITIC wins by +7.7% |
| o4-mini | IF-CRITIC matches or exceeds |
| Gemini-3-Pro | IF-CRITIC matches or exceeds |

The key advantage is that IF-CRITIC achieves this performance at substantially lower computational cost than using frontier models as judges, making it practical as a reward signal for training.

===== Constraint-Level Optimization Mathematics =====

The constraint-level preference optimization can be formalized as:

<latex>
\mathcal{L}_{	ext{IF-CRITIC}} = -\mathbb{E}_{(x, c_i, y_w, y_l)} \left[ \log \sigma \left( eta \log rac{\pi_	heta(y_w \mid x, c_i)}{\pi_{	ext{ref}}(y_w \mid x, c_i)} - eta \log rac{\pi_	heta(y_l \mid x, c_i)}{\pi_{	ext{ref}}(y_l \mid x, c_i)} 
ight) 
ight]
</latex>

where $x$ is the instruction, $c_i$ is the $i$-th constraint from the checklist, $y_w$ and $y_l$ are the preferred and dispreferred critique outputs, and $\beta$ controls the divergence from the reference policy $\pi_{\text{ref}}$.

===== Use as Reward Signal =====

IF-CRITIC's fine-grained scores serve as reward signals for instruction-following optimization via DPO and GRPO training. By providing constraint-level feedback rather than binary pass/fail, the system enables more targeted model improvement with lower computational overhead compared to using strong LLM critics directly.

===== References =====

  * [[https://arxiv.org/abs/2511.01014|Wen et al., "IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation," arXiv:2511.01014, 2025]]
  * [[https://github.com/thu-coai/IF-CRITIC|IF-CRITIC GitHub Repository (Tsinghua CoAI)]]

===== See Also =====

  * [[multi_turn_jailbreak_attacks|Multi-Turn Jailbreak Attacks (Crescendo)]]
  * [[personalized_agents_human_feedback|Personalized Agents from Human Feedback (PAHF)]]
  * [[world_of_workflows_benchmark|World of Workflows Benchmark]]
AI Agent Knowledge Base

User Tools

Site Tools

Page Tools
