--- title: 'Fara-7B: Efficient Multimodal Computer Use Agent' url: https://www.emergentmind.com/topics/fara-7b type: topic --- # Fara-7B: Efficient Multimodal Computer Use Agent Fara-7B is a 7-billion parameter multimodal Transformer specifically designed as a native computer use agent (CUA) that interacts with graphical user interfaces via direct pixel input and atomic action output. Trained entirely on a large-scale, high-diversity synthetic corpus generated through the FaraGen closed-loop pipeline, Fara-7B achieves state-of-the-art performance among models of comparable size on several computer use agent benchmarks and demonstrates competitive performance relative to significantly larger frontier system-of-models (SoM) agents. The model and its supporting artifacts—including the WebTailBench benchmark—are released openly to encourage reproducibility and further research [2511.19663]. ## 1. FaraGen: Synthetic Data Generation Pipeline FaraGen is a closed-loop, multi-agent pipeline devised to address the data bottleneck in training CUAs by systematically generating and verifying high-quality, multi-step web task trajectories (§2). Grounded in seed URLs from large web indices (ClueWeb22, Tranco), FaraGen leverages three principal modules: task proposal, task solving, and trajectory verification. - **Task Proposal** combines (a) targeted URL-based intent extraction and LLM prompting (“AgentInstruct” style) for subcategory-specific task generation (28% tasks) and (b) multimodal agentic exploration, where an agent (“WebExplorer”) generates tasks during live browsing (67%). An additional 5% uses LLM-driven exemplar expansion to diversify natural language variants. - **Task Solving** is mediated by the Magentic-One dual-agent system: an Orchestrator plans high-level task steps and enforces “critical-point” constraints, while a WebSurfer agent makes atomic UI tool calls (click, type, scroll, memorize, terminate) using step context and screenshots. Trajectories halt at critical points (personal data, irreversible actions) for safety and verification. - **Trajectory Verification** employs three LLM-based verifiers: Alignment (textual intent satisfaction), Rubric (per-task rubric with subgoal scoring, threshold 0.8), and Multimodal (joint vision-text alignment on key screenshots). - **Throughput and Corpus Yield**: With distributed orchestration (40 nodes × 4 browsers), FaraGen achieves ~600 verified trajectories/hour. The final corpus comprises 145,603 verified trajectories (1,010,797 total steps) across 70,117 unique web domains, with solution verification success rates ranging (e.g., Shopping: 9%, Flights: 3–11%). Trajectory synthesis costs are consistently ≈$1/trajectory even using state-of-the-art LLMs (e.g., $0.59 for o4-mini, $1.08 for o3, $1.00 for GPT-5), establishing scalable feasibility. ## 2. Fara-7B Model Architecture and Training Fara-7B is a supervised fine-tuned version of Qwen2.5-VL-7B with a multimodal "pixel-in, action-out" architecture (§3). The model processes the computer screen as a screenshot and generates both natural language reasoning outputs (chain-of-thought) and atomic GUI actions. - **Modal Input/Output**: A vision encoder embeds the screenshot into patch tokens, which are jointly attended with initial user instructions and previous reasoning steps. At each timestep $t$, the model predicts: (1) chain-of-thought $r_t$ as text, and (2) an action $a_t$ via tool-call syntax (e.g., `click(x,y)`, `type("...")`, `scroll`, `memorize`, `terminate`). Click locations are grounded via directly emitted $(x, y)$ coordinate tokens. - **Learning Objective**: Training optimizes the standard autoregressive cross-entropy objective on joint reasoning and action token sequences: $$ \log P(r_t, a_t \mid \mathbf{x}_{70K domains) enables small language models to achieve robust and general CUA performance, overcoming the core data scarcity barrier. - **Modeling Choices**: Pixel-in, action-out with direct coordinate grounding enables domain generalization without explicit reliance on web page structure, outperforming both prior 7B models and competitive with much larger SoM agents. - **Extensibility and Open Science**: By open-sourcing Fara-7B, its evaluation harness, and WebTailBench, the release supports further research and reproducibility in small, deployable CUAs. **Known Limitations** include restricted action space (no drag-and-drop, no audio/video input), lack of training beyond critical points (i.e., reservation/purchase flow endpoints), and incomplete robustness to site redesigns or edge-case error recovery. Future iterations anticipate extending end-to-end execution under simulated user consent, incorporating richer agent memory and meta-cognitive chains, and employing reinforcement learning for long-horizon optimization. Improved protocols for agent-user collaboration and periodic benchmark refreshes are also identified as research priorities [2511.19663]. ## 6. Artifacts and Community Impact Fara-7B, its weights, evaluation toolkit, and the WebTailBench benchmark are released on Microsoft Foundry and HuggingFace. The benchmark introduces novel, under-represented segments for CUA assessment and includes code for trajectory verification (§5). The release enables not only comparative evaluation but also supports advances in data-driven agentic modeling for practical, small-footprint deployment in personal and enterprise environments. Source: https://www.emergentmind.com/topics/fara-7b