代理浏览器:快速 AI 浏览器自动化 CLI - Openclaw 技能
作者:互联网
2026-04-16
什么是 代理浏览器?
代理浏览器(Agent Browser)是一款强大的工具,旨在为 AI 代理提供像人类用户一样浏览网页的能力。通过提供带有 Node.js 备选方案的快速 Rust 无头浏览器界面,它允许代理执行点击、输入和滚动等结构化命令。对于希望通过为代理提供与复杂 Web 应用程序交互并检索实时信息的可靠方式来扩展其 Openclaw 技能的开发人员来说,这项技能至关重要。
代理浏览器的核心优势在于其能够将复杂的文档对象模型 (DOM) 转换为简化的可访问性树。这使得 AI 代理能够通过稳定的参考 ID 识别交互式元素,从而使 Web 自动化比传统的抓取方法更具弹性和更易于编程。无论您是在构建研究机器人还是自动化测试程序,将此工具添加到您的 Openclaw 技能库中,都能在大型语言模型 (LLM) 与实时 Web 之间建立必要的桥梁。
下载入口:https://github.com/openclaw/skills/tree/main/skills/bo170814/agent-browser-bak
安装与下载
1. ClawHub CLI
从源直接安装技能的最快方式。
npx clawhub@latest install agent-browser-bak
2. 手动安装
将技能文件夹复制到以下位置之一
全局模式~/.openclaw/skills/
工作区
/skills/
优先级:工作区 > 本地 > 内置
3. 提示词安装
将此提示词复制到 OpenClaw 即可自动安装。
请帮我使用 Clawhub 安装 agent-browser-bak。如果尚未安装 Clawhub,请先安装(npm i -g clawhub)。
代理浏览器 应用场景
- 自动化复杂的多步骤表单提交和 Web UI 交互。
- 利用可访问性快照从大量使用 JavaScript 的网站中提取结构化数据。
- 执行自动化的跨浏览器测试和视觉回归检查。
- 创建能够导航和总结在线内容的研究型 Web 代理。
- 在 Openclaw 技能框架内通过保存和加载浏览器状态来管理身份验证会话。
- 导航:代理打开目标 URL 以初始化浏览器上下文并加载网页内容。
- 快照分析:该技能生成交互式快照,为可点击和输入元素分配唯一的参考 ID(如 @e1, @e2)。
- 交互执行:代理使用上一步中生成的特定参考 ID 发送点击、填充或滚动等命令。
- 动态等待:该工具可以等待特定的网络状态、元素或 JavaScript 条件,以确保页面已准备好执行下一步操作。
- 状态持久化:包括 Cookie 和本地存储在内的会话数据可以保存到 JSON 文件中,以便将来进行身份验证访问。
代理浏览器 配置指南
使用 npm 全局安装该包并设置必要的浏览器依赖项:
npm install -g agent-browser
agent-browser install
agent-browser install --with-deps
对于从源代码构建 Openclaw 技能的开发人员:
git clone https://github.com/vercel-labs/agent-browser
cd agent-browser
pnpm install
pnpm build
agent-browser install
代理浏览器 数据架构与分类体系
代理浏览器组织交互数据和页面元数据,以便 AI 模型轻松使用:
| 数据类型 | 描述 | 输出格式 |
|---|---|---|
| 快照 | 带有交互式参考的页面可访问性树 | 文本/JSON |
| 会话状态 | Cookie、本地存储和会话令牌 | JSON 文件 |
| 视觉效果 | 全页面或特定元素的截图 | PNG/PDF |
| 录制内容 | 交互序列的视频日志 | WebM |
| 网络日志 | 跟踪或拦截的请求列表 | JSON |
name: Agent Browser
description: A fast Rust-based headless browser automation CLI with Node.js fallback that enables AI agents to navigate, click, type, and snapshot pages via structured commands.
read_when:
- Automating web interactions
- Extracting structured data from pages
- Filling forms programmatically
- Testing web UIs
metadata: {"clawdbot":{"emoji":"??","requires":{"bins":["node","npm"]}}}
allowed-tools: Bash(agent-browser:*)
Browser Automation with agent-browser
Installation
npm recommended
npm install -g agent-browser
agent-browser install
agent-browser install --with-deps
From Source
git clone https://github.com/vercel-labs/agent-browser
cd agent-browser
pnpm install
pnpm build
agent-browser install
Quick start
agent-browser open # Navigate to page
agent-browser snapshot -i # Get interactive elements with refs
agent-browser click @e1 # Click element by ref
agent-browser fill @e2 "text" # Fill input by ref
agent-browser close # Close browser
Core workflow
- Navigate:
agent-browser open - Snapshot:
agent-browser snapshot -i(returns elements with refs like@e1,@e2) - Interact using refs from the snapshot
- Re-snapshot after navigation or significant DOM changes
Commands
Navigation
agent-browser open # Navigate to URL
agent-browser back # Go back
agent-browser forward # Go forward
agent-browser reload # Reload page
agent-browser close # Close browser
Snapshot (page analysis)
agent-browser snapshot # Full accessibility tree
agent-browser snapshot -i # Interactive elements only (recommended)
agent-browser snapshot -c # Compact output
agent-browser snapshot -d 3 # Limit depth to 3
agent-browser snapshot -s "#main" # Scope to CSS selector
Interactions (use @refs from snapshot)
agent-browser click @e1 # Click
agent-browser dblclick @e1 # Double-click
agent-browser focus @e1 # Focus element
agent-browser fill @e2 "text" # Clear and type
agent-browser type @e2 "text" # Type without clearing
agent-browser press Enter # Press key
agent-browser press Control+a # Key combination
agent-browser keydown Shift # Hold key down
agent-browser keyup Shift # Release key
agent-browser hover @e1 # Hover
agent-browser check @e1 # Check checkbox
agent-browser uncheck @e1 # Uncheck checkbox
agent-browser select @e1 "value" # Select dropdown
agent-browser scroll down 500 # Scroll page
agent-browser scrollintoview @e1 # Scroll element into view
agent-browser drag @e1 @e2 # Drag and drop
agent-browser upload @e1 file.pdf # Upload files
Get information
agent-browser get text @e1 # Get element text
agent-browser get html @e1 # Get innerHTML
agent-browser get value @e1 # Get input value
agent-browser get attr @e1 href # Get attribute
agent-browser get title # Get page title
agent-browser get url # Get current URL
agent-browser get count ".item" # Count matching elements
agent-browser get box @e1 # Get bounding box
Check state
agent-browser is visible @e1 # Check if visible
agent-browser is enabled @e1 # Check if enabled
agent-browser is checked @e1 # Check if checked
Screenshots & PDF
agent-browser screenshot # Screenshot to stdout
agent-browser screenshot path.png # Save to file
agent-browser screenshot --full # Full page
agent-browser pdf output.pdf # Save as PDF
Video recording
agent-browser record start ./demo.webm # Start recording (uses current URL + state)
agent-browser click @e1 # Perform actions
agent-browser record stop # Stop and save video
agent-browser record restart ./take2.webm # Stop current + start new recording
Recording creates a fresh context but preserves cookies/storage from your session. If no URL is provided, it automatically returns to your current page. For smooth demos, explore first, then start recording.
Wait
agent-browser wait @e1 # Wait for element
agent-browser wait 2000 # Wait milliseconds
agent-browser wait --text "Success" # Wait for text
agent-browser wait --url "/dashboard" # Wait for URL pattern
agent-browser wait --load networkidle # Wait for network idle
agent-browser wait --fn "window.ready" # Wait for JS condition
Mouse control
agent-browser mouse move 100 200 # Move mouse
agent-browser mouse down left # Press button
agent-browser mouse up left # Release button
agent-browser mouse wheel 100 # Scroll wheel
Semantic locators (alternative to refs)
agent-browser find role button click --name "Submit"
agent-browser find text "Sign In" click
agent-browser find label "Email" fill "user@test.com"
agent-browser find first ".item" click
agent-browser find nth 2 "a" text
Browser settings
agent-browser set viewport 1920 1080 # Set viewport size
agent-browser set device "iPhone 14" # Emulate device
agent-browser set geo 37.7749 -122.4194 # Set geolocation
agent-browser set offline on # Toggle offline mode
agent-browser set headers '{"X-Key":"v"}' # Extra HTTP headers
agent-browser set credentials user pass # HTTP basic auth
agent-browser set media dark # Emulate color scheme
Cookies & Storage
agent-browser cookies # Get all cookies
agent-browser cookies set name value # Set cookie
agent-browser cookies clear # Clear cookies
agent-browser storage local # Get all localStorage
agent-browser storage local key # Get specific key
agent-browser storage local set k v # Set value
agent-browser storage local clear # Clear all
Network
agent-browser network route # Intercept requests
agent-browser network route --abort # Block requests
agent-browser network route --body '{}' # Mock response
agent-browser network unroute [url] # Remove routes
agent-browser network requests # View tracked requests
agent-browser network requests --filter api # Filter requests
Tabs & Windows
agent-browser tab # List tabs
agent-browser tab new [url] # New tab
agent-browser tab 2 # Switch to tab
agent-browser tab close # Close tab
agent-browser window new # New window
Frames
agent-browser frame "#iframe" # Switch to iframe
agent-browser frame main # Back to main frame
Dialogs
agent-browser dialog accept [text] # Accept dialog
agent-browser dialog dismiss # Dismiss dialog
JavaScript
agent-browser eval "document.title" # Run JavaScript
State management
agent-browser state save auth.json # Save session state
agent-browser state load auth.json # Load saved state
Example: Form submission
agent-browser open https://example.com/form
agent-browser snapshot -i
# Output shows: textbox "Email" [ref=e1], textbox "Password" [ref=e2], button "Submit" [ref=e3]
agent-browser fill @e1 "user@example.com"
agent-browser fill @e2 "password123"
agent-browser click @e3
agent-browser wait --load networkidle
agent-browser snapshot -i # Check result
Example: Authentication with saved state
# Login once
agent-browser open https://app.example.com/login
agent-browser snapshot -i
agent-browser fill @e1 "username"
agent-browser fill @e2 "password"
agent-browser click @e3
agent-browser wait --url "/dashboard"
agent-browser state save auth.json
# Later sessions: load saved state
agent-browser state load auth.json
agent-browser open https://app.example.com/dashboard
Sessions (parallel browsers)
agent-browser --session test1 open site-a.com
agent-browser --session test2 open site-b.com
agent-browser session list
JSON output (for parsing)
Add --json for machine-readable output:
agent-browser snapshot -i --json
agent-browser get text @e1 --json
Debugging
agent-browser open example.com --headed # Show browser window
agent-browser console # View console messages
agent-browser console --clear # Clear console
agent-browser errors # View page errors
agent-browser errors --clear # Clear errors
agent-browser highlight @e1 # Highlight element
agent-browser trace start # Start recording trace
agent-browser trace stop trace.zip # Stop and save trace
agent-browser record start ./debug.webm # Record from current page
agent-browser record stop # Save recording
agent-browser --cdp 9222 snapshot # Connect via CDP
Troubleshooting
- If the command is not found on Linux ARM64, use the full path in the bin folder.
- If an element is not found, use snapshot to find the correct ref.
- If the page is not loaded, add a wait command after navigation.
- Use --headed to see the browser window for debugging.
Options
- --session
uses an isolated session. - --json provides JSON output.
- --full takes a full page screenshot.
- --headed shows the browser window.
- --timeout sets the command timeout in milliseconds.
- --cdp
connects via Chrome DevTools Protocol.
Notes
- Refs are stable per page load but change on navigation.
- Always snapshot after navigation to get new refs.
- Use fill instead of type for input fields to ensure existing text is cleared.
Reporting Issues
- Skill issues: Open an issue at https://github.com/TheSethRose/Agent-Browser-CLI
- agent-browser CLI issues: Open an issue at https://github.com/vercel-labs/agent-browser
相关推荐
专题
+ 收藏
+ 收藏
+ 收藏
+ 收藏
+ 收藏
+ 收藏
最新数据
相关文章
SNS 调度器:多平台贴文管理 - Openclaw Skills
AI 自我身份:管理不断进化的智能体人格 - Openclaw Skills
SaaS Builder:利用 Openclaw 技能发布 Micro-SaaS 产品
社交媒体调度器:多平台 SNS 自动化 - Openclaw Skills
智能模型路由器:自动 Claude 模型切换 - Openclaw Skills
Rey Developer:自主编程最佳实践 - Openclaw Skills
MetaMask 钱包:AI 驱动的加密支付与 DeFi - Openclaw Skills
LinkedIn 海报生成器:专业算法优化 - Openclaw 技能
Human Security:高级交互保护 - Openclaw Skills
GitHub 个人主页 README 生成器:自定义开发者主页 - Openclaw Skills
AI精选
