magnitudedev
browser-agent
TypeScript

Open-source, vision-first browser agent

Last updated Jul 9, 2026
4.1k
Stars
228
Forks
32
Issues
0
Stars/day
Attention Score
96
Language breakdown
TypeScript 85.0%
JavaScript 9.5%
HTML 5.0%
Python 0.4%
Shell 0.0%
โ–ธ Files click to expand
README

Magnitude Text Logo


Documentation License Discord Follow Tom Follow Anders


๐Ÿš€ New: Magnitude is state-of-the-art, scoring 94% on WebVoyager!

Magnitude uses vision AI to enable you to control your browser with natural language.

  • ๐Ÿงญ Navigate - Sees and understands any interface to plan out actions
  • ๐Ÿ–ฑ๏ธ Interact - Executes precise actions using mouse and keyboard
  • ๐Ÿ” Extract - Intelligently extracts useful structured data
  • โœ… Verify - Built-in test runner with powerful visual assertions
You can use it to automate tasks on the web, integrate between apps without APIs, extract data, test your web apps, or as a building block for your own browser agents.

Video showing Magnitude tests running in a terminal and agent taking actions in the browser

โ†•๏ธ Magnitude in action! โ†•๏ธ

// Magnitude can handle high-level tasks await agent.act('Create a task', {     // Optionally pass data that the agent will use where appropriate     data: {         title: 'Use Magnitude',         description: 'Run "npx create-magnitude-app" and follow the instructions',     }, });

// It can also handle low-level actions await agent.act('Drag "Use Magnitude" to the top of the in progress column');

// Intelligently extract data based on the DOM content matching a provided zod schema const tasks = await agent.extract( 'List in progress tasks', z.array(z.object({ title: z.string(), description: z.string(), // Agent can extract existing data or new insights difficulty: z.number().describe('Rate the difficulty between 1-5') })), );

Get started

Running your first browser automation

npx create-magnitude-app

This will create a new project and walk you through the steps for setting up Magnitude. It will also create an example script that you can run right away!

Using the test runner

To install the test runner for use in an existing web app, please run:
npm i --save-dev magnitude-test && npx magnitude init

This will create a basic tests directory tests/magnitude with:

  • magnitude.config.ts: Magnitude test configuration file
  • example.mag.ts: An example test file
For information on how to run tests and integrate into CI/CD see here.

[!NOTE]
Magnitude requires a large visually grounded model. We recommend Claude Sonnet 4 for the best performance, but are also compatible with Qwen-2.5VL 72B. See docs for more information.

Why Magnitude?

โŒ Problem #1: Most browser agents draw numbered boxes around page elements - doesn't generalize well due to complex modern sites

โœ… Solution: Vision-first architecture

  • Visually grounded LLM specifies pixel coordinates
  • True generalization independent of DOM structure
  • Future-proof architecture for desktop apps, VMs, etc.
โŒ Problem #2: Most browser agents follow "high-level prompt + tools = work until done" - works for demos, not production

โœ… Solution: Controllable & repeatable automation

  • Flexible abstraction levels (granular actions vs. flows)
  • Custom actions + prompts at agent and action level
Deterministic runs via native caching system (in progress)*

Additional info

Please see our docs for more information on how to best build Magnitude automations and test cases.

Contact

If you are an enterprise and want more features or support, feel free to reach out to us at founders@magnitude.run or schedule a call here to discuss your needs.

You can also join our Discord community for help or any suggestions!

๐Ÿ”— More in this category

ยฉ 2026 GitRepoTrend ยท magnitudedev/browser-agent ยท Updated daily from GitHub