Open Agent Studio - Build Unlimited Computer Use Agents Without Running Out Of Credits (Mac/Windows/Linux)

The first cross-platform desktop application for Agentic Process Automation An open-source alternative to UIPath and traditional RPA tools using unlimited VLM models for semantic targets. 🚀 Get Started • 📖 Documentation • 🤝 Contributing • 💬 Support

🌟 What is Open Agent Studio?

✨ Key Features

• 🎯 Semantic Targets: Future-proof automation that survives UI changes

• 🎬 Video-to-Agent: World's first video-based agent creation

• 🌐 Cross-Platform: Works on Windows and Linux

• 🔗 Built-in API: Every instance includes a REST API

• 🧠 AI-Powered: GPT-4 integration for intelligent decision making

• 🔄 Self-Healing: Robust verification and testing loops

📥 Installation

Windows

• Download: Windows Executable

• Extract the ZIP file

• Install Python 3.10 from Windows Store

• Run the application (click "More info" → "Run anyway" if Windows shows security warnings)

Linux

• Download: Linux Executable

• Extract and run

📺 Video Tutorials

• Windows Installation Guide

• Video-to-Agent Demo

✨ Tools built using Open Agent Studio

• Agentsbase.ai

• Toy.new

🚀 Quick Start

1. Create Your First Agent

{
  "key": "yourapikey",
  "json_output": [
    {
      "type": "open tab",
      "target": "https://example.com"
    },
    {
      "type": "click",
      "target": "Login button",
      "browser_mode": true
    }
  ],
  "goal": "Navigate to website and click login"
}

2. Test Locally

curl -X POST http://localhost:8080/agents \
  -H "Content-Type: application/json" \
  -d @your_agent.json

🎯 Semantic Targets

{
  "type": "click",
  "target": "blue submit button",
  "browser_mode": true
}

🛠 Agent Node Types

{
  "type": "click",
  "target": "Submit button",
  "browser_mode": true
}

{
  "type": "keypress",
  "prompt": "Hello, World!"
}

{
  "type": "open tab",
  "target": "https://example.com"
}

{
  "type": "delay",
  "time": 5
}

{
  "type": "gpt4",
  "prompt": "Summarize the following text:",
  "input": ["article_text"],
  "data": "summary"
}

{
  "type": "python",
  "code": "import pandas as pd\nprint('Hello from Python!')"
}

{
  "type": "semanticScrape",
  "target": "product prices",
  "data": "price_data"
}

{
  "type": "googlesheetsadd_row",
  "URL": "sheet_url",
  "Sheet_Name": "Sheet1",
  "data": ["John", "Doe", "30"]
}

{
  "type": "email",
  "to": "user@example.com",
  "subject": "Automation Report",
  "body": "Task completed successfully!"
}

{
  "type": "api",
  "URL": "https://api.example.com/data",
  "headers": {"Content-Type": "application/json"},
  "body": {"key": "value"}
}

📖 Complete Example

{
  "key": "yourapikey",
  "json_output": [
    {
      "type": "open tab",
      "target": "https://news.ycombinator.com"
    },
    {
      "type": "semanticScrape",
      "target": "top story headlines",
      "data": "headlines"
    },
    {
      "type": "gpt4",
      "prompt": "Summarize these headlines and identify key trends:",
      "input": ["headlines"],
      "data": "analysis"
    },
    {
      "type": "googlesheetscreate",
      "URL": "sheet_url",
      "SheetName": "newsanalysis"
    },
    {
      "type": "googlesheetsadd_row",
      "URL": "sheet_url",
      "SheetName": "newsanalysis",
      "data": ["{{analysis}}"]
    },
    {
      "type": "email",
      "to": "manager@company.com",
      "subject": "Daily News Analysis",
      "body": "Please find today's analysis attached.",
      "data": "analysis"
    }
  ],
  "goal": "Scrape news, analyze trends, save to sheets, and email results"
}

📡 Agent API Reference

POST /agents

{
  "key": "yourapikey",
  "json_output": [...],
  "goal": "description"
}

🗺 Roadmap

• [X] Open Agent Cloud - Cloud-based execution Done!

• [X] Enhanced Video-to-Agent - Improved conversion accuracy Done!

• [ ] Advanced Evaluations - Better testing for generalized agents

• [ ] Improved Testing Loop - Self-healing automation

• [X] Full Open Source Backend - Complete local deployment Done!

🤝 Contributing

🚀 Get Started

• Email rohan@cheatlayer.com for contributor access

• Join our community discussions

• Check out open issues and feature requests

🎯 Areas We Need Help

• Evaluations for generalized agents

• Testing loop improvements

• Video-to-agent enhancement

• Documentation and tutorials

• Bug reports and fixes

📋 Development Setup

# Clone the repository
git clone https://github.com/rohanarun/Open-Agent-Studio.git

Email: rohan@cheatlayer.com

💬 Support

• 📧 Email: rohan@cheatlayer.com

• 📚 Documentation: docs.cheatlayer.com

• 🐛 Issues: GitHub Issues

• 💡 Feature Requests: GitHub Discussions

🏆 Our Story