• English
      • New
      Control Any Platform with Midscene Skills|Details

      Midscene.js

      AI-powered, vision-driven UI automation for every platform.

      13k+
      Github Stars
      #2
      No.2 in Github trending
      DocumentationShowcases
      Platforms

      Web, PC, Mobile, and more

      Control browsers and mobile apps with natural language across multiple platforms
      Unified API design for seamless cross-platform automation
      Supports Android, iOS, HarmonyOS, Linux, macOS, and Windows
      Web

      Web

      Integrate with Puppeteer or Playwright, or use Bridge Mode to control desktop browsers.
      PC

      PC

      Control desktop applications on macOS, Windows, and Linux with natural language.
      AndroidiOS

      Mobile

      Control Android, iOS, and HarmonyOS devices with natural language automation.
      Any Interface

      Any Interface

      Automation on any interface, beyond DOM / Accessibility limitations.
      MODEL STRATEGY

      Vision Models Multi-model combination Adapt open-source models

      Vision models boost action precision
      Multi-model setups raise completion rates
      Open-source options that still perform

      Doubao Seed

      Doubao Seed vision model optimized for visual understanding and UI element recognition with excellent performance.

      qwen3.7-plus

      Qwen vision-language model with high-quality image understanding and UI element recognition at competitive pricing.

      gemini-3.5-flash

      Advanced Gemini multimodal model with powerful vision capabilities and comprehensive UI automation support.
      Multi-model combo

      Multi-model combo

      Supports using different models for planning and interaction to improve task completion rates
      DEVELOPER EXPERIENCE

      Rich APIs & Tools

      Practical APIs to control automation flows and run strategy
      Supports extending your own UI action agents
      Helps developers ship UI automation tasks faster
      Rich APIs

      Rich APIs

      Enables both smart automation workflows and fine-grained atomic control.
      Skills & MCP

      Skills & MCP

      Drop-in Agent Skills for AI coding tools, plus an MCP Server for model collaboration.
      Reports & Playground

      Reports & Playground

      Provides intuitive visualization reports to help developers trace back the automation process
      Flexible Integration

      Flexible Integration

      Supports using Yaml to write automation flows, supports custom Agent execution strategies
      .
      View All APIsArrow right
      aiAct, aiLocate, aiAssert...
      Explore the complete API documentation for more automation capabilities.

      Who is using Midscene

      ByteDance
      Volcengine
      Douyin
      TikTok
      Lark
      Soda Music
      Doubao
      Alibaba
      AVATR
      Xiaomi
      iQIYIBilibiliAutelDongchedi
      DocumentationShowcases