• English
      • New
      Control Any Platform with Midscene Skills|Details

      Midscene.js — GUI Agent for E2E Testing

      AI-powered vision. Cross-platform. Batteries included.

      14k+
      Github Stars
      #2
      No.2 in Github trending
      DocumentationShowcases
      Platforms

      Web, PC, Mobile, and more

      Test and automate with natural language across web, mobile, and desktop
      One unified API and test suite — the same way on every platform
      Reaches what selectors cannot — unlabeled elements, canvas, native apps, and cross-origin frames
      Web

      Web

      Add Midscene to your Playwright or Puppeteer tests, or drive your own Chrome via Bridge Mode.
      PC

      PC

      Test and automate desktop apps on macOS, Windows, and Linux with natural language.
      AndroidiOS

      Mobile

      Test and automate Android, iOS, and HarmonyOS apps on real devices and simulators.
      Any Interface

      Any Interface

      Automate any interface you can screenshot — beyond DOM and accessibility limits.
      MODEL STRATEGY

      Pure vision at the core

      Works from screenshots — no selectors or annotations
      Start with one model; add specialists for complex tasks
      Choose from supported models, including self-hosted options

      Doubao Seed

      Strong visual grounding for reliable element location — a solid default for Midscene.

      qwen3.7-plus

      High-quality visual grounding at competitive pricing, with open-source builds you can self-host.

      gemini-3.5-flash

      Powerful multimodal understanding with excellent element localization.
      Multi-model combo

      Multi-model combo

      Pair a planning model with a vision model to raise task completion rates.
      TESTING TOOLKIT

      Ready-to-use UI testing toolkit

      Practical APIs to script tests and control automation flows
      Supports extending your own UI action agents
      Lowers the maintenance cost of your UI tests
      Rich APIs

      Rich APIs

      Auto-planning for whole flows, plus atomic APIs like aiTap and aiAssert for precise tests.
      Skills

      Skills

      Drop-in Skills let AI coding agents test your UI through Midscene CLIs.
      Reports & Playground

      Reports & Playground

      Replay every step in a visual report, and try ideas fast in the playground.
      Flexible Integration

      Flexible Integration

      Write flows in YAML, integrate with your test runner, and customize agent execution strategies.
      .
      View All APIsArrow right
      aiAct, aiLocate, aiAssert...
      Explore the complete API documentation for more automation capabilities.
      EVALUATION

      Benchmarks

      Explore Midscene's results on AndroidWorld and MobileWorld.

      93.1%
      AndroidWorld Benchmark
      Pass@1 93.1% · Pass@3 97.4%
      78.6%
      MobileWorld Benchmark
      Pass@1 78.6% · 92/117

      Who is using Midscene

      ByteDance
      Volcengine
      Douyin
      TikTok
      Lark
      Soda Music
      Doubao
      Alibaba
      Ctrip
      AVATR
      Xiaomi
      iQIYIBilibiliAutelDongchedi
      DocumentationShowcases