• English
      • New
      Control Any Platform with Midscene Skills|Details

      Midscene.js

      Open-source, vision-driven UI testing — write tests in natural language, automate any platform.

      14k+
      Github Stars
      #2
      No.2 in Github trending
      DocumentationShowcases
      Platforms

      Web, PC, Mobile, and more

      Test and automate with natural language across web, mobile, and desktop
      One unified API and test suite — the same way on every platform
      Reaches what selectors cannot — unlabeled elements, canvas, native apps, and cross-origin frames
      Web

      Web

      Add Midscene to your Playwright or Puppeteer tests, or drive your own Chrome via Bridge Mode.
      PC

      PC

      Test and automate desktop apps on macOS, Windows, and Linux with natural language.
      AndroidiOS

      Mobile

      Test and automate Android, iOS, and HarmonyOS apps on real devices and simulators.
      Any Interface

      Any Interface

      Automate any interface you can screenshot — beyond DOM and accessibility limits.
      MODEL STRATEGY

      Vision Models Multi-model combination Adapt open-source models

      Vision locates elements precisely — no selectors to maintain
      Multi-model setups raise completion rates
      Bring your own model, including strong open-source options

      Doubao Seed

      Strong visual grounding for reliable element location — a solid default for Midscene.

      qwen3.7-plus

      High-quality visual grounding at competitive pricing, with open-source builds you can self-host.

      gemini-3.5-flash

      Powerful multimodal understanding with excellent element localization.
      Multi-model combo

      Multi-model combo

      Pair a planning model with a vision model to raise task completion rates.
      DEVELOPER EXPERIENCE

      Rich APIs & Tools

      Practical APIs to script tests and control automation flows
      Supports extending your own UI action agents
      Lowers the maintenance cost of your UI tests
      Rich APIs

      Rich APIs

      Auto-planning for whole flows, plus atomic APIs like aiTap and aiAssert for precise tests.
      Skills

      Skills

      Drop-in Skills let AI coding agents test your UI through Midscene CLIs.
      Reports & Playground

      Reports & Playground

      Replay every step in a visual report, and try ideas fast in the playground.
      Flexible Integration

      Flexible Integration

      Write flows in YAML, integrate with your test runner, and customize agent execution strategies.
      .
      View All APIsArrow right
      aiAct, aiLocate, aiAssert...
      Explore the complete API documentation for more automation capabilities.
      .
      93.1%
      AndroidWorld Benchmark
      Pass@1 93.1% · Pass@3 97.4%
      Review the AndroidWorld benchmark score, run configuration, reports, and validation notes.
      .
      78.6%
      MobileWorld Benchmark
      Pass@1 78.6% · 92/117
      Review the MobileWorld benchmark score, run configuration, reports, and validation notes.

      Who is using Midscene

      ByteDance
      Volcengine
      Douyin
      TikTok
      Lark
      Soda Music
      Doubao
      Alibaba
      Ctrip
      AVATR
      Xiaomi
      iQIYIBilibiliAutelDongchedi
      DocumentationShowcases