Changelog
v1.18.0
Highlights
Many new model integrations
This release includes support for three models for UI automation:
- Qwen4-Max (
qwen4-max), with model familyqwen4. Qwen configuration guide - Tencent Hunyuan 4 (
hy4), with model familytencent-hy. Tencent Hunyuan configuration guide - StepFun Step 3.7 Flash (
step-3.7-flash), with model familystep. StepFun configuration guide
Changes
Features 🎉
- feat(core): add OpenRouter reasoning parameter support by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3375
- feat(core): add StepFun model adapter by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3391
- feat(core): add Qwen4 model adapter by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3397
Fixes 🐞
- fix(test): keep failure frames from the project's own packages folders by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3377
- fix(test): escape Case and project names in the GitHub job summary by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3378
- fix(core): clarify pinch distance semantics and API distance documentation by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3386
- fix(core): include execution ID in Jev requests by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3389
Refactors ♻️
- refactor(core): centralize OpenRouter reasoning parameters by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3388
Documentation 📖
- docs(site): homepage copy clarity by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3382
- docs(site): align Android preparation Node.js requirement by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3383
- docs(site): add Tencent HY API setup and model cards by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3372
- docs(site): add Browser Use as a CDP WebSocket URL source by @gregpr07 in https://github.com/web-infra-dev/midscene/pull/3289
- docs(site): clarify model initialization config overrides by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3387
Other Changes
- revert(report): remove animated webp report poc by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3390
New Contributors
- @gregpr07 made their first contribution in https://github.com/web-infra-dev/midscene/pull/3289
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.8...v1.18.0
v1.17.8
Changes
Features 🎉
- feat(core): add Tencent HY model adapter by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3362
- feat(test): remove automatic credential redaction from run artifacts by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3371
- feat(badge): support skipped test counts by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3380
Fixes 🐞
- fix(webdriver): enforce request timeout through response body reads by @quanru in https://github.com/web-infra-dev/midscene/pull/3232
- fix(web-integration): honor explicit slow swipe durations by @quanru in https://github.com/web-infra-dev/midscene/pull/3243
- fix(core): clarify aiScroll node locator guidance by @codeestX in https://github.com/web-infra-dev/midscene/pull/3353
- fix(core): update vulnerable runtime dependencies by @quanru in https://github.com/web-infra-dev/midscene/pull/3356
- fix(badge): don't round a pass rate with failures to 100% by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3343
- fix(test): show paths literally in the GitHub job summary by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3334
- fix(workflow): upgrade security dependencies without overrides by @quanru in https://github.com/web-infra-dev/midscene/pull/3358
- fix(android): measure planning-frame age after clock recalibration by @wannT-1 in https://github.com/web-infra-dev/midscene/pull/3364
- fix(android): keep the reset packet count in the post-reset timeout error by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3363
- fix(core): handle GPT image-edge bboxes and separate coordinate semantics by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3368
- fix(test): omit misleading badges for failed runs by @quanru in https://github.com/web-infra-dev/midscene/pull/3370
- fix(test): keep parentheses in the file path of a failure frame by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3369
- fix(ios): bound scroll gestures and propagate boundary failures by @quanru in https://github.com/web-infra-dev/midscene/pull/3253
- fix(harmony): reject reversed and stationary edge scrolls by @quanru in https://github.com/web-infra-dev/midscene/pull/3241
- fix(android): reject scrolls without room to move by @quanru in https://github.com/web-infra-dev/midscene/pull/3242
- fix(core): add quick mappings for scroll and swipe directions by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3156
- fix(core): deduplicate cumulative planning context by @quanru in https://github.com/web-infra-dev/midscene/pull/3254
- fix(test): keep project config stable when filtering test paths by @gjreddy in https://github.com/web-infra-dev/midscene/pull/3332
- fix(web-integration): improve static report playground execution by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3090
- fix(core): preserve invalid System One responses in reports by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3379
Documentation 📖
- docs(site): add interactive get started guide by @ottomao in https://github.com/web-infra-dev/midscene/pull/3335
- docs(site): clarify MobileWorld GUI-only scope by @simplyme0823 in https://github.com/web-infra-dev/midscene/pull/2901
Testing 🧪
- test(workflow): finish migration to rstest and document SDK integration by @quanru in https://github.com/web-infra-dev/midscene/pull/3359
- test(android): isolate anonymous release asset fallback from CI tokens by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3381
CI & Chore ⚙️
- chore(workflow): track midscene-action v1 tag by @await-ovo in https://github.com/web-infra-dev/midscene/pull/3350
New Contributors
- @gjreddy made their first contribution in https://github.com/web-infra-dev/midscene/pull/3343
- @wannT-1 made their first contribution in https://github.com/web-infra-dev/midscene/pull/3364
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.7...v1.17.8
v1.17.7
Changes
Features 🎉
- feat(test): unify runtime artifact directories (PR3) by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3338
CI & Chore ⚙️
- chore(core): support configurable locate prompt order and grouping by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3348
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.6...v1.17.7
v1.17.6
Changes
Features 🎉
- feat(badge): localize and redesign badge homepage by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3341
- feat(test): add summary badges and improve badge site metadata by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3342
- feat(web-integration): add CLI browser tab management by @quanru in https://github.com/web-infra-dev/midscene/pull/3302
- feat(core): expose public SIWC authorization entry by @quanru in https://github.com/web-infra-dev/midscene/pull/3349
Fixes 🐞
- fix(workflow): use dedicated badge deployment token by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3340
- fix(core): clarify external abort errors by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3320
- fix(core): respect model proxy settings in SIWC requests by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3330
- fix(core): preserve arrays in aiQuery JSON responses by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3345
- fix(core): locate Jev targets without a presence check by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3347
Performance 🚀
- perf(workflow): speed up CI with bounded AI concurrency by @quanru in https://github.com/web-infra-dev/midscene/pull/3333
Testing 🧪
- test(report): run e2e files with isolated contexts at concurrency 3 by @await-ovo in https://github.com/web-infra-dev/midscene/pull/3346
CI & Chore ⚙️
- chore(badge): add badge service with GitHub Actions deployment by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3339
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.5...v1.17.6
v1.17.5
Changes
Features 🎉
- feat(test): host Agent records in unified reports (PR2) by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3326
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.4...v1.17.5
v1.17.4
Changes
Features 🎉
- feat(core): add mouse action: aiMiddleClick by @lufy90 in https://github.com/web-infra-dev/midscene/pull/2812
Fixes 🐞
- fix(core): preserve nested custom action parameter descriptions by @advance-hub in https://github.com/web-infra-dev/midscene/pull/3305
- fix(web-integration): honor replace mode for focused inputs without locate by @advance-hub in https://github.com/web-infra-dev/midscene/pull/3296
- fix(web-integration): align action hook option types with runtime arguments by @advance-hub in https://github.com/web-infra-dev/midscene/pull/3322
- fix(core): skip dump serialization without update listeners by @advance-hub in https://github.com/web-infra-dev/midscene/pull/3323
- fix(core): replace numbered point callout with badge-neutral centered marker by @NianZheChao in https://github.com/web-infra-dev/midscene/pull/3096
- fix(recorder): preserve input events across field changes and stop by @dakjdakd in https://github.com/web-infra-dev/midscene/pull/3192
- fix(test): publish GitHub summaries from the executable entry by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3321
Documentation 📖
- docs(site): redesign homepage feature sections by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3317
CI & Chore ⚙️
- chore(site): add provider selection to model configuration cards by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3328
New Contributors
- @advance-hub made their first contribution in https://github.com/web-infra-dev/midscene/pull/3305
- @lufy90 made their first contribution in https://github.com/web-infra-dev/midscene/pull/2812
- @NianZheChao made their first contribution in https://github.com/web-infra-dev/midscene/pull/3096
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.3...v1.17.4
v1.17.3
Changes
Features 🎉
- feat(core): add ant-ling model adapter by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3315
- feat(report): add directory report artifact foundation (PR1) by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3312
Refactors ♻️
- refactor(core): rename supportedTaskTypes to allowedTaskTypes by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3314
Documentation 📖
- docs(site): clarify test entry points by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3310
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.2...v1.17.3
v1.17.2
Changes
Features 🎉
- feat(core): support custom endpoints for System One models by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3301
Fixes 🐞
- fix(core): allow Jev as default model for supported tasks by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3308
- fix(core): support Gemini 4 Argon by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3309
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.1...v1.17.2
v1.17.1
Changes
Features 🎉
- feat(test): support namespaces for Midscene Nodes by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3300
Fixes 🐞
- fix(workflow): preserve MDX in release highlights by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3298
- fix(site): restore v1.17 changelog videos by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3299
Documentation 📖
- docs(site): sdk docs restructure by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3297
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.17.0...v1.17.1
v1.17.0
Highlights
Use your ChatGPT subscription
Authorize Midscene through Sign in with ChatGPT (SIWC) to call GPT models using your ChatGPT subscription allowance. The video below demonstrates the browser extension's sign-in and authorization flow. See Use your ChatGPT subscription for setup instructions.
Experimental Jev 1.14 support
Jev can handle planning, localization, and judgments, working with a general-purpose default model for tasks such as text input. See the Jev configuration guide for setup instructions and limitations.
The following measurements come from a single run of each demo. A step means one model call; latency excludes page actions and waits. Costs are in USD, calculated at $0.042 per million Jev input tokens, with output tokens free of charge.
Fruit tile matching: Jev only
Jev handles clicks and localization to clear all fruit pairs until the remaining count reaches zero. View the execution report.
- Model latency per call: 0.887 seconds on average, 0.774 seconds at P50.
- Input usage: 6,761.4 tokens per call on average, 101,421 tokens in total.
- Model cost: $0.000284 per call on average, $0.00426 in total.
Registration form: Jev + DeepSeek
Jev handles clicks, localization, gender dropdown selection, and completion checks. DeepSeek generates input values for the email, password, and username fields to complete the registration form together. View the execution report.
The following measurements cover Jev only and exclude DeepSeek:
- Model latency per call: 0.583 seconds on average, 0.559 seconds at P50.
- Input usage: 5,265.8 tokens per call on average, 68,455 tokens in total.
- Model cost: $0.000221 per call on average, $0.002875 in total.
Changes
Fixes 🐞
- fix(chrome-extension): keep recorder screenshots on their source tab by @dakjdakd in https://github.com/web-infra-dev/midscene/pull/3194
- fix(workflow): stabilize Studio notarization and unblock release notices by @quanru in https://github.com/web-infra-dev/midscene/pull/3294
Refactors ♻️
- refactor(core): restructure Jev integration and planning delegation by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3295
New Contributors
- @dakjdakd made their first contribution in https://github.com/web-infra-dev/midscene/pull/3194
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.16.5...v1.17.0
v1.16.5
Changes
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.16.4...v1.16.5
v1.16.4
Changes
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.16.3...v1.16.4
v1.16.3
Changes
Features 🎉
- feat(core): add SIWC auth mode and Chrome extension sign-in by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3287
Documentation 📖
- docs(site): make model configuration sections easier to discover by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3292
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.16.2...v1.16.3
v1.16.2
Changes
Features 🎉
- feat(test): redesign CLI reporting and model usage summaries by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3285
Fixes 🐞
- fix(workflow): diagnose Chrome Web Store OAuth failures by @quanru in https://github.com/web-infra-dev/midscene/pull/3284
- fix(core): keep trailing parenthesis in auto-glm finish message by @kwy404 in https://github.com/web-infra-dev/midscene/pull/3190
- fix(core): validate locate coordinate types strictly by @linhongyu510 in https://github.com/web-infra-dev/midscene/pull/3068
- fix(core): validate swipe action parameters by @linhongyu510 in https://github.com/web-infra-dev/midscene/pull/3069
- fix(workflow): build report dependencies and stabilize AI checks by @quanru in https://github.com/web-infra-dev/midscene/pull/3290
Documentation 📖
- docs(site): reorganize model setup and debugging guides by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3288
- docs(site): standardize navigation capitalization by @ottomao in https://github.com/web-infra-dev/midscene/pull/3291
New Contributors
- @kwy404 made their first contribution in https://github.com/web-infra-dev/midscene/pull/3190
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.16.1...v1.16.2
v1.16.1
Changes
Features 🎉
- feat(test): add file concurrency with maxConcurrentFiles by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3259
Fixes 🐞
- fix(playground): isolate reports between executions by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3252
Documentation 📖
- docs(site): add GitHub Actions guide for Midscene Test by @await-ovo in https://github.com/web-infra-dev/midscene/pull/3263
- docs(site): simplify GitHub Actions docs and link to Marketplace by @await-ovo in https://github.com/web-infra-dev/midscene/pull/3276
- docs(site): clarify Jev setup with combined model configuration by @ottomao in https://github.com/web-infra-dev/midscene/pull/3277
- docs(site): update introduction of GUI Agent by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3278
- docs(site): clarify Midscene Test terminology and release status by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3279
- docs(site): migrate introduction to the homepage by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3282
Testing 🧪
- test(report): migrate report app e2e tests to midscene-test and publish CI reports by @await-ovo in https://github.com/web-infra-dev/midscene/pull/3275
New Contributors
- @await-ovo made their first contribution in https://github.com/web-infra-dev/midscene/pull/3263
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.16.0...v1.16.1
v1.16.0
Highlights
Jev 1.4 support: faster, lower-cost visual E2E testing
Midscene now supports Jev 1.4, continuing our focus on visual understanding to drive UI automation. With this integration, developers can experience faster, lower-cost E2E testing. See the Jev configuration guide for setup instructions and the current experimental limitations.
In the tile-matching game test shown in the demo below, 28 model calls were made, with model inference averaging 393.57 ms (approximately 0.39 seconds) per call. Each call averaged 5,025 input tokens and 67 output tokens, at a model cost of approximately $0.000211 per call. This is calculated at $0.042 per million input tokens, with output tokens free of charge.
Changes
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.15.6...v1.16.0
v1.15.6
Changes
Features 🎉
- feat(llm): add dedicated locate model configuration by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3268
- feat(llm): add experimental Jev model support by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3271
CI & Chore ⚙️
- chore(core): redesign introduction page by @yuyutaotao in https://github.com/web-infra-dev/midscene/pull/3267
Full Changelog: https://github.com/web-infra-dev/midscene/compare/v1.15.5...v1.15.6
v1.15.5
Changes
Features 🎉
- feat(web): add Puppeteer test runner nodes by @quanru in https://github.com/web-infra-dev/midscene/pull/3160
- feat(report): redesign test report workspace and clarify execution details by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3245
Fixes 🐞
- fix(core): preserve aiAct reference images for independent locating by @EAGzzyCSL in https://github.com/web-infra-dev/midscene/pull/3257
- fix(ios): wait for input readiness and restore focus after clearing by @quanru in https://github.com/web-infra-dev/midscene/pull/3239
- fix(shared): preserve empty string CLI argument values by @quanru in https://github.com/web-infra-dev/midscene/pull/3260
- fix(core): align default scrolling across Android, iOS, and HarmonyOS by @resonlei in https://github.com/web-infra-dev/midscene/pull/3225
- fix(web-integration): preserve CLI viewport after disconnect by @quanru in https://github.com/web-infra-dev/midscene/pull/3261
- fix(test): validate wait options and preserve cross-module screenshots by @quanru in https://github.com/web-infra-dev/midscene/pull/3246
- fix(web-integration): launch cookie tests without sandbox on Linux CI by @xiong35 in https://github.com/web-infra-dev/midscene/pull/3269

