Quick Experience with Android

By using Midscene.js Android device, you can quickly experience the main features of Midscene on Android devices, without needing to write any code.

The Playground is also provided by the @midscene/android package, so you can think of it as a playground or a debugging tool for Midscene on Android.

Preparation

Please prepare an API key from a visual-language (VL) model.

You can check the supported models in Choose a model

Start Playground

npx --yes @midscene/android-playground

Config API Key

Click the gear button to enter the configuration page:

Refer to Config Model and Provider document, config the API Key.

Start experiencing

After the configuration, you can immediately experience Midscene. There are three main tabs in the extension:

  • Action: use action to interact with the web page, like "type Midscene in the search box" or "click the login button".
  • Query: use query to extract JSON data from the web page, like "extract the user id from the page, return in { id: string }".
  • Assert: use assert to validate the web page, like "the page title is "Midscene"".

Enjoy !

Want to write some code ?

After experiencing, you may want to write some code to integrate Midscene. There are multiple ways to do that. Please refer to the documents below: