Application settings

From / run control-openhands browser click 'testid=backend-selector-settings-link', control-openhands browser click 'testid=sidebar-settings-/settings/app', then control-openhands browser url, control-openhands browser snapshot 'testid=app-settings-screen' and control-openhands browser screenshot --feature F16.open --name desktop. The URL ends in /settings/app; the snapshot shows comboboxes "Language" (English), "Color Theme" (OpenHands-Neutral) and "Title generation model" (Automatic (recommended)), headings "Conversation titles", "Voice input" and "Git Settings", and button "Save Changes" [disabled].

Run control-openhands browser goto / (the previous bullet ends on /settings/app, where the URL check would pass at once), control-openhands browser press Control+k, control-openhands browser type 'testid=command-menu >> role=combobox' Application, control-openhands browser snapshot 'testid=command-menu' (option "Application settings Change app language, theme, and preferences. Go" is [selected]), control-openhands browser press Enter, then control-openhands browser url; it ends in /settings/app. For the URL entry run control-openhands browser goto /settings/app, control-openhands browser enabled 'testid=submit-button' (false) and control-openhands browser attr 'testid=sidebar-settings-/settings/app' aria-current (page).

Run control-openhands browser click 'testid=language-input' (15 options), control-openhands browser click 'role=option[name="Français"]', control-openhands browser enabled 'testid=submit-button' (true), control-openhands browser click 'testid=submit-button', then control-openhands browser text 'testid=submit-button'. It reads Enregistrer les modifications without a reload. Run control-openhands browser reload, control-openhands browser value 'testid=language-input' (Français), control-openhands browser screenshot --feature F16.language --name french (the screenshot, not a scoped snapshot, shows the sidebar's "Nouvelle discussion" and the headings "Titres des conversations", "Saisie vocale") and control-openhands api GET /api/settings (language is fr). Then check the document language with control-openhands browser eval "document.documentElement.lang + ' ' + document.documentElement.dir" (fr ltr) and the translated sidebar trigger with control-openhands browser attr 'testid=command-menu-trigger' aria-label (Rechercher des commandes). Choose role=option[name="Arabic"] the same way (click the input, the option, Save, reload): the eval reads ar rtl, and control-openhands browser bbox 'aside[data-collapsed]' has x 1140, so the 300 px sidebar now sits at the right edge of the 1440 px viewport. control-openhands browser screenshot --feature F16.language --name arabic shows the whole layout flipped right to left: the sidebar on the right, the settings navigation to its left, and the form on the left with its Arabic labels and values aligned right. Restore: control-openhands browser click 'testid=language-input', control-openhands browser click 'role=option[name="English"]', control-openhands browser click 'testid=submit-button', control-openhands browser reload, control-openhands browser text 'testid=submit-button' reads Save Changes and the eval reads en ltr.

Run control-openhands browser click 'testid=color-theme-input', control-openhands browser snapshot 'role=listbox' (OpenHands-DeepSea, OpenHands-Neutral [selected], OpenHands-Neo, Light+, Solarized Light), control-openhands browser click 'role=option[name="Light+"]', then control-openhands browser eval "document.documentElement.style.colorScheme + ' ' + localStorage.getItem('openhands-color-theme')" (light light-plus) and control-openhands browser enabled 'testid=submit-button' (false: no Save needed). control-openhands browser screenshot --feature F16.color-theme --name light-plus shows a white page. Second views: control-openhands browser reload then control-openhands browser value 'testid=color-theme-input' (Light+); control-openhands browser goto / then control-openhands browser eval "getComputedStyle(document.body).backgroundColor + ' ' + document.documentElement.style.colorScheme" (rgb(255, 255, 255) light); control-openhands api GET /api/settings contains no theme key. Restore on /settings/app (control-openhands browser goto /settings/app; the second view left /) by choosing role=option[name="OpenHands-Neutral"] the same way (dark openhands-neutral).

Run control-openhands browser click 'testid=app-settings-screen >> text=Send anonymous usage data', read the switch with the eval from Preconditions (true), control-openhands browser click 'testid=submit-button', control-openhands browser wait-text 'Settings saved', control-openhands browser reload, read the switch again (true), control-openhands api GET /api/settings (user_consents_to_analytics: true) and control-openhands browser eval "localStorage.getItem('openhands-telemetry-consent')" (granted). Restore by clicking the label again and saving; consent reads denied and the API false.

Blocked: needs a Cloud backend selected in the backend selector. Expected: control-openhands browser enabled 'testid=enable-analytics-switch' is false and the switch reads checked.

With a non-DNT build using a dummy PostHog key and loopback-only VITE_POSTHOG_HOST (no external analytics delivery), save opt-in and confirm its consent POST returned 200. Run service pause automation, save opt-out then opt-in through the same switch, and service resume automation before the five-second request timeout. Record the UI transitions and read browser network --filter 'telemetry/consent' --bodies; the final granted value must be posted and acknowledged. Resume before stop. The default hard-DNT build cannot exercise this reversal.

Run control-openhands browser click 'testid=app-settings-screen >> text=Sound Notifications', control-openhands browser click 'testid=submit-button', control-openhands browser wait-text 'Settings saved', control-openhands browser reload, read enable-sound-notifications-switch (true) and control-openhands api GET /api/settings (enable_sound_notifications: true). Restore by toggling and saving again (false). Audible half: with the switch on and saved, control-openhands conversation start --prompt "Reply with only the word ok. Do not run any tools." --wait --timeout 180, then control-openhands browser media: plays lists one /assets/notification-<hash>.mp3 at the moment the conversation finished. With the switch off, the same check after a conversation reads plays: [] (the F16.git-identity conversation below doubles as that negative check). Turn the switch off and save afterwards (control-openhands browser goto /settings/app first: conversation start left the browser on the conversation).

Run control-openhands browser count 'testid=sidebar-onboarding-checklist' (1), control-openhands browser click 'testid=app-settings-screen >> text=Show Getting Started checklist', then the same count (0, immediately) and control-openhands browser enabled 'testid=submit-button' (false). control-openhands browser screenshot --feature F16.checklist --name hidden shows the sidebar without the "Getting started" card. control-openhands browser reload keeps the count at 0 and the switch unchecked. Click the label again to restore; the count returns to 1.

Run control-openhands browser click 'testid=title-llm-profile-input' and control-openhands browser snapshot 'role=listbox': options Automatic (recommended), deepseek-flash · deepseek/deepseek-flash, deepseek-pro · deepseek/deepseek-v4-pro. Run control-openhands browser click 'role=option >> has-text=deepseek-pro', control-openhands browser click 'testid=submit-button', control-openhands browser wait-text 'Settings saved', control-openhands browser reload, control-openhands browser value 'testid=title-llm-profile-input' (deepseek-pro · deepseek/deepseek-v4-pro) and control-openhands api GET /api/settings (title_llm_profile: "deepseek-pro"). Then control-openhands conversation start --prompt "Reply with only the word ok. Do not run any tools." --wait --timeout 180 and, a few seconds later, control-openhands conversation status <id> with the id it printed: title is a generated title: an emoji and a short phrase whose wording varies (for example 🔧 Acknowledge with ok only). The start output's own title may already be set; when it is still null, the title is written a few seconds after the run finishes. Return with control-openhands browser goto /settings/app, choose role=option[name="Automatic (recommended)"], save; title_llm_profile is then absent from app_preferences.

Run control-openhands browser click 'role=link[name="Manage LLM profiles"]' then control-openhands browser url; it ends in /settings/llm and control-openhands browser count 'testid=profile-row' lists the profiles.

Arrange a throwaway profile: control-openhands llm set --profile qa-title --model deepseek/deepseek-flash --api-key-file <key file> --no-activate --no-validate. On /settings/app select it (control-openhands browser click 'testid=title-llm-profile-input', control-openhands browser click 'role=option >> has-text=qa-title', save). Delete it through the UI: control-openhands browser click 'role=link[name="Manage LLM profiles"]', control-openhands browser click 'testid=profile-row >> has-text=qa-title >> testid=profile-menu-trigger', control-openhands browser click 'testid=profile-actions-menu >> testid=profile-delete', control-openhands browser click 'testid=delete-profile-confirm', then control-openhands browser click 'testid=sidebar-settings-/settings/app'. control-openhands browser value 'testid=title-llm-profile-input' is Automatic (recommended), Save is disabled, and title_llm_profile is absent from the API's app_preferences. For a preference that goes stale outside the UI, arrange control-openhands api PATCH /api/settings --data '{"misc_settings_diff":{"app_preferences":{"title_llm_profile":"qa-missing"}}}' --write, then control-openhands browser reload: the dropdown still shows Automatic (recommended) and Save stays disabled, while the API keeps qa-missing until the next Save of this form. Any Save writes the form's current preferences, which no longer hold the stale key, so saving an unrelated change removes it: toggle Sound Notifications, save, toggle back, save.

Run control-openhands browser fill 'testid=transcription-base-url-input' http://127.0.0.1:9/v1, control-openhands browser fill 'testid=transcription-api-key-input' qa-dummy-key, control-openhands browser fill 'testid=transcription-model-input' qa-whisper, then control-openhands browser enabled 'testid=submit-button' (false) and control-openhands browser attr 'testid=transcription-api-key-input' type (password). After control-openhands browser reload, control-openhands browser value 'testid=transcription-model-input' is qa-whisper (same for the other two). control-openhands browser eval "localStorage.getItem('openhands-transcription-endpoint') + ' | session=' + sessionStorage.getItem('openhands-transcription-api-key')" reads {"baseUrl":"http://127.0.0.1:9/v1","model":"qa-whisper"} | session=qa-dummy-key; the API body has no qa-whisper. Clear each with control-openhands browser fill 'testid=transcription-base-url-input' '' (and the other two). Using the endpoint from the composer microphone is not driven here (needs microphone capture and a transcription server).

Run control-openhands browser fill 'testid=git-user-name-input' 'QA Tester', control-openhands browser fill 'testid=git-user-email-input' 'qa-tester@example.com', control-openhands browser click 'testid=submit-button', control-openhands browser wait-text 'Settings saved', control-openhands browser reload, then control-openhands browser value 'testid=git-user-name-input' (QA Tester) and control-openhands api GET /api/settings (git_user_name, git_user_email set). Agent half: control-openhands conversation start --prompt "Run exactly this command and reply with only its output: env | grep -c '^GIT_'; git init -q qa_t && cd qa_t && git commit --allow-empty -qm x; git log -1 --format='%an <%ae>'" --wait --timeout 240, then control-openhands conversation events <id> --kinds ObservationEvent,MessageEvent with the id from the start output. Expected: QA Tester <qa-tester@example.com>. Known failure: the observation is 0 Author identity unknown ...: the identity is stored only in misc_settings.app_preferences and never reaches the agent.

Run control-openhands browser fill 'testid=git-user-email-input' 'not-an-email', control-openhands browser click 'testid=submit-button', then control-openhands browser eval "document.querySelector('[data-testid=git-user-email-input]').validationMessage" (Please include an '@' in the email address. ...); the API email is unchanged. Then control-openhands browser fill 'testid=git-user-email-input' '', control-openhands browser fill 'testid=git-user-name-input' '', click submit, control-openhands browser wait-text 'Settings saved', control-openhands browser reload: the inputs read openhands and openhands@all-hands.dev, which also restores the baseline.

Click the analytics label once: control-openhands browser enabled 'testid=submit-button' is true; click it again: false (back to the stored value). Each successful save above made while the UI is in English shows the toast found by control-openhands browser wait-text 'Settings saved'; the Arabic save and the English restore in F16.language are made from a French and an Arabic UI and toast Paramètres enregistrés and تم حفظ الإعدادات instead (see Gotchas). Pending and failure: run control-openhands service stop agent-server (the open page keeps its form), click testid=app-settings-screen >> text=Sound Notifications, start a sampler with control-openhands browser eval "(() => { window.__seen = []; window.__iv = setInterval(() => { const s = document.querySelector('[data-testid=submit-button]'); const k = (s ? s.textContent : '-') + ' skeleton=' + !!document.querySelector('[data-testid=app-settings-skeleton]'); if (window.__seen.at(-1) !== k) window.__seen.push(k); }, 10); return 'started'; })()", click testid=submit-button, control-openhands browser wait-text 'An error occurred' (after three PATCH /api/settings attempts answer 502, browser network --filter /api/settings shows them; the ingress's plain-text 502 body carries no server message, so the toast is the generic one, #18051), then control-openhands browser eval "(() => { clearInterval(window.__iv); return window.__seen.join(' -> '); })()": it starts with Save Changes skeleton=false -> - skeleton=true, i.e. the form and its Save button are replaced by the skeleton while pending; Saving... never appears. By the time the failure toast is read the form has usually come back, adding -> Save Changes skeleton=false; assert the prefix. Expected after the failure: the Sound switch stays on so the user can retry. Known failure: control-openhands browser eval "document.querySelector('[data-testid=enable-sound-notifications-switch]').checked" is false and Save is disabled: the edit is silently discarded. Bring the backend back with control-openhands restart, control-openhands doctor, control-openhands browser goto /settings/app.

Run control-openhands browser focus 'testid=color-theme-input', then repeat control-openhands browser press Tab and control-openhands browser eval "(document.activeElement.getAttribute('data-testid')||'') + ' ' + document.activeElement.tagName". Expected (the acceptance criterion): focus visits the three switches before title-llm-profile-input. The first Tab lands on enable-analytics-switch, followed by enable-sound-notifications-switch and show-getting-started-checklist-switch; Space toggles the focused checkbox. control-openhands browser snapshot 'testid=app-settings-screen' --feature F16.keyboard --name aria exposes each checkbox label and checked state. The label draws a visible focus outline.

sh

  control-openhands browser viewport desktop
  control-openhands browser goto /settings/app
  control-openhands browser wait 'testid=submit-button'
  control-openhands browser record start --feature F16.keyboard --name keyboard-desktop
  control-openhands browser focus 'testid=color-theme-input'
  control-openhands browser press Tab
  control-openhands browser press Escape
  control-openhands browser screenshot --feature F16.keyboard --name keyboard-desktop
  control-openhands browser record stop --gif
  control-openhands assert --field value --equals enable-analytics-switch -- browser eval "document.activeElement.getAttribute('data-testid')"

sh

  control-openhands browser viewport phone
  control-openhands browser goto /settings/app
  control-openhands browser wait 'testid=submit-button'
  control-openhands browser record start --feature F16.keyboard --name keyboard-phone
  control-openhands browser focus 'testid=color-theme-input'
  control-openhands browser press Tab
  control-openhands browser press Escape
  control-openhands browser screenshot --feature F16.keyboard --name keyboard-phone
  control-openhands browser record stop --gif
  control-openhands assert --field value --equals enable-analytics-switch -- browser eval "document.activeElement.getAttribute('data-testid')"

Run control-openhands browser viewport phone, control-openhands browser goto /settings/app, control-openhands browser bbox 'testid=app-settings-screen' (pageHorizontalOverflow: false, width 348 at x 16), control-openhands browser screenshot --feature F16.phone --name top, control-openhands browser scroll 'testid=submit-button', control-openhands browser bbox 'testid=submit-button' (insideViewport: true) and control-openhands browser screenshot --feature F16.phone --name bottom. Return with control-openhands browser viewport desktop.

Run control-openhands browser click 'testid=title-llm-profile-input', control-openhands browser click 'role=option >> has-text=deepseek-flash' (Save enables), control-openhands browser hover 'testid=title-llm-profile-input', then control-openhands browser click 'testid=title-llm-profile-input >> xpath=../..//button[not(@aria-label)]'. control-openhands browser value 'testid=title-llm-profile-input' reads Automatic (recommended) and control-openhands browser enabled 'testid=submit-button' is false. Without the hover the click times out (<div ...> intercepts pointer events).

Run control-openhands browser fill 'testid=language-input' Deu and control-openhands browser snapshot 'role=listbox': the only option is Deutsch. Save is briefly true while the text is typed; control-openhands browser press Escape restores control-openhands browser value 'testid=language-input' to English and control-openhands browser enabled 'testid=submit-button' to false.

Choose Deutsch in testid=language-input and save, choose Solarized Light in testid=color-theme-input, and hide the checklist with control-openhands browser click 'testid=show-getting-started-checklist-switch >> xpath=ancestor::label' (the label text is German now). Then control-openhands browser reset, control-openhands onboard --skip, control-openhands browser goto /settings/app, control-openhands browser wait 'testid=submit-button': control-openhands browser text 'testid=submit-button' is Änderungen speichern and control-openhands browser value 'testid=language-input' is Deutsch (backend), while control-openhands browser value 'testid=color-theme-input' is OpenHands-Neutral, control-openhands browser eval "localStorage.getItem('openhands-color-theme')" is null and control-openhands browser count 'testid=sidebar-onboarding-checklist' is 1 (browser-only, back to defaults). Restore English (the option keeps its English name in the German UI): control-openhands browser click 'testid=language-input', control-openhands browser click 'role=option[name="English"]', control-openhands browser click 'testid=submit-button', control-openhands browser reload, control-openhands browser wait 'testid=submit-button'; control-openhands browser text 'testid=submit-button' reads Save Changes and control-openhands api GET /api/settings --pick misc_settings.app_preferences.language is en.

Needs a second backend with a different Git username: the second stack from F25's Preconditions added as QA_Second (F25 Add bullet), arranged with control-openhands api PATCH /api/settings --run "$OH_VERIFY_RUN_2" --write --data '{"misc_settings_diff":{"app_preferences":{"git_user_name":"QA Second Git"}}}'. With Local active, run control-openhands browser goto /settings/app and control-openhands browser reload; browser value 'testid=git-user-name-input' is openhands. Switch without leaving the page: control-openhands browser click 'testid=backend-selector', control-openhands browser click 'testid=backend-selector >> role=option[name="Connected QA_Second"]', control-openhands browser wait 'testid=environment-switch-overlay' --state detached --timeout 10000, wait a few seconds: the value is QA Second Git and browser text 'testid=backend-synced-settings-badge' names QA_Second (a first visit to a backend loads fresh). Switch back the same way to Connected Local: the value is openhands beside synced from Local backend, and it keeps following the active backend on further switches. The form remounts per backend, so an unsaved edit is dropped: on Local run control-openhands browser fill 'testid=git-user-name-input' 'QA Local Edit' (browser enabled 'testid=submit-button' is true), switch to QA_Second (QA Second Git, Save false) and back (openhands, Save false); control-openhands api GET /api/settings --pick misc_settings.app_preferences.git_user_name is unchanged. At browser viewport phone the selector is in the drawer (testid=sidebar-mobile-menu-toggle, then 'testid=sidebar-mobile-drawer >> testid=backend-selector' and role=option[name="Connected QA_Second"]; close the drawer with browser mouse-click 370 400) and the field follows the same way. Switch back to Local and remove QA_Second afterwards (F25).

After the family, control-openhands browser errors --app-only reports appErrors: 0. Requests to registry.npmjs.org (update check) and Google Fonts fail through the sandbox proxy; they are not app errors.

With the harness build's VITE_DO_NOT_TRACK=1, open /settings/app, read browser network --external --filter 'posthog|z.openhands.dev' and browser storage. Grant analytics through the real switch and Save, reload, inspect those again, then revoke and Save to restore. Expected: zero PostHog requests and no PostHog storage key, including after opt-in. This checks the build flag; browser-only DNT and builds without it have separate paths.