Parity was not testing window verbs since 2.0.652; extension-lane response gaps it now finds

by adom

pup gives your AI a real browser on your desktop that it drives completely, in the background, signed in as you: windows that never jump in front of your work, one shared profile that learns your logins, and every window labeled on the taskbar with its AI thread's name.

Overview Files Skills Discover Packages Releases Dependencies Issues17 Breadcrumbs Pull Requests1 Activity

Open bug report

John Lauer · 22d ago

Summary

Since 2.0.652 (CDP lane off by default), tools/parity.py has opened its test window with lane:"cdp" and been refused with cdp_lane_disabled. Every window fixture after it then failed with session_not_found, and parity counted those as "SCENARIO: shapes not comparable" rather than as failures. So the 55/56 baseline did not exercise navigate, screenshot, the tab verbs, maximize or alert for about a month.

2.0.726 opens a lane:"cdp" request on the extension lane when that lane is off, so parity now reaches these verbs, and it reports 49/56. The drops are real gaps on the extension lane. None is new in 2.0.726.

What parity found (arav-rog and ConfRoomROG, 2.0.726)

verb	finding
`pup_maximize`	failed with `window_failed` on every extension-lane window. Fixed in 2.0.727: fills the work area without raising.
`pup_open_window`	missing `active`, `activeTabId`, `ageMinutes`, `availableBrowsers`, `defaultBrowser` and other CDP-lane fields
`pup_navigate`	missing `renderCheck`
`pup_screenshot`	missing `capturedVia`, `sizeKB`
`pup_open_tab`	missing `active`, `activeTabId`, `errorCount`, `opener`, `openerTabId`, `renderCheck`, `tabCount`, `title`, `url`
`pup_switch_tab`	missing `active`, `errorCount`, `opener`, `openerTabId`, `title`, `url`
`pup_alert_window`	missing `clearMethod`

Asks

Fill the fields an AI actually reads on the extension lane: title/url/active/tabCount on the tab verbs, and sizeKB/capturedVia on screenshots.
Decide which CDP-only fields (availableBrowsers, defaultBrowser) leave the golden set.
Parity should treat an error where the golden is a success as a FAILURE, not "not comparable", so a refused open can never hide a whole block of verbs again.

1 Reply

John Lauer · 22d ago

2.0.727 (insiders): pup_maximize now succeeds on the extension lane (it fills the work area without raising), so parity scores it as DRIFT instead of a hidden error: its answer has no bounds yet. Same family as the rest of this issue.