* Fix blank terminal after split operations and add visual tests ## Blank Terminal Fix - Add `needsRefreshAfterWindowChange` flag in GhosttyTerminalView - Force terminal refresh when view is added to window, even if size unchanged - Add `ghostty_surface_refresh()` call in attachToView for same-view reattachment - Add debug logging for surface attachment lifecycle (DEBUG builds only) ## Bonsplit Migration - Add bonsplit as local Swift package (vendor/bonsplit submodule) - Replace custom SplitTree with BonsplitController - Add Panel protocol with TerminalPanel and BrowserPanel implementations - Add SidebarTab as main tab container with BonsplitController - Remove old Splits/ directory (SplitTree, SplitView, TerminalSplitTreeView) ## Visual Screenshot Tests - Add test_visual_screenshots.py for automated visual regression testing - Uses in-app screenshot API (CGWindowListCreateImage) - no screen recording needed - Generates HTML report with before/after comparisons - Tests: splits, browser panels, focus switching, close operations, rapid cycles - Includes annotation fields for easy feedback ## Browser Shortcut (⌘⇧B) - Add keyboard shortcut to open browser panel in current pane - Add openBrowser() method to TabManager - Add shortcut configuration in KeyboardShortcutSettings ## Screenshot Command - Add 'screenshot' command to TerminalController for in-app window capture - Returns OK with screenshot ID and path ## Other - Add tests/visual_output/ and tests/visual_report.html to .gitignore * Add browser title subscription and set tab height to 30px - Subscribe to BrowserPanel.$pageTitle changes to update bonsplit tabs - Update tab titles in real-time as page navigation occurs - Clean up subscriptions when panels are removed - Set bonsplit tab bar and tab height to 30px (in submodule) * Fix socket API regressions in list_surfaces, list_bonsplit_tabs, focus_pane - list_surfaces: Remove [terminal]/[browser] suffix to keep UUID-only format that clients and tests expect for parsing - list_bonsplit_tabs --pane: Properly look up pane by UUID instead of creating a new PaneID (requires bonsplit PaneID.id to be public) - focus_pane: Accept both UUID strings and integer indices as documented * Fix browser panel stability and keyboard shortcuts - Prevent WKWebView focus lifecycle crashes during split/view reshuffles - Match bracket shortcuts via keyCode (Cmd+Shift+[ / ], Cmd+Ctrl+[ / ]) - Support Ghostty config goto_split:* keybinds when WebView is focused - Add focus_webview/is_webview_focused socket commands and regression tests - Rename SidebarTab to Workspace and update docs * Make ctrl+enter keybind test skippable Skip when the Ghostty keybind isn't configured or when osascript can't send keystrokes (no Accessibility permission), so VM runs stay green. * Auto-focus browser omnibar when blank When a browser surface is focused but no URL is loaded yet, focus the address bar instead of the WKWebView. * Stabilize socket surface indexing * Focus browser omnibar escape; add webview keybind UI tests - Escape in omnibar now returns focus to WKWebView\n- Add UI tests for Cmd+Ctrl+H pane navigation with WebKit focused (including Ghostty config)\n- Avoid flaky element screenshots in UpdatePillUITests on the UTM VM * Fix browser drag-to-split blanks and socket parsing * Fix webview-focused shortcuts and stabilize browser splits - Match ctrl/shift shortcuts by keyCode where needed (Ctrl+H, bracket keys) - Load Ghostty goto_split triggers reliably and refresh on config load - Add debug socket helpers: set_shortcut + simulate_shortcut for tests - Convert browser goto_split/keybind tests to socket-based injection (no osascript) - Bump bonsplit for drag-to-split fixes * Fix split layout collapse and harden socket pane APIs * Stabilize OSC 99 notification test timing * Fix terminal focus routing after split reparent * Support simulate_shortcut enter for focus routing test * Stabilize terminal focus routing test * Fix frozen new terminal tabs after many splits * Fix frozen new terminal tabs after splits * Fix terminal freeze on launch/new tabs * Update ghostty submodule * Fix terminal focus/render stalls after split churn * Fix nested split collapsing existing pane * Fix nested split collapse + stabilize new-surface focus * Update bonsplit submodule * Fix SIGINT test flake * Remove bonsplit tab-switch crossfade * Remove PROJECTS.md * Remove bonsplit tab selection animation * Ignore generated test reports * Middle click closes tab * Revert unintended .gitignore change * Fix build after main merge * Revert "Fix build after main merge" This reverts commit 16bf9816d0856b5385d52f886aa5eb50f3c9d9a4. * Revert "Merge remote-tracking branch 'origin/main' into fix/blank-terminal-and-visual-tests" This reverts commit 7c20fb53fd71fea7a19a3673f2dd73e5f0c783c4, reversing changes made to 0aff107d787bc9d8bbc28220090b4ca7af72e040. * Remove tab close fade animation * Use terminal.fill icon * Make terminal tab icon smaller * Match browser globe tab icon size * Bonsplit: tab min width 48 and tighter close button * Bonsplit: smaller tab title font * Show unread notification badge in bonsplit tabs and improve UI polish Sync unread notification state to bonsplit tab badges (blue dot). Improve EmptyPanelView with Terminal/Browser buttons and shortcut hints. Add tooltips to close tab button and search overlay buttons. * Fix reload.sh single-instance safety check on macOS Replace GNU-only `ps -o etimes=` with portable `ps -o etime=` and parse the dd-hh:mm:ss format manually for macOS compatibility. * Centralize keyboard shortcut definitions into Action enum Replace per-shortcut boilerplate with a single Action enum that holds the label, defaults key, and default binding for each shortcut. All call sites now use shortcut(for:). Settings UI is data-driven via ForEach(Action.allCases). Titlebar tooltips update dynamically when shortcuts are changed. Remove duplicate .keyboardShortcut() modifiers from menu items that are already handled by the event monitor. * Fix WKWebView consuming app menu shortcuts and close panel confirmation Add CmuxWebView subclass that routes key equivalents through the main menu before WebKit, so Cmd+N/Cmd+W/tab switching work when a browser pane is focused. Fix Cmd+W close-panel path: bypass Bonsplit delegate gating after the user confirms the running-process dialog by tracking forceCloseTabIds. Add unit tests (CmuxWebViewKeyEquivalentTests) and UI test scaffolding (MenuKeyEquivalentRoutingUITests) with a new cmux-unit Xcode scheme. * Update CLAUDE.md and PROJECTS.md with recent changes CLAUDE.md: enforce --tag for reload commands, add cleanup safety rules. PROJECTS.md: log notification badge, reload.sh fix, Cmd+W fix, WebView key equiv fix, and centralized shortcuts work. * Keep selection index stable on close * Add concepts page documenting terminology hierarchy New docs page explaining Window > Workspace > Pane > Surface > Panel hierarchy with aligned ASCII diagram. Updated tabs.mdx and splits.mdx to use consistent terminology (workspace instead of tab, surface instead of panel) and corrected outdated CLI command references. * Update bonsplit submodule * WIP: improve split close stability and UI regressions * Close terminal panel on child exit; hide terminal dirty dot * Fix split close/focus regressions and stabilize UI tests * Add unread Dock/Cmd+Tab badge with settings toggle * Fix browser-surface shortcuts and Cmd+L browser opening * Snapshot current workspace state before regression fixes * Update bonsplit submodule snapshot * Stabilize split-close regression capture and sidebar resize assertions * Change default Show Notifications shortcut from Cmd+Shift+I to Cmd+I * Fix update check readiness race, enable release update logging, and improve checking spinner * Restore terminal file drop, fix browser omnibar click focus, and add panel workspace ID mutation for surface moves * Add Cmd+digit workspace hints, titlebar shortcut pills, sidebar drag-reorder, and workspace placement settings * Add v2 browser automation API, surface move/reorder commands, and short-handle ref system to TerminalController * Add CLI browser command surface, --id-format flag, and move/reorder commands * Extend test clients with move/reorder APIs, ref-handle support, and increased timeouts * Harden test runner scripts with deterministic builds, retry logic, and robust socket readiness * Stabilize existing test suites with focus-wait helpers, increased timeouts, and API shape updates * Add terminal file drop e2e regression test * Add v2 browser API, CLI ref resolution, and surface move/reorder test suites * Add unit tests for shortcut hints, workspace reorder, drop planner, and update UI test stabilization * Add cmux-debug-windows skill with snapshot script and agent config * Update project docs: mark browser parity and move/reorder phases complete, add parallel agent workflow guidelines * Update bonsplit submodule: re-entrant setPosition guard, tab shortcut hints, and moveTab/reorderTab API * Add browser agent UX improvements: snapshot refs, placement reuse, diagnostics, and skill docs - Upgrade browser.snapshot to emit accessibility tree text with element refs (eN) - Add right-sibling pane reuse policy for browser.open_split placement - Add rich not_found diagnostics with retry logic for selector actions - Support --snapshot-after for post-action verification on mutating commands - Allow browser fill with empty text for clearing inputs - Default CLI --id-format to refs-first (UUIDs opt-in via --id-format uuids|both) - Format legacy new-pane/new-surface output with short surface refs - Add skills/cmuxterm-browser/ and skills/cmuxterm/ end-user skill docs - Add regression tests for placement policy, snapshot refs, diagnostics, and ID defaults * Update bonsplit submodule: keep raster favicons in color when inactive
5.1 KiB
5.1 KiB
TODO
Socket API / Agent
- Add window handles +
window.list/current/focus/create/closefor multi-window socket control (v2) + v1 equivalents (list_windows, etc) + CLI support. - Add surface move/reorder commands (move between panes, reorder within pane, move across workspaces/windows).
- Add browser automation API inspired by
vercel-labs/agent-browser, but backed by cmux's WKWebView (wait, click, type, eval, screenshot, etc.). - Finalize browser parity contract and command mapping decisions in
docs/agent-browser-port-spec.md. - Add
cmux browsercommand surface that mirrors agent-browser semantics and targets explicitsurface_idhandles. - Add short handle refs (
surface:N,pane:N,workspace:N,window:N) and CLI--id-format refs|uuids|bothoutput control. - Add v1->v2 compatibility shim for migrated browser/topology commands while v1 remains supported.
- Port browser automation coverage to
tests_v2/perdocs/agent-browser-port-spec.mdand keep v1 + v2 suites green.- Added
tests_v2/test_browser_api_comprehensive.py,tests_v2/test_browser_api_p0.py,tests_v2/test_browser_api_extended_families.py,tests_v2/test_browser_api_unsupported_matrix.py, andtests_v2/test_browser_cli_agent_port.py. - Full VM runs:
./scripts/run-tests-v1.shand./scripts/run-tests-v2.shpassing (v2 visual D12 remains reported as a known non-blocking VM failure, matching v1 policy).
- Added
- Fix
cmux browser open|open-split|newURL parsing so routing flags (--workspace,--window) are removed before URL construction. - Fix
identify --workspace/--surfacecaller parsing to honor ref handles (workspace:N,surface:N) instead of falling back to current/focused IDs. - Update
browser.open_splitplacement policy: reuse nearest right sibling pane first (nested-aware), only create a new split when caller has no right sibling. - Upgrade
browser.snapshotto agent-browser-style output (snapshottree text +refs) and make non-JSON CLI output print snapshot content instead ofOK. - Add richer selector failure diagnostics (
hint, counts, sample, snapshot excerpt) with bounded retries for transientnot_foundraces. - Add regression coverage for browser placement policy + snapshot/ref output + diagnostics in v2 tests.
- Allow
browser fillwith empty text (clear input) in CLI + v2 API flows. - Make legacy
new-pane/new-surfaceCLI output prefer shortsurface:Nrefs by default. - Add optional
--snapshot-after/snapshot_afteraction feedback to include a fresh post-action browser snapshot. - Switch CLI
--jsondefault ID output to refs-first (UUIDs only via--id-format uuids|both) and add regression coverage. - Expand end-user skill docs with deep-linkable cmux-browser references/templates plus a new core
skills/cmux/topology skill.
Command Palette
- Add cmd+shift+p palette with all commands
Claude Code Integration
- Add "Install Claude Code integration" menu item in menubar
- Opens a new terminal
- Shows user the diff to their config file (claude.json, opencode config, codex config, etc.)
- Prompts user to type 'y' to confirm
- Implement as part of
cmuxCLI, menubar just triggers the CLI command
Additional Integrations
- Codex integration
- OpenCode integration
UI/UX Improvements
- Add question mark icon to learn shortcuts
- Notification popover: each button item should show outline outside when focused/hovered
- Notification popover: add right-click context menu to mark as read/unread
Analytics
- Add PostHog tracking (set
PostHogAnalytics.apiKeyinSources/PostHogAnalytics.swift)
Browser Parity Completion (agent-browser port)
- Implement locator family:
browser.find.rolebrowser.find.textbrowser.find.labelbrowser.find.placeholderbrowser.find.altbrowser.find.titlebrowser.find.testidbrowser.find.firstbrowser.find.lastbrowser.find.nth
- Implement frame/dialog/download:
browser.frame.selectbrowser.frame.mainbrowser.dialog.acceptbrowser.dialog.dismissbrowser.download.wait
- Implement session/context state APIs:
browser.cookies.get|set|clearbrowser.storage.get|set|clearbrowser.tab.new|list|switch|closebrowser.state.save|load
- Implement developer/diagnostic helpers:
browser.console.list|clearbrowser.errors.listbrowser.highlightbrowser.addinitscriptbrowser.addscriptbrowser.addstyle
- Add explicit
not_supportedfor WebKit/CDP-gap commands:browser.viewport.setbrowser.geolocation.setbrowser.offline.setbrowser.trace.start|stopbrowser.network.route|unroute|requestsbrowser.screencast.start|stopbrowser.input_mouse|input_keyboard|input_touch
- Extend
cmux browser ...CLI grammar for the new families (including aliases). - Port/add v2 tests for all newly implemented families.
- Update unsupported matrix tests to assert
not_supportedfor hard platform gaps (instead ofmethod_not_found). - Re-run full
run-tests-v1.shandrun-tests-v2.shoncmux-vm.