Commit Graph

585 Commits

Author SHA1 Message Date
Tommy D. Rossi 4a8caf19bd refactor: extract recording code into separate modules with proper types
- Create extension/src/offscreen-types.ts with Chrome tabCapture constraint types
- Create extension/src/recording.ts extracting recording functions from background.ts
- Create playwriter/src/recording-relay.ts extracting recording logic from cdp-relay.ts
- Remove 'as any' usages by adding proper MediaStream constraint types
- Add typesafe message types for offscreen document communication
- Remove duplicate OUR_EXTENSION_IDS constant (uses EXTENSION_IDS from utils.ts)
2026-01-27 13:35:23 +01:00
Tommy D. Rossi 98c62eab60 Update utils.ts 2026-01-27 13:35:23 +01:00
Tommy D. Rossi 54d3f02a5b feat: support concurrent screen recordings across multiple tabs
- Change offscreen.ts from single recording variable to Map<tabId, RecordingState>
- Update all recording message handlers to route by tabId
- Track sessionId in relay server for proper recording lookup when stopping
- All recording operations now consistently require tabId
2026-01-27 13:35:23 +01:00
Tommy D. Rossi c9e8361a54 fix: address PR review comments
- Fix misleading comment about user gesture requirement in background.ts
- Remove unused 'target' variable in /recording/stop endpoint
- Fix /recording/cancel to not delete all recordings (handled by event)
- Remove redundant security middlewares (CORS handles it)
2026-01-27 13:35:22 +01:00
Tommy D. Rossi 050c6d5b50 feat: use MP4 format for screen recording instead of WebM 2026-01-27 13:35:22 +01:00
Tommy D. Rossi df63f418e5 feat: add Chrome flags for automated recording without user interaction
- Add getChromeRestartCommand() with --allowlisted-extension-id and --auto-accept-this-tab-capture flags
- Move EXTENSION_IDS to utils.ts for cleaner imports
- Add sessionId support for multi-tab recording
- Add helpful error message when activeTab permission is missing
- Add null check for empty extension result
- Document offscreen recording flow with ASCII diagram
2026-01-27 13:35:22 +01:00
Tommy D. Rossi 8449006e59 refactor: simplify screen recording code
- Fix vite output path (was broken lib/background.mjs, now background.js)
- Import recording types from protocol.ts instead of duplicating in background.ts
- Remove dead getSessionId() and unused sessionId params from screen-recording.ts
- Replace 4 executor wrapper functions with single withRecordingDefaults helper
- Fix binary chunk routing with lastRecordingMetadataTabId tracking
- Add ExtensionStopRecordingResult type for proper extension/relay separation

Saves ~56 lines while improving correctness of multi-tab recording.
2026-01-27 13:35:22 +01:00
Tommy D. Rossi 3b5427ebe8 update notes on permissions for recording 2026-01-27 13:35:22 +01:00
Tommy D. Rossi 09f502cc43 Update background.ts 2026-01-27 13:35:22 +01:00
Tommy D. Rossi 608afc8d54 fix: clear setTimeout on successful recording stop to prevent process hang 2026-01-27 13:35:22 +01:00
Tommy D. Rossi b159d6fbc7 refactor: use satisfies for fetch body types in screen-recording 2026-01-27 13:35:22 +01:00
Tommy D. Rossi e79dd472db test: skip recording test, write proper test flow for manual testing 2026-01-27 13:35:22 +01:00
Tommy D. Rossi b52928cc90 refactor: move HTML files to src/, use vite HTML entry points
- Move welcome.html to src/
- Use vite HTML inputs instead of static copy for offscreen.html and welcome.html
- Source HTML references .ts, vite transforms to .js
- Update paths in background.ts to src/
2026-01-27 13:35:22 +01:00
Tommy D. Rossi c9768965b5 Update .gitignore 2026-01-27 13:35:22 +01:00
Tommy D. Rossi f8d6640819 refactor: use vite rollupOptions instead of esbuild for offscreen.ts 2026-01-27 13:35:22 +01:00
Tommy D. Rossi 74497c2a1a feat: implement screen recording via chrome.tabCapture with offscreen document
- Use chrome.tabCapture.getMediaStreamId() from service worker
- Pass stream ID to offscreen document for MediaRecorder
- Recording survives page navigation (unlike getDisplayMedia)
- Requires user to click extension icon first (activeTab permission)
- Add esbuild to build offscreen.ts separately
- Update prompt docs with recording instructions
2026-01-27 13:35:22 +01:00
Tommy D. Rossi e56e27e5e5 WIP: screen recording via chrome.tabCapture
Work in progress for navigation-safe screen recording.

Implemented:
- tabCapture permission in manifest
- Recording handlers in extension background.ts
- Recording endpoints in relay server
- Binary WebSocket streaming for video chunks
- Protocol types for recording messages
- Executor integration

Needs:
- Offscreen document implementation (tabCapture not available in service workers)
- Connect background.ts to offscreen document via messages
- Update manifest for offscreen document

The offscreen.ts/html files are scaffolding for this next step.
2026-01-27 13:35:22 +01:00
Tommy D. Rossi 81988c3305 show cli examples in welcome 2026-01-27 13:29:03 +01:00
Tommy D. Rossi fd3d4a1aee Update SKILL.md 2026-01-26 15:08:16 +01:00
Tommy D. Rossi d4107d1ddd fix(extension): detach child sessions on parent detach 2026-01-26 15:04:37 +01:00
Tommy D. Rossi d51d8b8e72 feat(cdp): allow iframe targets and serialize extension builds 2026-01-26 14:56:17 +01:00
Tommy D. Rossi 1f59a819da update test snapshots 2026-01-26 14:23:33 +01:00
Tommy D. Rossi c8bd87d8f6 release: playwriter@0.0.56 2026-01-26 14:10:26 +01:00
Tommy D. Rossi 9e79565e1a test: add youtube navigation hang regression 2026-01-26 14:09:42 +01:00
Tommy D. Rossi 3fa98ab689 fix(cdp): resume filtered targets to avoid hung navigations 2026-01-26 13:54:47 +01:00
Tommy D. Rossi 67e8976d2f cover auto-enable after closing pages 2026-01-26 13:50:22 +01:00
Tommy D. Rossi 6b0b9d3bf4 about jq and cdp logfile 2026-01-26 13:44:41 +01:00
Tommy D. Rossi 6364acf316 agents updates 2026-01-26 13:42:44 +01:00
Tommy D. Rossi 60495a8b9a add auto-enable mcp test for no pages 2026-01-26 13:42:29 +01:00
Tommy D. Rossi db93e0d841 Fix auto-enable page selection when no pages 2026-01-26 13:31:46 +01:00
Tommy D. Rossi a64fc2d8a0 add cdp jsonl logging and update log docs 2026-01-26 13:28:18 +01:00
Tommy D. Rossi 4d2606253b add source param in CDP messages 2026-01-26 13:07:59 +01:00
Tommy D. Rossi dc771ddc1d sync tab state for automated tabs 2026-01-26 12:56:27 +01:00
Tommy D. Rossi 2eb2c4fe3d set default timeout 2026-01-26 12:54:21 +01:00
Tommy D. Rossi 4fa618134d nicer logging of returned output 2026-01-26 12:46:36 +01:00
Tommy D. Rossi 905288a790 Update PLAYWRITER_AGENTS.md 2026-01-26 12:24:15 +01:00
Tommy D. Rossi 020ac77695 Update AGENTS.md 2026-01-26 12:23:43 +01:00
Tommy D. Rossi 4bce98bdae Update PLAYWRITER_AGENTS.md 2026-01-26 12:23:36 +01:00
Tommy D. Rossi 5ade53bed1 print logs using node.js util.inspect 2026-01-26 12:18:58 +01:00
Tommy D. Rossi b000fd42b5 release: playwriter@0.0.55 2026-01-25 23:04:54 +01:00
Tommy D. Rossi 393d23e1e2 Delete docker.package.json 2026-01-25 16:18:47 +01:00
Tommy D. Rossi 45cdc372a8 refactor: move SKILL.md to src, add playwriter skill command
- Move skills/playwriter/SKILL.md to playwriter/src/skill.md (source of truth)
- Add 'playwriter skill' CLI command to output full docs
- Make skills/playwriter/SKILL.md a lightweight stub pointing to CLI
- Generate prompt.md to dist/ instead of src/
- Strip CLI-only content from MCP prompt
2026-01-25 16:18:23 +01:00
Tommy D. Rossi dba08e932f chore: stop tracking generated prompt.md 2026-01-25 15:04:55 +01:00
Tommy D. Rossi 8313b7a43a release: playwriter@0.0.54 2026-01-25 15:02:59 +01:00
Tommy D. Rossi b29b1395d1 Optimize aria snapshot ref lookup 2026-01-25 15:02:26 +01:00
Tommy D. Rossi 0fb9d2c229 Clamp extension log payloads 2026-01-25 15:01:40 +01:00
Tommy D. Rossi 5175f5cc8e Update executor.ts 2026-01-25 14:58:08 +01:00
Tommy D. Rossi d4e49b2d5d nn 2026-01-25 14:58:00 +01:00
Tommy D. Rossi ee1f9729d6 add sse test to make sure responses are not buffered 2026-01-25 14:54:08 +01:00
Tommy D. Rossi b769df94e3 wait for extension only if ws restarted 2026-01-25 14:44:35 +01:00