Commit Graph

5298 Commits

Author SHA1 Message Date
Nick Sweeting
78ee73c949 cleaner logging slightly 2025-08-14 19:06:18 -07:00
Nick Sweeting
c5d33b4537 add timeouts around occasionally slow getLayoutMetrics and always focus before getting layout 2025-08-14 18:38:42 -07:00
Nick Sweeting
efdbad7cfb better llm hints for dropdowns 2025-08-14 18:36:55 -07:00
Nick Sweeting
5bc9cbe141 when click_element_by_index fails, auto-call get_dropdown_options and return result directly 2025-08-14 18:16:12 -07:00
Nick Sweeting
287a66822c tweak get_dropdown_options wording to avoid LLM over-use 2025-08-14 17:39:41 -07:00
Nick Sweeting
d509759c57 more get_dropdown_options fixes 2025-08-14 17:11:18 -07:00
Nick Sweeting
d71d39d326 only include options list in click hint if under 100 entries long 2025-08-14 16:57:54 -07:00
Nick Sweeting
b1ca5bd8e1 include dropdown options hints in llm error 2025-08-14 16:54:23 -07:00
Nick Sweeting
8b134dd25a port over merts new llm_error_msg tags 2025-08-14 16:46:54 -07:00
Nick Sweeting
b03ebc2f1c disable storage state watchdog temporarily 2025-08-14 16:44:30 -07:00
Nick Sweeting
d84f89abf9 immediately update focus on SwitchTab to fix laminar issue 2025-08-14 16:44:30 -07:00
Nick Sweeting
5cc7d0f301 move dropdown options to proper event handlers 2025-08-14 16:44:29 -07:00
Mert Unsal
f00c271468 Update system prompts with recent feedback (#2688)
Updated system prompts based on recent feedback and testing
    
<!-- This is an auto-generated description by cubic. -->
---

## Summary by cubic
Updated all system prompt files and code to clarify how to reference
available file paths and ensure all findings are shared with the user in
the reply.

- **Prompt Improvements**
 - Added a reminder to use absolute file paths when referencing files.
- Updated guidance for the `done` action to include all relevant
information in the `text` field.

<!-- End of auto-generated description by cubic. -->
2025-08-15 00:19:10 +01:00
mertunsall
beaede9631 small additions 2025-08-15 00:18:12 +01:00
Mert Unsal
2638f41dd6 Fix Error Messages (#2686)
<!-- This is an auto-generated description by cubic. -->

## Summary by cubic
Improved error messages across browser actions so that responses to the
LLM are cleaner and easier to parse. Read state descriptions now better
handle multiple extracted contents.

- **Bug Fixes**
 - Added standardized <llm_error_msg> tags for errors sent to the LLM.
- Refactored error handling to extract and return simple, clean error
messages.
- Enhanced dropdown selection errors to show available options when
possible.
- Updated state descriptions to clearly separate multiple extracted
contents.

<!-- End of auto-generated description by cubic. -->
2025-08-14 22:54:21 +01:00
Mert Unsal
0c8d863d6c Merge branch 'main' into mert/fix_error_messages 2025-08-14 22:54:13 +01:00
Nick Sweeting
6fab25c043 tests fixes 2025-08-14 14:32:32 -07:00
Nick Sweeting
3c9456decc bump version 2025-08-14 14:32:32 -07:00
Nick Sweeting
654c08342a remove playwright and patchright deps 2025-08-14 14:32:32 -07:00
Nick Sweeting
878586edcd examples fixes 2025-08-14 14:32:32 -07:00
Nick Sweeting
a1f1330aa6 linter fixes 2025-08-14 14:32:32 -07:00
Nick Sweeting
d8654dfced make NavigateToUrl re-use existing tab with matching URL unless new_tab=True 2025-08-14 14:32:31 -07:00
Nick Sweeting
d150b5ca09 prevent pages from pausing execution and blocking agent using debugger breakpoints 2025-08-14 14:32:31 -07:00
Nick Sweeting
fe9b287841 finish removing playwright enitrely, get local browser paths manually 2025-08-14 14:32:31 -07:00
Nick Sweeting
8684fa0d00 make agent focus on new tabs when they open as a suprise after clicking 2025-08-14 14:32:31 -07:00
Nick Sweeting
35e122def1 use go_to_url action to preload urls in tasks instead of force-navigating 2025-08-14 14:32:31 -07:00
Nick Sweeting
86fb443895 remove old unused playwright types 2025-08-14 14:32:31 -07:00
mertunsall
aa7095df86 fix wrong url in extract content 2025-08-14 21:38:49 +01:00
Nick Sweeting
30d2a33ef7 Merge branch 'main' into mert/fix_error_messages 2025-08-14 12:53:06 -07:00
Nick Sweeting
6f51eab6a4 Fix typo (#2644) 2025-08-14 12:50:31 -07:00
Mert Unsal
f5284c996f Merge branch 'main' into mert/fix_error_messages 2025-08-14 20:46:59 +01:00
mertunsall
3ac58d9457 LLM should get clean messages without emojis and weird error logs 2025-08-14 20:46:26 +01:00
mertunsall
d243ae7bcb make sure that read state can handle multiple items nicely 2025-08-14 20:45:02 +01:00
Nick Sweeting
ffcd511772 add StreamableHttp support to mcp (#2673) 2025-08-14 12:39:32 -07:00
Nick Sweeting
1689b9a2e7 Fix #2614: Prevent QueueShutDown exception when using add_new_task + multiple runs (#2649) 2025-08-14 12:37:51 -07:00
Nick Sweeting
5de5c746fd Merge branch 'main' into fix/issue-2614-queue-shutdown-clean 2025-08-14 12:37:21 -07:00
Nick Sweeting
05fb8a85f7 Cross origin iframes (#2680) 2025-08-14 12:30:50 -07:00
Nick Sweeting
25bbcb597c Merge branch 'main' into cross-origin-iframes 2025-08-14 12:30:38 -07:00
Gregor Žunič
e63423c6be Revert prompt changes (#2684) 2025-08-14 09:52:27 -07:00
Gregor Žunič
fb4700a38e revert prompt changes 2025-08-14 09:39:15 -07:00
Nick Sweeting
22ae5afd73 rename ScrollAction.index to frame_element_index because llm was misusing it often 2025-08-14 05:05:30 -07:00
Nick Sweeting
524017c8b9 more clear_existing fixes for input_text 2025-08-14 05:04:38 -07:00
Nick Sweeting
fcc38f6f44 bump cli default models to gpt-5-mini 2025-08-14 05:03:38 -07:00
Nick Sweeting
391b1c47a9 disable redundant 2025-08-14 05:03:16 -07:00
Nick Sweeting
b3546b0cf5 fix iframe scroll detection and viewport element inclusion tests after scroll 2025-08-14 05:02:57 -07:00
Nick Sweeting
a476a1ec28 fix clear_existing param to input_text 2025-08-14 04:59:22 -07:00
Nick Sweeting
6c2e854ee5 dont use preload cache for anything after the first step 2025-08-14 00:11:03 -07:00
Nick Sweeting
e2d777a347 increase delay between keystrokes to avoid laggy js keyUp event handlers messing with input 2025-08-13 22:56:58 -07:00
Nick Sweeting
cdfd8b9fcc clear selector map cache after scolling so its recalculated 2025-08-13 22:56:16 -07:00
Nick Sweeting
e9769ac18e tweak logging line lengths 2025-08-13 22:55:50 -07:00