Commit Graph

299 Commits

Author SHA1 Message Date
mertunsall
47b2b7f2fa fix more 2025-06-26 01:02:50 +02:00
mertunsall
6b4953e922 rewrite file system 2025-06-26 00:41:56 +02:00
Gregor Žunič
1e93ca5a9f fixed UnionType type error 2025-06-25 11:13:42 +02:00
Gregor Žunič
cda43e9573 fixed types 2025-06-25 11:06:38 +02:00
Gregor Žunič
5d55435491 fixed controller registry types 2025-06-25 10:52:38 +02:00
Magnus Müller
7cf9667127 Enhance ActionModelUnion to maintain interface and delegate methods
Refactors the ActionModelUnion class to ensure it properly maintains the ActionModel interface by delegating methods like get_index, set_index, and model_dump to the underlying action model. This improves the usability and consistency of the union type in handling action models.
2025-06-24 23:21:18 +02:00
Magnus Müller
f138b522cc Fix output model for openai 2025-06-24 23:08:06 +02:00
Mert Unsal
92ec19de0d Merge branch 'main' into fix/input-detection-logic 2025-06-24 20:00:00 +02:00
Daniel T.
72fe90377f Enhances null handling in file input check
Prevents NoneType error by adding a null check before assessing
if an element is a file input, ensuring robust functionality in
file upload checks.
2025-06-24 19:28:34 +02:00
Daniel Tremer
9bb69bd3d4 Update browser_use/controller/service.py
Co-authored-by: Mert Unsal <mertunsal1905@gmail.com>
2025-06-24 14:46:41 +02:00
Daniel T.
18452798f8 Improves file input detection logic
Refines the conditional check for identifying file input elements
to enhance accuracy by reorganizing the code logic for better
readability and maintainability.
2025-06-24 13:11:22 +02:00
Daniel T.
bf4887bb26 Refines file input detection logic
Enhances logic to accurately identify file input elements by
checking element's tag and type attributes, reducing false
positives in file upload detection.
2025-06-24 13:06:19 +02:00
Gregor Žunič
1a807d1d5d Merge branch 'main' into feature/squashed-langchain-to-native 2025-06-24 12:35:06 +02:00
Gregor Žunič
7a10ae0c96 Squashed commit langchain to native 2025-06-24 12:26:55 +02:00
mertunsall
4158611b2b fix 2025-06-24 11:12:58 +02:00
mertunsall
3ff2443c9a update emoji in extracted_content 2025-06-24 10:59:07 +02:00
Mert Unsal
6e1a2172db Merge branch 'main' into mert/click_download 2025-06-24 10:49:03 +02:00
mertunsall
d92a960983 fix download memory in clicking 2025-06-24 10:42:41 +02:00
mertunsall
87e3529e85 bugfix 2025-06-24 01:14:00 +02:00
Mert Unsal
4f9793b065 move filesystem controllers (#2065)
Moved file system action controllers from agent/service.py to
controller/service.py to centralize file operations. 
Fixed a bug with read_file.
2025-06-24 00:08:30 +02:00
Nick Sweeting
01b9580743 show full error text, check for missing special args, dont check browser tabs for connection status 2025-06-23 15:03:02 -07:00
mertunsall
9edffbdd10 move filesystem controllers 2025-06-23 23:56:51 +02:00
mertunsall
15d25f4b61 fix click element upload_index problem
update file upload example
2025-06-23 21:46:17 +02:00
mertunsall
ab6819885e Extracted content is automatically saved to a file and leaving better description to the memory for better agent context 2025-06-23 13:56:13 +02:00
mertunsall
b3ccedf632 Update action description for input_text to clarify functionality 2025-06-22 17:56:53 +02:00
mertunsall
258d0b0bec Implemented a try-except block to handle exceptions when inputting text into DOM elements. If an error occurs, a descriptive message is returned to indicate the failure, improving robustness in browser interactions. 2025-06-22 15:34:37 +02:00
Nick Sweeting
b67be37490 fix type hint errors 2025-06-21 04:35:24 -07:00
Magnus Müller
4a8cf30dac Merge branch 'main' into mert/new_everything 2025-06-20 12:27:19 +02:00
Magnus Müller
4c2952d640 Squashed commit of the following:
commit a9cf53a1b1
Merge: 5aa62c11 0f9ffa10
Author: Magnus Müller <67061560+MagMueller@users.noreply.github.com>
Date:   Fri Jun 20 10:41:19 2025 +0200

    Set user_data_dir to None (#2015)

    <!-- This is an auto-generated description by cubic. -->
    Changed browser session setup to use incognito mode by setting
    user_data_dir to None, preventing persistent state between evaluation
    runs.

    <!-- End of auto-generated description by cubic. -->

commit 0f9ffa1072
Author: Magnus Müller <67061560+MagMueller@users.noreply.github.com>
Date:   Fri Jun 20 10:38:01 2025 +0200

    Set user_data_dir to None

commit 5aa62c1113
Merge: d8a9d21b e559ff5e
Author: Nick Sweeting <git@sweeting.me>
Date:   Thu Jun 19 23:01:49 2025 -0700

    Fix cross-origin iframe DOM retrieval (#1965)

commit d8a9d21b00
Merge: 3e5f3049 b6be1583
Author: Nick Sweeting <git@sweeting.me>
Date:   Thu Jun 19 23:01:21 2025 -0700

    Fix critical domain restriction bypass vulnerability (#2006)

commit b6be158319
Author: Sahar <saharhashai@gmail.com>
Date:   Thu Jun 19 02:28:34 2025 -0700

    Delete tests/ci/test_security_url_validation.py

commit aca4b57329
Author: Sahar <saharhashai@gmail.com>
Date:   Thu Jun 19 02:27:57 2025 -0700

    Delete SECURITY_FIX_REPORT.md

commit 45872c1e45
Author: Your Name <your.email@example.com>
Date:   Thu Jun 19 11:24:50 2025 +0200

    fix(security): prevent domain restriction bypass in controller actions

    - Add domain validation to controller.click() and controller.type() methods
    - Implement comprehensive security checks before executing actions
    - Prevent potential prompt injection and unauthorized data access
    - Add extensive test coverage for domain validation scenarios
    - Update documentation with security considerations

    This critical fix prevents complete bypass of domain restrictions that
    could enable attackers to perform unauthorized actions on any domain.

commit e559ff5eaa
Merge: 19ae8a11 f348e0c5
Author: Nick Sweeting <git@sweeting.me>
Date:   Sat Jun 14 01:56:09 2025 -0700

    Merge branch 'main' into main

commit 19ae8a1146
Merge: e1b3ff9e 08ed0be3
Author: Nick Sweeting <git@sweeting.me>
Date:   Sat Jun 14 00:31:30 2025 -0700

    Merge branch 'main' into main

commit e1b3ff9e9d
Author: Ilya Biryukov <ilbiryuk@microsoft.com>
Date:   Thu Jun 12 17:40:40 2025 -0700

    Revert changes to  examples/features/multiple_agents_same_browser.py

commit d20a3b55d6
Author: Ilya Biryukov <ilbiryuk@microsoft.com>
Date:   Thu Jun 12 17:30:59 2025 -0700

    Fix pre-commit lint issues and compile error in multiple_agents_same_browser

commit 13d5468aa2
Author: Ilya Biryukov <ilbiryuk@microsoft.com>
Date:   Thu Jun 12 14:07:21 2025 -0700

    Fix cross-origin iframe DOM retrieval
2025-06-20 10:51:06 +02:00
Nick Sweeting
d8a9d21b00 Fix critical domain restriction bypass vulnerability (#2006) 2025-06-19 23:01:21 -07:00
Magnus Müller
ad446f5769 Merge branch 'main' into mert/new_everything 2025-06-19 23:45:41 +02:00
Magnus Müller
af09713d15 Enhance error reporting in retry_async_function by including the exception message in ActionResult. Update scroll height retrieval logic to correctly negate the result, improving clarity and consistency in error handling. 2025-06-19 23:27:43 +02:00
Magnus Müller
90ae26316e Refactor ActionResult to standardize the inclusion of extracted content, replacing update_only_read_state with include_extracted_content_only_once across multiple services. This change enhances clarity in memory management and ensures consistent handling of extracted content. 2025-06-19 23:18:30 +02:00
Magnus Müller
ce880e5e35 Refactor ActionResult handling across multiple services to standardize the use of long_term_memory, replacing memory references. Update related logic to ensure extracted content is consistently managed for improved clarity and error handling. 2025-06-19 23:11:55 +02:00
Nick Sweeting
c36ca35984 improve logging of errors 2025-06-19 06:40:14 -07:00
mertunsall
76ef41da45 Merge branch 'main' into mert/new_everything 2025-06-19 14:11:56 +02:00
Nick Sweeting
60f2abd206 add retry for actions that fail due to page navigation mid-action 2025-06-19 04:15:04 -07:00
mertunsall
862f9d545a Refine prompt in service.py to enhance clarity for vague queries and improve response structure 2025-06-19 12:13:09 +02:00
mertunsall
51d7626c1a Update prompt in service.py to clarify response for vague queries 2025-06-19 12:07:06 +02:00
mertunsall
e29d98e6da Add retry mechanism for async functions in service.py
- Introduced a new `retry_async_function` to handle retries for async operations, improving error resilience.
- Updated existing async calls in the content extraction and scrolling functions to utilize the new retry mechanism, enhancing reliability in case of transient errors.
- Added detailed logging for retry attempts to aid in debugging.
2025-06-19 11:55:47 +02:00
Nick Sweeting
9bf0b10b31 throw explicit error for missing page 2025-06-19 02:27:38 -07:00
Your Name
45872c1e45 fix(security): prevent domain restriction bypass in controller actions
- Add domain validation to controller.click() and controller.type() methods
- Implement comprehensive security checks before executing actions
- Prevent potential prompt injection and unauthorized data access
- Add extensive test coverage for domain validation scenarios
- Update documentation with security considerations

This critical fix prevents complete bypass of domain restrictions that
could enable attackers to perform unauthorized actions on any domain.
2025-06-19 11:24:50 +02:00
Magnus Müller
0b6ebea431 Merge branch 'main' into mert/new_everything 2025-06-19 09:49:43 +02:00
Yasith Jayawardana
e2e11966d3 Merge branch 'main' into typing-improvements 2025-06-18 21:20:47 -04:00
mertunsall
4f73c36a6e default include links to False 2025-06-18 15:57:08 +02:00
mertunsall
bbc8d26f63 - Updated ActionResult to include an attachments field for displaying files in the done message.
- Enhanced logging in the Agent class to inform users about available attachments after task completion.
- Revised system prompt guidelines to clarify the use of text and files_to_display in the done action.
2025-06-18 14:24:27 +02:00
mertunsall
38b0b4771c Update extract_structured_data action to default include_links to True for improved usability 2025-06-18 13:19:49 +02:00
mertunsall
1864e52635 Merge branch 'main' into mert/new_everything 2025-06-18 10:00:25 +02:00
Magnus Müller
1b5593d1aa remove unused success parameter from ActionResult in service.py 2025-06-17 19:15:33 +02:00
mertunsall
b8621e1089 Improve logging and action result handling: update messages for new elements detection and adjust success flag in action results so that agent doesn't stop. 2025-06-17 18:58:17 +02:00