Commit Graph

30 Commits

Author SHA1 Message Date
Magnus Müller
b678f27a3e Migration from highlight index to backendnode id 2025-10-21 21:02:28 -07:00
Magnus Müller
9ae7144e5a type-safe-element-element 2025-09-11 10:42:30 -07:00
Magnus Müller
e7897a90d9 Remove overlays 2025-09-03 15:14:18 -07:00
Magnus Müller
4f891cd5f6 Remove gc 2025-09-03 15:14:00 -07:00
Magnus Müller
198f343c6a Refactor type hint for font cache and function return type in python_highlights.py
Updated the type hint for the _FONT_CACHE dictionary to use a union type for better clarity. Modified the return type of get_cross_platform_font function to reflect the same change, enhancing type safety and readability.
2025-09-03 14:21:19 -07:00
Magnus Müller
53e5858d8e fix-pil-import 2025-09-03 14:19:23 -07:00
Magnus Müller
33f69b1525 less-timeouts 2025-08-31 11:18:47 -07:00
Magnus Müller
833ad7128d Remove comment 2025-08-31 09:34:45 -07:00
Magnus Müller
1b5b360ae8 smaller-highlights-with-screensize 2025-08-31 09:29:18 -07:00
Magnus Müller
e10826ca34 Fix Bug: Async Function Error in Screenshot Handling 2025-08-31 08:45:00 -07:00
Magnus Müller
929489352e Len to show highlight index set less than 3 2025-08-31 08:18:12 -07:00
Magnus Müller
8ecc46daf6 Update system prompts for clarity and adjust bounding box rendering in Python highlights
- Revised system prompt descriptions to clarify the provision of screenshots and bounding boxes for interactive elements.
- Enhanced bounding box positioning logic in `python_highlights.py` to improve visibility and avoid content blocking.
- Updated screenshot logging to reflect dynamic filename usage.
2025-08-31 08:14:32 -07:00
Magnus Müller
20193556a1 Add PNG files to .gitignore and refactor screenshot saving in Python highlights
- Updated .gitignore to exclude PNG files.
- Refactored the screenshot saving logic in `python_highlights.py` to use an environment variable for the filename and added async file writing for improved performance.
- Adjusted font size and padding to fixed values for consistent appearance across different screen sizes.
2025-08-31 07:57:24 -07:00
Magnus Müller
81461cdfff Adjust font size and padding calculations for enhanced bounding box rendering in Python highlights; update task description in example script for clarity. 2025-08-31 07:43:38 -07:00
Magnus Müller
aad4b932bf time_execution_async import 2025-08-29 22:32:05 -07:00
Magnus Müller
25823ce670 make highlights sync 2025-08-29 22:25:32 -07:00
Magnus Müller
ce0876adb7 highlight in parallel 2025-08-29 22:17:50 -07:00
Magnus Müller
d8b23062b9 Formatter 2025-08-29 21:46:45 -07:00
Magnus Müller
7b0e216ff0 Update font size and padding adjustments in bounding box drawing for enhanced visibility
- Increased font size in `draw_enhanced_bounding_box_with_text` from 30 to 36 for improved readability.
- Adjusted padding from 8 to 6 to accommodate the larger font while maintaining visual clarity.
- Enhanced text positioning logic to prevent clipping and ensure proper alignment within the bounding box.
2025-08-29 21:36:25 -07:00
Magnus Müller
a31ae9dffb Refactor bounding box drawing and enhance LLM text representation
- Removed the `_raise_if_stopped_or_paused` method from the `Agent` class to streamline functionality.
- Updated `draw_enhanced_bounding_box_with_text` to improve font size and padding for better visibility of index boxes.
- Introduced `get_meaningful_text_for_llm` method in `EnhancedDOMTreeNode` to provide more relevant text for LLM processing.
- Enhanced `llm_representation` method with observability features for better debugging.
2025-08-29 21:30:11 -07:00
Magnus Müller
e8bd85865d Add filter for highlight IDs in screenshot generation and update element colors
- Introduced `filter_highlight_ids` option in `BrowserProfile`, `BrowserSession`, and `create_highlighted_screenshot` to control the visibility of element IDs based on text length.
- Updated `draw_enhanced_bounding_box_with_text` to utilize the new filtering logic for enhanced visual clarity.
- Changed the color of text areas from yellow to orange for improved visibility in the UI.
2025-08-29 20:56:03 -07:00
Magnus Müller
66822d6090 Update font size and padding in bounding box drawing functions for improved visibility
- Increased font size in `draw_enhanced_bounding_box_with_text` from 35 to 40 for better readability.
- Adjusted padding in `draw_bounding_box_with_text` from 3 to 5 to enhance spacing around text elements.
2025-08-29 20:45:54 -07:00
Magnus Müller
8511c2d398 Remove display highlights on screen feature and adjust bounding box drawing parameters
- Eliminated the `display_highlights_on_screen` option from `BrowserProfile` and `BrowserSession` to streamline the highlighting functionality.
- Updated the `draw_enhanced_bounding_box_with_text` function to increase font size for better visibility and reduced padding for a more compact layout.
- Removed associated screenshot overlay logic in `DOMWatchdog` to reflect the removal of the display highlights feature.
2025-08-29 20:38:57 -07:00
Magnus Müller
3b6c5d11ba Enhance bounding box drawing with dashed borders and larger index containers
- Updated `draw_enhanced_bounding_box_with_text` function to draw dashed bounding boxes for better visibility.
- Increased the size of index text and padding for improved prominence.
- Adjusted text positioning logic to ensure proper placement within or outside the bounding box based on available space.
- Enhanced background rectangle drawing for better contrast and visibility.
2025-08-29 20:24:13 -07:00
Magnus Müller
634dd20e37 Add display highlights on screen feature and enhance bounding box drawing
- Introduced `display_highlights_on_screen` option in `BrowserProfile` and `BrowserSession` to control the visibility of highlights directly on the browser screen.
- Implemented `draw_enhanced_bounding_box_with_text` function to improve the visual representation of highlighted elements with larger indices and solid borders.
- Updated screenshot overlay logic in `DOMWatchdog` to utilize the new highlighting feature, ensuring better visibility of interactive elements during browser sessions.
2025-08-29 20:19:26 -07:00
Magnus Müller
ae585cf2c5 Highlights clever placement 2025-08-17 17:14:57 -07:00
Magnus Müller
8d7bf52223 bigger highlights and less dashes 2025-08-17 17:01:23 -07:00
Magnus Müller
78a1f70ade Use dash lines for highlights 2025-08-17 16:32:16 -07:00
Magnus Müller
1375013df7 BBox on entire page works 2025-08-17 16:14:50 -07:00
Cursor Agent
6ad7e708d8 Add Python-based screenshot highlighting with element bounding boxes
Co-authored-by: mamagnus00 <mamagnus00@gmail.com>
2025-08-17 22:39:32 +00:00