Commit Graph

11 Commits

Author SHA1 Message Date
Magnus Müller
a31ae9dffb Refactor bounding box drawing and enhance LLM text representation
- Removed the `_raise_if_stopped_or_paused` method from the `Agent` class to streamline functionality.
- Updated `draw_enhanced_bounding_box_with_text` to improve font size and padding for better visibility of index boxes.
- Introduced `get_meaningful_text_for_llm` method in `EnhancedDOMTreeNode` to provide more relevant text for LLM processing.
- Enhanced `llm_representation` method with observability features for better debugging.
2025-08-29 21:30:11 -07:00
Magnus Müller
e8bd85865d Add filter for highlight IDs in screenshot generation and update element colors
- Introduced `filter_highlight_ids` option in `BrowserProfile`, `BrowserSession`, and `create_highlighted_screenshot` to control the visibility of element IDs based on text length.
- Updated `draw_enhanced_bounding_box_with_text` to utilize the new filtering logic for enhanced visual clarity.
- Changed the color of text areas from yellow to orange for improved visibility in the UI.
2025-08-29 20:56:03 -07:00
Magnus Müller
66822d6090 Update font size and padding in bounding box drawing functions for improved visibility
- Increased font size in `draw_enhanced_bounding_box_with_text` from 35 to 40 for better readability.
- Adjusted padding in `draw_bounding_box_with_text` from 3 to 5 to enhance spacing around text elements.
2025-08-29 20:45:54 -07:00
Magnus Müller
8511c2d398 Remove display highlights on screen feature and adjust bounding box drawing parameters
- Eliminated the `display_highlights_on_screen` option from `BrowserProfile` and `BrowserSession` to streamline the highlighting functionality.
- Updated the `draw_enhanced_bounding_box_with_text` function to increase font size for better visibility and reduced padding for a more compact layout.
- Removed associated screenshot overlay logic in `DOMWatchdog` to reflect the removal of the display highlights feature.
2025-08-29 20:38:57 -07:00
Magnus Müller
3b6c5d11ba Enhance bounding box drawing with dashed borders and larger index containers
- Updated `draw_enhanced_bounding_box_with_text` function to draw dashed bounding boxes for better visibility.
- Increased the size of index text and padding for improved prominence.
- Adjusted text positioning logic to ensure proper placement within or outside the bounding box based on available space.
- Enhanced background rectangle drawing for better contrast and visibility.
2025-08-29 20:24:13 -07:00
Magnus Müller
634dd20e37 Add display highlights on screen feature and enhance bounding box drawing
- Introduced `display_highlights_on_screen` option in `BrowserProfile` and `BrowserSession` to control the visibility of highlights directly on the browser screen.
- Implemented `draw_enhanced_bounding_box_with_text` function to improve the visual representation of highlighted elements with larger indices and solid borders.
- Updated screenshot overlay logic in `DOMWatchdog` to utilize the new highlighting feature, ensuring better visibility of interactive elements during browser sessions.
2025-08-29 20:19:26 -07:00
Magnus Müller
ae585cf2c5 Highlights clever placement 2025-08-17 17:14:57 -07:00
Magnus Müller
8d7bf52223 bigger highlights and less dashes 2025-08-17 17:01:23 -07:00
Magnus Müller
78a1f70ade Use dash lines for highlights 2025-08-17 16:32:16 -07:00
Magnus Müller
1375013df7 BBox on entire page works 2025-08-17 16:14:50 -07:00
Cursor Agent
6ad7e708d8 Add Python-based screenshot highlighting with element bounding boxes
Co-authored-by: mamagnus00 <mamagnus00@gmail.com>
2025-08-17 22:39:32 +00:00