163 Commits

Author	SHA1	Message	Date
magmueller	f27e65500a	Merge remote-tracking branch 'origin/HEAD' into multi-step	2024-12-04 17:31:21 +01:00
magmueller	05d0bc7d6b	Check siblings when searching for element	2024-12-04 17:27:07 +01:00
magmueller	7450a469fa	Include function descriptions in prompt	2024-12-04 17:26:51 +01:00
magmueller	faf22c8c34	Hacky fix just tell user to close all chrome instances	2024-12-04 16:49:33 +01:00
Gregor Žunič	45a46f8fbd	tiny improvements to css selector generation	2024-12-04 15:22:07 +01:00
magmueller	05300b30f8	File upload works robust and can connect to existing browser	2024-12-04 15:08:55 +01:00
magmueller	56b0eb77f2	Improve prompt	2024-12-03 16:15:33 +01:00
magmueller	db9b66963c	Remove highlights	2024-12-03 16:15:26 +01:00
magmueller	604aad957d	Validator gets new state	2024-12-03 15:28:23 +01:00
magmueller	03a93c7083	Logging	2024-12-03 14:39:28 +01:00
magmueller	81e33566a4	Prompt improvement and set max actions per step	2024-12-03 14:20:40 +01:00
magmueller	e0ab9d9a0c	Default headless to false	2024-12-03 14:20:12 +01:00
magmueller	754a9f6d9b	Include action results in state	2024-12-03 14:19:51 +01:00
Gregor Žunič	4a445aef6a	removed unnecesary files, added screenshots to history	2024-12-03 14:15:12 +01:00
magmueller	ca8d060754	Keys send description	2024-12-03 12:27:35 +01:00
magmueller	90aceaa038	Improve prompt of evaluation	2024-12-03 12:26:14 +01:00
magmueller	ac60344336	Improve prompt	2024-12-03 11:09:52 +01:00
magmueller	cb654d3ab8	Scrolling to text works	2024-12-03 11:09:43 +01:00
magmueller	13bb5f7141	Merge remote-tracking branch 'origin/staging' into multi-step	2024-12-03 10:18:55 +01:00
magmueller	969856478a	Include clicks in memory	2024-12-03 10:06:46 +01:00
magmueller	60fbbcae93	Split HistoryTreeProcessor in views and service	2024-12-03 09:26:17 +01:00
magmueller	b0fcf2816e	Check if state changed	2024-12-03 09:22:23 +01:00
magmueller	9af6b1ab76	Dom include elements for amazon dropdown	2024-12-03 07:51:42 +01:00
magmueller	25196b57d1	Create hashes of state in multi act	2024-12-02 20:36:59 +01:00
magmueller	969e31140c	Simplified buildDomTree.js	2024-12-02 18:39:37 +01:00
magmueller	9d44efb9bf	Change window size	2024-12-02 18:36:35 +01:00
magmueller	c99665ae4a	Simplify dom builder	2024-12-02 18:34:19 +01:00
Gregor Žunič	ad0db053b7	Merge branch 'staging' into feature/infrastructure	2024-12-02 18:34:16 +01:00
magmueller	3ca8f50acb	Improve function description	2024-12-02 14:50:43 +01:00
Gregor Žunič	b6214fe4fd	save traces, browser context has context_id	2024-12-02 13:07:01 +01:00
Gregor Žunič	941122a72c	ability to save trace	2024-12-02 11:42:56 +01:00
magmueller	8e31e82919	Improve prompt	2024-12-02 11:21:15 +01:00
magmueller	921a23d5ef	No sleep after last action	2024-12-02 11:20:37 +01:00
magmueller	e994da11c1	Error trace only in debug mode	2024-12-02 11:19:51 +01:00
magmueller	1b1201a45b	BBox with different color and little bit better label placement	2024-12-02 11:19:30 +01:00
Gregor Žunič	1721eefa8c	save recording path	2024-12-02 10:29:53 +01:00
Gregor Žunič	36fabb799c	fixed tests, now headless, no more asyncio errors (hopefully)	2024-12-02 10:09:22 +01:00
magmueller	34ca52ea3a	Fix small actions - improve prompt for multiaction - improve logging	2024-12-01 22:34:17 +01:00
magmueller	5128b6f0c4	Multiaction works	2024-12-01 22:02:41 +01:00
magmueller	90ef74aceb	Removed num_clicks, fixed type valuation -> evaluation, and multiaction with output list	2024-12-01 21:49:57 +01:00
magmueller	dd937112ba	Improve prompt	2024-12-01 21:49:15 +01:00
magmueller	764cf91b55	No response format	2024-12-01 21:04:49 +01:00
magmueller	a7f0151cc4	Fix history as list	2024-12-01 21:04:38 +01:00
magmueller	c581a1b251	First draft multi-action runs	2024-12-01 21:00:22 +01:00
Gregor Žunič	cf27d9e1c5	allows parralelized agents	2024-12-01 20:17:10 +01:00
magmueller	180815b0ce	Option to load only k messages	2024-12-01 20:03:00 +01:00
magmueller	fcbd9a8cd7	Remove highlights before action	2024-12-01 20:02:11 +01:00
magmueller	9ca311652e	Switch max error and attributes in arguments	2024-12-01 20:01:55 +01:00
magmueller	0c15d6c6d3	More robust when page closes	2024-12-01 20:00:34 +01:00
Gregor Žunič	d4e9257c4c	renamed service to browser	2024-12-01 14:14:48 +01:00