Tests: Create imported WPT test output from completion callback data

This allows us to disable test output, which performs expensive assert
tracking. This was making our imported tests run significantly slower
than tests run via `WPT.sh`.

Formatting the output ourselves also allows us to remove unnecessary
information from the test output.

This commit also rebaselines all existing imported WPT tests to follow
the new format.
This commit is contained in:
Tim Ledbetter
2024-12-02 18:45:22 +00:00
committed by Tim Ledbetter
parent e38b206957
commit 61ae388140
Notes: github-actions[bot] 2024-12-02 22:42:57 +00:00
1036 changed files with 17493 additions and 22639 deletions

View File

@@ -1,17 +1,12 @@
Summary
Harness status: OK
Rerun
Found 6 tests
1 Pass
5 Fail
Details
Result Test Name MessageFail #target > div 1
Fail #target > div 2
Fail #target > div 3
Pass #target > div 4
Fail #target > div 5
Fail #target > div 6
Fail #target > div 1
Fail #target > div 2
Fail #target > div 3
Pass #target > div 4
Fail #target > div 5
Fail #target > div 6

View File

@@ -1,16 +1,11 @@
Summary
Harness status: OK
Rerun
Found 6 tests
6 Fail
Details
Result Test Name MessageFail #target > div 1
Fail #target > div 2
Fail #target > div 3
Fail #target > div 4
Fail #target > div 5
Fail #target > div 6
Fail #target > div 1
Fail #target > div 2
Fail #target > div 3
Fail #target > div 4
Fail #target > div 5
Fail #target > div 6

View File

@@ -1,16 +1,11 @@
Summary
Harness status: OK
Rerun
Found 6 tests
6 Fail
Details
Result Test Name MessageFail #target > div 1
Fail #target > div 2
Fail #target > div 3
Fail #target > div 4
Fail #target > div 5
Fail #target > div 6
Fail #target > div 1
Fail #target > div 2
Fail #target > div 3
Fail #target > div 4
Fail #target > div 5
Fail #target > div 6

View File

@@ -1,17 +1,12 @@
Summary
Harness status: OK
Rerun
Found 6 tests
1 Pass
5 Fail
Details
Result Test Name MessageFail #target > div 1
Pass #target > div 2
Fail #target > div 3
Fail #target > div 4
Fail #target > div 5
Fail #target > div 6
Fail #target > div 1
Pass #target > div 2
Fail #target > div 3
Fail #target > div 4
Fail #target > div 5
Fail #target > div 6

View File

@@ -1,14 +1,9 @@
Summary
Harness status: OK
Rerun
Found 3 tests
1 Pass
2 Fail
Details
Result Test Name MessageFail #target > div 1
Pass #target > div 2
Fail #target > div 3
Fail #target > div 1
Pass #target > div 2
Fail #target > div 3

View File

@@ -1,13 +1,8 @@
Summary
Harness status: OK
Rerun
Found 3 tests
3 Fail
Details
Result Test Name MessageFail #target > div 1
Fail #target > div 2
Fail #target > div 3
Fail #target > div 1
Fail #target > div 2
Fail #target > div 3

View File

@@ -1,13 +1,8 @@
Summary
Harness status: OK
Rerun
Found 3 tests
3 Fail
Details
Result Test Name MessageFail #target > div 1
Fail #target > div 2
Fail #target > div 3
Fail #target > div 1
Fail #target > div 2
Fail #target > div 3

View File

@@ -1,15 +1,10 @@
Summary
Harness status: OK
Rerun
Found 4 tests
2 Pass
2 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4

View File

@@ -1,14 +1,9 @@
Summary
Harness status: OK
Rerun
Found 4 tests
4 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4

View File

@@ -1,14 +1,9 @@
Summary
Harness status: OK
Rerun
Found 4 tests
4 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4

View File

@@ -1,59 +1,54 @@
Summary
Harness status: OK
Rerun
Found 48 tests
24 Pass
24 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 13
Pass .target > * 14
Fail .target > * 15
Pass .target > * 16
Fail .target > * 17
Pass .target > * 18
Fail .target > * 19
Pass .target > * 20
Fail .target > * 21
Pass .target > * 22
Fail .target > * 23
Pass .target > * 24
Fail .target > * 25
Pass .target > * 26
Fail .target > * 27
Pass .target > * 28
Fail .target > * 29
Pass .target > * 30
Fail .target > * 31
Pass .target > * 32
Fail .target > * 33
Pass .target > * 34
Fail .target > * 35
Pass .target > * 36
Fail .target > * 37
Pass .target > * 38
Fail .target > * 39
Pass .target > * 40
Fail .target > * 41
Pass .target > * 42
Fail .target > * 43
Pass .target > * 44
Fail .target > * 45
Pass .target > * 46
Fail .target > * 47
Pass .target > * 48
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 13
Pass .target > * 14
Fail .target > * 15
Pass .target > * 16
Fail .target > * 17
Pass .target > * 18
Fail .target > * 19
Pass .target > * 20
Fail .target > * 21
Pass .target > * 22
Fail .target > * 23
Pass .target > * 24
Fail .target > * 25
Pass .target > * 26
Fail .target > * 27
Pass .target > * 28
Fail .target > * 29
Pass .target > * 30
Fail .target > * 31
Pass .target > * 32
Fail .target > * 33
Pass .target > * 34
Fail .target > * 35
Pass .target > * 36
Fail .target > * 37
Pass .target > * 38
Fail .target > * 39
Pass .target > * 40
Fail .target > * 41
Pass .target > * 42
Fail .target > * 43
Pass .target > * 44
Fail .target > * 45
Pass .target > * 46
Fail .target > * 47
Pass .target > * 48

View File

@@ -1,58 +1,53 @@
Summary
Harness status: OK
Rerun
Found 48 tests
48 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 17
Fail .target > * 18
Fail .target > * 19
Fail .target > * 20
Fail .target > * 21
Fail .target > * 22
Fail .target > * 23
Fail .target > * 24
Fail .target > * 25
Fail .target > * 26
Fail .target > * 27
Fail .target > * 28
Fail .target > * 29
Fail .target > * 30
Fail .target > * 31
Fail .target > * 32
Fail .target > * 33
Fail .target > * 34
Fail .target > * 35
Fail .target > * 36
Fail .target > * 37
Fail .target > * 38
Fail .target > * 39
Fail .target > * 40
Fail .target > * 41
Fail .target > * 42
Fail .target > * 43
Fail .target > * 44
Fail .target > * 45
Fail .target > * 46
Fail .target > * 47
Fail .target > * 48
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 17
Fail .target > * 18
Fail .target > * 19
Fail .target > * 20
Fail .target > * 21
Fail .target > * 22
Fail .target > * 23
Fail .target > * 24
Fail .target > * 25
Fail .target > * 26
Fail .target > * 27
Fail .target > * 28
Fail .target > * 29
Fail .target > * 30
Fail .target > * 31
Fail .target > * 32
Fail .target > * 33
Fail .target > * 34
Fail .target > * 35
Fail .target > * 36
Fail .target > * 37
Fail .target > * 38
Fail .target > * 39
Fail .target > * 40
Fail .target > * 41
Fail .target > * 42
Fail .target > * 43
Fail .target > * 44
Fail .target > * 45
Fail .target > * 46
Fail .target > * 47
Fail .target > * 48

View File

@@ -1,27 +1,22 @@
Summary
Harness status: OK
Rerun
Found 16 tests
8 Pass
8 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 13
Pass .target > * 14
Fail .target > * 15
Pass .target > * 16
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 13
Pass .target > * 14
Fail .target > * 15
Pass .target > * 16

View File

@@ -1,26 +1,21 @@
Summary
Harness status: OK
Rerun
Found 16 tests
16 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16

View File

@@ -1,23 +1,18 @@
Summary
Harness status: OK
Rerun
Found 12 tests
6 Pass
6 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12

View File

@@ -1,22 +1,17 @@
Summary
Harness status: OK
Rerun
Found 12 tests
12 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12

View File

@@ -1,22 +1,17 @@
Summary
Harness status: OK
Rerun
Found 12 tests
12 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12

View File

@@ -1,35 +1,30 @@
Summary
Harness status: OK
Rerun
Found 24 tests
12 Pass
12 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 13
Pass .target > * 14
Fail .target > * 15
Pass .target > * 16
Fail .target > * 17
Pass .target > * 18
Fail .target > * 19
Pass .target > * 20
Fail .target > * 21
Pass .target > * 22
Fail .target > * 23
Pass .target > * 24
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 13
Pass .target > * 14
Fail .target > * 15
Pass .target > * 16
Fail .target > * 17
Pass .target > * 18
Fail .target > * 19
Pass .target > * 20
Fail .target > * 21
Pass .target > * 22
Fail .target > * 23
Pass .target > * 24

View File

@@ -1,34 +1,29 @@
Summary
Harness status: OK
Rerun
Found 24 tests
24 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 17
Fail .target > * 18
Fail .target > * 19
Fail .target > * 20
Fail .target > * 21
Fail .target > * 22
Fail .target > * 23
Fail .target > * 24
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 17
Fail .target > * 18
Fail .target > * 19
Fail .target > * 20
Fail .target > * 21
Fail .target > * 22
Fail .target > * 23
Fail .target > * 24

View File

@@ -1,34 +1,29 @@
Summary
Harness status: OK
Rerun
Found 24 tests
24 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 17
Fail .target > * 18
Fail .target > * 19
Fail .target > * 20
Fail .target > * 21
Fail .target > * 22
Fail .target > * 23
Fail .target > * 24
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 13
Fail .target > * 14
Fail .target > * 15
Fail .target > * 16
Fail .target > * 17
Fail .target > * 18
Fail .target > * 19
Fail .target > * 20
Fail .target > * 21
Fail .target > * 22
Fail .target > * 23
Fail .target > * 24

View File

@@ -1,23 +1,18 @@
Summary
Harness status: OK
Rerun
Found 12 tests
6 Pass
6 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12

View File

@@ -1,22 +1,17 @@
Summary
Harness status: OK
Rerun
Found 12 tests
12 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12

View File

@@ -1,22 +1,17 @@
Summary
Harness status: OK
Rerun
Found 12 tests
12 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12

View File

@@ -1,23 +1,18 @@
Summary
Harness status: OK
Rerun
Found 12 tests
6 Pass
6 Fail
Details
Result Test Name MessageFail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Pass .target > * 5
Fail .target > * 6
Pass .target > * 7
Fail .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12
Fail .target > * 1
Pass .target > * 2
Fail .target > * 3
Pass .target > * 4
Pass .target > * 5
Fail .target > * 6
Pass .target > * 7
Fail .target > * 8
Fail .target > * 9
Pass .target > * 10
Fail .target > * 11
Pass .target > * 12

View File

@@ -1,23 +1,18 @@
Summary
Harness status: OK
Rerun
Found 12 tests
3 Pass
9 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Pass .target > * 9
Pass .target > * 10
Pass .target > * 11
Fail .target > * 12
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Fail .target > * 6
Fail .target > * 7
Fail .target > * 8
Pass .target > * 9
Pass .target > * 10
Pass .target > * 11
Fail .target > * 12

View File

@@ -1,23 +1,18 @@
Summary
Harness status: OK
Rerun
Found 12 tests
3 Pass
9 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Pass .target > * 5
Fail .target > * 6
Pass .target > * 7
Pass .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Pass .target > * 5
Fail .target > * 6
Pass .target > * 7
Pass .target > * 8
Fail .target > * 9
Fail .target > * 10
Fail .target > * 11
Fail .target > * 12

View File

@@ -1,19 +1,14 @@
Summary
Harness status: OK
Rerun
Found 8 tests
2 Pass
6 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 5
Pass .target > * 6
Fail .target > * 7
Pass .target > * 8

View File

@@ -1,14 +1,9 @@
Summary
Harness status: OK
Rerun
Found 4 tests
4 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4

View File

@@ -1,14 +1,9 @@
Summary
Harness status: OK
Rerun
Found 4 tests
4 Fail
Details
Result Test Name MessageFail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4
Fail .target > * 1
Fail .target > * 2
Fail .target > * 3
Fail .target > * 4