List skipped extensions explicitly

We also fix the summary alignment for 10k+ tests.

Closes GH-8363.

Retry tests on deadlock

Closes GH-12693

Automatically mark tests as flaky

Marking all of these tests as flaky is annoying, so attempt to recognize them
automatically.

Closes GH-12638

Increase run-tests.php timeout for asan

Closes GH-12087

Make unrepeatable tests retriable

This was an error in thinking on my side. The reason these tests are
unrepeatable is because --repeat executes the same request in the same process,

Make unrepeatable tests retriable

This was an error in thinking on my side. The reason these tests are
unrepeatable is because --repeat executes the same request in the same process,
and does not run the CLEAN section in between runs. This is not the case when
retrying tests.

We could potentially make CLEAN tests repeatable by including the CLEAN section
in the tested script. This does however not work for all tests (e.g. tests that
set open_basedir).

Closes GH-12072

show more ...

Implement flaky test section

This re-uses the already used for automatic retesting. That's certainly better
than XFAIL.

Closes GH-11325

[skip ci] Add more patterns to run-tests.php retry list

CURL: 404: Page Not Found
IMAP: Can't create a temporary mailbox: [ALREADYEXISTS] Mailbox already exists
Sockets: socket_bind(

[skip ci] Add more patterns to run-tests.php retry list

CURL: 404: Page Not Found
IMAP: Can't create a temporary mailbox: [ALREADYEXISTS] Mailbox already exists
Sockets: socket_bind(): Unable to bind address [98]: Address already in use

show more ...

Add retry mechanism in run-tests.php

We have lots of spurious failures in CI, many of them with the "all" CONFLICT.
We're limiting the retrying to specific error messages. In the future

Add retry mechanism in run-tests.php

We have lots of spurious failures in CI, many of them with the "all" CONFLICT.
We're limiting the retrying to specific error messages. In the future we may
also provide a FLAKY section to retry specific tests.

Closes GH-10892

show more ...

Another attempt to fix MSAN nightly on master

use_tls=0 on MSAN

Attempt to fix MSAN failure in CI

Closes GH-10851

[skip ci] Fix diff cmd env name in run-tests.php

Fix run-tests.php hanging when a worker process dies without notice (#9931)

run-tests.php with `-jN` can hang if a parallel worker dies without notice. This
can happen due to fatal error

Fix run-tests.php hanging when a worker process dies without notice (#9931)

run-tests.php with `-jN` can hang if a parallel worker dies without notice. This
can happen due to fatal errors in the worker, or if the worker is killed.

- run-tests.php (main process)
\_ run-tests.php (worker #0) // main process hangs if this one crashes
\_ test-001.php (test-001.phpt)

show more ...

Migrate i386 to GitHub actions

Closes GH-9856

Use external diff tool if TEST_PHP_DIFF_CMD env var is set

Fix run-tests.php --no-progress flag for non-parallel testing

Add --[no-]progress option to run-tests.php (#9255)

Previously, adding the -g argument would disable progress, even locally.
Now it needs to be disabled explicitly.

Hide skipped tests in CI (#9163)

Add opcache.preload_user=root to run-tests.php if root

This prevents breaking the testsuite when running it as root.

[run-tests.php] echo call performance optimization

[run-tests.php] Combine multiple `str_replace` calls to a single `strtr` call

Makes the replacement easier to see, neatly aligned, and only takes one function call.
This is safe because

[run-tests.php] Combine multiple `str_replace` calls to a single `strtr` call

Makes the replacement easier to see, neatly aligned, and only takes one function call.
This is safe because none of the combined replacement values contain tokens that would be recursively replaced.

This also improves the readability on how the regular expressions in `EXPECTF` matcher is constructed.

Co-authored-by: Michael Voříšek <mvorisek@mvorisek.cz>

show more ...

[run-tests.php] Replace backtick operator string literals with `shell_exec()` calls

The rationale is that `shell_exec()` is identical to the backtick operator (both of which are disabled whe

[run-tests.php] Replace backtick operator string literals with `shell_exec()` calls

The rationale is that `shell_exec()` is identical to the backtick operator (both of which are disabled when `shell_exec` function is disabled) makes it very clear that it is a shell execution, and eases security audits too.

show more ...

[run-tests.php] Merge multiple `unset()` calls to a single call

[run-tests.php] Minor optimizations in `if` blocks by placing simple expressions first

[run-tests.php] Improve non-optimal nested `if`/`elseif`/`else` blocks with happy path optimizations

Simplifies and improves the readability of multiple `if`/`elseif`/`else` blocks by removi

[run-tests.php] Improve non-optimal nested `if`/`elseif`/`else` blocks with happy path optimizations

Simplifies and improves the readability of multiple `if`/`elseif`/`else` blocks by removing them when an earlier branch exists the execution flow by either returning or terminating the script.

show more ...

Fix --CGI-- support of run-tests.php

The `--CGI--` section is supposed to be just a marker, and to be empty
as such. However, a previous refactoring[1] broke that.

[1] <https:/

Fix --CGI-- support of run-tests.php

The `--CGI--` section is supposed to be just a marker, and to be empty
as such. However, a previous refactoring[1] broke that.

[1] <https://github.com/php/php-src/commit/9140c9038a83ff55a78f357f8485de086d83d94e>

Closes GH-9061.

show more ...