Retry tests on deadlock

Closes GH-12693

Automatically mark tests as flaky

Marking all of these tests as flaky is annoying, so attempt to recognize them
automatically.

Closes GH-12638

Increase run-tests.php timeout for asan

Closes GH-12087

Make unrepeatable tests retriable

This was an error in thinking on my side. The reason these tests are
unrepeatable is because --repeat executes the same request in the same process,

Make unrepeatable tests retriable

This was an error in thinking on my side. The reason these tests are
unrepeatable is because --repeat executes the same request in the same process,
and does not run the CLEAN section in between runs. This is not the case when
retrying tests.

We could potentially make CLEAN tests repeatable by including the CLEAN section
in the tested script. This does however not work for all tests (e.g. tests that
set open_basedir).

Closes GH-12072

show more ...

Implement flaky test section

This re-uses the already used for automatic retesting. That's certainly better
than XFAIL.

Closes GH-11325

[skip ci] Add more patterns to run-tests.php retry list

CURL: 404: Page Not Found
IMAP: Can't create a temporary mailbox: [ALREADYEXISTS] Mailbox already exists
Sockets: socket_bind(

[skip ci] Add more patterns to run-tests.php retry list

CURL: 404: Page Not Found
IMAP: Can't create a temporary mailbox: [ALREADYEXISTS] Mailbox already exists
Sockets: socket_bind(): Unable to bind address [98]: Address already in use

show more ...

Add retry mechanism in run-tests.php

We have lots of spurious failures in CI, many of them with the "all" CONFLICT.
We're limiting the retrying to specific error messages. In the future

Add retry mechanism in run-tests.php

We have lots of spurious failures in CI, many of them with the "all" CONFLICT.
We're limiting the retrying to specific error messages. In the future we may
also provide a FLAKY section to retry specific tests.

Closes GH-10892

show more ...

Another attempt to fix MSAN nightly on master

use_tls=0 on MSAN

Attempt to fix MSAN failure in CI

Closes GH-10851

Fix run-tests.php hanging when a worker process dies without notice (#9931)

run-tests.php with `-jN` can hang if a parallel worker dies without notice. This
can happen due to fatal error

Fix run-tests.php hanging when a worker process dies without notice (#9931)

run-tests.php with `-jN` can hang if a parallel worker dies without notice. This
can happen due to fatal errors in the worker, or if the worker is killed.

- run-tests.php (main process)
\_ run-tests.php (worker #0) // main process hangs if this one crashes
\_ test-001.php (test-001.phpt)

show more ...

Migrate i386 to GitHub actions

Closes GH-9856

Fix --CGI-- support of run-tests.php

The `--CGI--` section is supposed to be just a marker, and to be empty
as such. However, a previous refactoring[1] broke that.

[1] <https:/

Fix --CGI-- support of run-tests.php

The `--CGI--` section is supposed to be just a marker, and to be empty
as such. However, a previous refactoring[1] broke that.

[1] <https://github.com/php/php-src/commit/9140c9038a83ff55a78f357f8485de086d83d94e>

Closes GH-9061.

show more ...

Avoid accessing undefined variables in run-tests.php (#8669)

The $php_cgi and $phpdbg cases here are definitely real bugs, and
caused the script to bail out under certain ini settings.

Avoid accessing undefined variables in run-tests.php (#8669)

The $php_cgi and $phpdbg cases here are definitely real bugs, and
caused the script to bail out under certain ini settings.

The other paths may actually be unreachable in practice, but were
highlighted by PhpStorm.

show more ...

[ci skip] Drop ability to send QA reports by email (#8657)

This fails regularly and on top of that we don't look at these reports.

Deprecate ${} string interpolation

https://wiki.php.net/rfc/deprecate_dollar_brace_string_interpolation

Don't test hidden files that happen to end in .phpt

This is a tiny improvement to run-tests.php which helps keep it from
tripping over hidden files, including autosave files from various

Don't test hidden files that happen to end in .phpt

This is a tiny improvement to run-tests.php which helps keep it from
tripping over hidden files, including autosave files from various
editors, metadata on certain platforms, etc.

Closes GH-7783.

show more ...

Fix #81520 TEST_PHP_CGI_EXECUTABLE badly set in run-tests.php

Report output from CLEAN (#7456)

Mark test as borked if the test passed and CLEAN produces output.

Co-authored-by: Nikita Popov <nikita.ppv@gmail.com>

Support generate lldb command in run-tests.php (#7451)

Fix GH-8691 Add required extensions for redirected tests

typo

run-tests.php: fix TypeError: Unsupported operand types: string * int <n> is mandatory for --show-slow and --set-timeout use <n> in help message instead of confusing [n]

Don't truncate subsecond precision in run-tests.php JUNIT output

When run-tests.php has been typed[1], the type of `$time` has been
chosen to be `int`. This, however, leads to truncatio

Don't truncate subsecond precision in run-tests.php JUNIT output

When run-tests.php has been typed[1], the type of `$time` has been
chosen to be `int`. This, however, leads to truncation, and the
somewhat relevant subsecond precision is lost. We fix that by
changing the type to `float`, although `int|string` would be more
appropriate, but requires PHP ≥ 7.4.0. Another option would be to
move the `number_format()` formatting into `junit_mark_test_as()`.

[1] <https://github.com/php/php-src/commit/11274f53e7fb9d669d74c23aa7883f5f04d92094>

Closes GH-7836.

show more ...

[ci skip] typo

Fix #81520 TEST_PHP_CGI_EXECUTABLE badly set in run-tests.php