#
4e121896 |
| 13-Sep-2024 |
Ilija Tovilo |
Mark some phar tests as flaky on macOS Fixes GH-15748 Closes GH-15876
|
#
71b90874 |
| 13-Aug-2024 |
Christoph M. Becker |
Fix run-tests.php to propagate status code on Windows There is now a workaround in `system_with_timeout()` to avoid issues with quotes and spaces in the filenames of the executable by us
Fix run-tests.php to propagate status code on Windows There is now a workaround in `system_with_timeout()` to avoid issues with quotes and spaces in the filenames of the executable by using `start`[1]. However, calling `start` will not propagate the process status of the actual process. Thus, calling `proc_get_status()` is pretty meaningless, and especially Microsoft errors cannot be detected (typically, access violations etc.), and as such no "Termsig" message is output. We fix this by executing `exit` after the started command has finished. [1] <https://github.com/php/php-src/blob/a6d7d5234b05582d3a333c0f2646fdeae44b4728/run-tests.php#L1157-L1162> Closes GH-15378.
show more ...
|
#
379e913e |
| 06-Jan-2024 |
Ilija Tovilo |
Fix run-tests.php differ calculateCommonSubsequence for EXPECTF calculateCommonSubsequence should not contain regexes. Fixes GH-13083 Closes GH-13084
|
#
58712e06 |
| 16-Nov-2023 |
Ilija Tovilo |
Retry tests on deadlock Closes GH-12693
|
#
6d596409 |
| 09-Nov-2023 |
Ilija Tovilo |
Automatically mark tests as flaky Marking all of these tests as flaky is annoying, so attempt to recognize them automatically. Closes GH-12638
|
#
f4a6a6d0 |
| 30-Aug-2023 |
Ilija Tovilo |
Increase run-tests.php timeout for asan Closes GH-12087
|
#
f2c16b7b |
| 29-Aug-2023 |
Ilija Tovilo |
Make unrepeatable tests retriable This was an error in thinking on my side. The reason these tests are unrepeatable is because --repeat executes the same request in the same process,
Make unrepeatable tests retriable This was an error in thinking on my side. The reason these tests are unrepeatable is because --repeat executes the same request in the same process, and does not run the CLEAN section in between runs. This is not the case when retrying tests. We could potentially make CLEAN tests repeatable by including the CLEAN section in the tested script. This does however not work for all tests (e.g. tests that set open_basedir). Closes GH-12072
show more ...
|
#
e199104a |
| 22-Aug-2023 |
Peter Kokot |
Fix passing null to parameter of type string (#12014) This fixes builds without cgi or phpdbg: ./configure --disable-cgi --disable-phpdbg make ./sapi/cli/php run-tests.php
Fix passing null to parameter of type string (#12014) This fixes builds without cgi or phpdbg: ./configure --disable-cgi --disable-phpdbg make ./sapi/cli/php run-tests.php Otherwise, deprecation warnings (since PHP-8.1) are emitted: Deprecated: escapeshellarg(): Passing null to parameter #1 ($arg) of type string is deprecated in run-tests.php...
show more ...
|
#
d397fec1 |
| 07-Jul-2023 |
Ilija Tovilo |
Skip xleak tests on asan (#11610) Fixes GH-11077
|
#
849fdcae |
| 26-May-2023 |
Ilija Tovilo |
Implement flaky test section This re-uses the already used for automatic retesting. That's certainly better than XFAIL. Closes GH-11325
|
#
f249958c |
| 27-May-2023 |
Ilija Tovilo |
[skip ci] Add more patterns to run-tests.php retry list CURL: 404: Page Not Found IMAP: Can't create a temporary mailbox: [ALREADYEXISTS] Mailbox already exists Sockets: socket_bind(
[skip ci] Add more patterns to run-tests.php retry list CURL: 404: Page Not Found IMAP: Can't create a temporary mailbox: [ALREADYEXISTS] Mailbox already exists Sockets: socket_bind(): Unable to bind address [98]: Address already in use
show more ...
|
#
11597d18 |
| 20-Mar-2023 |
Ilija Tovilo |
Add retry mechanism in run-tests.php We have lots of spurious failures in CI, many of them with the "all" CONFLICT. We're limiting the retrying to specific error messages. In the future
Add retry mechanism in run-tests.php We have lots of spurious failures in CI, many of them with the "all" CONFLICT. We're limiting the retrying to specific error messages. In the future we may also provide a FLAKY section to retry specific tests. Closes GH-10892
show more ...
|
#
fc88f155 |
| 03-Apr-2023 |
Ilija Tovilo |
Add zend_alloc XLEAK support In the future we may want to use a different exit code to warn for tests that didn't leak. Closes GH-10999
|
#
50f58c89 |
| 02-Apr-2023 |
Ilija Tovilo |
Add ASAN XLEAK support Only disable LSAN instead of skipping the test. This way we can still detect memory issues which is arguably more important anyway. Closes GH-10996
|
#
ed0b773c |
| 01-Apr-2023 |
Ilija Tovilo |
[skip ci] Avoid infinite loop in differ TBH I don't understand why this can happen here but not in sebastian/diff. I'll have to take a closer look.
|
#
b9f8b696 |
| 27-Mar-2023 |
Ilija Tovilo |
Fix one more differ direct comparison (through in_array)
|
#
c58c2666 |
| 23-Mar-2023 |
Ilija Tovilo |
Fix direct comparison in run-tests.php differ
|
#
d8544926 |
| 23-Mar-2023 |
Ilija Tovilo |
[skip ci] Fix var_dump statement in run-tests.php
|
#
ac961bbb |
| 17-Mar-2023 |
Ilija Tovilo |
Implement better diff for run-tests.php Borrow sebastianbergmann/diff with MemoryEfficientLongestCommonSubsequenceCalculator Fixes GH-10806 Closes GH-10875
|
#
471105ab |
| 15-Mar-2023 |
Ilija Tovilo |
Another attempt to fix MSAN nightly on master
|
#
63525ee6 |
| 14-Mar-2023 |
Ilija Tovilo |
use_tls=0 on MSAN Attempt to fix MSAN failure in CI Closes GH-10851
|
#
d3c95852 |
| 10-Mar-2023 |
Ilija Tovilo |
[skip ci] Fix diff cmd env name in run-tests.php
|
#
486fb809 |
| 06-Mar-2023 |
Ilija Tovilo |
[skip ci] Remove accidental run-tests.php line
|
#
3e6d49e0 |
| 03-Mar-2023 |
Danack |
Fix warning in run-tests when PHP compiled without generating phpdbg support. (#10745)
|
#
dcc3255b |
| 25-Feb-2023 |
Niels Dossche <7771979+nielsdos@users.noreply.github.com> |
Fix GH-10489: run-tests.php does not escape path when building cmd (#10560) Multiple tests had to be changed to escape the arguments in shell commands. Some tests are skipped because th
Fix GH-10489: run-tests.php does not escape path when building cmd (#10560) Multiple tests had to be changed to escape the arguments in shell commands. Some tests are skipped because they behave differently with spaces in the path versus without. One notable example of this is the hashbang test which does not work because spaces in hashbangs paths are not supported in Linux. Co-authored-by: Michael Voříšek <mvorisek@mvorisek.cz>
show more ...
|