run-tests improvements:
Add XLEAK section, this is made necessary by the support
for valgrind tools other than memcheck.
XLEAK is to a leaking test what XFAIL is to a failing test.

run-tests improvements:
Add XLEAK section, this is made necessary by the support
for valgrind tools other than memcheck.
XLEAK is to a leaking test what XFAIL is to a failing test.
Tidy up summary a little to exclude Expected Fail and Expected Leak
when there are no expected fail/leaks

show more ...

add support for valgrind tools to run-tests.php

Merge branch 'PHP-7.3' into PHP-7.4

* PHP-7.3:
Add {TMP} placeholder for PHPT INI sections

Merge branch 'PHP-7.2' into PHP-7.3

* PHP-7.2:
Add {TMP} placeholder for PHPT INI sections

Add {TMP} placeholder for PHPT INI sections

Several tests use `/tmp` in the `--INI--` section, but this is not
portable. We therefore introduce the `{TMP}` placeholder which
evaluat

Add {TMP} placeholder for PHPT INI sections

Several tests use `/tmp` in the `--INI--` section, but this is not
portable. We therefore introduce the `{TMP}` placeholder which
evaluates to the system's temporary directory using
`sys_get_temp_dir()`.

We also remove the doubtful `strpos()` optimization.

show more ...

Add minimum required PHP version to run-tests.php

This integrates a simple minimum PHP version info in the tool and to
also define the minimum version that the tool syntax should support.

Don't use parallel testing with -j1

Drop lightning for concurrent worker count

This looked rather awkward even on terminals that have full unicode
support.

Make run-tests.php compatible with php 7.0-7.2

Motivation:
As an extension author, I want to speed up running tests in php <=7.3,
both locally and in CI (e.g. with valgrind).
Thi

Make run-tests.php compatible with php 7.0-7.2

Motivation:
As an extension author, I want to speed up running tests in php <=7.3,
both locally and in CI (e.g. with valgrind).
This can be done by manually copying php 7.4's run-tests.php script
to replace the one generated by `phpize`

- list() doesn't work in php 7.0
- negative string offset doesn't work in php 7.2

If run-tests.php can be copied from php-src without any manual patches,
that would be the easiest.

Related to #2822 - I didn't see any discussion for/against compatibility
with older php versions

show more ...

Add special "all" conflict

If a test conflicts with "all", then no other tests may be run in
parallel. This is needed for windows_mb_path tests, which rely on
the console codepage, w

Add special "all" conflict

If a test conflicts with "all", then no other tests may be run in
parallel. This is needed for windows_mb_path tests, which rely on
the console codepage, which is shared across all parallel workers.

Also add support for comments in the CONFLICTS section/file.

show more ...

Don't use uniqid for temporary POST data files

uniqid() is not necessarily unique when multiple testing processes
run in parallel.

Add a --shuffle mode to run-tests

Makes it easier to find paralellization issues. Of course only works
if the tests aren't order-dependent...

Use PHP_BINARY by default in run-tests.php

You pretty much always want to run with -P, make it the default.

Implement fine-grained conflict handling

Tests can specify conflict keys, either in --CONFLICTS-- or
a per-directory CONFLICTS file. Non-conflicting tests may be run
in parallel.

Don't preload tests without --FILE-- section

Better new-line handling

Make parallel run-tests compatible with IO capture tests

Inherit the main stdin/stdout/stderr streams into the worker processes.
We don't talk to workers via these pipes, so there should

Make parallel run-tests compatible with IO capture tests

Inherit the main stdin/stdout/stderr streams into the worker processes.
We don't talk to workers via these pipes, so there shouldn't be a
problem doing this.

show more ...

Better line handling

Filter preloading warning messages

run-tests.php: fix typo

run-tests.php: experimental parallel testing support

Don't suppress errors during in preload testing

run-tests.php: fix all tab-space indentation inconsistency

run-tests.php: move all top-level code into a function

Prerequisite for parallelised testing:
https://github.com/php/php-src/pull/2822

Quoth Nikita @
https://github.com/php/

run-tests.php: move all top-level code into a function

Prerequisite for parallelised testing:
https://github.com/php/php-src/pull/2822

Quoth Nikita @
https://github.com/php/php-src/pull/3789#issuecomment-462724550:

> @hikari-no-yume Please feel free to directly commit the first commit
> (to PHP-7.4). That's probably a big and unnecessary source of
> conflicts, and makes reviewing harder as well.

show more ...

Add a --preload testing mode to run-tests.php

Not intended for general use, it has many false positives.