Set up asan+ubsan scheduled build on azure

Also adds an --asan flag to run-tests.php to setup all the necessary
environment variables. Some tests are marked as skipped because they
a

Set up asan+ubsan scheduled build on azure

Also adds an --asan flag to run-tests.php to setup all the necessary
environment variables. Some tests are marked as skipped because they
are incompatible with asan or too slow.

I'm basing this on the DEBUG_ZTS build, which seems to give us the
most mileage.

show more ...

run-tests: Don't pass --INI-- settings to --SKIPIF--

If we're testing ini settings that cause startup failures, we'll
never get to that SKIPIF block...

Also change settings2para

run-tests: Don't pass --INI-- settings to --SKIPIF--

If we're testing ini settings that cause startup failures, we'll
never get to that SKIPIF block...

Also change settings2param to return a value instead of modifying
(to a different type no less!) in place.

show more ...

run-tests: Don't die unnecessarily

die/exit leak memory, don't use them if we don't need to.

Don't force USE_ZEND_ALLOC=0 in run-tests.php

USE_ZEND_ALLOC=0 is useful not just for valgrind ... we should not
force USE_ZEND_ALLOC=1 if the user explicitly disabled it.

Add test for bug #78106

Also add PHP_TEST_EXTRA_ARGS environment variable, which allows
to pass on -c, -d etc flags provided by run-tests.php. Otherwise
we won't get the built-in ser

Add test for bug #78106

Also add PHP_TEST_EXTRA_ARGS environment variable, which allows
to pass on -c, -d etc flags provided by run-tests.php. Otherwise
we won't get the built-in server to run with opcache.

show more ...

junit testcase classname is used as filename on azure

only clear when showing in parallel runner

Fix NO_INTERACTION handling in parallel test runner

This printing shouldn't depend on NO_INTERACTION, the variable that
controls this is SHOW_ONLY_GROUPS.

Add junit support for parallel test runner

run-tests: Remove redundant 'suites' key

We don't have nestead testsuites or similar, so drop this confusing
key.

have parallel test runner respect NO_INTERACTION

Run sapi tests when running all tests

Restore the execute bit for run-tests.php

It looks like this was accidentally removed in 03f15f705ad30ce2dde7f7b2ab087a132b859ba0

fix notice in run-tests

run-tests improvements:
Add XLEAK section, this is made necessary by the support
for valgrind tools other than memcheck.
XLEAK is to a leaking test what XFAIL is to a failing test.

run-tests improvements:
Add XLEAK section, this is made necessary by the support
for valgrind tools other than memcheck.
XLEAK is to a leaking test what XFAIL is to a failing test.
Tidy up summary a little to exclude Expected Fail and Expected Leak
when there are no expected fail/leaks

show more ...

add support for valgrind tools to run-tests.php

Add {TMP} placeholder for PHPT INI sections

Several tests use `/tmp` in the `--INI--` section, but this is not
portable. We therefore introduce the `{TMP}` placeholder which
evaluat

Add {TMP} placeholder for PHPT INI sections

Several tests use `/tmp` in the `--INI--` section, but this is not
portable. We therefore introduce the `{TMP}` placeholder which
evaluates to the system's temporary directory using
`sys_get_temp_dir()`.

We also remove the doubtful `strpos()` optimization.

show more ...

Add minimum required PHP version to run-tests.php

This integrates a simple minimum PHP version info in the tool and to
also define the minimum version that the tool syntax should support.

Don't use parallel testing with -j1

Drop lightning for concurrent worker count

This looked rather awkward even on terminals that have full unicode
support.

Make run-tests.php compatible with php 7.0-7.2

Motivation:
As an extension author, I want to speed up running tests in php <=7.3,
both locally and in CI (e.g. with valgrind).
Thi

Make run-tests.php compatible with php 7.0-7.2

Motivation:
As an extension author, I want to speed up running tests in php <=7.3,
both locally and in CI (e.g. with valgrind).
This can be done by manually copying php 7.4's run-tests.php script
to replace the one generated by `phpize`

- list() doesn't work in php 7.0
- negative string offset doesn't work in php 7.2

If run-tests.php can be copied from php-src without any manual patches,
that would be the easiest.

Related to #2822 - I didn't see any discussion for/against compatibility
with older php versions

show more ...

Add special "all" conflict

If a test conflicts with "all", then no other tests may be run in
parallel. This is needed for windows_mb_path tests, which rely on
the console codepage, w

Add special "all" conflict

If a test conflicts with "all", then no other tests may be run in
parallel. This is needed for windows_mb_path tests, which rely on
the console codepage, which is shared across all parallel workers.

Also add support for comments in the CONFLICTS section/file.

show more ...

Don't use uniqid for temporary POST data files

uniqid() is not necessarily unique when multiple testing processes
run in parallel.

Add a --shuffle mode to run-tests

Makes it easier to find paralellization issues. Of course only works
if the tests aren't order-dependent...

Use PHP_BINARY by default in run-tests.php

You pretty much always want to run with -P, make it the default.