Dear Andres,
Sorry for late response. I have not been reproduced till now and now I do.
When happened, the problem still happens even when another build directory
is introduced.
There might be hidden conditions I have not found yet.
> I can't reproduce this. For me the psql started by pg_regress is the one in
> tmp_install and so is the libpq it links to.
>
> $ killall -STOP psql
> $ ps aux|grep psql
> andres 3375208 0.0 0.0 28696 9972 pts/5 T Apr10 0:00 psql
> tpch_10
> andres 3597915 1.0 0.0 36036 10120 ? T 09:42 0:00 psql -X
> -a -q -d regression -v HIDE_TABLEAM=on -v HIDE_TOAST_COMPRESSION=on
> andres 3597916 1.0 0.0 36036 10120 ? T 09:42 0:00 psql -X
> -a -q -d regression -v HIDE_TABLEAM=on -v HIDE_TOAST_COMPRESSION=on
> andres 3597918 0.6 0.0 36036 10144 ? T 09:42 0:00 psql -X
> -a -q -d regression -v HIDE_TABLEAM=on -v HIDE_TOAST_COMPRESSION=on
> andres 3597920 0.3 0.0 36036 10104 ? T 09:42 0:00 psql -X
> -a -q -d regression -v HIDE_TABLEAM=on -v HIDE_TOAST_COMPRESSION=on
> andres 3597922 0.6 0.0 36036 10120 ? T 09:42 0:00 psql -X
> -a -q -d regression -v HIDE_TABLEAM=on -v HIDE_TOAST_COMPRESSION=on
> andres 3597955 0.0 0.0 6608 2180 pts/0 S+ 09:42 0:00 grep
> psql
> $ ls -l /proc/3597918/exe
> lrwxrwxrwx 1 andres andres 0 Apr 11 09:42 /proc/3597918/exe ->
> /srv/dev/build/postgres/m-dev-assert/tmp_install/srv/dev/install/postgres/m-
> dev-assert/bin/psql
>
> $ less /proc/3597918/maps
> ...
> 000 103:06 4831894711
> /srv/dev/build/postgres/m-dev-assert/tmp_install/srv/dev/install/postgres/m-
> dev-assert/lib/x86_64-linux-gnu/libpq.so.5.18
Hmm. I could not do the check because the psql command could not be start or it
exit immediately with the symbol lookup error.
Not sure it is meaningful, but I attached the execution log of ldd command, with
the same PATH/LD_LIBRARY_PATH while doing a meson test.
> And meson-logs/testlog.txt shows that the command is executed with
> PATH=/srv/dev/build/postgres/m-dev-assert/tmp_install//srv/dev/install/post
> gres/m-dev-assert/bin:<other things>
> LD_LIBRARY_PATH=/srv/dev/build/postgres/m-dev-assert/tmp_install//srv/d
> ev/install/postgres/m-dev-assert/lib/x86_64-linux-gnu
> Can you check whether your meson-logs/testlog.txt shows the appropriate
> PATH/LD_LIBRARY_PATH and whether libpq is in the right place?
I also checked PATH/LD_LIBRARY_PATH and they looked correct.
PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/bin:/home/hayato/builddir/src/test/regress:/usr/local/pgsql/bin/:<others>...
LD_LIBRARY_PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/lib64:/usr/local/pgsql/lib:/usr/local/lib:/usr/lib64/...
Attached is a file which extract some lines from testlog.txt.
Best regards,
Hayato Kuroda
FUJITSU LIMITED
...
==================================== 1/4 =====================================
test: postgresql:setup / tmp_install
start time: 10:41:52
duration: 0.82s
result: exit status 0
command: MALLOC_PERTURB_=22 DESTDIR=/home/hayato/builddir/tmp_install/
/usr/bin/meson install --quiet --only-changed --no-rebuild
==============================================================================
==================================== 2/4 =====================================
test: postgresql:setup / install_test_files
start time: 10:41:53
duration: 0.05s
result: exit status 0
command: MALLOC_PERTURB_=157
PATH=/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/lib64:/usr/local/pgsql/bin/:/home/hayato/.local/bin:/home/hayato/bin:/usr/share/Modules/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
/usr/bin/python3 /home/hayato/builddir/../postgres/src/tools/install_files
--prefix /usr/local/pgsql --install share/extension
/home/hayato/builddir/../postgres/src/test/modules/dummy_index_am/dummy_index_am.control
/home/hayato/builddir/../postgres/src/test/modules/dummy_index_am/dummy_index_am--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/dummy_seclabel/dummy_seclabel.control
/home/hayato/builddir/../postgres/src/test/modules/dummy_seclabel/dummy_seclabel--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/injection_points/injection_points.control
/home/hayato/builddir/../postgres/src/test/modules/injection_points/injection_points--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/plsample/plsample.control
/home/hayato/builddir/../postgres/src/test/modules/plsample/plsample--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/spgist_name_ops/spgist_name_ops.control
/home/hayato/builddir/../postgres/src/test/modules/spgist_name_ops/spgist_name_ops--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_aio/test_aio.control
/home/hayato/builddir/../postgres/src/test/modules/test_aio/test_aio--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_bloomfilter/test_bloomfilter.control
/home/hayato/builddir/../postgres/src/test/modules/test_bloomfilter/test_bloomfilter--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_copy_callbacks/test_copy_callbacks.control
/home/hayato/builddir/../postgres/src/test/modules/test_copy_callbacks/test_copy_callbacks--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_custom_rmgrs/test_custom_rmgrs.control
/home/hayato/builddir/../postgres/src/test/modules/test_custom_rmgrs/test_custom_rmgrs--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_ddl_deparse/test_ddl_deparse.control
/home/hayato/builddir/../postgres/src/test/modules/test_ddl_deparse/test_ddl_deparse--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_dsa/test_dsa.control
/home/hayato/builddir/../postgres/src/test/modules/test_dsa/test_dsa--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_dsm_registry/test_dsm_registry.control
/home/hayato/builddir/../postgres/src/test/modules/test_dsm_registry/test_dsm_registry--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext1--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext1.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext2--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext2.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext3--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext3.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext4--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext4.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext5--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext5.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext6--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext6.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext7--1.0--2.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext7--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext7--2.0--2.1bad.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext7--2.0--2.2bad.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext7.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext8--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext8.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext9--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext9.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cine--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cine--1.0--1.1.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cine.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cor--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cor.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cyclic1--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cyclic1.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cyclic2--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_cyclic2.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_extschema--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_extschema.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_evttrig--1.0--2.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_evttrig--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_evttrig.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_req_schema1--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_req_schema1.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_req_schema2--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_req_schema2.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_req_schema3--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_req_schema3.control
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_set_schema--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_extensions/test_ext_set_schema.control
/home/hayato/builddir/../postgres/src/test/modules/test_ginpostinglist/test_ginpostinglist.control
/home/hayato/builddir/../postgres/src/test/modules/test_ginpostinglist/test_ginpostinglist--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_integerset/test_integerset.control
/home/hayato/builddir/../postgres/src/test/modules/test_integerset/test_integerset--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_lfind/test_lfind.control
/home/hayato/builddir/../postgres/src/test/modules/test_lfind/test_lfind--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_parser/test_parser.control
/home/hayato/builddir/../postgres/src/test/modules/test_parser/test_parser--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_pg_dump/test_pg_dump.control
/home/hayato/builddir/../postgres/src/test/modules/test_pg_dump/test_pg_dump--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_predtest/test_predtest.control
/home/hayato/builddir/../postgres/src/test/modules/test_predtest/test_predtest--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_radixtree/test_radixtree.control
/home/hayato/builddir/../postgres/src/test/modules/test_radixtree/test_radixtree--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_rbtree/test_rbtree.control
/home/hayato/builddir/../postgres/src/test/modules/test_rbtree/test_rbtree--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_regex/test_regex.control
/home/hayato/builddir/../postgres/src/test/modules/test_regex/test_regex--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_resowner/test_resowner.control
/home/hayato/builddir/../postgres/src/test/modules/test_resowner/test_resowner--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_shm_mq/test_shm_mq.control
/home/hayato/builddir/../postgres/src/test/modules/test_shm_mq/test_shm_mq--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_slru/test_slru.control
/home/hayato/builddir/../postgres/src/test/modules/test_slru/test_slru--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/test_tidstore/test_tidstore.control
/home/hayato/builddir/../postgres/src/test/modules/test_tidstore/test_tidstore--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/worker_spi/worker_spi.control
/home/hayato/builddir/../postgres/src/test/modules/worker_spi/worker_spi--1.0.sql
/home/hayato/builddir/../postgres/src/test/modules/xid_wraparound/xid_wraparound.control
/home/hayato/builddir/../postgres/src/test/modules/xid_wraparound/xid_wraparound--1.0.sql
--install lib64 src/test/regress/regress.so
src/test/modules/delay_execution/delay_execution.so
src/test/modules/dummy_index_am/dummy_index_am.so
src/test/modules/dummy_seclabel/dummy_seclabel.so
src/test/modules/injection_points/injection_points.so
src/test/modules/oauth_validator/validator.so
src/test/modules/oauth_validator/fail_validator.so
src/test/modules/oauth_validator/magic_validator.so
src/test/modules/plsample/plsample.so
src/test/modules/spgist_name_ops/spgist_name_ops.so
src/test/modules/ssl_passphrase_callback/ssl_passphrase_func.so
src/test/modules/test_aio/test_aio.so
src/test/modules/test_bloomfilter/test_bloomfilter.so
src/test/modules/test_copy_callbacks/test_copy_callbacks.so
src/test/modules/test_custom_rmgrs/test_custom_rmgrs.so
src/test/modules/test_ddl_deparse/test_ddl_deparse.so
src/test/modules/test_dsa/test_dsa.so
src/test/modules/test_dsm_registry/test_dsm_registry.so
src/test/modules/test_ginpostinglist/test_ginpostinglist.so
src/test/modules/test_integerset/test_integerset.so
src/test/modules/test_lfind/test_lfind.so
src/test/modules/test_oat_hooks/test_oat_hooks.so
src/test/modules/test_parser/test_parser.so
src/test/modules/test_predtest/test_predtest.so
src/test/modules/test_radixtree/test_radixtree.so
src/test/modules/test_rbtree/test_rbtree.so
src/test/modules/test_regex/test_regex.so
src/test/modules/test_resowner/test_resowner.so
src/test/modules/test_rls_hooks/test_rls_hooks.so
src/test/modules/test_shm_mq/test_shm_mq.so
src/test/modules/test_slru/test_slru.so
src/test/modules/test_tidstore/test_tidstore.so
src/test/modules/worker_spi/worker_spi.so
src/test/modules/xid_wraparound/xid_wraparound.so --destdir
/home/hayato/builddir/tmp_install/
==============================================================================
==================================== 3/4 =====================================
test: postgresql:setup / initdb_cache
start time: 10:41:53
duration: 1.88s
result: exit status 0
command: top_builddir=/home/hayato/builddir MALLOC_PERTURB_=136
LD_LIBRARY_PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/lib64:/usr/local/pgsql/lib:/usr/local/lib:/usr/lib64/
REGRESS_SHLIB=/home/hayato/builddir/src/test/regress/regress.so
INITDB_TEMPLATE=/home/hayato/builddir/tmp_install/initdb-template
PG_REGRESS=/home/hayato/builddir/src/test/regress/pg_regress /usr/bin/python3
-c '
import shutil
import sys
import subprocess
shutil.rmtree(sys.argv[1], ignore_errors=True)
sp = subprocess.run(sys.argv[2:] + [sys.argv[1]])
sys.exit(sp.returncode)
' /home/hayato/builddir/tmp_install/initdb-template
/home/hayato/builddir/tmp_install//usr/local/pgsql/bin/initdb --auth trust
--no-sync --no-instructions --lc-messages=C --no-clean
----------------------------------- stdout -----------------------------------
Running in no-clean mode. Mistakes will not be cleaned up.
The files belonging to this database system will be owned by user "hayato".
This user must also own the server process.
The database cluster will be initialized with this locale configuration:
locale provider: libc
LC_COLLATE: en_US.UTF-8
LC_CTYPE: en_US.UTF-8
LC_MESSAGES: C
LC_MONETARY: en_US.UTF-8
LC_NUMERIC: en_US.UTF-8
LC_TIME: en_US.UTF-8
The default database encoding has accordingly been set to "UTF8".
The default text search configuration will be set to "english".
Data page checksums are enabled.
creating directory /home/hayato/builddir/tmp_install/initdb-template ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default "max_connections" ... 100
selecting default "autovacuum_worker_slots" ... 16
selecting default "shared_buffers" ... 128MB
selecting default time zone ... Asia/Tokyo
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
Sync to disk skipped.
The data directory might become corrupt if the operating system crashes.
==============================================================================
==================================== 4/4 =====================================
test: postgresql:regress / regress/regress
start time: 10:41:55
duration: 3.75s
result: exit status 2
command: top_builddir=/home/hayato/builddir
LD_LIBRARY_PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/lib64:/usr/local/pgsql/lib:/usr/local/lib:/usr/lib64/
MALLOC_PERTURB_=228
REGRESS_SHLIB=/home/hayato/builddir/src/test/regress/regress.so
INITDB_TEMPLATE=/home/hayato/builddir/tmp_install/initdb-template
PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/bin:/home/hayato/builddir/src/test/regress:/usr/local/pgsql/bin/:/home/hayato/.local/bin:/home/hayato/bin:/usr/share/Modules/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
PG_REGRESS=/home/hayato/builddir/src/test/regress/pg_regress /usr/bin/python3
/home/hayato/builddir/../postgres/src/tools/testwrap --basedir
/home/hayato/builddir --srcdir /home/hayato/postgres/src/test/regress
--pg-test-extra '' --testgroup regress --testname regress --
/home/hayato/builddir/src/test/regress/pg_regress --inputdir
/home/hayato/postgres/src/test/regress --expecteddir
/home/hayato/postgres/src/test/regress --bindir '' --dlpath
/home/hayato/builddir/src/test/regress --max-concurrent-tests=20 --dbname
regression --outputdir /home/hayato/builddir/testrun/regress/regress
--temp-instance /home/hayato/builddir/testrun/regress/regress/tmp_check --port
40047 --schedule
/home/hayato/builddir/../postgres/src/test/regress/parallel_schedule
----------------------------------- stdout -----------------------------------
# executing test in /home/hayato/builddir/testrun/regress/regress group regress
test regress
# initializing database system by copying initdb template
# using temp instance on port 40047 with PID 1790382
Bail out!# test failed
----------------------------------- stderr -----------------------------------
psql: symbol lookup error: psql: undefined symbol: PQservice
# command failed: "psql" -X -q -c "CREATE DATABASE \"regression\"
TEMPLATE=template0" -c "ALTER DATABASE \"regression\" SET lc_messages TO
'C';ALTER DATABASE \"regression\" SET lc_monetary TO 'C';ALTER DATABASE
\"regression\" SET lc_numeric TO 'C';ALTER DATABASE \"regression\" SET lc_time
TO 'C';ALTER DATABASE \"regression\" SET bytea_output TO 'hex';ALTER DATABASE
\"regression\" SET timezone_abbreviations TO 'Default';" "postgres"
(test program exited with status code 2)
==============================================================================
Summary of Failures:
4/4 postgresql:regress / regress/regress ERROR 3.75s exit status
2
Ok: 3
Expected Fail: 0
Fail: 1
Unexpected Pass: 0
Skipped: 0
Timeout: 0
$
PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/bin:/home/hayato/builddir/src/test/regress:/usr/local/pgsql/bin/:/home/hayato/.local/bin:/home/hayato/bin:/usr/share/Modules/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
LD_LIBRARY_PATH=/home/hayato/builddir/tmp_install//usr/local/pgsql/lib64:/usr/local/pgsql/lib:/usr/local/lib:/usr/lib64/
ldd /home/hayato/builddir/tmp_install/usr/local/pgsql/bin/psql
linux-vdso.so.1 (0x00007ffd5c7c7000)
libpq.so.5 => /usr/local/pgsql/lib64/libpq.so.5 (0x00007f127aa50000)
libm.so.6 => /usr/lib64/libm.so.6 (0x00007f127a975000)
libreadline.so.8 => /usr/lib64/libreadline.so.8 (0x00007f127a91d000)
libc.so.6 => /usr/lib64/libc.so.6 (0x00007f127a600000)
libssl.so.3 => /usr/lib64/libssl.so.3 (0x00007f127a837000)
libcrypto.so.3 => /usr/lib64/libcrypto.so.3 (0x00007f127a000000)
/lib64/ld-linux-x86-64.so.2 (0x00007f127aab4000)
libtinfo.so.6 => /usr/lib64/libtinfo.so.6 (0x00007f127a5d0000)
libz.so.1 => /usr/lib64/libz.so.1 (0x00007f127a81b000)
