Hi,
The why doesn’t matter, but it is a third party software package. They
source different files from different location which define variables. They set
-a before and +a after. I’m stuck in the middle. As long as I didn’t trigger
the bug, it didn’t matter.
Changing the parameters of ps, is beside the point. It works fine as is if
we don’t trigger this bug. Beside I would have to modify at least 6 different
scripts which come with this software package. There is also that this doesn’t
fix the problem :
Here is a proof that using ‘w’ doesn’t fix the issue :
$ set -a
# First ps works just fine
$ ps ax | grep java | grep -v grep
… long ps output…
/icos/acm/apps/karaf-server/lib/boot/org.apache.karaf.jaas.boot-4.4.3.jar:/icos/acm/apps/karaf-server/lib/boot/org.apache.karaf.main-4.4.3.jar:/icos/acm/apps/karaf-server/lib/boot/org.apache.karaf.specs.activator-4.4.3.jar:/icos/acm/apps/karaf-server/lib/boot/osgi.core-8.0.0.jar:/icos/acm/apps/karaf-server/lib/jdk9plus/istack-commons-runtime-3.0.10.jar:/icos/acm/apps/karaf-server/lib/jdk9plus/jakarta.xml.bind-api-2.3.3.jar:/icos/acm/apps/karaf-server/lib/jdk9plus/javax.annotation-api-1.3.2.jar:/icos/acm/apps/karaf-server/lib/jdk9plus/jaxb-runtime-2.3.3.jar:/icos/acm/apps/karaf-server/lib/jdk9plus/org.apache.servicemix.specs.activation-api-1.2.1-1.2.1_3.jar:/icos/acm/apps/karaf-server/lib/jdk9plus/txw2-2.3.3.jar
org.apache.karaf.main.Main
# All the next ps have truncated output
host:/$ ps ax | grep java | grep -v grep
2051669 ? Sl 0:04 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -Xms2g
-Xmx2g -server -XX:+Us
2052152 ? Sl 2:01 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -Xms2g
-Xmx2g -server -XX:+Us
2052632 ? Sl 0:54 /usr/lib/jvm/java-17-openjdk-amd64/bin/java
-server -Xms2g -Xmx2g -XX:+Us
2052917 ? Sl 2:31 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plug
2054219 ? Sl 6:36 /usr/lib/jvm/java-17-openjdk-amd64/bin/java
-XX:+UnlockDiagnosticVMOption
# with ‘w’ option, doesn’t change much, just adds a few more chars at end.
host:/$ ps awx | grep java | grep -v grep
2051669 ? Sl 0:04 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -Xms2g
-Xmx2g -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20
2052152 ? Sl 2:01 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -Xms2g
-Xmx2g -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20
2052632 ? Sl 0:54 /usr/lib/jvm/java-17-openjdk-amd64/bin/java
-server -Xms2g -Xmx2g -XX:+UseG1GC -XX:+PerfDisableSharedMe
2052917 ? Sl 2:31 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plugins/*:/icos/acm/config/neo4j/*
2054219 ? Sl 6:36 /usr/lib/jvm/java-17-openjdk-amd64/bin/java
-XX:+UnlockDiagnosticVMOptions -Xms6g -Xmx6g --add-reads=ja
The ps goes through a PIPE, its output should never get truncated.
Regards,
Alain
[cid:ISP-REYL_HubSWS_Col_email_v2_88f4ea19-df87-4cc1-aef3-c28f2127924c.png]<http://www.reyl.com>
Alain BROSSARD
System & Network Administrator
Technology
D +41 22 816 8607<tel:+41%2022%20816%208607>
M +41 79 612 2336<tel:+41%2079%20612%202336>
T +41 22 816 8600<tel:+41%2022%20816%208600>
F +41 22 816 8009<tel:+41%2022%20816%208009>
[email protected]<mailto:[email protected]>
REYL & Cie SA
Rue du Rhône 4
1204 Genève
www.reyl.com<https://www.reyl.com>
[cid:SUCCES.TOGETHER_RVB_email_345119d7-0ea9-4fc1-b2e0-c31313eae094.png]
________________________________
The information contained in email messages from REYL & Cie SA may contain
confidential, proprietary or legally privileged information and is intended
only for the use of the addressee named above. No confidentiality or privilege
is waived or lost by any mis-transmission. If you are not the addressee of this
email message, you must not use, distribute, copy it in any form or take any
action in reliance on it. If you have received this email message by error,
please notify us immediately by replying to the message and delete it from your
computer. If there are any attachments to the email messages that you received
in error, kindly refrain from opening them and do not download or save them to
your computer. In accordance with industry standards and practices, and to
comply with our legal and regulatory retention requirement REYL & Cie SA
monitors and retains email messages for a period of time in accordance with its
policies, guidelines and procedures. Email transmission cannot be guaranteed to
be secured or error-free as information could be intercepted, corrupted, lost,
destroyed, arrive late or incomplete, or contain viruses. REYL & Cie SA is not
liable for any unproper or incomplete transmission of the information contained
in email messages or for any delay it their receipt. Some publications included
in email message may be advertising material (pursuant to Art. 68 of the
Federal Act on Financial Services, Financial Services Act of 15 June 2018) for
financial services or for financial instruments. For any financial instruments
mentioned, we will be happy to provide you with additional documents at any
time and free of charge, such as a key information document pursuant to Art. 58
et seq. of the Financial Services Act, a prospectus pursuant to Art. 35 et seq.
of the Financial Services Act or an equivalent foreign product information
sheet, e.g. a basic information sheet pursuant to Regulation EU 1286/2014 for
packaged investment products for retail investors and insurance investment
products (PRIIPS KID). We consider your inquiries about our products and
services as a request to contact you and send you relevant information.
From: alex xmb sw ratchev <[email protected]>
Sent: Thursday, June 13, 2024 3:32 PM
To: Alain BROSSARD <[email protected]>
Cc: [email protected]
Subject: Re: set -a leads to truncated output from ps
try the ps arg w for full length ps output why u set -a ? On Thu, Jun 13, 2024,
3: 29 PM Alain BROSSARD via Bug reports for the GNU Bourne Again SHell
<bug-bash@ gnu. org> wrote: Configuration Information [Automatically generated,
do not
ZjQcmQRYFpfptBannerStart
This Message Is From an Untrusted Sender
This message was sent from outside of REYL & CIE.
You have not previously corresponded with this sender.
Report Suspicious
<https://us-phishalarm-ewt.proofpoint.com/EWT/v1/HLcdjgI!MxEYukcrhqUO4Xuin4mvk9H4XbjEO1w8IDPEZhbES8WCBZswxwsKChFM_zuI8ZPSfa-J2KXk30f6XK8o_wf79dZfLkaVal5Y_0pB6Jy8dEhnIswbfGAE7ege8Q$>
ZjQcmQRYFpfptBannerEnd
try the ps arg w for full length ps output
why u set -a ?
On Thu, Jun 13, 2024, 3:29 PM Alain BROSSARD via Bug reports for the GNU Bourne
Again SHell <[email protected]<mailto:[email protected]>> wrote:
Configuration Information [Automatically generated, do not change]:
Machine: x86_64
OS: linux-gnu
Compiler: gcc
Compilation CFLAGS: -g -O2 -flto=auto -ffat-lto-objects -flto=auto
-ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security
-Wall
uname output: Linux admu01-rgr-gva 5.15.0-107-generic #117-Ubuntu SMP Fri Apr
26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Machine Type: x86_64-pc-linux-gnu
Bash Version: 5.1
Patch Level: 16
Release Status: release
Description:
I encountered this bug while tracing an issue within a third-party bash
script.
The following command wasn't detecting that the Neo4j Java application was
running:
ps ax | grep java | grep -i "com.neo4j.server.enterprise.EnterpriseEntryPoint"
| grep -v grep | awk '{print $1}'
In practice, ps ax | grep java is sufficient to illustrate the issue as
shown below.
host:/$ set -a
# first execution of ps works fine as shown next
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:14 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plugins/*:/icos/acm/config/neo4j/*:/icos/acm/apps/neo4j/lib/*
-XX:+UseG1GC -XX:-OmitStackTraceInFastThrow -XX:+AlwaysPreTouch
-XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields
-XX:+DisableExplicitGC -Djdk.nio.maxCachedBufferSize=1024
-Dio.netty.tryReflectionSetAccessible=true -Djdk.tls.ephemeralDHKeySize=2048
-Djdk.tls.rejectClientInitiatedRenegotiation=true
-XX:FlightRecorderOptions=stackdepth=256 -XX:+UnlockDiagnosticVMOptions
-XX:+DebugNonSafepoints --add-opens=java.base/java.nio=ALL-UNNAMED
--add-opens=java.base/java.io<http://java.io/>=ALL-UNNAMED
--add-opens=java.base/sun.nio.ch<http://sun.nio.ch/>=ALL-UNNAMED
-Dlog4j2.disable.jmx=true
-Xlog:gc*,safepoint,age*=trace:file=/icos/acm/logs/neo4j/gc.log::filecount=5,filesize=20480k
-Dfile.encoding=UTF-8 -Xms4194304k -Xmx8388608k
com.neo4j.server.enterprise.EnterpriseEntryPoint
--home-dir=/icos/acm/apps/neo4j --config-dir=/icos/acm/config/neo4j
# however, the second one has truncated output to the terminal width
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:14 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plug
At this stage, only a restart of the bash shell seems to fix the issue.
All output from ps is now truncated even when passed through a pipe. I haven't
found a work-around once this bug is triggered. I’ve compared the environment
variables before and after and same for output from stty -a and found no
difference.
Assigning to a variable within an 'if' or after either '||' or '&&' also
triggers the problem. Example, the following code triggers the bug:
icos%cobfm03-uat-gva[167] bash
# ps output is good
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:16 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plugins/*:/icos/acm/config/neo4j/*:/icos/acm/apps/neo4j/lib/*
-XX:+UseG1GC -XX:-OmitStackTraceInFastThrow -XX:+AlwaysPreTouch
-XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields
-XX:+DisableExplicitGC -Djdk.nio.maxCachedBufferSize=1024
-Dio.netty.tryReflectionSetAccessible=true -Djdk.tls.ephemeralDHKeySize=2048
-Djdk.tls.rejectClientInitiatedRenegotiation=true
-XX:FlightRecorderOptions=stackdepth=256 -XX:+UnlockDiagnosticVMOptions
-XX:+DebugNonSafepoints --add-opens=java.base/java.nio=ALL-UNNAMED
--add-opens=java.base/java.io<http://java.io/>=ALL-UNNAMED
--add-opens=java.base/sun.nio.ch<http://sun.nio.ch/>=ALL-UNNAMED
-Dlog4j2.disable.jmx=true
-Xlog:gc*,safepoint,age*=trace:file=/icos/acm/logs/neo4j/gc.log::filecount=5,filesize=20480k
-Dfile.encoding=UTF-8 -Xms4194304k -Xmx8388608k
com.neo4j.server.enterprise.EnterpriseEntryPoint
--home-dir=/icos/acm/apps/neo4j --config-dir=/icos/acm/config/neo4j
host:/$ set -a
host:/$ echo $PATH | grep -q reyl/scripts || PATH=${PATH}:/reyl/scripts
# ps output is now always truncated, even if/after we call ‘unset +a’.
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:16 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plug
replace PATH= by { PATH=... } also triggers the bug. Using 'if' also
triggers it.
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:17 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plugins/*:/icos/acm/config/neo4j/*:/icos/acm/apps/neo4j/lib/*
-XX:+UseG1GC -XX:-OmitStackTraceInFastThrow -XX:+AlwaysPreTouch
-XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields
-XX:+DisableExplicitGC -Djdk.nio.maxCachedBufferSize=1024
-Dio.netty.tryReflectionSetAccessible=true -Djdk.tls.ephemeralDHKeySize=2048
-Djdk.tls.rejectClientInitiatedRenegotiation=true
-XX:FlightRecorderOptions=stackdepth=256 -XX:+UnlockDiagnosticVMOptions
-XX:+DebugNonSafepoints --add-opens=java.base/java.nio=ALL-UNNAMED
--add-opens=java.base/java.io<http://java.io/>=ALL-UNNAMED
--add-opens=java.base/sun.nio.ch<http://sun.nio.ch/>=ALL-UNNAMED
-Dlog4j2.disable.jmx=true
-Xlog:gc*,safepoint,age*=trace:file=/icos/acm/logs/neo4j/gc.log::filecount=5,filesize=20480k
-Dfile.encoding=UTF-8 -Xms4194304k -Xmx8388608k
com.neo4j.server.enterprise.EnterpriseEntryPoint
--home-dir=/icos/acm/apps/neo4j --config-dir=/icos/acm/config/neo4j
host:/$ set -a
host:/$ if echo $PATH | grep -q java ; then
> PATH=${PATH}:/reyl/scripts
> fi
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:17 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plug
host:/$ exit
Work-around that works is to assign a variable within $( ) and set +a :
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:18 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plugins/*:/icos/acm/config/neo4j/*:/icos/acm/apps/neo4j/lib/*
-XX:+UseG1GC -XX:-OmitStackTraceInFastThrow -XX:+AlwaysPreTouch
-XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields
-XX:+DisableExplicitGC -Djdk.nio.maxCachedBufferSize=1024
-Dio.netty.tryReflectionSetAccessible=true -Djdk.tls.ephemeralDHKeySize=2048
-Djdk.tls.rejectClientInitiatedRenegotiation=true
-XX:FlightRecorderOptions=stackdepth=256 -XX:+UnlockDiagnosticVMOptions
-XX:+DebugNonSafepoints --add-opens=java.base/java.nio=ALL-UNNAMED
--add-opens=java.base/java.io<http://java.io/>=ALL-UNNAMED
--add-opens=java.base/sun.nio.ch<http://sun.nio.ch/>=ALL-UNNAMED
-Dlog4j2.disable.jmx=true
-Xlog:gc*,safepoint,age*=trace:file=/icos/acm/logs/neo4j/gc.log::filecount=5,filesize=20480k
-Dfile.encoding=UTF-8 -Xms4194304k -Xmx8388608k
com.neo4j.server.enterprise.EnterpriseEntryPoint
--home-dir=/icos/acm/apps/neo4j --config-dir=/icos/acm/config/neo4j
host:/$ set -a
host:/$ opta_is_set=$(echo $- | grep -q a && echo 1 )
# record whether -a is set or not, this must be done within $( ) or the
bug gets triggered
host:/$ set +a
# change the PATH as required after unseting -a
host:/$ echo $PATH | grep -q reyl/scripts || PATH=${PATH}:/reyl/scripts
# no bug, ps output isn't truncated
host:/$ ps ax | grep java | grep -v grep
645101 pts/2 Sl 8:19 /usr/lib/jvm/java-17-openjdk-amd64/bin/java -cp
/icos/acm/apps/neo4j/plugins/*:/icos/acm/config/neo4j/*:/icos/acm/apps/neo4j/lib/*
-XX:+UseG1GC -XX:-OmitStackTraceInFastThrow -XX:+AlwaysPreTouch
-XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields
-XX:+DisableExplicitGC -Djdk.nio.maxCachedBufferSize=1024
-Dio.netty.tryReflectionSetAccessible=true -Djdk.tls.ephemeralDHKeySize=2048
-Djdk.tls.rejectClientInitiatedRenegotiation=true
-XX:FlightRecorderOptions=stackdepth=256 -XX:+UnlockDiagnosticVMOptions
-XX:+DebugNonSafepoints --add-opens=java.base/java.nio=ALL-UNNAMED
--add-opens=java.base/java.io<http://java.io/>=ALL-UNNAMED
--add-opens=java.base/sun.nio.ch<http://sun.nio.ch/>=ALL-UNNAMED
-Dlog4j2.disable.jmx=true
-Xlog:gc*,safepoint,age*=trace:file=/icos/acm/logs/neo4j/gc.log::filecount=5,filesize=20480k
-Dfile.encoding=UTF-8 -Xms4194304k -Xmx8388608k
com.neo4j.server.enterprise.EnterpriseEntryPoint
--home-dir=/icos/acm/apps/neo4j --config-dir=/icos/acm/config/neo4j
# as part of the work-around, we reset -a to its prior state and
continue
host:/$ [ $opta_is_set == 1 ] && set -a
host:/$ unset -v opta_is_set
Repeat-By:
set -a
ps as | grep 'find a long line'
# next ps output gets truncated and all subsequent executions until we exit the
shell
ps as | grep 'find a long line'
[cid:ISP-REYL_HubSWS_Col_email_v2_88f4ea19-df87-4cc1-aef3-c28f2127924c.png]<http://www.reyl.com<http://www.reyl.com/>>
Alain BROSSARD
System & Network Administrator
Technology
D +41 22 816 8607<tel:+41%2022%20816%208607>
M +41 79 612 2336<tel:+41%2079%20612%202336>
T +41 22 816 8600<tel:+41%2022%20816%208600>
F +41 22 816 8009<tel:+41%2022%20816%208009>
[email protected]<mailto:[email protected]><mailto:[email protected]<mailto:[email protected]>>
REYL & Cie SA
Rue du Rhône 4
1204 Genève
www.reyl.com<http://www.reyl.com/><https://www.reyl.com<https://www.reyl.com/>>
[cid:SUCCES.TOGETHER_RVB_email_345119d7-0ea9-4fc1-b2e0-c31313eae094.png]
________________________________
The information contained in email messages from REYL & Cie SA may contain
confidential, proprietary or legally privileged information and is intended
only for the use of the addressee named above. No confidentiality or privilege
is waived or lost by any mis-transmission. If you are not the addressee of this
email message, you must not use, distribute, copy it in any form or take any
action in reliance on it. If you have received this email message by error,
please notify us immediately by replying to the message and delete it from your
computer. If there are any attachments to the email messages that you received
in error, kindly refrain from opening them and do not download or save them to
your computer. In accordance with industry standards and practices, and to
comply with our legal and regulatory retention requirement REYL & Cie SA
monitors and retains email messages for a period of time in accordance with its
policies, guidelines and procedures. Email transmission cannot be guaranteed to
be secured or error-free as information could be intercepted, corrupted, lost,
destroyed, arrive late or incomplete, or contain viruses. REYL & Cie SA is not
liable for any unproper or incomplete transmission of the information contained
in email messages or for any delay it their receipt. Some publications included
in email message may be advertising material (pursuant to Art. 68 of the
Federal Act on Financial Services, Financial Services Act of 15 June 2018) for
financial services or for financial instruments. For any financial instruments
mentioned, we will be happy to provide you with additional documents at any
time and free of charge, such as a key information document pursuant to Art. 58
et seq. of the Financial Services Act, a prospectus pursuant to Art. 35 et seq.
of the Financial Services Act or an equivalent foreign product information
sheet, e.g. a basic information sheet pursuant to Regulation EU 1286/2014 for
packaged investment products for retail investors and insurance investment
products (PRIIPS KID). We consider your inquiries about our products and
services as a request to contact you and send you relevant information.
