[
https://issues.apache.org/jira/browse/HUDI-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-9143:
------------------------------
Description:
The merging of Jacoco execution data files fail because the file is corrupt
from Azure CI Job 1 FT. The merge can succeed when the file is empty, which is
also abnormal.
{code:java}
-rw-r--r-- 1 vsts docker 1126236 Mar 8 20:32
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec
-rw-r--r-- 1 vsts docker 1880 Mar 8 20:50
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec.
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec.
Exception in thread "main" java.io.EOFException
at java.base/java.io.DataInputStream.readByte(DataInputStream.java:272)
at
org.jacoco.cli.internal.core.internal.data.CompactDataInput.readBooleanArray(CompactDataInput.java:64)
at
org.jacoco.cli.internal.core.data.ExecutionDataReader.readExecutionData(ExecutionDataReader.java:150)
at
org.jacoco.cli.internal.core.data.ExecutionDataReader.readBlock(ExecutionDataReader.java:116)
at
org.jacoco.cli.internal.core.data.ExecutionDataReader.read(ExecutionDataReader.java:93)
at
org.jacoco.cli.internal.core.tools.ExecFileLoader.load(ExecFileLoader.java:60)
at
org.jacoco.cli.internal.core.tools.ExecFileLoader.load(ExecFileLoader.java:74)
at
org.jacoco.cli.internal.commands.Merge.loadExecutionData(Merge.java:61)
at org.jacoco.cli.internal.commands.Merge.execute(Merge.java:45)
at org.jacoco.cli.internal.Main.execute(Main.java:90)
at org.jacoco.cli.internal.Main.main(Main.java:105)
{code}
{code:java}
Hudi source directory: /home/vsts/work/1/s
-rw-r--r-- 1 vsts docker 1126064 Mar 6 04:42
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec
-rw-r--r-- 1 vsts docker 0 Mar 6 04:42
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec.
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec.
[INFO] Writing execution data to /home/vsts/work/1/s/merged-jacoco.exec.
Jacoco merge succeeded on attempt 1
{code}
was:
The merging of Jacoco execution data files fail because the file is corrupt
from Azure CI Job 1. The merge can succeed when the file is empty, which is
also abnormal.
{code:java}
-rw-r--r-- 1 vsts docker 1126236 Mar 8 20:32
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec
-rw-r--r-- 1 vsts docker 1880 Mar 8 20:50
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec.
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec.
Exception in thread "main" java.io.EOFException
at java.base/java.io.DataInputStream.readByte(DataInputStream.java:272)
at
org.jacoco.cli.internal.core.internal.data.CompactDataInput.readBooleanArray(CompactDataInput.java:64)
at
org.jacoco.cli.internal.core.data.ExecutionDataReader.readExecutionData(ExecutionDataReader.java:150)
at
org.jacoco.cli.internal.core.data.ExecutionDataReader.readBlock(ExecutionDataReader.java:116)
at
org.jacoco.cli.internal.core.data.ExecutionDataReader.read(ExecutionDataReader.java:93)
at
org.jacoco.cli.internal.core.tools.ExecFileLoader.load(ExecFileLoader.java:60)
at
org.jacoco.cli.internal.core.tools.ExecFileLoader.load(ExecFileLoader.java:74)
at
org.jacoco.cli.internal.commands.Merge.loadExecutionData(Merge.java:61)
at org.jacoco.cli.internal.commands.Merge.execute(Merge.java:45)
at org.jacoco.cli.internal.Main.execute(Main.java:90)
at org.jacoco.cli.internal.Main.main(Main.java:105)
{code}
{code:java}
Hudi source directory: /home/vsts/work/1/s
-rw-r--r-- 1 vsts docker 1126064 Mar 6 04:42
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec
-rw-r--r-- 1 vsts docker 0 Mar 6 04:42
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec.
[INFO] Loading execution data file
/home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec.
[INFO] Writing execution data to /home/vsts/work/1/s/merged-jacoco.exec.
Jacoco merge succeeded on attempt 1
{code}
> Investigate empty or corrupt Jacoco execution data file from Azure CI Job 1
> ---------------------------------------------------------------------------
>
> Key: HUDI-9143
> URL: https://issues.apache.org/jira/browse/HUDI-9143
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Priority: Major
>
> The merging of Jacoco execution data files fail because the file is corrupt
> from Azure CI Job 1 FT. The merge can succeed when the file is empty, which
> is also abnormal.
> {code:java}
> -rw-r--r-- 1 vsts docker 1126236 Mar 8 20:32
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec
> -rw-r--r-- 1 vsts docker 1880 Mar 8 20:50
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec
> [INFO] Loading execution data file
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec.
> [INFO] Loading execution data file
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec.
> Exception in thread "main" java.io.EOFException
> at java.base/java.io.DataInputStream.readByte(DataInputStream.java:272)
> at
> org.jacoco.cli.internal.core.internal.data.CompactDataInput.readBooleanArray(CompactDataInput.java:64)
> at
> org.jacoco.cli.internal.core.data.ExecutionDataReader.readExecutionData(ExecutionDataReader.java:150)
> at
> org.jacoco.cli.internal.core.data.ExecutionDataReader.readBlock(ExecutionDataReader.java:116)
> at
> org.jacoco.cli.internal.core.data.ExecutionDataReader.read(ExecutionDataReader.java:93)
> at
> org.jacoco.cli.internal.core.tools.ExecFileLoader.load(ExecFileLoader.java:60)
> at
> org.jacoco.cli.internal.core.tools.ExecFileLoader.load(ExecFileLoader.java:74)
> at
> org.jacoco.cli.internal.commands.Merge.loadExecutionData(Merge.java:61)
> at org.jacoco.cli.internal.commands.Merge.execute(Merge.java:45)
> at org.jacoco.cli.internal.Main.execute(Main.java:90)
> at org.jacoco.cli.internal.Main.main(Main.java:105)
> {code}
> {code:java}
> Hudi source directory: /home/vsts/work/1/s
> -rw-r--r-- 1 vsts docker 1126064 Mar 6 04:42
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec
> -rw-r--r-- 1 vsts docker 0 Mar 6 04:42
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec
> [INFO] Loading execution data file
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco1.exec.
> [INFO] Loading execution data file
> /home/vsts/work/1/s/hudi-client/hudi-spark-client/target/jacoco-agent/jacoco2.exec.
> [INFO] Writing execution data to /home/vsts/work/1/s/merged-jacoco.exec.
> Jacoco merge succeeded on attempt 1
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
