LuciferYang commented on PR #48646:
URL: https://github.com/apache/spark/pull/48646#issuecomment-2440478091
It seems that after this pr, the `spark-protobuf` module will fail to
compile using Maven:
**Before:**
```
git reset --hard b0dc6546a0b720f86ddbaa87e4d055557160af54
build/mvn -DskipTests clean install -pl connector/protobuf -e -am
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 4.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 2.854
s]
[INFO] Spark Project Tags ................................. SUCCESS [ 5.257
s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 5.023
s]
[INFO] Spark Project Common Utils ......................... SUCCESS [ 16.851
s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 8.222
s]
[INFO] Spark Project Networking ........................... SUCCESS [ 11.172
s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 9.049
s]
[INFO] Spark Project Variant .............................. SUCCESS [ 3.260
s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 10.125
s]
[INFO] Spark Project Connect Shims ........................ SUCCESS [ 2.640
s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 6.882
s]
[INFO] Spark Project Core ................................. SUCCESS [01:43
min]
[INFO] Spark Project SQL API .............................. SUCCESS [ 29.428
s]
[INFO] Spark Project Catalyst ............................. SUCCESS [02:02
min]
[INFO] Spark Project SQL .................................. SUCCESS [02:33
min]
[INFO] Spark Protobuf ..................................... SUCCESS [ 24.383
s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 08:34 min
[INFO] Finished at: 2024-10-28T11:12:10+08:00
[INFO]
------------------------------------------------------------------------
```
**After:**
```
git reset --hard b0dc6546a0b720f86ddbaa87e4d055557160af54
build/mvn -DskipTests clean install -pl connector/protobuf -e -am
[INFO] --- protoc-jar:3.11.4:run (default) @ spark-protobuf_2.13 ---
[INFO] Resolving artifact: com.google.protobuf:protoc:4.28.3, platform:
osx-aarch_64
protoc-jar: executing:
[/var/folders/j2/cfn7w6795538n_416_27rkqm0000gn/T/protoc17161577217517635203.exe,
--version]
libprotoc 28.3
[INFO] Protoc command:
/var/folders/j2/cfn7w6795538n_416_27rkqm0000gn/T/protoc17161577217517635203.exe
[INFO] Additional include types:
/var/folders/j2/cfn7w6795538n_416_27rkqm0000gn/T/protocjar1650670058665477047/include
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 4.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 5.220
s]
[INFO] Spark Project Tags ................................. SUCCESS [ 5.724
s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 6.586
s]
[INFO] Spark Project Common Utils ......................... SUCCESS [ 17.162
s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 7.086
s]
[INFO] Spark Project Networking ........................... SUCCESS [ 13.517
s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 8.659
s]
[INFO] Spark Project Variant .............................. SUCCESS [ 3.383
s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 9.294
s]
[INFO] Spark Project Connect Shims ........................ SUCCESS [ 2.865
s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 5.692
s]
[INFO] Spark Project Core ................................. SUCCESS [01:39
min]
[INFO] Spark Project SQL API .............................. SUCCESS [ 26.080
s]
[INFO] Spark Project Catalyst ............................. SUCCESS [01:56
min]
[INFO] Spark Project SQL .................................. SUCCESS [02:27
min]
[INFO] Spark Protobuf ..................................... FAILURE [ 7.295
s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 08:02 min
[INFO] Finished at: 2024-10-28T11:20:52+08:00
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
com.github.os72:protoc-jar-maven-plugin:3.11.4:run (default) on project
spark-protobuf_2.13: Execution default of goal
com.github.os72:protoc-jar-maven-plugin:3.11.4:run failed: Cannot read the
array length because "<local6>" is null -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (default) on project
spark-protobuf_2.13: Execution default of goal
com.github.os72:protoc-jar-maven-plugin:3.11.4:run failed: Cannot read the
array length because "<local6>" is null
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2
(MojoExecutor.java:333)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute
(MojoExecutor.java:316)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:174)
at org.apache.maven.lifecycle.internal.MojoExecutor.access$000
(MojoExecutor.java:75)
at org.apache.maven.lifecycle.internal.MojoExecutor$1.run
(MojoExecutor.java:162)
at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute
(DefaultMojosExecutionStrategy.java:39)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:159)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:105)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:73)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:53)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:118)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:77)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:569)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:255)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:201)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:361)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:314)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
default of goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run failed:
Cannot read the array length because "<local6>" is null
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:133)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2
(MojoExecutor.java:328)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute
(MojoExecutor.java:316)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:174)
at org.apache.maven.lifecycle.internal.MojoExecutor.access$000
(MojoExecutor.java:75)
at org.apache.maven.lifecycle.internal.MojoExecutor$1.run
(MojoExecutor.java:162)
at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute
(DefaultMojosExecutionStrategy.java:39)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:159)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:105)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:73)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:53)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:118)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:77)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:569)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:255)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:201)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:361)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:314)
Caused by: java.lang.NullPointerException: Cannot read the array length
because "<local6>" is null
at com.github.os72.protocjar.Protoc.extractStdTypes (Protoc.java:372)
at com.github.os72.protocjar.maven.ProtocJarMojo.performProtoCompilation
(ProtocJarMojo.java:397)
at com.github.os72.protocjar.maven.ProtocJarMojo.execute
(ProtocJarMojo.java:374)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:126)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2
(MojoExecutor.java:328)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute
(MojoExecutor.java:316)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:174)
at org.apache.maven.lifecycle.internal.MojoExecutor.access$000
(MojoExecutor.java:75)
at org.apache.maven.lifecycle.internal.MojoExecutor$1.run
(MojoExecutor.java:162)
at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute
(DefaultMojosExecutionStrategy.java:39)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:159)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:105)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:73)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:53)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:118)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:77)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:569)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:255)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch
(Launcher.java:201)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:361)
at org.codehaus.plexus.classworlds.launcher.Launcher.main
(Launcher.java:314)
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <args> -rf :spark-protobuf_2.13
```
The Maven daily tests for the past two days have all failed to compile, and
I haven't found the root cause yet:
- https://github.com/apache/spark/actions/runs/11532032555
- https://github.com/apache/spark/actions/runs/11532395027
- https://github.com/apache/spark/actions/runs/11524716596
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
