[
https://issues.apache.org/jira/browse/BEAM-6558?focusedWorklogId=193695&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-193695
]
ASF GitHub Bot logged work on BEAM-6558:
----------------------------------------
Author: ASF GitHub Bot
Created on: 02/Feb/19 17:27
Start Date: 02/Feb/19 17:27
Worklog Time Spent: 10m
Work Description: kennknowles commented on issue #7707: [BEAM-6558]
Cherrypick IWYU fixes
URL: https://github.com/apache/beam/pull/7707#issuecomment-459982909
This was actually a success. Java precommit ends with:
```
16:47:43 BUILD SUCCESSFUL in 23m 37s
16:47:43 921 actionable tasks: 921 executed
16:47:43
16:47:43 Publishing build scan...
16:47:44 https://gradle.com/s/cdv3vf7hap73u
16:47:44
16:47:45 Build step 'Invoke Gradle script' changed build result to SUCCESS
16:47:45 Recording test results
16:47:48 [Error Prone] Sleeping for 5 seconds due to JENKINS-32191...
16:47:53 [Error Prone] Parsing console log (workspace:
'/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit')
16:47:53 ERROR: Build step failed with exception
16:47:53 java.lang.NumberFormatException: For input string: "checkstyle]
[WARN]
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src/sdks/java/extensions/euphoria/src/main/java/org/apache/beam/sdk/extensions/euphoria/core/annotation/audience/Audience.java"
16:47:53 at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
16:47:53 at java.lang.Integer.parseInt(Integer.java:580)
16:47:53 at java.lang.Integer.parseInt(Integer.java:615)
16:47:53 at
se.bjurr.violations.lib.parsers.GoogleErrorProneParser.parseReportOutput(GoogleErrorProneParser.java:29)
16:47:53 at
edu.hm.hafner.analysis.parser.violations.AbstractViolationAdapter.parse(AbstractViolationAdapter.java:32)
16:47:53 Caused: edu.hm.hafner.analysis.ParsingException: Exception occurred
during parsing:
16:47:53 For input string: "checkstyle] [WARN]
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src/sdks/java/extensions/euphoria/src/main/java/org/apache/beam/sdk/extensions/euphoria/core/annotation/audience/Audience.java"
16:47:53 at
edu.hm.hafner.analysis.parser.violations.AbstractViolationAdapter.parse(AbstractViolationAdapter.java:36)
16:47:53 at
io.jenkins.plugins.analysis.core.model.ReportScanningTool.scanInConsoleLog(ReportScanningTool.java:150)
16:47:53 at
io.jenkins.plugins.analysis.core.model.ReportScanningTool.scan(ReportScanningTool.java:99)
16:47:53 at
io.jenkins.plugins.analysis.core.steps.IssuesScanner.scan(IssuesScanner.java:64)
16:47:53 at
io.jenkins.plugins.analysis.core.steps.IssuesRecorder.scanWithTool(IssuesRecorder.java:679)
16:47:53 at
io.jenkins.plugins.analysis.core.steps.IssuesRecorder.record(IssuesRecorder.java:647)
16:47:53 at
io.jenkins.plugins.analysis.core.steps.IssuesRecorder.perform(IssuesRecorder.java:619)
16:47:53 at
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
16:47:53 at
hudson.tasks.BuildStepMonitor$3.perform(BuildStepMonitor.java:45)
16:47:53 at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
16:47:53 at
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
16:47:53 at hudson.model.Build$BuildExecution.post2(Build.java:186)
16:47:53 at
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
16:47:53 at hudson.model.Run.execute(Run.java:1835)
16:47:53 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
16:47:53 at
hudson.model.ResourceController.execute(ResourceController.java:97)
16:47:53 at hudson.model.Executor.run(Executor.java:429)
16:47:53 Build step 'Record compiler warnings and static analysis results'
marked build as failure
16:47:54 Setting status of ad4d20fa1084f6d179be828ebc2aeac02f608f0d to
FAILURE with url https://builds.apache.org/job/beam_PreCommit_Java_Commit/3993/
and message: 'FAILURE
16:47:54 '
16:47:54 Using context: Java ("Run Java PreCommit")
16:47:55 Finished: FAILURE
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 193695)
Time Spent: 40m (was: 0.5h)
> Beam SQL transitive dependencies appear incomplete / broken
> -----------------------------------------------------------
>
> Key: BEAM-6558
> URL: https://issues.apache.org/jira/browse/BEAM-6558
> Project: Beam
> Issue Type: Bug
> Components: dsl-sql
> Affects Versions: 2.9.0
> Reporter: Kenneth Knowles
> Assignee: Kenneth Knowles
> Priority: Blocker
> Fix For: 2.10.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Reporting on the dev list:
> ----
> Hi, all,
> Newbie here trying to figure out how to use published
> beam-sdks-java-extensions-sql-2.9.0 in my own project.
> I tried to create a gradle project to use BeamSQL sdk libraries. Here is the
> build.gradle I have:
> {code:java}
> plugins {
> id 'java'
> }
> group 'com.mycompany.myproject'
> version '1.0-SNAPSHOT'
> sourceCompatibility = 1.8
> repositories {
> mavenCentral()
> }
> apply plugin: 'java'
> sourceSets.main.java.srcDirs = [
> 'src/main/java'
> ]
> dependencies {
> compile 'org.apache.beam:beam-sdks-java-core:2.9.0'
> compile 'org.apache.beam:beam-sdks-java-extensions-sql:2.9.0'
> compile 'com.google.code.findbugs:jsr305:3.0.2'
> runtime 'org.apache.beam:beam-runners-direct-java:2.9.0'
> testCompile group: 'junit', name: 'junit', version: '4.12'
> }
> // Run basic SQL example
> task runBasicExample(type: JavaExec) {
> description = "Run basic SQL example"
> main = "com.mycompany.myproject.streamsql.examples.BeamSQLExample"
> classpath = sourceSets.main.runtimeClasspath
> args = ["--runner=DirectRunner"]
> println classpath.getAsPath()
> println args
> }
> {code}
> The example BeamSQLExample is just copied from
> [https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/example/BeamSqlExample.java].
> I was able to compile the example in JDK8. However, when I tried to run it, I
> hit the following exception:
> {code:java}
> Exception in thread "main" java.util.ServiceConfigurationError:
> org.apache.beam.sdk.extensions.sql.impl.udf.BeamBuiltinFunctionProvider:
> Provider org.apache.beam.sdk.extensions.sql.impl.udf.BuiltinStringFunctions
> could not be instantiated
> at java.util.ServiceLoader.fail(ServiceLoader.java:232)
> at java.util.ServiceLoader.access$100(ServiceLoader.java:185)
> at
> java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384)
> at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
> at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
> at
> org.apache.beam.sdk.extensions.sql.impl.BeamSqlEnv.loadBeamBuiltinFunctions(BeamSqlEnv.java:128)
> at
> org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:94)
> at
> org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:76)
> at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
> at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
> at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
> at
> com.mycompany.myprject.streamsql.examples.BeamSQLExample.main(BeamSQLExample.java:72)
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/commons/codec/DecoderException
> at java.lang.Class.getDeclaredConstructors0(Native Method)
> at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)
> at java.lang.Class.getConstructor0(Class.java:3075)
> at java.lang.Class.newInstance(Class.java:412)
> at
> java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380)
> ... 9 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.commons.codec.DecoderException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 14 more
> {code}
> When I traced into the code, it turns out that the failure occurs when the
> classloader tries to get the default constructor w/o any parameters for
> BuiltinStringFunctions.class. I double checked my local gradle cache and
> confirmed that the jar is there:
> {code:java}
> SJCMAC91THJHD4:beamsql-demo ypan$ ls -l
> ~/.gradle/caches/modules-2/files-2.1/org.apache.beam/beam-sdks-java-extensions-sql/2.9.0/67e7675519859ff332619c4c6ea5d26a505dbd50/beam-sdks-java-extensions-sql-2.9.0.jar
>
> -rw-r--r-- 1 ypan 192360288 12761025 Jan 29 18:02
> /Users/ypan/.gradle/caches/modules-2/files-2.1/org.apache.beam/beam-sdks-java-extensions-sql/2.9.0/67e7675519859ff332619c4c6ea5d26a505dbd50/beam-sdks-java-extensions-sql-2.9.0.jar
> {code}
> I also have tried to compile the sql sdk libraries in Beam's source repo and
> just copying over the generated class files over to my runtime classpath.
> Apparently, that did not work well since there are many shadowed libraries
> now need explicit declaring dependencies. I tried to search for an example of
> maven or gradle dependency declaration that users will use to create their
> own application using the SQL SDKs but was not lucky enough to find one.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
