See <https://builds.apache.org/job/beam_PerformanceTests_Python/1173/display/redirect?page=changes>
Changes: [djiofack007] modified result set to be forward only and read only [djiofack007] made fetchsize configurable [djiofack007] modified result set to be forward only and read only [djiofack007] made fetchsize configurable [djiofack007] added documentation [bbassingthwaite] Adding a go datastore io reader [kirpichov] Reshuffle filenames before returning them from WriteFilesResult [djiofack007] modified docs [bbassingthwaite] Add apache header and fix imports / gofmt [bbassingthwaite] - Add package doc [swegner] Disable Jacoco plugin unless explicitly requested. [djiofack007] fixed checkstyle [thw] [BEAM-2887, BEAM-3886] Have the Python SDK use the state api service [swegner] Add parameter overrides to run examples with personal GCS resources. [github] Minor style updates for consistency. ------------------------------------------ [...truncated 621.60 KB...] [WARNING] - org.apache.http.annotation.NotThreadSafe [WARNING] - org.apache.http.annotation.Immutable [WARNING] - org.apache.http.annotation.GuardedBy [WARNING] - org.apache.http.annotation.ThreadSafe [WARNING] maven-shade-plugin has detected that some class files are [WARNING] present in two or more JARs. When this happens, only one [WARNING] single version of the class is copied to the uber jar. [WARNING] Usually this is not harmful and you can skip these warnings, [WARNING] otherwise try to manually exclude artifacts based on [WARNING] mvn dependency:tree -Ddetail=true and the above output. [WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/ [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-2.5.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/java/nexmark/target/beam-sdks-java-nexmark-2.5.0-SNAPSHOT-shaded.jar> [INFO] [INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-sdks-java-nexmark --- [INFO] No dependency problems found [INFO] [INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-sdks-java-nexmark --- [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/java/nexmark/target/beam-sdks-java-nexmark-2.5.0-SNAPSHOT.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-nexmark/2.5.0-SNAPSHOT/beam-sdks-java-nexmark-2.5.0-SNAPSHOT.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/java/nexmark/dependency-reduced-pom.xml> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-nexmark/2.5.0-SNAPSHOT/beam-sdks-java-nexmark-2.5.0-SNAPSHOT.pom [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/java/nexmark/target/beam-sdks-java-nexmark-2.5.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-nexmark/2.5.0-SNAPSHOT/beam-sdks-java-nexmark-2.5.0-SNAPSHOT-tests.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/java/nexmark/target/beam-sdks-java-nexmark-2.5.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-nexmark/2.5.0-SNAPSHOT/beam-sdks-java-nexmark-2.5.0-SNAPSHOT-tests.jar [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Beam :: SDKs :: Python 2.5.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- groovy-maven-plugin:2.0:execute (find-supported-python-for-clean) @ beam-sdks-python --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Beam :: Parent .............................. SUCCESS [ 18.099 s] [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 10.181 s] [INFO] Apache Beam :: Model ............................... SUCCESS [ 0.179 s] [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 14.815 s] [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 6.573 s] [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 7.712 s] [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.308 s] [INFO] Apache Beam :: SDKs :: Go .......................... SUCCESS [01:27 min] [INFO] Apache Beam :: SDKs :: Go :: Container ............. SUCCESS [ 20.361 s] [INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 0.153 s] [INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [ 44.870 s] [INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 6.011 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.226 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.463 s] [INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.115 s] [INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 4.767 s] [INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 3.645 s] [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 5.664 s] [INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 11.452 s] [INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.177 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 6.216 s] [INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 2.565 s] [INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 12.074 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 5.984 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 4.225 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 4.783 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 2.962 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 1.568 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 1.107 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 4.362 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 5.664 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 3.800 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 2.717 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 7.702 s] [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 14.070 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 3.415 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 6.552 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 5.016 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 2.805 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 22.986 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 9.004 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 11.118 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 2.705 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 3.403 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.294 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.664 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.514 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 2.249 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 6.085 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 4.591 s] [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.086 s] [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 9.810 s] [INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.137 s] [INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 4.072 s] [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 33.252 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 2.016 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.557 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.878 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 3.142 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 25.782 s] [INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 19.467 s] [INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 4.913 s] [INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED [INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED [INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED [INFO] Apache Beam :: Runners :: Reference ................ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED [INFO] Apache Beam :: Runners :: Flink .................... SKIPPED [INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 08:50 min [INFO] Finished at: 2018-04-21T00:29:04Z [INFO] Final Memory: 341M/1872M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.gmaven:groovy-maven-plugin:2.0:execute (find-supported-python-for-clean) on project beam-sdks-python: Unable to find pip for Python 2.7 in path -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :beam-sdks-python STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache). log4j:WARN Please initialize the log4j system properly. Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. 2018-04-21 00:29:06,839 9a10af66 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-04-21 00:29:06,850 9a10af66 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 646, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/python/target> 2018-04-21 00:29:06,851 9a10af66 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-04-21 00:29:06,853 9a10af66 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 780, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 646, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/beam/sdks/python/target> 2018-04-21 00:29:06,854 9a10af66 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-04-21 00:29:06,871 9a10af66 MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-04-21 00:29:06,872 9a10af66 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/pkb.log> 2018-04-21 00:29:06,872 9a10af66 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9a10af66/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
