See <https://builds.apache.org/job/beam_PerformanceTests_JDBC/188/display/redirect?page=changes>
Changes: [owenzhang1990] [BEAM-79] add Gearpump runner [klk] move integration tests to profile [klk] add package-info.java [klk] Update Gearpump runner version to 0.3.0-incubating [klk] Rename DoFn to OldDoFn in Gearpump runner [dhalperi] gearpump: switch to stable version [dhalperi] Made byteArrayCoder final static [dhalperi] CompressedSource: CompressedReader is never splittable [dhalperi] Do not add DataDisks to windmill service jobs. [dhalperi] Remove timeout in DirectRunnerTest [dhalperi] Improve Write Error Message [dhalperi] Remove Streaming Write Overrides in DataflowRunner [dhalperi] Remove Counter and associated code [dhalperi] [BEAM-495] Create General Verifier for File Checksum [dhalperi] Add output checksum to WordCountITOptions [dhalperi] More unit test and code style fix [dhalperi] Using IOChannelUtils to resolve file path [dhalperi] Added unit tests and error handling in removeTemporaryTables [dhalperi] [flink] add missing maven config to example pom [dhalperi] Remove DataflowPipelineJob from examples [dhalperi] [BEAM-432] Corrected BigQueryIO javadoc [dhalperi] Add TransformEvaluatorFactory#cleanup [dhalperi] Replace CloningThreadLocal with DoFnLifecycleManager [dhalperi] Add DoFn @Setup and @Teardown [dhalperi] Move ParDo Lifecycle tests to their own file [dhalperi] Exclude ParDoTest from Dataflow @RunnableOnService [dhalperi] Exclude guava-testlib from shading relocation [dhalperi] ByteKeyRangeTracker: synchronize toString [dhalperi] Fix repackaging exclude pattern for guava-testlib [dhalperi] Rewrites DoFnReflector to go via DoFnSignature [dhalperi] Replace ParDo with simpler transforms where possible [dhalperi] Set Gcs upload buffer size to 1M in streaming mode in DataflowRunner [dhalperi] addressed feedback [dhalperi] fix unused imports [dhalperi] DatastoreIO Sink as ParDo [dhalperi] Change name of result returned by BigQueryIO.Read [dhalperi] Fix NPE in BigQueryIO.TransformingReader [dhalperi] Add inEarlyPanesInGlobalWindow as a PAssert Extractor [dhalperi] Add TestStream to the Testing package [dhalperi] Implement TestStream in the DirectRunner [dhalperi] Incorporate private IP option for Dataflow runner [dhalperi] Datastore Sink support for writing Mutations [dhalperi] Mark JAXBContext as Volatile in JAXBCoder [dhalperi] Modify example dependencies to only add runners as optional [dhalperi] DatastoreIO v1beta3 to v1 [dhalperi] Remove unused constant in ExecutorServiceParallelExecutor [dhalperi] Remove extra timer firings in WatermarkManager [dhalperi] FileBasedSink: improve parallelism in GCS copy/remove [dhalperi] [BEAM-574] Remove log when new records have not been read yet (KafkaIO) [dhalperi] Write: Remove invalid import [dhalperi] JUnit tests: add @RunWith annotation [dhalperi] Remove ParDoTest Suppression in Google Cloud Dataflow [dhalperi] Fix Emission in startBundle/finishBundle in Flink Wrappers [dhalperi] [BEAM-253] Unify Flink-Streaming Operator Wrappers [dhalperi] Fix Checkstyle Errors in FlinkStreamingTransformTranslators [dhalperi] [BEAM-102] Add Side Inputs in Flink Streaming Runner [dhalperi] Allow DoFn Reuse in ParDoTest.TestDoFnWithContext [dhalperi] Don't Suppress Throwable in PAssert in Streaming Mode [dhalperi] Fix Flink Runner Pom for Batch RunnableOnService tests [dhalperi] Enable Flink Streaming Runner RunnableOnService tests [dhalperi] Fix combine tests with Accumulation Mode [dhalperi] Use AllPanes as the PaneExtractor in IterableAssert [dhalperi] Make ParDoLifecycleTest Serializable to Fix Test with TupleTag [dhalperi] Fix Exception Unwrapping in TestFlinkRunner [dhalperi] Update checkstyle.xml to put all imports in one group [dhalperi] Optimize imports [dhalperi] BigQueryIO.Write: raise size limit to 11 TiB [dhalperi] Cleanup some javadoc that referring Dataflow [dhalperi] Move the samples data to gs://apache-beam-samples/ [dhalperi] [BEAM-545] Promote JobName to PipelineOptions [dhalperi] Update DoFn javadocs to remove references to OldDoFn and Dataflow [dhalperi] Make WriteTest more resilient to Randomness [dhalperi] checkstyle: prohibit API client repackaged Guava [dhalperi] Modified BigtableIO to use DoFn setup/tearDown methods instead of [dhalperi] [BEAM-294] Rename dataflow references to beam [dhalperi] Added support for reporting aggregator values to Spark sinks [dhalperi] travis.yml: disable updating snapshots [dhalperi] Query latest timestamp [dhalperi] [BEAM-589] Fixing IO.Read transformation [dhalperi] kinesis: a connector for Amazon Kinesis [dhalperi] Organize imports in Kinesis [dhalperi] Fix javadoc in Kinesis [dhalperi] [BEAM-592] Fix SparkRunner Dependency Problem in WordCount [dhalperi] DataflowRunner: get PBegin from PInput [dhalperi] [BEAM-313] Provide a context for SparkRunner [dhalperi] Update Dataflow Container Version [dhalperi] [BEAM-572] Remove Spark Reference in WordCount [dhalperi] Returned KafkaIO getWatermark log line in debug mode [dhalperi] take advantage of setup/teardown for KafkaWriter [dhalperi] Add LeaderBoardTest [dhalperi] [BEAM-569] Define maxNumRecords default value to Long.MAX_VALUE in JmsIO [dhalperi] Address comments of Flink Side-Input PR [dhalperi] Fix condition in FlinkStreamingPipelineTranslator [dhalperi] Correct some accidental renames [dhalperi] Test that multiple instances of TestStream are supported [dhalperi] Remove empty unused method in TestStreamEvaluatorFactory [dhalperi] Add Latest CombineFn and PTransforms [dhalperi] DatastoreIO SplitQueryFn integration test [dhalperi] Cloud Datastore naming clean-up [dhalperi] Fixed Combine display data [dhalperi] Delegate populateDipslayData to wrapped combineFn's [dhalperi] Put classes in runners-core package into runners.core namespace [dhalperi] Remove the DataflowRunner instructions from examples [dhalperi] FluentBackoff: a replacement for a variety of custom backoff [dhalperi] [BEAM-456] Add MongoDbIO [dhalperi] [BEAM-242] Enable checkstyle and fix checkstyle errors in Flink runner [dhalperi] BigQuery: limit max job polling time to 1 minute [dhalperi] Be more accepting in UnboundedReadDeduplicatorTest [dhalperi] Remove timeout in JAXBCoderTest [dhalperi] [BEAM-242] Enable and fix checkstyle in Flink runner examples [dhalperi] Add header/footer support to TextIO.Write [dhalperi] Revised according to comments following a code review. [dhalperi] Reverted header and footer to be of type String. [dhalperi] Added javadoc to TextIO#withHeader and TextIO#withFooter. [dhalperi] Added even more javadoc to TextIO#withHeader and TextIO#withFooter. [dhalperi] Added even more javadoc to TextIO#withHeader and TextIO#withFooter (2). [dhalperi] !fixup Minor javadoc clean-up [dhalperi] fix import order [owenzhang1990] [BEAM-79] fix integration-test failure [owenzhang1990] post-merge fix [owenzhang1990] remove "pipeline" in runner name [owenzhang1990] upgrade gearpump-runner to 0.4.0-incubating-SNAPSHOT [klk] [BEAM-79] Port Gearpump runner from OldDoFn to new DoFn [owenzhang1990] [BEAM-79] update GearpumpPipelineResult [owenzhang1990] [BEAM-79] fix gearpump runner build failure [owenzhang1990] Upgrade Gearpump version [owenzhang1990] Add Window.Bound translator [owenzhang1990] Skip window assignment when windows don't change [owenzhang1990] Remove print to stdout [owenzhang1990] Fix NoOpAggregatorFactory [owenzhang1990] [BEAM-79] Update to latest Gearpump API [owenzhang1990] [BEAM-79] Upgrade to beam-0.5.0-incubating-SNAPSHOT [owenzhang1990] [BEAM-1180] Implement GearpumpPipelineResult [owenzhang1990] update ROS configurations [owenzhang1990] activate ROS on Gearpump by default [owenzhang1990] fix group by window [owenzhang1990] update to latest gearpump dsl function interface [owenzhang1990] support OutputTimeFn [owenzhang1990] return encoded key for GroupByKey translation [owenzhang1990] fix ParDo.BoundMulti translation [owenzhang1990] reduce timeout to wait for result [owenzhang1990] Remove cache for Gearpump on travis [owenzhang1990] note thread is interrupted on InterruptedException [owenzhang1990] [BEAM-79] Fix PostCommit test confs for Gearpump runner [owenzhang1990] [BEAM-79] Support merging windows in GearpumpRunner [owenzhang1990] [BEAM-79] Add SideInput support for GearpumpRunner [owenzhang1990] enable ParDoTest [owenzhang1990] [BEAM-79] Fix gearpump-runner merge conflicts and test failure [huafengw] [BEAM-972] Add unit tests to Gearpump runner [huafengw] [BEAM-972] Add more unit test to Gearpump runner [owenzhang1990] Update gearpump-runner against master changes. [owenzhang1990] Update gearpump-runner against master changes [owenzhang1990] Update gearpump-runner against master changes [owenzhang1990] Update against master changes [owenzhang1990] Activate Gearpump local-validates-runner-tests in precommit [owenzhang1990] Respect WindowFn#getOutputTime in gearpump-runner [owenzhang1990] Fix side input handling in DoFnFunction [owenzhang1990] upgrade to gearpump 0.8.4-SNAPSHOT [owenzhang1990] Fix PCollectionView translation [owenzhang1990] Fix kryo exception [owenzhang1990] Remove unused codes [owenzhang1990] Upgrade to gearpump 0.8.4 [owenzhang1990] Fix ParDoTest#testPipelineOptionsParameter [owenzhang1990] Revert accidental changes to sdks/java/pom.xml [owenzhang1990] Upgrade BEAM version to 2.2.0-SNAPSHOT in gearpump-runner [owenzhang1990] Add beam-runners-gearpump dependency to javadoc [owenzhang1990] Deactivate integration-tests for gearpump-runner by default [owenzhang1990] Require java 8 for precommit tests and add gearpump-runner [owenzhang1990] Override maven-enforcer-plugin for precommit tests [owenzhang1990] Remove gearpump-runner in precommit tests [tgroh] Suppress Attempted Metrics tests in Dataflow Batch [tgroh] Add GRPC to Compilation of the Runner API [tgroh] Delete list job creation -- creates in wrong place. ------------------------------------------ [...truncated 47.61 KB...] [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runners/google-cloud-dataflow-java/target/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-runners-google-cloud-dataflow-java/2.2.0-SNAPSHOT/beam-runners-google-cloud-dataflow-java-2.2.0-SNAPSHOT-tests.jar [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:19 min [INFO] Finished at: 2017-08-08T00:01:39Z [INFO] Final Memory: 93M/1393M [INFO] ------------------------------------------------------------------------ [beam_PerformanceTests_JDBC] $ /bin/bash -xe /tmp/jenkins41848128251433225.sh + /home/jenkins/tools/maven/latest/bin/mvn -B -e verify -pl sdks/java/io/jdbc -Dio-it-suite -DpkbLocation=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/pkb.py> -DmvnBinary=/home/jenkins/tools/maven/latest/bin/mvn '-DintegrationTestPipelineOptions=[ "--project=apache-beam-testing", "--tempRoot=gs://temp-storage-for-end-to-end-tests" ]' [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] ------------------------------------------------------------------------ [INFO] Detecting the operating system and CPU architecture [INFO] ------------------------------------------------------------------------ [INFO] os.detected.name: linux [INFO] os.detected.arch: x86_64 [INFO] os.detected.version: 4.4 [INFO] os.detected.version.major: 4 [INFO] os.detected.version.minor: 4 [INFO] os.detected.release: ubuntu [INFO] os.detected.release.version: 14.04 [INFO] os.detected.release.like.ubuntu: true [INFO] os.detected.release.like.debian: true [INFO] os.detected.classifier: linux-x86_64 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Beam :: SDKs :: Java :: IO :: JDBC 2.2.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: https://repo.maven.apache.org/maven2/org/codehaus/mojo/exec-maven-plugin/1.6.0/exec-maven-plugin-1.6.0.pom [INFO] Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/mojo/exec-maven-plugin/1.6.0/exec-maven-plugin-1.6.0.pom (13 kB at 13 kB/s) [INFO] Downloading: https://repo.maven.apache.org/maven2/org/codehaus/mojo/exec-maven-plugin/1.6.0/exec-maven-plugin-1.6.0.jar [INFO] Downloaded: https://repo.maven.apache.org/maven2/org/codehaus/mojo/exec-maven-plugin/1.6.0/exec-maven-plugin-1.6.0.jar (58 kB at 502 kB/s) [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-runners-direct-java/2.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-runners-direct-java/2.2.0-SNAPSHOT/maven-metadata.xml (1.7 kB at 7.5 kB/s) [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-runners-direct-java/2.2.0-SNAPSHOT/beam-runners-direct-java-2.2.0-20170807.071408-24.pom [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-runners-direct-java/2.2.0-SNAPSHOT/beam-runners-direct-java-2.2.0-20170807.071408-24.pom (10 kB at 63 kB/s) [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/maven-metadata.xml [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/maven-metadata.xml (1.4 kB at 8.5 kB/s) [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/beam-sdks-java-io-common-2.2.0-20170807.071515-22.pom [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/beam-sdks-java-io-common-2.2.0-20170807.071515-22.pom (1.4 kB at 8.6 kB/s) [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-runners-direct-java/2.2.0-SNAPSHOT/beam-runners-direct-java-2.2.0-20170807.071408-24.jar [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/beam-sdks-java-io-common-2.2.0-20170807.071515-22-tests.jar [INFO] Downloading: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/beam-sdks-java-io-common-2.2.0-20170807.071515-22.jar [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/beam-sdks-java-io-common-2.2.0-20170807.071515-22-tests.jar (17 kB at 76 kB/s) [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-sdks-java-io-common/2.2.0-SNAPSHOT/beam-sdks-java-io-common-2.2.0-20170807.071515-22.jar (2.7 MB at 5.9 MB/s) [INFO] Downloaded: http://repository.apache.org/snapshots/org/apache/beam/beam-runners-direct-java/2.2.0-SNAPSHOT/beam-runners-direct-java-2.2.0-20170807.071408-24.jar (12 MB at 17 MB/s) [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- groovy-maven-plugin:2.0:execute (find-supported-python-for-compile) @ beam-sdks-java-io-jdbc --- [INFO] Using python interpreter binary 'python2.7' with pip 'pip2' [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ beam-sdks-java-io-jdbc --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/src/main/resources> [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.6.2:compile (default-compile) @ beam-sdks-java-io-jdbc --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 2 source files to <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/classes> [WARNING] bootstrap class path not set in conjunction with -source 1.7 [INFO] [INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ beam-sdks-java-io-jdbc --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/src/test/resources> [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.6.2:testCompile (default-testCompile) @ beam-sdks-java-io-jdbc --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 3 source files to <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/test-classes> [INFO] [INFO] --- maven-checkstyle-plugin:2.17:check (default) @ beam-sdks-java-io-jdbc --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- maven-surefire-plugin:2.20:test (default-test) @ beam-sdks-java-io-jdbc --- [INFO] Tests are skipped. [INFO] [INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ beam-sdks-java-io-jdbc --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ beam-sdks-java-io-jdbc --- [INFO] [INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @ beam-sdks-java-io-jdbc --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-tests.jar> [INFO] [INFO] --- maven-shade-plugin:3.0.0:shade (bundle-and-repackage) @ beam-sdks-java-io-jdbc --- [INFO] Excluding org.apache.beam:beam-sdks-java-core:jar:2.2.0-SNAPSHOT from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.8.9 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.8.9 from the shaded jar. [INFO] Excluding org.apache.avro:avro:jar:1.8.2 from the shaded jar. [INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar. [INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 from the shaded jar. [INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.7 from the shaded jar. [INFO] Excluding org.apache.commons:commons-compress:jar:1.14 from the shaded jar. [INFO] Excluding org.tukaani:xz:jar:1.5 from the shaded jar. [INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.4-M3 from the shaded jar. [INFO] Excluding joda-time:joda-time:jar:2.4 from the shaded jar. [INFO] Including com.google.guava:guava:jar:20.0 in the shaded jar. [INFO] Excluding com.google.code.findbugs:jsr305:jar:3.0.1 from the shaded jar. [INFO] Excluding org.apache.commons:commons-dbcp2:jar:2.1.1 from the shaded jar. [INFO] Excluding org.apache.commons:commons-pool2:jar:2.4.2 from the shaded jar. [INFO] Excluding commons-logging:commons-logging:jar:1.2 from the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/target/beam-sdks-java-io-jdbc-2.2.0-SNAPSHOT-shaded-tests.jar> [INFO] Dependency-reduced POM written at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/sdks/java/io/jdbc/dependency-reduced-pom.xml> [INFO] [INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @ beam-sdks-java-io-jdbc --- [INFO] No dependency problems found [INFO] [INFO] --- exec-maven-plugin:1.6.0:exec (default) @ beam-sdks-java-io-jdbc --- WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory. 2017-08-08 00:02:16,808 5c98fcbb MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/5c98fcbb/pkb.log 2017-08-08 00:02:16,808 5c98fcbb MainThread INFO PerfKitBenchmarker version: v1.12.0-94-g8c7b5a4 2017-08-08 00:02:16,809 5c98fcbb MainThread INFO Flag values: --beam_it_class=org.apache.beam.sdk.io.jdbc.JdbcIOIT --beam_sdk=java --beam_it_options=[ "--project=apache-beam-testing", "--tempRoot=gs://temp-storage-for-end-to-end-tests" ] --beam_prebuilt --kubeconfig=/home/jenkins/.kube/config --kubectl=kubectl --beam_kubernetes_scripts=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/postgres.yml> --beam_it_module=sdks/java/io/jdbc --beam_options_config_file=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/pkb-config.yml> --beam_location=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/> --beam_it_profile=io-it --benchmarks=beam_integration_benchmark 2017-08-08 00:02:17,092 5c98fcbb MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo. 2017-08-08 00:02:17,240 5c98fcbb MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark 2017-08-08 00:02:17,243 5c98fcbb MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark 2017-08-08 00:02:17,244 5c98fcbb MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=/home/jenkins/.kube/config create -f <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/postgres.yml> 2017-08-08 00:02:17,250 5c98fcbb MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 555, in RunBenchmark DoPreparePhase(spec, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 450, in DoPreparePhase spec.BenchmarkPrepare(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 109, in Prepare kubernetes_helper.CreateAllFiles(getKubernetesScripts()) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py";,> line 54, in CreateAllFiles CreateFromFile(file) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/kubernetes_helper.py";,> line 37, in CreateFromFile return vm_util.IssueCommand(create_cmd) File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py";,> line 294, in IssueCommand stderr=tf_err, cwd=cwd) File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory 2017-08-08 00:02:17,252 5c98fcbb MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2017-08-08 00:02:17,252 5c98fcbb MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=/home/jenkins/.kube/config delete -f <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/.test-infra/kubernetes/postgres/postgres.yml> 2017-08-08 00:02:17,263 5c98fcbb MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2017-08-08 00:02:17,311 5c98fcbb MainThread INFO Benchmark run statuses: --------------------------------------------------------------- Name UID Status --------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------- Success rate: 0.00% (0/1) 2017-08-08 00:02:17,311 5c98fcbb MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/5c98fcbb/pkb.log 2017-08-08 00:02:17,311 5c98fcbb MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/5c98fcbb/completion_statuses.json [ERROR] Command execution failed. org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:804) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:751) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:313) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:993) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:345) at org.apache.maven.cli.MavenCli.main(MavenCli.java:191) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 33.465 s [INFO] Finished at: 2017-08-08T00:02:17Z [INFO] Final Memory: 78M/1082M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec (default) on project beam-sdks-java-io-jdbc: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec (default) on project beam-sdks-java-io-jdbc: Command execution failed. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:993) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:345) at org.apache.maven.cli.MavenCli.main(MavenCli.java:191) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed. at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:326) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) ... 20 more Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:804) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:751) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:313) ... 22 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException Build step 'Execute shell' marked build as failure
