See <https://builds.apache.org/job/beam_PerformanceTests_Python/993/display/redirect?page=changes>
Changes: [herohde] Initial sketches of a Go SDK [herohde] Initial version of the direct style w/ direct runner. Incomplete. [herohde] Add Data as UserFn context w/ immediate value. [herohde] Added no-I/O wordcount for profiling. [herohde] Fleshed out possible approach to generic transformations. [herohde] Add “dag” example that use multiplexing and side input. [herohde] Added a more complex DAG example. [herohde] Add yatzy example with more complex construction-time setup [herohde] Add proto for Fn API [herohde] Add beam.Composite helper for the most common pattern to align with java [herohde] Move pipeline-construction time errors into an accumulator [herohde] Add Dataflow job and Fn API clients. Incomplete. [herohde] Add binary cross-compile and upload to Dataflow runner. Incomplete. [herohde] Add tentative runner indirection (default: local). [herohde] Made data flow runner detect user main for cross-compilation. [herohde] Remove error accumulation in favor of panic. [herohde] Improve Dataflow translation of coders, side input and composite names. [herohde] Fix name for AsView. [herohde] Use 2 grpc endpoints in harness [herohde] Add gRPC harness logging [herohde] Flesh out harness and serialization further. [herohde] Made the dataflow runner wait for job termination by default [herohde] beam: [herohde] beam: [herohde] combinefn.go: fix compilation issues [herohde] Improve dataflow serialization and execution. Incomplete. [herohde] Sleep 30 sec in wordcap to allow logs to propagate to Cloud Logging. [herohde] Move the 30s sleep for logging to the harness instead of in WordCap. [herohde] Post-review updates. [herohde] Doc updates. [herohde] Flesh out coders. Incomplete. [herohde] Added prototype implementation of more coders and the runner source. [herohde] dofn: illustrates how dofns are written. [herohde] beam: add viewfn and windowfn to side inputs match support Beam 1.0 [herohde] dofn: timers [herohde] Complete revamp: coders, graph and execution use element-wise [herohde] Fix coder encoding for Dataflow side input. Otherwise, the job is [herohde] Added more godoc comments to graph types. [herohde] Added more comments plus made local GBK use coder equality. [herohde] Added Flatten support and “forest” example that uses it. [herohde] Move bigqueryio to defunct [herohde] Make forest example print less [herohde] Add external struct registry and serialization. [herohde] Updated comments in node.go. [herohde] Replace real type with 'full type' since that's the current term. [herohde] Refactor Fn API dependency. [herohde] Added more comments to the runner/dataflow and runner/beamexec packages [herohde] Fix most go vet issues [herohde] Make core operations panic to cut down on the error propagation [herohde] Add more comments to the graph package. [herohde] Add DoFn wrapper to handle either function or (ptr to) struct [herohde] Fix remaining go vet warnings. [herohde] Code review for beam/graph/coder package. [herohde] Code review of the runtime/graphx package. [herohde] Remove Data options in favor of using a Fn struct [herohde] Code review of the beam/graph/userfn package. [herohde] Code review for beam/graph package. [herohde] godoc for runtime/graphx [herohde] Add support for []T and Combine functions [herohde] Add adapted documentation from the Java SDK to the beam package [herohde] Update snapshot of Fn API. [herohde] Add experiments flag to the Dataflow runner [herohde] Remove context arg from beamexec.Init [herohde] Migration to Runner API. [herohde] Add support for creating DOT graphs. [herohde] Make pretty printing of types and coders more concise [herohde] Add flexible Signature to aid type checking [herohde] Adding unit testability to harness translation. [herohde] Fix crash due to initialization order [herohde] Add CreateValues and Impulse [herohde] Add Runner API support for WindowingStrategy. [herohde] Run goimports on baseline. [herohde] Fix encoding of global window strategy. [herohde] Ensure the windowed value is atomically encoded. [herohde] Limit gRPC messages to max size. [herohde] Developer conveniences for running jobs. [herohde] Fix sends to not close the network channel. [herohde] Add re-iterable side input [herohde] Add per-key Combine [herohde] Add Min [herohde] Reorganize non-user-facing code into core [herohde] Make type register reject unnamed or predeclared types [herohde] Add type specialization tool [herohde] Don't run grpc plugin in generate phase. [herohde] Fix import reference path for runner API proto. [herohde] Revamp runner registration as _ imports [herohde] Add stats.Max and Mean [herohde] Add global pipeline options [herohde] Unify global and per-key combiners [herohde] Add beam convenience wrapper for imports and runner selection [herohde] Add session recording and CPU profiling to harness. [herohde] Add ptest and passert for testing pipelines [herohde] Add GCS and glob support to textio [herohde] Add BigQuery IO and examples [herohde] Adds a session runner for testing. [herohde] Add Partition and dynamic functions [herohde] Adding example that returns 10 words that contain provided search [herohde] Remove duplicate LOG line [herohde] Enable Combine Fns in Dataflow runner by modifying translation. [herohde] Fixing type bug by dropping T and using underlying type of value in [herohde] Adding graph validation at build time. [herohde] Import the Fn API changes. [herohde] Simple changes to support new Fn API coder changes. [herohde] Update translator to work with new Fn API changes. [herohde] Use appropriate equality tests. [herohde] Fix test to not use path of package. [herohde] Renaming directory to match package name. [herohde] Fixing random nits in comments. [herohde] Modify build command to avoid bash. [herohde] Fixing selected golint issues. [herohde] Addressing import review comments. [herohde] Add coder specialization for bytes/strings. [herohde] Adding unit tests to stats. [herohde] Fixing typo. [herohde] Add beam.External [herohde] Fix grpc.Dial calls to block properly. [herohde] Creates a symtab verifier by running Sym2Addr and Addr2Sym in a binary. [herohde] Add spec field to help interpretation of payload. [herohde] Use beam.T alias for typex.T etc with Go 1.9 [herohde] Move shared GCP options to a separate package [herohde] Update portability protos [herohde] Remove old source/sink from beam package [herohde] Add context-aware logging for both pipeline-submission time and runtime [herohde] Fix coder inference for strings. [herohde] Improve tornadoes example [herohde] Fix beam.External to map arguments correctly. [herohde] Added comments to yatzy and forest [herohde] Add comments to tornadoes from the java counterpart [herohde] Rename Pipeline Composite to Scope [herohde] Add 3 progressive wordcount examples [herohde] Clarify comments in wordcount pipelines [herohde] Add apache 2.0 license to files [herohde] Updates to examples. [herohde] Adding more godoc for the main beam package. [herohde] Update to new proto structure [herohde] Split Combine and fields in to global and per-key variants [herohde] Refactor Flatten of a single []T into Explode [herohde] Rename local runner to direct runner [herohde] Fix argument index error in ParDo execution [herohde] Add Apache copyright header to files that need it. [herohde] Made debug.Head not just work per bundle [herohde] Impose a total ordering on Fn parameters. [herohde] Rename Dedup to Distinct for consistency with other SDKs [herohde] Add coder to model coder translation [herohde] Simplify harness coder translation [herohde] Split Pipeline into Pipeline and Scope [herohde] Relocate Go SDK code [herohde] Fix Go SDK maven build [herohde] Move Go SKD to latest version of bigquery [herohde] Add Go SDK container image [herohde] Add Go SDK README [herohde] Update version for Go Dataflow pipelines [herohde] Make Scope a value type [herohde] Add Go graph/pipeline translation [herohde] Stage Go model pipeline for Dataflow [herohde] Use pipeline unmarhaller in runtime harness [herohde] CR: [BEAM-3287] Use model pipelines in Go SDK [herohde] CR: [BEAM-3287] Use model pipelines in Go SDK [herohde] Fix name of syscallx ErrUnsupported [herohde] Allow any named type to be registered and serialized as external [herohde] Add more package comments for core packages [herohde] Make Go SDK External a graph primitive [herohde] Cache Go runtime symbol lookups [wcn] Fix storagePath variable. [wcn] BEAM-3368 fix translation for external [robertwb] [BEAM-3356] Add Go SDK int and varint custom coders (#4276) [lcwik] BEAM-3361 Increase Go gRPC message size [herohde] Go SDK runtime revamp [lcwik] Add a few function call overhead benchmarks [lcwik] Add type-specialized emitters [lcwik] BEAM-3324 improve symtab memory usage [lcwik] BEAM-3324 improve symtab memory usage [lcwik] BEAM-3324 improve symtab memory usage [lcwik] Store objects in pool so they can be reused. [lcwik] Add builtin varint coder [herohde] Type-specialize custom decoders and encoders in Go SDK runtime [herohde] Type-specialize iterators and side input in the Go SDK [herohde] Add warnings if Go runtime registrations are overwritten [herohde] Add reusable element coders in Go SDK runtime [wcn] Updated translater to preserve payload and its URN. [herohde] Initial version of type-specialized general reflective calls [herohde] Add general-purpose untyped callers in Go SDK runtime [herohde] Use fast caller for filter transform predicate [herohde] CR: Clarified comment on caller template [herohde] Fix value encoding for Create [lcwik] BEAM-3473: Fix GroupByKey iterators to be initialized. [lcwik] BEAM-3474 Include stacks in panic messages. [lcwik] BEAM-3299: Add source reporting support. [lcwik] Remove GetId() call from under lock. [lcwik] Add additional comments about concurrency invariants. [lcwik] Add initialization of active plans map. [lcwik] Renamed Go runtime Caller to Func and added name [lcwik] Use reflectx.Func as the fundamental function representation [lcwik] CR: fix DynFn comments [lcwik] CR: fix comments [herohde] Avoid reflect.Value conversions in Go runtime [wcn] Allow grpcx.Dial to support overrides. [rober] Use a typeswitch instead of reflect.Convert when encoding strings or [github] Update coder.go [robert] Replace reflective convert to direct convert. [rober] Fix beam.Combine to combine globally [herohde] Add optional function registration to Go SDK runtime [rober] fixup! Remove reflection from varint codecs [herohde] Changed core GBK to CoGBK [herohde] Add CoGBK support to direct runner and Join example [herohde] [BEAM-3316] Translate bundle descriptors directly to execution plans in [herohde] Translate CoGBK into GBK for Dataflow and model pipeline runners [herohde] CR: [BEAM-3302] Support CoGBK in the Go SDK [herohde] [BEAM-3579] Fix textio.Write [herohde] CR: fix Go SDK textio.Write [wcn] Fixing filename. [ehudm] Integration test for Python HDFS implementation. [wcn] Improve rendering of DOT diagrams. [herohde] Update Go SDK coder constants [1028332163] replace mockito-all [1028332163] replace mockito [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] replace mockito-all and harcrest-all [1028332163] ignoredUnusedDeclaredDependencies [1028332163] ban hamcrest-all and mockito-all [1028332163] ban mockito-all and hamcrest-all [tgroh] Make Impulse#create() visible [tgroh] Update QueryablePipeline Factory Method Name [tgroh] Add JavaReadViaImpulse to core-construction [amyrvold] Beam runner inventory, run as a cron job, not on each CL [amyrvold] [BEAM-3775] Increase timeout in [ehudm] Improve FileBasedSink rename safety. [ehudm] Add missing import statements. [lcwik] [BEAM-3690] ban mockito-all and hamcrest-all ------------------------------------------ [...truncated 56.13 KB...] [INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT-shaded-tests.jar> [INFO] Dependency-reduced POM written at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/dependency-reduced-pom.xml> [INFO] [INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-model-fn-execution --- [INFO] No dependency problems found [INFO] [INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-model-fn-execution --- [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-model-fn-execution/2.5.0-SNAPSHOT/beam-model-fn-execution-2.5.0-SNAPSHOT.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/dependency-reduced-pom.xml> to /home/jenkins/.m2/repository/org/apache/beam/beam-model-fn-execution/2.5.0-SNAPSHOT/beam-model-fn-execution-2.5.0-SNAPSHOT.pom [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-model-fn-execution/2.5.0-SNAPSHOT/beam-model-fn-execution-2.5.0-SNAPSHOT-tests.jar [INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/model/fn-execution/target/beam-model-fn-execution-2.5.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-model-fn-execution/2.5.0-SNAPSHOT/beam-model-fn-execution-2.5.0-SNAPSHOT-tests.jar [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Beam :: SDKs :: Go :: Container 2.3.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ beam-sdks-go-container --- [INFO] Deleting <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/go/container> (includes = [**/*.pyc, **/*.egg-info/, **/sdks/python/LICENSE, **/sdks/python/NOTICE, **/sdks/python/README.md, **/sdks/python/apache_beam/portability/api/*pb2*.*, **/sdks/python/**/*.c, **/sdks/python/**/*.so, **/sdks/python/**/*.egg], excludes = []) [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-go-container --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-go-container --- [INFO] [INFO] --- maven-dependency-plugin:3.0.1:unpack (copy-dependency) @ beam-sdks-go-container --- [INFO] Configured Artifact: org.apache.beam:beam-sdks-go:pkg-sources:2.3.0-SNAPSHOT:zip [INFO] Unpacking /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-go/2.3.0-SNAPSHOT/beam-sdks-go-2.3.0-SNAPSHOT-pkg-sources.zip to <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/go/container/target/src/github.com/apache/beam/sdks/go> with includes "" and excludes "" [INFO] [INFO] --- maven-resources-plugin:3.0.2:copy-resources (copy-go-pkg-source) @ beam-sdks-go-container --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/go/container/pkg> [INFO] [INFO] --- maven-resources-plugin:3.0.2:copy-resources (copy-go-cmd-source) @ beam-sdks-go-container --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-assembly-plugin:3.0.0:single (export-go-pkg-sources) @ beam-sdks-go-container --- [INFO] Reading assembly descriptor: descriptor.xml [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Beam :: Parent .............................. SUCCESS [ 8.997 s] [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 4.744 s] [INFO] Apache Beam :: Model ............................... SUCCESS [ 0.040 s] [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 12.184 s] [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 8.681 s] [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 9.341 s] [INFO] Apache Beam :: SDKs :: Go :: Container ............. FAILURE [ 1.858 s] [INFO] Apache Beam :: SDKs ................................ SKIPPED [INFO] Apache Beam :: SDKs :: Go .......................... SKIPPED [INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED [INFO] Apache Beam :: Runners ............................. SKIPPED [INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED [INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED [INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED [INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED [INFO] Apache Beam :: Examples ............................ SKIPPED [INFO] Apache Beam :: Examples :: Java .................... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED [INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED [INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED [INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED [INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED [INFO] Apache Beam :: Runners :: Reference ................ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED [INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED [INFO] Apache Beam :: Runners :: Flink .................... SKIPPED [INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 51.917 s [INFO] Finished at: 2018-03-07T00:01:59Z [INFO] Final Memory: 96M/1348M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:3.0.0:single (export-go-pkg-sources) on project beam-sdks-go-container: Error reading assemblies: Error locating assembly descriptor: descriptor.xml [ERROR] [ERROR] [1] [INFO] Searching for file location: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/go/container/descriptor.xml> [ERROR] [ERROR] [2] [INFO] File: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/go/container/descriptor.xml> does not exist. [ERROR] [ERROR] [3] [INFO] File: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/descriptor.xml> does not exist. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :beam-sdks-go-container STDERR: 2018-03-07 00:01:59,626 9f769da3 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-03-07 00:01:59,634 9f769da3 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/python/target> 2018-03-07 00:01:59,635 9f769da3 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-03-07 00:01:59,638 9f769da3 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 732, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/beam/sdks/python/target> 2018-03-07 00:01:59,638 9f769da3 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-03-07 00:01:59,638 9f769da3 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-03-07 00:01:59,639 9f769da3 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/pkb.log> 2018-03-07 00:01:59,639 9f769da3 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9f769da3/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user lukasz.gaj...@polidea.com Not sending mail to unregistered user arost...@google.com Not sending mail to unregistered user c...@google.com Not sending mail to unregistered user luke_...@brown.edu Not sending mail to unregistered user 1028332...@qq.com Not sending mail to unregistered user mott...@gmail.com Not sending mail to unregistered user ro...@frantil.com Not sending mail to unregistered user mark...@google.com Not sending mail to unregistered user w...@google.com Not sending mail to unregistered user samuel.waggo...@healthsparq.com Not sending mail to unregistered user apill...@google.com Not sending mail to unregistered user aljoscha.kret...@gmail.com Not sending mail to unregistered user dcava...@google.com Not sending mail to unregistered user wi...@bounceexchange.com Not sending mail to unregistered user ccla...@bluewin.ch Not sending mail to unregistered user abhyan...@gmail.com Not sending mail to unregistered user aromanenko....@gmail.com Not sending mail to unregistered user amyrv...@google.com Not sending mail to unregistered user ekirpic...@gmail.com Not sending mail to unregistered user fjetum...@gmail.com Not sending mail to unregistered user arnaudfournier...@gmail.com Not sending mail to unregistered user ni...@google.com Not sending mail to unregistered user wtan...@yahoo.com Not sending mail to unregistered user xuming...@users.noreply.github.com Not sending mail to unregistered user j...@nanthrax.net Not sending mail to unregistered user daniel.o.program...@gmail.com Not sending mail to unregistered user mair...@google.com Not sending mail to unregistered user dariusz.aniszew...@polidea.com Not sending mail to unregistered user z...@giggles.nyc.corp.google.com Not sending mail to unregistered user pawel.pk.kaczmarc...@gmail.com Not sending mail to unregistered user ke...@google.com Not sending mail to unregistered user sweg...@google.com Not sending mail to unregistered user kirpic...@google.com Not sending mail to unregistered user zhouha...@meituan.com Not sending mail to unregistered user ankurgoe...@gmail.com Not sending mail to unregistered user sid...@google.com Not sending mail to unregistered user meliss...@google.com Not sending mail to unregistered user arnaudfournier...@gmail.com Not sending mail to unregistered user boyu...@google.com Not sending mail to unregistered user mari...@mariagh.svl.corp.google.com Not sending mail to unregistered user samu...@google.com Not sending mail to unregistered user hero...@google.com Not sending mail to unregistered user jiang...@gmail.com Not sending mail to unregistered user sdus...@google.com Not sending mail to unregistered user git...@alasdairhodge.co.uk Not sending mail to unregistered user eh...@google.com Not sending mail to unregistered user bat...@batbat-linuxworkstation.sea.corp.google.com Not sending mail to unregistered user xumingmi...@gmail.com Not sending mail to unregistered user yifan...@yifanzou-linuxworkstation.sea.corp.google.com Not sending mail to unregistered user g...@telligent-data.com Not sending mail to unregistered user k...@google.com Not sending mail to unregistered user holdenka...@google.com Not sending mail to unregistered user rob...@frantil.com Not sending mail to unregistered user joey.bar...@gmail.com
