[jira] [Work logged] (BEAM-4700) JDBC driver cannot support TIMESTAMP data type

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4700?focusedWorklogId=117939=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117939
 ]

ASF GitHub Bot logged work on BEAM-4700:


Author: ASF GitHub Bot
Created on: 01/Jul/18 04:45
Start Date: 01/Jul/18 04:45
Worklog Time Spent: 10m 
  Work Description: apilloud commented on issue #5849: [BEAM-4700] Convert 
Beam Row to Avatica Row in BeamEnumerableCollector
URL: https://github.com/apache/beam/pull/5849#issuecomment-401582729
 
 
   LGTM.
   
   Are there tests we should write?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117939)
Time Spent: 0.5h  (was: 20m)

> JDBC driver cannot support TIMESTAMP data type
> --
>
> Key: BEAM-4700
> URL: https://issues.apache.org/jira/browse/BEAM-4700
> Project: Beam
>  Issue Type: Bug
>  Components: dsl-sql
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>Priority: Blocker
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Avatica allows column representation to be customized, so a timestamp can be 
> stored as a variety of types. Joda ReadableInstant is none of these types: 
> https://github.com/apache/calcite-avatica/blob/acb675de97b9b0743c09368820a770e2ceda05f8/core/src/main/java/org/apache/calcite/avatica/util/AbstractCursor.java#L162
> By default, it seems to be configured to store {{TIMESTAMP}} columns as 
> {{long}} values. If you run the SQL shell and select a {{TIMESTAMP}} column, 
> you get:
> {code}
> ava.lang.ClassCastException: org.joda.time.Instant cannot be cast to 
> java.lang.Number
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$NumberAccessor.getNumber(AbstractCursor.java:726)
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$TimestampFromNumberAccessor.getString(AbstractCursor.java:1026)
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.AvaticaResultSet.getString(AvaticaResultSet.java:225)
> at sqlline.Rows$Row.(Rows.java:183)
> {code}
> So, essentially, Beam SQL Shell does not support timestamps.
> We may be able to:
>  - override how the accessor for our existing storage is created
>  - configure what the column representation is (this doesn't really help, 
> since none of the choices are ours)
>  - convert timestamps to longs in BeamEnumerableConverter; not sure how many 
> conversions will be required here



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam-site] branch asf-site updated (c0bb975 -> e4990b6)

2018-06-30 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


from c0bb975  Regenerate site content
 add 23e3ff8  New blog post about 2.5.0 release
 add a1702d1  This closes #476
 new e4990b6  Prepare repository for deployment.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../19/beam-2.3.0.html => 06/26/beam-2.5.0.html}   | 134 --
 content/blog/index.html|  30 
 content/feed.xml   | 156 +
 content/index.html |  10 +-
 src/_data/authors.yml  |   4 +
 src/_posts/2018-06-26-beam-2.5.0.md|  85 +++
 6 files changed, 287 insertions(+), 132 deletions(-)
 copy content/blog/2018/{02/19/beam-2.3.0.html => 06/26/beam-2.5.0.html} (68%)
 create mode 100644 src/_posts/2018-06-26-beam-2.5.0.md



[beam-site] 01/01: Prepare repository for deployment.

2018-06-30 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e4990b6324433bbadaa170892b833601de243126
Author: Mergebot 
AuthorDate: Sat Jun 30 21:26:07 2018 -0700

Prepare repository for deployment.
---
 .../2018/06/26/beam-2.5.0.html}| 313 -
 content/blog/index.html|  30 ++
 content/feed.xml   | 156 ++
 content/index.html |  10 +-
 4 files changed, 250 insertions(+), 259 deletions(-)

diff --git a/content/index.html b/content/blog/2018/06/26/beam-2.5.0.html
similarity index 56%
copy from content/index.html
copy to content/blog/2018/06/26/beam-2.5.0.html
index d37f1cd..fe2f393 100644
--- a/content/index.html
+++ b/content/blog/2018/06/26/beam-2.5.0.html
@@ -28,9 +28,8 @@
   
   
   
-  Apache Beam
-  
+  Apache Beam 2.5.0
+  
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
   
   https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
@@ -39,7 +38,7 @@
   
   
   
-  https://beam.apache.org/; data-proofer-ignore>
+  https://beam.apache.org/blog/2018/06/26/beam-2.5.0.html; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   
@@ -52,7 +51,7 @@
   
 
 
-  
+  
 
+
+
+
+http://schema.org/BlogPosting;>
+
+  
+Apache Beam 2.5.0
+Jun 26, 2018 • 
-
-  
-
-  
-
-  
-Apache Beam: An advanced unified programming model
-  
-  
-Implement batch and streaming data processing jobs that run on any 
execution engine.
-  
-  
-Learn more
-Download Beam SDK 2.5.0
-  
-  
-Java 
Quickstart
-Python 
Quickstart
-   Go 
Quickstart
-  
-
-  
-  
-
-  
-The latest from the blog
-  
-  
-
-
-  Apache Beam 
2.3.0
-  Feb 19, 2018
-
-
-
-  Apache Beam: A Look 
Back at 2017
-  Jan 9, 2018
-
-
-
-  Timely (and 
Stateful) Processing with Apache Beam
-  Aug 28, 2017
-
-
-  
-
-  
-
-  
-
+ Alexey Romanenko [https://twitter.com/alexromdev;>@alexromdev]
+
+  
 
-
-  
-All about Apache Beam
-  
-  
-
-
-  
-Unified
-  
-  
-Use a single programming model for both batch and streaming use cases.
-  
-
-
-
-  
-Portable
-  
-  
-Execute pipelines on multiple execution environments.
-  
-
-
-
-  
-Extensible
-  
-  
-Write and share new SDKs, IO connectors, and transformation libraries.
-  
-
-
-  
-
+  
+We are glad to present the new 2.5.0 release of Beam. This release 
includes
+multiple fixes and new functionalities.  For more information
+please check the detailed release notes.
 
-
-
-
-
-
+New Features / Improvements
 
-
-  
-Works with
-  
-  
-
-
-  http://apex.apache.org;>
-
-
-
-  http://flink.apache.org;>
-
-
-
-  http://spark.apache.org/;>
-
-
-
-  https://cloud.google.com/dataflow/;>
-
-
-
-  http://gearpump.apache.org/;>
-
-
-
-  http://samza.apache.org/;>
-
-
-  
-
+Go SDK support
+The Go SDK has been officially accepted into the project, after an 
incubation period and community effort. Go pipelines run on Dataflow runner. 
More details are https://beam.apache.org/documentation/sdks/go/;>here.
 
-
-  
-
-  Testimonials
-
-
-  
-  
-
-  A framework that delivers the flexibility and advanced functionality 
our customers need.
-
-
-  
-  
-–Talend
-  
-
-  
-  
-  
-
-  Apache Beam has powerful semantics that solve real-world challenges 
of stream processing.
-
-
-  
-  
-–PayPal
-  
-
-  
-  
-  
-
-  Apache Beam represents a principled approach for analyzing data 
streams.
-
-
-  
-  
-–data Artisans
-  
-
-  
-  
-
-
-  Beam is an open source community and contributions are greatly 
appreciated!
-  If you’d like to contribute, please see the Contribute section.
-
-  
-
+Parquet support
+Support for Apache Parquet format was added. It uses Parquet 1.10 release 
which, thanks to AvroParquerWriter’s API changes, allows FileIO.Sink 
implementation.
+
+Performance/Integration Tests
+
+  Added new integration tests - 

[beam-site] 01/02: New blog post about 2.5.0 release

2018-06-30 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 23e3ff8a11ebed3452bee571f1c83548774f843c
Author: Alexey Romanenko 
AuthorDate: Fri Jun 22 17:29:18 2018 +0200

New blog post about 2.5.0 release
---
 src/_data/authors.yml   |  4 ++
 src/_posts/2018-06-26-beam-2.5.0.md | 85 +
 2 files changed, 89 insertions(+)

diff --git a/src/_data/authors.yml b/src/_data/authors.yml
index 3f249d0..ea0ee96 100644
--- a/src/_data/authors.yml
+++ b/src/_data/authors.yml
@@ -72,3 +72,7 @@ ianand:
 name: Anand Iyer
 email: ian...@google.com
 twitter:
+aromanenko:
+name: Alexey Romanenko
+email: aromane...@apache.org
+twitter: alexromdev
diff --git a/src/_posts/2018-06-26-beam-2.5.0.md 
b/src/_posts/2018-06-26-beam-2.5.0.md
new file mode 100644
index 000..b445d6b
--- /dev/null
+++ b/src/_posts/2018-06-26-beam-2.5.0.md
@@ -0,0 +1,85 @@
+---
+layout: post
+title:  "Apache Beam 2.5.0"
+date:   2018-06-26 00:00:01 -0800
+excerpt_separator: 
+categories: blog
+authors:
+  - aromanenko
+---
+
+We are glad to present the new 2.5.0 release of Beam. This release includes
+multiple fixes and new functionalities.  For more information
+please check the detailed release notes.
+
+# New Features / Improvements
+
+## Go SDK support
+The Go SDK has been officially accepted into the project, after an incubation 
period and community effort. Go pipelines run on Dataflow runner. More details 
are [here](https://beam.apache.org/documentation/sdks/go/).
+
+## Parquet support
+Support for Apache Parquet format was added. It uses Parquet 1.10 release 
which, thanks to AvroParquerWriter's API changes, allows FileIO.Sink 
implementation.
+
+## Performance/Integration Tests
+* Added new integration tests - HCatalogIOIT (Hive), HBaseIOIT, ParquetIOIT 
(with the IO itself, local filesystem, HDFS)
+* Multinode (3 data node) HDFS cluster is used for running tests on HDFS.
+* Several improvements on performance tests running and results analysis.
+* Scaled up Kubernetes cluster from 1 to 3 nodes.
+* Added metrics in Spark streaming.
+
+## Internal Build System: Migrated to Gradle 
+After a months-long community effort, the internal Beam build has been 
migrated from Maven to Gradle. The new build system was chosen because of 
dependency-driven build support, incremental build/test, and support for 
non-Java languages.
+
+
+## Nexmark Improvements
+* Kafka support as a source/sink for events and results.
+* Translation of some queries to Beam SQL.
+
+## Beam SQL 
+* Support for MAP, ROW, ARRAY data types
+* Support UNNEST on array fields
+* Improved optimizations
+* Upgrade Calcite to 1.16
+* Support SQL on POJOs via automatic conversion
+* Schema moved into core Beam
+* UDAFs can be indirect suclasses of CombineFn
+* Many other small bugfixes
+
+## Portability
+* Common shared code related to supporting portable execution for runners.
+* Python SDK supporting side inputs over the portability APIs.
+
+
+## Extract metrics in a runner agnostic way
+Metrics are pushed by the runners to configurable sinks (Http REST sink 
available). It is already enabled in Flink and Spark runner, work is in 
progress for Dataflow.
+
+# Miscellaneous Fixes
+
+## SDKs
+
+* Implemented HDFS FileSystem for Python SDK.
+* Python SDK adds support for side inputs for streaming execution.
+
+## Runners
+* Updated Spark runner to Spark version 2.3.1
+* Fixed issue with late elements windowed into expired fixed windows get 
dropped in Directrunner.
+
+## IOs
+
+* CassandraIO gained a better split algorithm based on overlapping regions.
+* ElasticsearchIO supports partial updates.
+* ElasticsearchIO allows to pass id, type and index per document.
+* SolrIO supports a more robust retry on write strategy.
+* S3 FileSystem supports encryption (SSE-S3, SSE-C and SSE-KMS).
+* Improved connection management in JdbcIO.
+* Added support the element timestamps while publishing to Kafka.
+
+## Other
+
+* Use Java ErrorProne for static analysis.
+
+# List of Contributors
+
+According to git shortlog, the following 84 people contributed to the 2.5.0 
release. Thank you to all contributors!
+
+Ahmet Altay, Alan Myrvold, Alex Amato, Alex Van Boxel, Alexander Dejanovski, 
Alexey Romanenko, Aljoscha Krettek, ananvay, Andreas Ehrencrona, Andrew 
Pilloud, Ankur Goenka, Anton Kedin, arkash, Austin Bennett, Axel Magnuson, Ben 
Chambers, Ben Sidhom, Bill Neubauer, Boyuan Zhang, Braden Bassingthwaite, Cade 
Markegard, cclauss, Chamikara Jayalath, Charles Chen, Chuan Yu Foo, Cody 
Schroeder, Colm O hEigeartaigh, Daniel Oliveira, Dariusz Aniszewski, David 
Cavazos, Dawid Wysakowicz, Eric Rosha [...]
\ No newline at end of file



[beam-site] branch mergebot updated (8e949bb -> a1702d1)

2018-06-30 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a change to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


 discard 8e949bb  This closes #487
 discard 25ed146  Add SQL Set page
 add 703f2b2  Add SQL Set page
 add 41868a4  Merge #487: Add SQL SET page
 add 2dcf129  Regenerate site content
 add fa0eec8  [BEAM-3079]: Samza Runner docs and capability matrix
 add 0bc08e3  Update the option docs
 add 02c2301  Add Samza to the runner list
 add 7cd0ea7  Merge #471: Add Samza runner to web site
 add 5de31d1  Regenerate site content
 add 8a711a6  Make Samza icon a reasonable size
 add e22acef  Alphabetize runners
 add a68b37e  Regenerate site content
 add a212ef8  Add redirect to new team page
 add bcff1a8  Merge #485: Add redirect to new team page
 add c0bb975  Regenerate site content
 new 23e3ff8  New blog post about 2.5.0 release
 new a1702d1  This closes #476

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (8e949bb)
\
 N -- N -- N   refs/heads/mergebot (a1702d1)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 content/contribute/team/index.html |   10 +
 .../dsls/sql/aggregate-functions/index.html|1 +
 .../documentation/dsls/sql/create-table/index.html |1 +
 .../documentation/dsls/sql/data-types/index.html   |1 +
 content/documentation/dsls/sql/joins/index.html|1 +
 content/documentation/dsls/sql/lexical/index.html  |1 +
 content/documentation/dsls/sql/overview/index.html |1 +
 .../dsls/sql/scalar-functions/index.html   |1 +
 content/documentation/dsls/sql/select/index.html   |1 +
 .../{sdks/java => dsls/sql/set}/index.html |   58 +-
 .../dsls/sql/user-defined-functions/index.html |1 +
 .../documentation/dsls/sql/walkthrough/index.html  |1 +
 .../dsls/sql/windowing-and-triggering/index.html   |1 +
 content/documentation/index.html   |1 +
 content/documentation/runners/apex/index.html  |1 +
 .../runners/capability-matrix/index.html   | 1149 ++--
 content/documentation/runners/dataflow/index.html  |1 +
 content/documentation/runners/direct/index.html|1 +
 content/documentation/runners/flink/index.html |1 +
 content/documentation/runners/gearpump/index.html  |1 +
 content/documentation/runners/mapreduce/index.html |1 +
 .../runners/{flink => samza}/index.html|  214 ++--
 content/documentation/runners/spark/index.html |1 +
 .../sdks/feature-comparison/index.html |1 +
 content/documentation/sdks/go/index.html   |1 +
 .../documentation/sdks/java-extensions/index.html  |1 +
 .../documentation/sdks/java-thirdparty/index.html  |1 +
 .../documentation/sdks/java/euphoria/index.html|1 +
 content/documentation/sdks/java/index.html |1 +
 content/documentation/sdks/java/nexmark/index.html |1 +
 .../documentation/sdks/python-custom-io/index.html |1 +
 .../sdks/python-pipeline-dependencies/index.html   |1 +
 .../documentation/sdks/python-streaming/index.html |1 +
 .../sdks/python-type-safety/index.html |1 +
 content/documentation/sdks/python/index.html   |1 +
 content/get-started/beam-overview/index.html   |1 +
 content/get-started/quickstart-java/index.html |   21 +
 content/get-started/wordcount-example/index.html   |   43 +
 content/images/logo_samza.png  |  Bin 0 -> 11728 bytes
 content/images/logos/runners/samza.png |  Bin 0 -> 11728 bytes
 content/index.html |4 +
 content/learn/runners/Samza/index.html |   10 +
 content/project/team/index.html|   10 +
 content/team/index.html|   10 +
 src/_data/authors.yml  |4 +
 src/_data/capability-matrix.yml|  118 +-
 src/_includes/section-menu/runners.html|1 +
 src/_posts/2018-06-26-beam-2.5.0.md|   85 ++
 src/contribute/team.md |   23 

[beam-site] 02/02: This closes #476

2018-06-30 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit a1702d1a3339a9be2a1e07844e6e096fdc407ac4
Merge: c0bb975 23e3ff8
Author: Mergebot 
AuthorDate: Sat Jun 30 21:23:37 2018 -0700

This closes #476

 src/_data/authors.yml   |  4 ++
 src/_posts/2018-06-26-beam-2.5.0.md | 85 +
 2 files changed, 89 insertions(+)



[jira] [Work logged] (BEAM-4700) JDBC driver cannot support TIMESTAMP data type

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4700?focusedWorklogId=117936=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117936
 ]

ASF GitHub Bot logged work on BEAM-4700:


Author: ASF GitHub Bot
Created on: 01/Jul/18 03:40
Start Date: 01/Jul/18 03:40
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5849: [BEAM-4700] 
Convert Beam Row to Avatica Row in BeamEnumerableCollector
URL: https://github.com/apache/beam/pull/5849#issuecomment-401580944
 
 
   R: @apilloud @amaliujia 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117936)
Time Spent: 20m  (was: 10m)

> JDBC driver cannot support TIMESTAMP data type
> --
>
> Key: BEAM-4700
> URL: https://issues.apache.org/jira/browse/BEAM-4700
> Project: Beam
>  Issue Type: Bug
>  Components: dsl-sql
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>Priority: Blocker
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Avatica allows column representation to be customized, so a timestamp can be 
> stored as a variety of types. Joda ReadableInstant is none of these types: 
> https://github.com/apache/calcite-avatica/blob/acb675de97b9b0743c09368820a770e2ceda05f8/core/src/main/java/org/apache/calcite/avatica/util/AbstractCursor.java#L162
> By default, it seems to be configured to store {{TIMESTAMP}} columns as 
> {{long}} values. If you run the SQL shell and select a {{TIMESTAMP}} column, 
> you get:
> {code}
> ava.lang.ClassCastException: org.joda.time.Instant cannot be cast to 
> java.lang.Number
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$NumberAccessor.getNumber(AbstractCursor.java:726)
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$TimestampFromNumberAccessor.getString(AbstractCursor.java:1026)
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.AvaticaResultSet.getString(AvaticaResultSet.java:225)
> at sqlline.Rows$Row.(Rows.java:183)
> {code}
> So, essentially, Beam SQL Shell does not support timestamps.
> We may be able to:
>  - override how the accessor for our existing storage is created
>  - configure what the column representation is (this doesn't really help, 
> since none of the choices are ours)
>  - convert timestamps to longs in BeamEnumerableConverter; not sure how many 
> conversions will be required here



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4700) JDBC driver cannot support TIMESTAMP data type

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4700?focusedWorklogId=117935=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117935
 ]

ASF GitHub Bot logged work on BEAM-4700:


Author: ASF GitHub Bot
Created on: 01/Jul/18 03:39
Start Date: 01/Jul/18 03:39
Worklog Time Spent: 10m 
  Work Description: kennknowles opened a new pull request #5849: 
[BEAM-4700] Convert Beam Row to Avatica Row in BeamEnumerableCollector
URL: https://github.com/apache/beam/pull/5849
 
 
   This is a fairly surgical fix that makes timestamps work.
   
   It is not at all a comprehensive solution to the general problem of 
establishing a proper compatibility between Beam `Row` and Avatica's meta 
schema stuff. I suspect we can override `Cursor.getAccessors` at the right 
place to avoid conversion at all. Since there's no meaningful documentation, it 
will take a minute to figure that out.
   
   
   
   Follow this checklist to help us incorporate your contribution quickly and 
easily:
   
- [x] Format the pull request title like `[BEAM-XXX] Fixes bug in 
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA 
issue, if applicable. This will automatically link the pull request to the 
issue.
- [x] If this contribution is large, please file an Apache [Individual 
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   It will help us expedite review of your Pull Request if you tag someone 
(e.g. `@username`) to look at it.
   
   Post-Commit Tests Status (on master branch)
   

   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/)
 | --- | --- | --- | --- | --- | ---
   Java | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
   Python | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
 | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
  [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
 | --- | --- | --- | ---
   
   
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117935)
Time Spent: 10m
Remaining Estimate: 0h

> JDBC driver cannot support TIMESTAMP data type
> --
>
> Key: BEAM-4700
> 

[jira] [Updated] (BEAM-4700) JDBC driver cannot support TIMESTAMP data type

2018-06-30 Thread Kenneth Knowles (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-4700:
--
Issue Type: Bug  (was: New Feature)

> JDBC driver cannot support TIMESTAMP data type
> --
>
> Key: BEAM-4700
> URL: https://issues.apache.org/jira/browse/BEAM-4700
> Project: Beam
>  Issue Type: Bug
>  Components: dsl-sql
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>Priority: Blocker
>
> Avatica allows column representation to be customized, so a timestamp can be 
> stored as a variety of types. Joda ReadableInstant is none of these types: 
> https://github.com/apache/calcite-avatica/blob/acb675de97b9b0743c09368820a770e2ceda05f8/core/src/main/java/org/apache/calcite/avatica/util/AbstractCursor.java#L162
> By default, it seems to be configured to store {{TIMESTAMP}} columns as 
> {{long}} values. If you run the SQL shell and select a {{TIMESTAMP}} column, 
> you get:
> {code}
> ava.lang.ClassCastException: org.joda.time.Instant cannot be cast to 
> java.lang.Number
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$NumberAccessor.getNumber(AbstractCursor.java:726)
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$TimestampFromNumberAccessor.getString(AbstractCursor.java:1026)
> at 
> org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.AvaticaResultSet.getString(AvaticaResultSet.java:225)
> at sqlline.Rows$Row.(Rows.java:183)
> {code}
> So, essentially, Beam SQL Shell does not support timestamps.
> We may be able to:
>  - override how the accessor for our existing storage is created
>  - configure what the column representation is (this doesn't really help, 
> since none of the choices are ours)
>  - convert timestamps to longs in BeamEnumerableConverter; not sure how many 
> conversions will be required here



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (BEAM-4700) JDBC driver cannot support TIMESTAMP data type

2018-06-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-4700:
-

 Summary: JDBC driver cannot support TIMESTAMP data type
 Key: BEAM-4700
 URL: https://issues.apache.org/jira/browse/BEAM-4700
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: Kenneth Knowles
Assignee: Kenneth Knowles


Avatica allows column representation to be customized, so a timestamp can be 
stored as a variety of types. Joda ReadableInstant is none of these types: 
https://github.com/apache/calcite-avatica/blob/acb675de97b9b0743c09368820a770e2ceda05f8/core/src/main/java/org/apache/calcite/avatica/util/AbstractCursor.java#L162

By default, it seems to be configured to store {{TIMESTAMP}} columns as 
{{long}} values. If you run the SQL shell and select a {{TIMESTAMP}} column, 
you get:

{code}
ava.lang.ClassCastException: org.joda.time.Instant cannot be cast to 
java.lang.Number
at 
org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$NumberAccessor.getNumber(AbstractCursor.java:726)
at 
org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.util.AbstractCursor$TimestampFromNumberAccessor.getString(AbstractCursor.java:1026)
at 
org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.AvaticaResultSet.getString(AvaticaResultSet.java:225)
at sqlline.Rows$Row.(Rows.java:183)
{code}

So, essentially, Beam SQL Shell does not support timestamps.

We may be able to:

 - override how the accessor for our existing storage is created
 - configure what the column representation is (this doesn't really help, since 
none of the choices are ours)
 - convert timestamps to longs in BeamEnumerableConverter; not sure how many 
conversions will be required here



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Jenkins build is back to normal : beam_PostCommit_Java_GradleBuild #1005

2018-06-30 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PreCommit_Java_Cron #50

2018-06-30 Thread Apache Jenkins Server
See 


Changes:

[klk] Revert accidental clobber of MinimalWordCount.java

[relax] Exclude schema tests from Samza runner.

[klk] Update BigQueryAvroUtils to support BigQuery's NUMERIC type.

--
[...truncated 16.63 MB...]
INFO: 2018-07-01T00:42:00.023Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
 with random key
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.051Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.083Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.106Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.139Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop 
key/Values/Map into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.166Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather 
bundles into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop 
key/Values/Map
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.194Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
 with random key into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather 
bundles
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.226Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.251Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.283Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.310Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.343Z: Unzipping flatten s13-u58 for input 
s14.org.apache.beam.sdk.values.PCollection.:349#f0cbc4d341b04049-c56
Jul 01, 2018 12:42:03 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-07-01T00:42:00.377Z: Fusing unzipped copy of 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign,
 through flatten s13-u58, into producer 

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Samza_Gradle #45

2018-06-30 Thread Apache Jenkins Server
See 




[beam] 01/01: Merge pull request #5755: [BEAM-4417] Support BigQuery's NUMERIC type using Java

2018-06-30 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c6e97409554e0ff0fab3b3f1f2f5272587ad54e5
Merge: c172aeb f92515d
Author: Kenn Knowles 
AuthorDate: Sat Jun 30 16:00:59 2018 -0700

Merge pull request #5755: [BEAM-4417] Support BigQuery's NUMERIC type using 
Java

 .../apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java |  9 +
 .../org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java |  2 +-
 .../beam/sdk/io/gcp/bigquery/StandardSQLTypeName.java  |  2 ++
 .../beam/sdk/io/gcp/bigquery/BigQueryAvroUtilsTest.java| 14 --
 4 files changed, 24 insertions(+), 3 deletions(-)



[jira] [Work logged] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4417?focusedWorklogId=117927=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117927
 ]

ASF GitHub Bot logged work on BEAM-4417:


Author: ASF GitHub Bot
Created on: 30/Jun/18 23:01
Start Date: 30/Jun/18 23:01
Worklog Time Spent: 10m 
  Work Description: kennknowles closed pull request #5755: [BEAM-4417] 
Support BigQuery's NUMERIC type using Java
URL: https://github.com/apache/beam/pull/5755
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java
index f8bf472bb97..bf2cb63e55c 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java
@@ -28,6 +28,7 @@
 import com.google.common.collect.ImmutableList;
 import com.google.common.collect.ImmutableMap;
 import com.google.common.io.BaseEncoding;
+import java.math.BigDecimal;
 import java.nio.ByteBuffer;
 import java.util.ArrayList;
 import java.util.List;
@@ -53,6 +54,7 @@
   .put("BYTES", Type.BYTES)
   .put("INTEGER", Type.LONG)
   .put("FLOAT", Type.DOUBLE)
+  .put("NUMERIC", Type.STRING)
   .put("BOOLEAN", Type.BOOLEAN)
   .put("TIMESTAMP", Type.LONG)
   .put("RECORD", Type.RECORD)
@@ -60,6 +62,7 @@
   .put("DATETIME", Type.STRING)
   .put("TIME", Type.STRING)
   .build();
+
   /**
* Formats BigQuery seconds-since-epoch into String matching JSON export. 
Thread-safe and
* immutable.
@@ -194,6 +197,12 @@ private static Object convertRequiredField(
   case "FLOAT":
 verify(v instanceof Double, "Expected Double, got %s", v.getClass());
 return v;
+  case "NUMERIC":
+verify(
+v instanceof CharSequence || v instanceof BigDecimal,
+"Expected CharSequence (String) or BigDecimal, got %s",
+v.getClass());
+return v.toString();
   case "BOOLEAN":
 verify(v instanceof Boolean, "Expected Boolean, got %s", v.getClass());
 return v;
diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java
index 218e9c272f5..00b0a7d97b0 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java
@@ -70,7 +70,7 @@
   .put(TypeName.INT64, StandardSQLTypeName.INT64)
   .put(TypeName.FLOAT, StandardSQLTypeName.FLOAT64)
   .put(TypeName.DOUBLE, StandardSQLTypeName.FLOAT64)
-  .put(TypeName.DECIMAL, StandardSQLTypeName.FLOAT64)
+  .put(TypeName.DECIMAL, StandardSQLTypeName.NUMERIC)
   .put(TypeName.BOOLEAN, StandardSQLTypeName.BOOL)
   .put(TypeName.ARRAY, StandardSQLTypeName.ARRAY)
   .put(TypeName.ROW, StandardSQLTypeName.STRUCT)
diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StandardSQLTypeName.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StandardSQLTypeName.java
index 632b8aeb1a6..7ffa85c8b66 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StandardSQLTypeName.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StandardSQLTypeName.java
@@ -31,6 +31,8 @@
   INT64,
   /** A 64-bit IEEE binary floating-point value. */
   FLOAT64,
+  /** A decimal value with 38 digits of precision and 9 digits of scale. */
+  NUMERIC,
   /** Variable-length character (Unicode) data. */
   STRING,
   /** Variable-length binary data. */
diff --git 
a/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtilsTest.java
 
b/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtilsTest.java
index 42f9167a009..e000b561b1b 100644
--- 
a/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtilsTest.java
+++ 
b/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtilsTest.java
@@ -27,6 +27,7 @@

[beam] branch master updated (c172aeb -> c6e9740)

2018-06-30 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from c172aeb  Merge pull request #5848: [BEAM-4698] Exclude schema tests 
from Samza runner
 add f92515d  Update BigQueryAvroUtils to support BigQuery's NUMERIC type.
 new c6e9740  Merge pull request #5755: [BEAM-4417] Support BigQuery's 
NUMERIC type using Java

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java |  9 +
 .../org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java |  2 +-
 .../beam/sdk/io/gcp/bigquery/StandardSQLTypeName.java  |  2 ++
 .../beam/sdk/io/gcp/bigquery/BigQueryAvroUtilsTest.java| 14 --
 4 files changed, 24 insertions(+), 3 deletions(-)



[jira] [Work logged] (BEAM-4698) SchemaTest not sickbayed for Samza runner

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4698?focusedWorklogId=117925=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117925
 ]

ASF GitHub Bot logged work on BEAM-4698:


Author: ASF GitHub Bot
Created on: 30/Jun/18 22:44
Start Date: 30/Jun/18 22:44
Worklog Time Spent: 10m 
  Work Description: kennknowles closed pull request #5848: [BEAM-4698] 
Exclude schema tests from Samza runner
URL: https://github.com/apache/beam/pull/5848
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/runners/samza/build.gradle b/runners/samza/build.gradle
index b1a87f995b9..74dfb07b0c8 100644
--- a/runners/samza/build.gradle
+++ b/runners/samza/build.gradle
@@ -83,6 +83,7 @@ task validatesRunner(type: Test) {
 excludeCategories 'org.apache.beam.sdk.testing.UsesAttemptedMetrics'
 excludeCategories 'org.apache.beam.sdk.testing.UsesCommittedMetrics'
 excludeCategories 'org.apache.beam.sdk.testing.UsesImpulse'
+excludeCategories 'org.apache.beam.sdk.testing.UsesSchema'
 excludeCategories 'org.apache.beam.sdk.testing.UsesSplittableParDo'
 excludeCategories 'org.apache.beam.sdk.testing.UsesTestStream'
 excludeCategories 'org.apache.beam.sdk.testing.UsesTimersInParDo'


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117925)
Time Spent: 20m  (was: 10m)

> SchemaTest not sickbayed for Samza runner
> -
>
> Key: BEAM-4698
> URL: https://issues.apache.org/jira/browse/BEAM-4698
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-samza
>Reporter: Kenneth Knowles
>Assignee: Reuven Lax
>Priority: Major
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/
> This failed the SchemaTest, which we know all runners will fail since it uses 
> a different entry point for {{SimpleDoFnRunner}}. It should be excluded from 
> their test suites.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam] 01/01: Merge pull request #5848: [BEAM-4698] Exclude schema tests from Samza runner

2018-06-30 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit c172aeb26af8c1f84799ad3e37da023b6df0df6c
Merge: 21cc093 992cb9c
Author: Kenn Knowles 
AuthorDate: Sat Jun 30 15:44:41 2018 -0700

Merge pull request #5848: [BEAM-4698] Exclude schema tests from Samza runner

 runners/samza/build.gradle | 1 +
 1 file changed, 1 insertion(+)



[beam] branch master updated (21cc093 -> c172aeb)

2018-06-30 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 21cc093  Merge pull request #5846: Revert accidental clobber of 
MinimalWordCount.java
 add 992cb9c  Exclude schema tests from Samza runner.
 new c172aeb  Merge pull request #5848: [BEAM-4698] Exclude schema tests 
from Samza runner

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/samza/build.gradle | 1 +
 1 file changed, 1 insertion(+)



[jira] [Work logged] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4417?focusedWorklogId=117924=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117924
 ]

ASF GitHub Bot logged work on BEAM-4417:


Author: ASF GitHub Bot
Created on: 30/Jun/18 22:43
Start Date: 30/Jun/18 22:43
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5755: [BEAM-4417] 
Support BigQuery's NUMERIC type using Java
URL: https://github.com/apache/beam/pull/5755#issuecomment-401570800
 
 
   OK it passed before & after. Since you will no longer need your local copy 
to be in sync with this PR, I am going to fix up the commit history then merge 
this.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117924)
Time Spent: 3h  (was: 2h 50m)

> BigqueryIO Numeric datatype Support
> ---
>
> Key: BEAM-4417
> URL: https://issues.apache.org/jira/browse/BEAM-4417
> Project: Beam
>  Issue Type: Improvement
>  Components: io-java-gcp
>Affects Versions: 2.4.0
>Reporter: Kishan Kumar
>Assignee: Chamikara Jayalath
>Priority: Critical
>  Labels: newbie, patch
> Fix For: 2.6.0
>
>  Time Spent: 3h
>  Remaining Estimate: 0h
>
> The BigQueryIO.read fails while parsing the data from the avro file generated 
> while reading the data from the table which has columns with *Numeric* 
> datatypes. 
> We have gone through the source code at Git-Hub and noticed that *Numeric 
> data type is not yet supported.* 
>  
> Caused by: com.google.common.base.VerifyException: Unsupported BigQuery type: 
> NUMERIC
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam] 01/01: Merge pull request #5846: Revert accidental clobber of MinimalWordCount.java

2018-06-30 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 21cc0931307f7cea6dfd038a59bae9f0f5957a56
Merge: d76402c adab3a3
Author: Kenn Knowles 
AuthorDate: Sat Jun 30 14:51:38 2018 -0700

Merge pull request #5846: Revert accidental clobber of MinimalWordCount.java

 examples/java/build.gradle |  1 -
 .../org/apache/beam/examples/MinimalWordCount.java | 88 +++---
 2 files changed, 62 insertions(+), 27 deletions(-)



[beam] branch master updated (d76402c -> 21cc093)

2018-06-30 Thread kenn
This is an automated email from the ASF dual-hosted git repository.

kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from d76402c  Merge pull request #5845: [BEAM-4697] Fix build.
 add adab3a3  Revert accidental clobber of MinimalWordCount.java
 new 21cc093  Merge pull request #5846: Revert accidental clobber of 
MinimalWordCount.java

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 examples/java/build.gradle |  1 -
 .../org/apache/beam/examples/MinimalWordCount.java | 88 +++---
 2 files changed, 62 insertions(+), 27 deletions(-)



[jira] [Commented] (BEAM-4698) SchemaTest not sickbayed for Samza runner

2018-06-30 Thread Reuven Lax (JIRA)


[ 
https://issues.apache.org/jira/browse/BEAM-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528907#comment-16528907
 ] 

Reuven Lax commented on BEAM-4698:
--

https://github.com/apache/beam/pull/5848

On Sat, Jun 30, 2018 at 2:33 PM Kenneth Knowles (JIRA) 



> SchemaTest not sickbayed for Samza runner
> -
>
> Key: BEAM-4698
> URL: https://issues.apache.org/jira/browse/BEAM-4698
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-samza
>Reporter: Kenneth Knowles
>Assignee: Reuven Lax
>Priority: Major
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/
> This failed the SchemaTest, which we know all runners will fail since it uses 
> a different entry point for {{SimpleDoFnRunner}}. It should be excluded from 
> their test suites.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4698) SchemaTest not sickbayed for Samza runner

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4698?focusedWorklogId=117922=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117922
 ]

ASF GitHub Bot logged work on BEAM-4698:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:46
Start Date: 30/Jun/18 21:46
Worklog Time Spent: 10m 
  Work Description: reuvenlax opened a new pull request #5848: [BEAM-4698] 
Exclude schema tests from Samza runner
URL: https://github.com/apache/beam/pull/5848
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117922)
Time Spent: 10m
Remaining Estimate: 0h

> SchemaTest not sickbayed for Samza runner
> -
>
> Key: BEAM-4698
> URL: https://issues.apache.org/jira/browse/BEAM-4698
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-samza
>Reporter: Kenneth Knowles
>Assignee: Reuven Lax
>Priority: Major
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/
> This failed the SchemaTest, which we know all runners will fail since it uses 
> a different entry point for {{SimpleDoFnRunner}}. It should be excluded from 
> their test suites.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4659) Add well known timer coder for Java SDK

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4659?focusedWorklogId=117921=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117921
 ]

ASF GitHub Bot logged work on BEAM-4659:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:41
Start Date: 30/Jun/18 21:41
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on a change in pull request 
#5794: [BEAM-4659] Add well known timer coder to Java SDK.
URL: https://github.com/apache/beam/pull/5794#discussion_r199333073
 
 

 ##
 File path: 
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/Timer.java
 ##
 @@ -0,0 +1,131 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.beam.runners.core.construction;
+
+import com.google.auto.value.AutoValue;
+import java.io.IOException;
+import java.io.InputStream;
+import java.io.OutputStream;
+import java.util.Collections;
+import java.util.List;
+import javax.annotation.Nullable;
+import org.apache.beam.sdk.coders.CoderException;
+import org.apache.beam.sdk.coders.InstantCoder;
+import org.apache.beam.sdk.coders.StructuredCoder;
+import org.apache.beam.sdk.util.common.ElementByteSizeObserver;
+import org.joda.time.Instant;
+
+/**
+ * A timer consists of a timestamp and a corresponding user supplied payload.
+ *
+ * Note that this implementation is specifically used during execution 
within runners and inside
+ * the SDK harness. The {@link org.apache.beam.sdk.state.Timer} represents the 
current user facing
+ * API. Consider consolidating the two once {@link 
org.apache.beam.runners.core.TimerInternals} is
 
 Review comment:
   This causes a failure in publishing due to a broken link when building 
`:beam-runners-core-construction:javadoc`. There are two options:
   
   1. Suppress all individual javadoc builds and just build one giant one, so 
dependencies are a non-issue. This allows references that are often useful, 
though conceptually "shouldn't" be there.
   2. Only talk about things that are actual dependencies, since the library 
should not require knowledge of thing that are not its dependencies.
   
   This particular sentence seems like it does not add a lot, could be a 
non-javadoc TODO or a JIRA.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117921)
Time Spent: 1h 10m  (was: 1h)

> Add well known timer coder for Java SDK
> ---
>
> Key: BEAM-4659
> URL: https://issues.apache.org/jira/browse/BEAM-4659
> Project: Beam
>  Issue Type: Sub-task
>  Components: sdk-java-core
>Reporter: Luke Cwik
>Assignee: Luke Cwik
>Priority: Major
>  Labels: portability
> Fix For: 2.6.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Encoding is: [Instant, Payload]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (BEAM-4699) BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest flake

2018-06-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-4699:
-

 Summary: 
BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest flake
 Key: BEAM-4699
 URL: https://issues.apache.org/jira/browse/BEAM-4699
 Project: Beam
  Issue Type: New Feature
  Components: runner-core
Reporter: Kenneth Knowles
Assignee: Henning Rohde


I've seen a few transient failures from {{BeamFileSystemArtifactServicesTest}}. 
I don't recall if they are all {{putArtifactsSingleSmallFileTest}} or how often 
they occur.

https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/

{code}
java.io.FileNotFoundException: 
/tmp/junit8499382858780569091/staging/123/artifacts/artifact_c147efcfc2d7ea666a9e4f5187b115c90903f0fc896a56df9a6ef5d8f3fc9f31
 (No such file or directory)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (BEAM-4698) SchemaTest not sickbayed for Samza runner

2018-06-30 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-4698:
-

 Summary: SchemaTest not sickbayed for Samza runner
 Key: BEAM-4698
 URL: https://issues.apache.org/jira/browse/BEAM-4698
 Project: Beam
  Issue Type: New Feature
  Components: runner-samza
Reporter: Kenneth Knowles
Assignee: Reuven Lax


https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/

This failed the SchemaTest, which we know all runners will fail since it uses a 
different entry point for {{SimpleDoFnRunner}}. It should be excluded from 
their test suites.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3761) Fix Python 3 cmp function

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3761?focusedWorklogId=117917=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117917
 ]

ASF GitHub Bot logged work on BEAM-3761:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:29
Start Date: 30/Jun/18 21:29
Worklog Time Spent: 10m 
  Work Description: cclauss commented on a change in pull request #5843: 
[BEAM-3761] Define cmp() in Python 3
URL: https://github.com/apache/beam/pull/5843#discussion_r199332628
 
 

 ##
 File path: sdks/python/apache_beam/io/gcp/datastore/v1/helper.py
 ##
 @@ -49,6 +49,12 @@
 
 # pylint: enable=ungrouped-imports
 
+try:
 
 Review comment:
   @superbobry A perfect suggestion.  Thanks much.  Done.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117917)
Time Spent: 9h 20m  (was: 9h 10m)

> Fix Python 3 cmp function
> -
>
> Key: BEAM-3761
> URL: https://issues.apache.org/jira/browse/BEAM-3761
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: holdenk
>Priority: Major
>  Time Spent: 9h 20m
>  Remaining Estimate: 0h
>
> Various functions don't exist in Python 3 that did in python 2. This Jira is 
> to fix the use of cmp (which often will involve rewriting __cmp__ as well).
>  
> Note: there are existing PRs for basestring and unicode ( 
> [https://github.com/apache/beam/pull/4697|https://github.com/apache/beam/pull/4697,]
>  , [https://github.com/apache/beam/pull/4730] )
>  
> Note once all of the missing names/functions are fixed we can enable F821 in 
> falke8 python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4689) Dataflow cannot deserialize SplittableParDo DoFns

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4689?focusedWorklogId=117916=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117916
 ]

ASF GitHub Bot logged work on BEAM-4689:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:25
Start Date: 30/Jun/18 21:25
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5834: [BEAM-4689] 
Reverts change of SDF key type
URL: https://github.com/apache/beam/pull/5834#issuecomment-401567193
 
 
   Curiously enough `:beam-examples-java-compileJava` at the same lastest 
`master` reliably fails on my workstation and reliably succeeds on my laptop. 
Not a clue why. I'm still going to revert the changes that seem like they don't 
make sense here.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117916)
Time Spent: 2h 20m  (was: 2h 10m)

> Dataflow cannot deserialize SplittableParDo DoFns
> -
>
> Key: BEAM-4689
> URL: https://issues.apache.org/jira/browse/BEAM-4689
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-dataflow
>Reporter: Kenneth Knowles
>Assignee: Eugene Kirpichov
>Priority: Blocker
> Fix For: 2.6.0
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> The Dataflow postcommit is broken in a way that seems real and user-impacting:
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/testReport/junit/org.apache.beam.sdk.transforms/SplittableDoFnTest/testSideInput/
> {code}
> Caused by: java.lang.IllegalArgumentException: unable to deserialize 
> Serialized DoFnInfo
> ...
> Caused by: java.io.InvalidClassException: 
> org.apache.beam.runners.core.construction.SplittableParDo$RandomUniqueKeyFn; 
> local class incompatible: stream classdesc serialVersionUID = 
> 6068396661487412884, local class serialVersionUID = -617521663543732196
> {code}
> This means that the worker is using a version of the class from its own 
> classpath, not the version from the user's staged pipeline. It implies that 
> the worker is not shading runners-core-construction. Because that is where a 
> ton of utility DoFns live, it is critical that it be shaded.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3761) Fix Python 3 cmp function

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3761?focusedWorklogId=117914=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117914
 ]

ASF GitHub Bot logged work on BEAM-3761:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:17
Start Date: 30/Jun/18 21:17
Worklog Time Spent: 10m 
  Work Description: superbobry commented on a change in pull request #5843: 
[BEAM-3761] Define cmp() in Python 3
URL: https://github.com/apache/beam/pull/5843#discussion_r199332439
 
 

 ##
 File path: sdks/python/apache_beam/io/gcp/datastore/v1/helper.py
 ##
 @@ -49,6 +49,12 @@
 
 # pylint: enable=ungrouped-imports
 
+try:
 
 Review comment:
   This one-liner has the same effect:
   
   ```python
   from past.bulitins import cmp
   ``


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117914)
Time Spent: 9h  (was: 8h 50m)

> Fix Python 3 cmp function
> -
>
> Key: BEAM-3761
> URL: https://issues.apache.org/jira/browse/BEAM-3761
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: holdenk
>Priority: Major
>  Time Spent: 9h
>  Remaining Estimate: 0h
>
> Various functions don't exist in Python 3 that did in python 2. This Jira is 
> to fix the use of cmp (which often will involve rewriting __cmp__ as well).
>  
> Note: there are existing PRs for basestring and unicode ( 
> [https://github.com/apache/beam/pull/4697|https://github.com/apache/beam/pull/4697,]
>  , [https://github.com/apache/beam/pull/4730] )
>  
> Note once all of the missing names/functions are fixed we can enable F821 in 
> falke8 python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3761) Fix Python 3 cmp function

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3761?focusedWorklogId=117915=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117915
 ]

ASF GitHub Bot logged work on BEAM-3761:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:17
Start Date: 30/Jun/18 21:17
Worklog Time Spent: 10m 
  Work Description: superbobry commented on a change in pull request #5843: 
[BEAM-3761] Define cmp() in Python 3
URL: https://github.com/apache/beam/pull/5843#discussion_r199332439
 
 

 ##
 File path: sdks/python/apache_beam/io/gcp/datastore/v1/helper.py
 ##
 @@ -49,6 +49,12 @@
 
 # pylint: enable=ungrouped-imports
 
+try:
 
 Review comment:
   This one-liner has the same effect:
   
   ```python
   from past.bulitins import cmp
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117915)
Time Spent: 9h 10m  (was: 9h)

> Fix Python 3 cmp function
> -
>
> Key: BEAM-3761
> URL: https://issues.apache.org/jira/browse/BEAM-3761
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: holdenk
>Priority: Major
>  Time Spent: 9h 10m
>  Remaining Estimate: 0h
>
> Various functions don't exist in Python 3 that did in python 2. This Jira is 
> to fix the use of cmp (which often will involve rewriting __cmp__ as well).
>  
> Note: there are existing PRs for basestring and unicode ( 
> [https://github.com/apache/beam/pull/4697|https://github.com/apache/beam/pull/4697,]
>  , [https://github.com/apache/beam/pull/4730] )
>  
> Note once all of the missing names/functions are fixed we can enable F821 in 
> falke8 python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4689) Dataflow cannot deserialize SplittableParDo DoFns

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4689?focusedWorklogId=117913=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117913
 ]

ASF GitHub Bot logged work on BEAM-4689:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:14
Start Date: 30/Jun/18 21:14
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5834: [BEAM-4689] 
Reverts change of SDF key type
URL: https://github.com/apache/beam/pull/5834#issuecomment-40153
 
 
   FWIW I think you may have reverted the unrelated parts locally and not 
pushed them. I get compile failures in the example locally; not sure how 
precommit was/is stable.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117913)
Time Spent: 2h 10m  (was: 2h)

> Dataflow cannot deserialize SplittableParDo DoFns
> -
>
> Key: BEAM-4689
> URL: https://issues.apache.org/jira/browse/BEAM-4689
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-dataflow
>Reporter: Kenneth Knowles
>Assignee: Eugene Kirpichov
>Priority: Blocker
> Fix For: 2.6.0
>
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> The Dataflow postcommit is broken in a way that seems real and user-impacting:
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/testReport/junit/org.apache.beam.sdk.transforms/SplittableDoFnTest/testSideInput/
> {code}
> Caused by: java.lang.IllegalArgumentException: unable to deserialize 
> Serialized DoFnInfo
> ...
> Caused by: java.io.InvalidClassException: 
> org.apache.beam.runners.core.construction.SplittableParDo$RandomUniqueKeyFn; 
> local class incompatible: stream classdesc serialVersionUID = 
> 6068396661487412884, local class serialVersionUID = -617521663543732196
> {code}
> This means that the worker is using a version of the class from its own 
> classpath, not the version from the user's staged pipeline. It implies that 
> the worker is not shading runners-core-construction. Because that is where a 
> ton of utility DoFns live, it is critical that it be shaded.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4417?focusedWorklogId=117910=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117910
 ]

ASF GitHub Bot logged work on BEAM-4417:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:09
Start Date: 30/Jun/18 21:09
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5755: [BEAM-4417] 
Support BigQuery's NUMERIC type using Java
URL: https://github.com/apache/beam/pull/5755#issuecomment-401566432
 
 
   Someone broke head for an unfortunate minute.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117910)
Time Spent: 2.5h  (was: 2h 20m)

> BigqueryIO Numeric datatype Support
> ---
>
> Key: BEAM-4417
> URL: https://issues.apache.org/jira/browse/BEAM-4417
> Project: Beam
>  Issue Type: Improvement
>  Components: io-java-gcp
>Affects Versions: 2.4.0
>Reporter: Kishan Kumar
>Assignee: Chamikara Jayalath
>Priority: Critical
>  Labels: newbie, patch
> Fix For: 2.6.0
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> The BigQueryIO.read fails while parsing the data from the avro file generated 
> while reading the data from the table which has columns with *Numeric* 
> datatypes. 
> We have gone through the source code at Git-Hub and noticed that *Numeric 
> data type is not yet supported.* 
>  
> Caused by: com.google.common.base.VerifyException: Unsupported BigQuery type: 
> NUMERIC
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4417?focusedWorklogId=117912=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117912
 ]

ASF GitHub Bot logged work on BEAM-4417:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:09
Start Date: 30/Jun/18 21:09
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5755: [BEAM-4417] 
Support BigQuery's NUMERIC type using Java
URL: https://github.com/apache/beam/pull/5755#issuecomment-401566441
 
 
   run java postcommit


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117912)
Time Spent: 2h 50m  (was: 2h 40m)

> BigqueryIO Numeric datatype Support
> ---
>
> Key: BEAM-4417
> URL: https://issues.apache.org/jira/browse/BEAM-4417
> Project: Beam
>  Issue Type: Improvement
>  Components: io-java-gcp
>Affects Versions: 2.4.0
>Reporter: Kishan Kumar
>Assignee: Chamikara Jayalath
>Priority: Critical
>  Labels: newbie, patch
> Fix For: 2.6.0
>
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> The BigQueryIO.read fails while parsing the data from the avro file generated 
> while reading the data from the table which has columns with *Numeric* 
> datatypes. 
> We have gone through the source code at Git-Hub and noticed that *Numeric 
> data type is not yet supported.* 
>  
> Caused by: com.google.common.base.VerifyException: Unsupported BigQuery type: 
> NUMERIC
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4417?focusedWorklogId=117911=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117911
 ]

ASF GitHub Bot logged work on BEAM-4417:


Author: ASF GitHub Bot
Created on: 30/Jun/18 21:09
Start Date: 30/Jun/18 21:09
Worklog Time Spent: 10m 
  Work Description: kennknowles commented on issue #5755: [BEAM-4417] 
Support BigQuery's NUMERIC type using Java
URL: https://github.com/apache/beam/pull/5755#issuecomment-401566438
 
 
   retest this please


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117911)
Time Spent: 2h 40m  (was: 2.5h)

> BigqueryIO Numeric datatype Support
> ---
>
> Key: BEAM-4417
> URL: https://issues.apache.org/jira/browse/BEAM-4417
> Project: Beam
>  Issue Type: Improvement
>  Components: io-java-gcp
>Affects Versions: 2.4.0
>Reporter: Kishan Kumar
>Assignee: Chamikara Jayalath
>Priority: Critical
>  Labels: newbie, patch
> Fix For: 2.6.0
>
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> The BigQueryIO.read fails while parsing the data from the avro file generated 
> while reading the data from the table which has columns with *Numeric* 
> datatypes. 
> We have gone through the source code at Git-Hub and noticed that *Numeric 
> data type is not yet supported.* 
>  
> Caused by: com.google.common.base.VerifyException: Unsupported BigQuery type: 
> NUMERIC
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4565) Hot key fanout should not distribute keys to all shards.

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4565?focusedWorklogId=117903=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117903
 ]

ASF GitHub Bot logged work on BEAM-4565:


Author: ASF GitHub Bot
Created on: 30/Jun/18 20:34
Start Date: 30/Jun/18 20:34
Worklog Time Spent: 10m 
  Work Description: katsiapis commented on a change in pull request #5649: 
[BEAM-4565] Fix hot key fanout in the face of combiner lifting.
URL: https://github.com/apache/beam/pull/5649#discussion_r199331674
 
 

 ##
 File path: sdks/python/apache_beam/transforms/core.py
 ##
 @@ -1118,7 +1118,7 @@ def _clone(self, **extra_attributes):
 return clone
 
   def with_fanout(self, fanout):
-return self._clone(fanout=fanout)
+return self._clone(fanout=self.fanout)
 
 Review comment:
   We don't want "self." in front of the fanout here (since it is now being 
ignored).
   
   The test still pass of course, but the "optimization" (ie the fanout itself) 
is lost.
   
   My other comment was referring to a separate "self.fanout" issue, which has 
however been fixed in https://github.com/apache/beam/pull//5800.
   
   Could we fix the issue here?
   
   /cc @aaltay 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117903)
Time Spent: 1h  (was: 50m)

> Hot key fanout should not distribute keys to all shards.
> 
>
> Key: BEAM-4565
> URL: https://issues.apache.org/jira/browse/BEAM-4565
> Project: Beam
>  Issue Type: Task
>  Components: sdk-java-core, sdk-py-core
>Affects Versions: 2.0.0, 2.1.0, 2.2.0, 2.3.0, 2.4.0, 2.5.0
>Reporter: Robert Bradshaw
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> The goal is to reduce the number of value sent to a single post-GBK worker. 
> If combiner lifting happens, each bundle will sends a single value per 
> sub-key, causing an N-fold blowup in shuffle data and N reducers with the 
> same amount of data to consume as the single reducer in the non-fanout case. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Jenkins build is back to normal : beam_PerformanceTests_MongoDBIO_IT #377

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_ParquetIOIT #184

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_TextIOIT_HDFS #371

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_TFRecordIOIT #684

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_Compressed_TextIOIT_HDFS #361

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_ParquetIOIT_HDFS #79

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_HadoopInputFormat #460

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_XmlIOIT_HDFS #360

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_Compressed_TextIOIT #686

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_AvroIOIT #691

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_TextIOIT #703

2018-06-30 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #1004

2018-06-30 Thread Apache Jenkins Server
See 


Changes:

[relax] Fix build.

--
[...truncated 19.44 MB...]
INFO: 2018-06-30T20:06:22.775Z: Fusing adjacent ParDo, Read, Write, and 
Flatten operations
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.796Z: Elided trivial flatten 
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.831Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Wait.OnSignal/Wait/Map into SpannerIO.Write/Write 
mutations to Cloud Spanner/Create seed/Read(CreateSource)
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.859Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Read information schema into SpannerIO.Write/Write 
mutations to Cloud Spanner/Wait.OnSignal/Wait/Map
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.892Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.925Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) 
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.951Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
 into SpannerIO.Write/Write mutations to Cloud Spanner/Read information schema
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:22.983Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:23.018Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:23.053Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:23.085Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 30, 2018 8:06:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T20:06:23.109Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
 mutations to Cloud Spanner/Schema 

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex_Gradle #924

2018-06-30 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PreCommit_Java_Cron #49

2018-06-30 Thread Apache Jenkins Server
See 


Changes:

[relax] Fix build.

--
[...truncated 16.61 MB...]
INFO: 2018-06-30T19:46:05.700Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
 with random key
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.731Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.761Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.791Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.823Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop 
key/Values/Map into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.856Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather 
bundles into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop 
key/Values/Map
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.879Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair
 with random key into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather 
bundles
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.910Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.934Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.963Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:05.993Z: Fusing consumer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow
 into 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:06.020Z: Unzipping flatten s13-u58 for input 
s14.org.apache.beam.sdk.values.PCollection.:349#f0cbc4d341b04049-c56
Jun 30, 2018 7:46:11 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-30T19:46:06.052Z: Fusing unzipped copy of 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign,
 through flatten s13-u58, into producer 
WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void 
key/AddKeys/Map
Jun 30, 2018 7:46:11 PM 

Jenkins build is back to normal : beam_PerformanceTests_JDBC #789

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_XmlIOIT #455

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle #123

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Gradle #993

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_AvroIOIT_HDFS #360

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Flink #21

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Direct #24

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #977

2018-06-30 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Spark #20

2018-06-30 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Samza_Gradle #44

2018-06-30 Thread Apache Jenkins Server
See 


Changes:

[relax] Fix build.

--
[...truncated 47.33 MB...]
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Starting stores in task instance Partition 0
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Got non logged storage partition directory as 
/tmp/beam-samza-test/beamStore/Partition_0
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Got logged storage partition directory as 
/tmp/beam-samza-test/beamStore/Partition_0
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Deleting logged storage partition directory 
/tmp/beam-samza-test/beamStore/Partition_0.
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Using non logged storage partition directory: 
/tmp/beam-samza-test/beamStore/Partition_0 for store: beamStore.
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Validating change log streams: Map()
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Got change log stream metadata: Map()
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Assigning oldest change log offsets for taskName Partition 0: Map()
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Starting table manager in task instance Partition 0
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Starting host statistics monitor
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Registering task instances with producers.
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Starting producer multiplexer.
Jun 30, 2018 7:27:22 PM org.apache.samza.util.Logging$class info
INFO: Initializing stream tasks.
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
0-split0_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
0-split0_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
1-split1_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
1-split1_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
2-split2_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
2-split2_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
3-split3_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
3-split3_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
4-split4_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
4-split4_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
5-split5_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
5-split5_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
6-split6_out__PCollection_. Keys will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the value serde for stream 
6-split6_out__PCollection_. Values will not be (de)serialized
Jun 30, 2018 7:27:22 PM org.apache.samza.operators.StreamGraphImpl 
getKVSerdes
INFO: Using NoOpSerde as the key serde for stream 
7-split7_out__PCollection_. Keys will not be 

[jira] [Work logged] (BEAM-4076) Schema followups

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4076?focusedWorklogId=117896=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117896
 ]

ASF GitHub Bot logged work on BEAM-4076:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:40
Start Date: 30/Jun/18 18:40
Worklog Time Spent: 10m 
  Work Description: reuvenlax commented on issue #5545: [BEAM-4076] Import 
Schema branch into master
URL: https://github.com/apache/beam/pull/5545#issuecomment-401558917
 
 
   Fix merged.
   
   On Sat, Jun 30, 2018 at 11:32 AM Reuven Lax  wrote:
   
   > More specifically what happened: it appear that the conflicting PR was
   > merged after regular tests had triggered for this PR but before I had
   > merged my PR. The fact that I made sure to run ValidatesRunner tests before
   > merging my PR ironically caused this, as it widened the window between
   > tests running and PR merging (since it took many hours to run the
   > ValidatesRunner tests).
   >
   > I sent you https://github.com/apache/beam/pull/5845 to fix this.
   >
   > On Sat, Jun 30, 2018 at 11:25 AM Reuven Lax  wrote:
   >
   >> There is a compilation error, introduced by a conflict with
   >> 
https://github.com/apache/beam/commit/34edbd5cc38c1eab0307569da518bceef325e696#diff-6f8f4b5d3d2bc0ef3cc57759b224bc36.Sending
   >> you a PR to fix this.
   >>
   >> On Sat, Jun 30, 2018 at 11:10 AM Reuven Lax  wrote:
   >>
   >>> Looking. I explicitly triggered a bunch of PostCommit tests before
   >>> merging this, so might have been one I missed.
   >>>
   >>> On Sat, Jun 30, 2018 at 11:03 AM Łukasz Gajowy 
   >>> wrote:
   >>>
    I'm afraid after merging this the build started breaking:
   
    
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_GradleBuild/1002/console
   
    Better (more verbose) logs:
    
https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_XmlIOIT/453/console
   
    —
    You are receiving this because you modified the open/close state.
    Reply to this email directly, view it on GitHub
    , or 
mute
    the thread
    

    .
   
   >>>
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117896)
Time Spent: 9h  (was: 8h 50m)

> Schema followups
> 
>
> Key: BEAM-4076
> URL: https://issues.apache.org/jira/browse/BEAM-4076
> Project: Beam
>  Issue Type: Improvement
>  Components: beam-model, dsl-sql, sdk-java-core
>Reporter: Kenneth Knowles
>Priority: Major
>  Time Spent: 9h
>  Remaining Estimate: 0h
>
> This umbrella bug contains subtasks with followups for Beam schemas, which 
> were moved from SQL to the core Java SDK and made to be type-name-based 
> rather than coder based.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4697) Build broken

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4697?focusedWorklogId=117895=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117895
 ]

ASF GitHub Bot logged work on BEAM-4697:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:40
Start Date: 30/Jun/18 18:40
Worklog Time Spent: 10m 
  Work Description: reuvenlax closed pull request #5845: [BEAM-4697] Fix 
build.
URL: https://github.com/apache/beam/pull/5845
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git 
a/runners/core-java/src/main/java/org/apache/beam/runners/core/DoFnRunners.java 
b/runners/core-java/src/main/java/org/apache/beam/runners/core/DoFnRunners.java
index eded0779684..20992013bcb 100644
--- 
a/runners/core-java/src/main/java/org/apache/beam/runners/core/DoFnRunners.java
+++ 
b/runners/core-java/src/main/java/org/apache/beam/runners/core/DoFnRunners.java
@@ -112,7 +112,7 @@
   TupleTag mainOutputTag,
   List> additionalOutputTags,
   StepContext stepContext,
-  @Nullable Coder>> 
inputCoder,
+  @Nullable Coder>> 
inputCoder,
   Map, Coder> outputCoders,
   WindowingStrategy windowingStrategy) {
 return new ProcessFnRunner<>(


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117895)
Time Spent: 0.5h  (was: 20m)

> Build broken
> 
>
> Key: BEAM-4697
> URL: https://issues.apache.org/jira/browse/BEAM-4697
> Project: Beam
>  Issue Type: Bug
>  Components: runner-core
>Reporter: Reuven Lax
>Assignee: Kenneth Knowles
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Caused by a race between two separate PRs being merged.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam] 01/01: Merge pull request #5845: [BEAM-4697] Fix build.

2018-06-30 Thread reuvenlax
This is an automated email from the ASF dual-hosted git repository.

reuvenlax pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit d76402c2575d5b113e0951c3ea059fd1e7f3c66f
Merge: d6a3fae 38ae5a5
Author: reuvenlax 
AuthorDate: Sat Jun 30 11:40:27 2018 -0700

Merge pull request #5845: [BEAM-4697] Fix build.

 .../src/main/java/org/apache/beam/runners/core/DoFnRunners.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)



[beam] branch master updated (d6a3fae -> d76402c)

2018-06-30 Thread reuvenlax
This is an automated email from the ASF dual-hosted git repository.

reuvenlax pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from d6a3fae  Merge pull request #5545: [BEAM-4076] Import Schema branch 
into master
 add 38ae5a5  Fix build.
 new d76402c  Merge pull request #5845: [BEAM-4697] Fix build.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../src/main/java/org/apache/beam/runners/core/DoFnRunners.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)



[jira] [Work logged] (BEAM-4697) Build broken

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4697?focusedWorklogId=117894=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117894
 ]

ASF GitHub Bot logged work on BEAM-4697:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:36
Start Date: 30/Jun/18 18:36
Worklog Time Spent: 10m 
  Work Description: lgajowy commented on issue #5845: [BEAM-4697] Fix build.
URL: https://github.com/apache/beam/pull/5845#issuecomment-401558707
 
 
   Lgtm. Could you merge? I'm afk now...


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117894)
Time Spent: 20m  (was: 10m)

> Build broken
> 
>
> Key: BEAM-4697
> URL: https://issues.apache.org/jira/browse/BEAM-4697
> Project: Beam
>  Issue Type: Bug
>  Components: runner-core
>Reporter: Reuven Lax
>Assignee: Kenneth Knowles
>Priority: Major
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Caused by a race between two separate PRs being merged.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4076) Schema followups

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4076?focusedWorklogId=117893=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117893
 ]

ASF GitHub Bot logged work on BEAM-4076:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:32
Start Date: 30/Jun/18 18:32
Worklog Time Spent: 10m 
  Work Description: reuvenlax commented on issue #5545: [BEAM-4076] Import 
Schema branch into master
URL: https://github.com/apache/beam/pull/5545#issuecomment-401558495
 
 
   More specifically what happened: it appear that the conflicting PR was
   merged after regular tests had triggered for this PR but before I had
   merged my PR. The fact that I made sure to run ValidatesRunner tests before
   merging my PR ironically caused this, as it widened the window between
   tests running and PR merging (since it took many hours to run the
   ValidatesRunner tests).
   
   I sent you https://github.com/apache/beam/pull/5845 to fix this.
   
   On Sat, Jun 30, 2018 at 11:25 AM Reuven Lax  wrote:
   
   > There is a compilation error, introduced by a conflict with
   > 
https://github.com/apache/beam/commit/34edbd5cc38c1eab0307569da518bceef325e696#diff-6f8f4b5d3d2bc0ef3cc57759b224bc36.Sending
   > you a PR to fix this.
   >
   > On Sat, Jun 30, 2018 at 11:10 AM Reuven Lax  wrote:
   >
   >> Looking. I explicitly triggered a bunch of PostCommit tests before
   >> merging this, so might have been one I missed.
   >>
   >> On Sat, Jun 30, 2018 at 11:03 AM Łukasz Gajowy 
   >> wrote:
   >>
   >>> I'm afraid after merging this the build started breaking:
   >>>
   >>> 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_GradleBuild/1002/console
   >>>
   >>> Better (more verbose) logs:
   >>> 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_XmlIOIT/453/console
   >>>
   >>> —
   >>> You are receiving this because you modified the open/close state.
   >>> Reply to this email directly, view it on GitHub
   >>> , or 
mute
   >>> the thread
   >>> 

   >>> .
   >>>
   >>
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117893)
Time Spent: 8h 50m  (was: 8h 40m)

> Schema followups
> 
>
> Key: BEAM-4076
> URL: https://issues.apache.org/jira/browse/BEAM-4076
> Project: Beam
>  Issue Type: Improvement
>  Components: beam-model, dsl-sql, sdk-java-core
>Reporter: Kenneth Knowles
>Priority: Major
>  Time Spent: 8h 50m
>  Remaining Estimate: 0h
>
> This umbrella bug contains subtasks with followups for Beam schemas, which 
> were moved from SQL to the core Java SDK and made to be type-name-based 
> rather than coder based.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4697) Build broken

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4697?focusedWorklogId=117892=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117892
 ]

ASF GitHub Bot logged work on BEAM-4697:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:30
Start Date: 30/Jun/18 18:30
Worklog Time Spent: 10m 
  Work Description: reuvenlax opened a new pull request #5845: [BEAM-4697] 
Fix build.
URL: https://github.com/apache/beam/pull/5845
 
 
   Two conflicting PRs were merged, and due to race conditions both tests 
passed. This PR fixes the build.
   
   R: @lgajowy 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117892)
Time Spent: 10m
Remaining Estimate: 0h

> Build broken
> 
>
> Key: BEAM-4697
> URL: https://issues.apache.org/jira/browse/BEAM-4697
> Project: Beam
>  Issue Type: Bug
>  Components: runner-core
>Reporter: Reuven Lax
>Assignee: Kenneth Knowles
>Priority: Major
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Caused by a race between two separate PRs being merged.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (BEAM-4697) Build broken

2018-06-30 Thread Reuven Lax (JIRA)
Reuven Lax created BEAM-4697:


 Summary: Build broken
 Key: BEAM-4697
 URL: https://issues.apache.org/jira/browse/BEAM-4697
 Project: Beam
  Issue Type: Bug
  Components: runner-core
Reporter: Reuven Lax
Assignee: Kenneth Knowles


Caused by a race between two separate PRs being merged.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4076) Schema followups

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4076?focusedWorklogId=117891=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117891
 ]

ASF GitHub Bot logged work on BEAM-4076:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:26
Start Date: 30/Jun/18 18:26
Worklog Time Spent: 10m 
  Work Description: reuvenlax commented on issue #5545: [BEAM-4076] Import 
Schema branch into master
URL: https://github.com/apache/beam/pull/5545#issuecomment-401558091
 
 
   There is a compilation error, introduced by a conflict with
   
https://github.com/apache/beam/commit/34edbd5cc38c1eab0307569da518bceef325e696#diff-6f8f4b5d3d2bc0ef3cc57759b224bc36.Sending
   you a PR to fix this.
   
   On Sat, Jun 30, 2018 at 11:10 AM Reuven Lax  wrote:
   
   > Looking. I explicitly triggered a bunch of PostCommit tests before merging
   > this, so might have been one I missed.
   >
   > On Sat, Jun 30, 2018 at 11:03 AM Łukasz Gajowy 
   > wrote:
   >
   >> I'm afraid after merging this the build started breaking:
   >>
   >> 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_GradleBuild/1002/console
   >>
   >> Better (more verbose) logs:
   >> 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_XmlIOIT/453/console
   >>
   >> —
   >> You are receiving this because you modified the open/close state.
   >> Reply to this email directly, view it on GitHub
   >> , or mute
   >> the thread
   >> 

   >> .
   >>
   >
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117891)
Time Spent: 8h 40m  (was: 8.5h)

> Schema followups
> 
>
> Key: BEAM-4076
> URL: https://issues.apache.org/jira/browse/BEAM-4076
> Project: Beam
>  Issue Type: Improvement
>  Components: beam-model, dsl-sql, sdk-java-core
>Reporter: Kenneth Knowles
>Priority: Major
>  Time Spent: 8h 40m
>  Remaining Estimate: 0h
>
> This umbrella bug contains subtasks with followups for Beam schemas, which 
> were moved from SQL to the core Java SDK and made to be type-name-based 
> rather than coder based.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4076) Schema followups

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4076?focusedWorklogId=117890=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117890
 ]

ASF GitHub Bot logged work on BEAM-4076:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:10
Start Date: 30/Jun/18 18:10
Worklog Time Spent: 10m 
  Work Description: reuvenlax commented on issue #5545: [BEAM-4076] Import 
Schema branch into master
URL: https://github.com/apache/beam/pull/5545#issuecomment-401557318
 
 
   Looking. I explicitly triggered a bunch of PostCommit tests before merging
   this, so might have been one I missed.
   
   On Sat, Jun 30, 2018 at 11:03 AM Łukasz Gajowy 
   wrote:
   
   > I'm afraid after merging this the build started breaking:
   >
   > 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_GradleBuild/1002/console
   >
   > Better (more verbose) logs:
   > 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_XmlIOIT/453/console
   >
   > —
   > You are receiving this because you modified the open/close state.
   > Reply to this email directly, view it on GitHub
   > , or mute
   > the thread
   > 

   > .
   >
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117890)
Time Spent: 8.5h  (was: 8h 20m)

> Schema followups
> 
>
> Key: BEAM-4076
> URL: https://issues.apache.org/jira/browse/BEAM-4076
> Project: Beam
>  Issue Type: Improvement
>  Components: beam-model, dsl-sql, sdk-java-core
>Reporter: Kenneth Knowles
>Priority: Major
>  Time Spent: 8.5h
>  Remaining Estimate: 0h
>
> This umbrella bug contains subtasks with followups for Beam schemas, which 
> were moved from SQL to the core Java SDK and made to be type-name-based 
> rather than coder based.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-4076) Schema followups

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-4076?focusedWorklogId=117887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117887
 ]

ASF GitHub Bot logged work on BEAM-4076:


Author: ASF GitHub Bot
Created on: 30/Jun/18 18:03
Start Date: 30/Jun/18 18:03
Worklog Time Spent: 10m 
  Work Description: lgajowy commented on issue #5545: [BEAM-4076] Import 
Schema branch into master
URL: https://github.com/apache/beam/pull/5545#issuecomment-401556941
 
 
   I'm afraid after merging this the build started breaking: 
   
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_GradleBuild/1002/console
 
   
   Better (more verbose) logs: 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_XmlIOIT/453/console
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117887)
Time Spent: 8h 20m  (was: 8h 10m)

> Schema followups
> 
>
> Key: BEAM-4076
> URL: https://issues.apache.org/jira/browse/BEAM-4076
> Project: Beam
>  Issue Type: Improvement
>  Components: beam-model, dsl-sql, sdk-java-core
>Reporter: Kenneth Knowles
>Priority: Major
>  Time Spent: 8h 20m
>  Remaining Estimate: 0h
>
> This umbrella bug contains subtasks with followups for Beam schemas, which 
> were moved from SQL to the core Java SDK and made to be type-name-based 
> rather than coder based.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3775) Failure in beam_PostCommit_Java_ValidatesRunner_Dataflow/

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3775?focusedWorklogId=117886=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117886
 ]

ASF GitHub Bot logged work on BEAM-3775:


Author: ASF GitHub Bot
Created on: 30/Jun/18 17:44
Start Date: 30/Jun/18 17:44
Worklog Time Spent: 10m 
  Work Description: ThatRfernand edited a comment on issue #5844: 
[BEAM-3775] Return timeout value to 180
URL: https://github.com/apache/beam/pull/5844#issuecomment-401555885
 
 
   R: @swegner 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117886)
Time Spent: 1h 40m  (was: 1.5h)

> Failure in beam_PostCommit_Java_ValidatesRunner_Dataflow/
> -
>
> Key: BEAM-3775
> URL: https://issues.apache.org/jira/browse/BEAM-3775
> Project: Beam
>  Issue Type: Bug
>  Components: runner-dataflow
>Reporter: María GH
>Assignee: Thomas Groh
>Priority: Major
> Fix For: Not applicable
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> Build timed out (after 120 minutes). Marking the build as aborted.
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/5070/
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3775) Failure in beam_PostCommit_Java_ValidatesRunner_Dataflow/

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3775?focusedWorklogId=117885=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117885
 ]

ASF GitHub Bot logged work on BEAM-3775:


Author: ASF GitHub Bot
Created on: 30/Jun/18 17:43
Start Date: 30/Jun/18 17:43
Worklog Time Spent: 10m 
  Work Description: ThatRfernand commented on issue #5844: [BEAM-3775] 
Return timeout value to 180
URL: https://github.com/apache/beam/pull/5844#issuecomment-401555885
 
 
   @swegner Please review this change.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117885)
Time Spent: 1.5h  (was: 1h 20m)

> Failure in beam_PostCommit_Java_ValidatesRunner_Dataflow/
> -
>
> Key: BEAM-3775
> URL: https://issues.apache.org/jira/browse/BEAM-3775
> Project: Beam
>  Issue Type: Bug
>  Components: runner-dataflow
>Reporter: María GH
>Assignee: Thomas Groh
>Priority: Major
> Fix For: Not applicable
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Build timed out (after 120 minutes). Marking the build as aborted.
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/5070/
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3079) Samza runner

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3079?focusedWorklogId=117871=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117871
 ]

ASF GitHub Bot logged work on BEAM-3079:


Author: ASF GitHub Bot
Created on: 30/Jun/18 15:55
Start Date: 30/Jun/18 15:55
Worklog Time Spent: 10m 
  Work Description: xinyuiscool edited a comment on issue #471: 
[BEAM-3079]: Samza Runner docs and capability matrix
URL: https://github.com/apache/beam-site/pull/471#issuecomment-401548761
 
 
   Thanks. It wasn't intended to make Samza logo huge compared to other runners 
:). Just saw you already put up a fix for them. Thanks a lot for the help!


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117871)
Time Spent: 5h 10m  (was: 5h)

> Samza runner
> 
>
> Key: BEAM-3079
> URL: https://issues.apache.org/jira/browse/BEAM-3079
> Project: Beam
>  Issue Type: Wish
>  Components: runner-samza
>Reporter: Xinyu Liu
>Assignee: Kenneth Knowles
>Priority: Major
> Fix For: Not applicable
>
>  Time Spent: 5h 10m
>  Remaining Estimate: 0h
>
> Apache Samza is a distributed data-processing platform which supports both 
> stream and batch processing. It'll be awesome if we can run BEAM's advanced 
> data transform and multi-language sdks on top of Samza.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3761) Fix Python 3 cmp function

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3761?focusedWorklogId=117870=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117870
 ]

ASF GitHub Bot logged work on BEAM-3761:


Author: ASF GitHub Bot
Created on: 30/Jun/18 15:47
Start Date: 30/Jun/18 15:47
Worklog Time Spent: 10m 
  Work Description: cclauss edited a comment on issue #5843: [BEAM-3761] 
Define cmp() in Python 3
URL: https://github.com/apache/beam/pull/5843#issuecomment-401548830
 
 
   Agreed.  When I thought about centralizing it but the three files are not 
near each other in the hierarchy (io, testing, transforms) but I suppose we 
could do something like __from apache_beam.utils.compat import cmp__  It also 
stuck me as a bit weird (in legacy Python) to import a _builtin_ from another 
file so that made the try/except block essential which in turn means that just 
_one line per file_ is actually saved.  I will make the change if that seems 
like the best approach.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117870)
Time Spent: 8h 50m  (was: 8h 40m)

> Fix Python 3 cmp function
> -
>
> Key: BEAM-3761
> URL: https://issues.apache.org/jira/browse/BEAM-3761
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: holdenk
>Priority: Major
>  Time Spent: 8h 50m
>  Remaining Estimate: 0h
>
> Various functions don't exist in Python 3 that did in python 2. This Jira is 
> to fix the use of cmp (which often will involve rewriting __cmp__ as well).
>  
> Note: there are existing PRs for basestring and unicode ( 
> [https://github.com/apache/beam/pull/4697|https://github.com/apache/beam/pull/4697,]
>  , [https://github.com/apache/beam/pull/4730] )
>  
> Note once all of the missing names/functions are fixed we can enable F821 in 
> falke8 python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3761) Fix Python 3 cmp function

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3761?focusedWorklogId=117869=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117869
 ]

ASF GitHub Bot logged work on BEAM-3761:


Author: ASF GitHub Bot
Created on: 30/Jun/18 15:46
Start Date: 30/Jun/18 15:46
Worklog Time Spent: 10m 
  Work Description: cclauss edited a comment on issue #5843: [BEAM-3761] 
Define cmp() in Python 3
URL: https://github.com/apache/beam/pull/5843#issuecomment-401548830
 
 
   Agreed.  When I thought about centralizing it but the three files are not 
near each other in the hierarchy (io, testing, transforms) but I suppose we 
could do something like __from apache_beam.utils.compat import cmp__  It also 
stuck me as a bit weird (in legacy Python) to import a _builtin_ from another 
file so that made the try/except block essential which then means that one _one 
line per file_ is actually saved.  I will make the change if that seems like 
the best approach.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117869)
Time Spent: 8h 40m  (was: 8.5h)

> Fix Python 3 cmp function
> -
>
> Key: BEAM-3761
> URL: https://issues.apache.org/jira/browse/BEAM-3761
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: holdenk
>Priority: Major
>  Time Spent: 8h 40m
>  Remaining Estimate: 0h
>
> Various functions don't exist in Python 3 that did in python 2. This Jira is 
> to fix the use of cmp (which often will involve rewriting __cmp__ as well).
>  
> Note: there are existing PRs for basestring and unicode ( 
> [https://github.com/apache/beam/pull/4697|https://github.com/apache/beam/pull/4697,]
>  , [https://github.com/apache/beam/pull/4730] )
>  
> Note once all of the missing names/functions are fixed we can enable F821 in 
> falke8 python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3761) Fix Python 3 cmp function

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3761?focusedWorklogId=117868=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117868
 ]

ASF GitHub Bot logged work on BEAM-3761:


Author: ASF GitHub Bot
Created on: 30/Jun/18 15:45
Start Date: 30/Jun/18 15:45
Worklog Time Spent: 10m 
  Work Description: cclauss commented on issue #5843: [BEAM-3761] Define 
cmp() in Python 3
URL: https://github.com/apache/beam/pull/5843#issuecomment-401548830
 
 
   Agreed.  When I thought about centralizing it but the three files are not 
near each other in the hierarchy (io, testing, transforms) but I suppose we 
could do something like __from from apache_beam.utils.compat import cmp__  It 
also stuck me as a bit weird (in legacy Python) to import a _builtin_ from 
another file so that made the try/except block essential which then means that 
one _one line per file_ is actually saved.  I will make the change if that 
seems like the best approach.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117868)
Time Spent: 8.5h  (was: 8h 20m)

> Fix Python 3 cmp function
> -
>
> Key: BEAM-3761
> URL: https://issues.apache.org/jira/browse/BEAM-3761
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-core
>Reporter: holdenk
>Priority: Major
>  Time Spent: 8.5h
>  Remaining Estimate: 0h
>
> Various functions don't exist in Python 3 that did in python 2. This Jira is 
> to fix the use of cmp (which often will involve rewriting __cmp__ as well).
>  
> Note: there are existing PRs for basestring and unicode ( 
> [https://github.com/apache/beam/pull/4697|https://github.com/apache/beam/pull/4697,]
>  , [https://github.com/apache/beam/pull/4730] )
>  
> Note once all of the missing names/functions are fixed we can enable F821 in 
> falke8 python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work logged] (BEAM-3079) Samza runner

2018-06-30 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-3079?focusedWorklogId=117867=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117867
 ]

ASF GitHub Bot logged work on BEAM-3079:


Author: ASF GitHub Bot
Created on: 30/Jun/18 15:44
Start Date: 30/Jun/18 15:44
Worklog Time Spent: 10m 
  Work Description: xinyuiscool commented on issue #471: [BEAM-3079]: Samza 
Runner docs and capability matrix
URL: https://github.com/apache/beam-site/pull/471#issuecomment-401548761
 
 
   Thanks. It wasn't intended to make Samza logo huge compared to other runners 
:). I will try to open another pr today to make it smaller.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 117867)
Time Spent: 5h  (was: 4h 50m)

> Samza runner
> 
>
> Key: BEAM-3079
> URL: https://issues.apache.org/jira/browse/BEAM-3079
> Project: Beam
>  Issue Type: Wish
>  Components: runner-samza
>Reporter: Xinyu Liu
>Assignee: Kenneth Knowles
>Priority: Major
> Fix For: Not applicable
>
>  Time Spent: 5h
>  Remaining Estimate: 0h
>
> Apache Samza is a distributed data-processing platform which supports both 
> stream and batch processing. It'll be awesome if we can run BEAM's advanced 
> data transform and multi-language sdks on top of Samza.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Build failed in Jenkins: beam_PerformanceTests_MongoDBIO_IT #376

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 193.47 KB...]
Build cache key for task 
':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar' is 
b6b8d0b6ea2409acc29e48d059c4394e
Caching disabled for task 
':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar' 
as it is up-to-date.
:beam-sdks-java-extensions-google-cloud-platform-core:shadowJar (Thread[Task 
worker for ':' Thread 6,5,main]) completed. Took 0.007 secs.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 6,5,main]) started.

> Task :beam-runners-core-construction-java:compileJava UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:compileJava' is 
3d11783a7db4caaabab8ee55ede506fd
Skipping task ':beam-runners-core-construction-java:compileJava' as it is 
up-to-date.
:beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' 
Thread 13,5,main]) completed. Took 0.057 secs.
:beam-runners-core-construction-java:classes (Thread[Task worker for ':' Thread 
13,5,main]) started.

> Task :beam-runners-core-construction-java:classes UP-TO-DATE
Skipping task ':beam-runners-core-construction-java:classes' as it has no 
actions.
:beam-runners-core-construction-java:classes (Thread[Task worker for ':' Thread 
13,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 13,5,main]) started.

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
10463e05429ab101b83c54f386d1a8a0
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 13,5,main]) completed. Took 0.011 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
13,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 046bc87b4024220dc06d87f732258a15
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 6,5,main]) completed. Took 0.08 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 6,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 6,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 6,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
6e95ac6bbffb5f3bd97ec383b42cd402
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
3,5,main]) completed. Took 0.253 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
3,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
3,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 3,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 3,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
3,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is a5e35df30946f3bbfcd64fca0d549b25
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***

Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS #78

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 218.19 KB...]
> Task :beam-sdks-java-io-parquet:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
12,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
8,5,main]) started.

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
6c9be587d3be8d74d49979e44c8b131f
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 7,5,main]) completed. Took 0.01 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
7,5,main]) started.

> Task :beam-sdks-java-io-hadoop-file-system:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowJar' is 
f48535d4d8e5e8ef1c36181ba1937656
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowJar' as it is 
up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[Task worker for ':' 
Thread 9,5,main]) completed. Took 0.007 secs.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
23e6c6df602a718e3be81016384240fc
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
8,5,main]) completed. Took 0.01 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is bccc786102701abfa48f2784ee3b8c1c
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[main,5,main]) 
completed. Took 0.095 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[main,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[main,5,main]) 
completed. Took 0.001 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[main,5,main]) 
started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
402156e6cd0e4989200dfceb622c44f8
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 0.636 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
10,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 10,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 10,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
10,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is ea731583fcc5dda3c0a9dbfa2ed45868
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[main,5,main]) 
completed. Took 0.75 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[main,5,main]) 
started.

> Task :beam-runners-core-java:compileJava
Build cache key for task ':beam-runners-core-java:compileJava' is 

Build failed in Jenkins: beam_PerformanceTests_Compressed_TextIOIT_HDFS #360

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 222.91 KB...]
:beam-sdks-java-extensions-google-cloud-platform-core:shadowJar (Thread[Task 
worker for ':' Thread 4,5,main]) completed. Took 0.009 secs.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 14,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
039164949d770ef46b59f4558f24a9d4
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
13,5,main]) completed. Took 0.011 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 917b5fb4794e8269e0dea815e397521b
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 14,5,main]) completed. Took 0.071 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 14,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 14,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 14,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
257f4df6edffe52fed43ba1cf542e048
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
5,5,main]) completed. Took 0.563 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
5,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
5,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 5,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 5,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
5,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 1fdd8953b38846143487e497e45651e2
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 14,5,main]) completed. Took 0.716 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 14,5,main]) started.

> Task :beam-runners-google-cloud-dataflow-java:compileJava FROM-CACHE
Build cache key for task ':beam-runners-google-cloud-dataflow-java:compileJava' 
is 546e07e9266f475043be792d72940f21
Task ':beam-runners-google-cloud-dataflow-java:compileJava' is not up-to-date 
because:
  No history is available.
Custom actions are attached to task 
':beam-runners-google-cloud-dataflow-java:compileJava'.
Origin for task ':beam-runners-google-cloud-dataflow-java:compileJava': 
{executionTime=7792, hostName=apache-beam-jenkins-slave-group-rjdl, 
operatingSystem=Linux, buildInvocationId=3if3uhtatbcgvocuqbb7sbdqxu, 
creationTime=1530371529729, 
type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, 
gradleVersion=4.8, 
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TFRecordIOIT/src,
 path=:beam-runners-google-cloud-dataflow-java:compileJava}
Unpacked output for task ':beam-runners-google-cloud-dataflow-java:compileJava' 
from cache.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 14,5,main]) completed. Took 0.362 secs.

Build failed in Jenkins: beam_PerformanceTests_XmlIOIT_HDFS #359

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 218.51 KB...]
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
13,5,main]) started.

> Task :beam-sdks-java-io-hadoop-file-system:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-hadoop-file-system:classes' as it has no 
actions.
:beam-sdks-java-io-hadoop-file-system:classes (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.003 secs.

> Task :beam-sdks-java-io-parquet:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.004 secs.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) started.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-hadoop-file-system:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowJar' is 
4a8bba445776069134cfdb42c71d1f5a
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowJar' as it is 
up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.005 secs.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
449575502d74fdfb880f0abe7f7097ea
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.011 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 917b5fb4794e8269e0dea815e397521b
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 7,5,main]) completed. Took 0.083 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 7,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 7,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 7,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
257f4df6edffe52fed43ba1cf542e048
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.621 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 2,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 2,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 76f3ff6f6c0d8063beed06ed6f075201
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 7,5,main]) completed. Took 0.759 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 7,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task 

Build failed in Jenkins: beam_PerformanceTests_Compressed_TextIOIT #685

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 198.39 KB...]

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
26a0e5fb0ec902254f28f92a7de3617f
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 6,5,main]) completed. Took 0.009 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
530ca93853f8b044c2993d29189107e7
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
14,5,main]) completed. Took 0.01 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is adcc7b71f6e80f47e53d2f4c1ce3c5de
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':',5,main]) completed. Took 0.065 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 12,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
bfe9f8f0541cd3c7f803e00b622f0f3b
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.571 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 2,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 2,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is afcbfc6602fe61a33e49de52083baa0d
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.695 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 12,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task ':beam-runners-core-java:compileJava' is 
6b1f90b858e8e73577e621051697a930
Task ':beam-runners-core-java:compileJava' is not up-to-date because:
  Task has failed previously.
Custom actions are attached to task ':beam-runners-core-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-runners-core-java:compileJava FAILED
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 4.896 secs.

> Task :beam-sdks-java-core:shadowTestJar
Build cache key for task ':beam-sdks-java-core:shadowTestJar' is 
74bd323ebca089f1ceb1ac281b500de5
Caching disabled for task 

Build failed in Jenkins: beam_PerformanceTests_AvroIOIT #690

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 202.10 KB...]

> Task :beam-sdks-java-io-parquet:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':',5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':',5,main]) 
started.

> Task :beam-sdks-java-fn-execution:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-fn-execution:shadowJar' is 
dfceae51da49feddb65eccb65521e1f1
Caching disabled for task ':beam-sdks-java-fn-execution:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-fn-execution:shadowJar' as it is up-to-date.
:beam-sdks-java-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
4,5,main]) completed. Took 0.006 secs.

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
6148e25f96e01d7bd4f213c5b890c2fc
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 15,5,main]) completed. Took 0.006 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
15,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
6e432fd1eb1f9bb5e1a8651f4fba4032
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':',5,main]) 
completed. Took 0.009 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is adcc7b71f6e80f47e53d2f4c1ce3c5de
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 11,5,main]) completed. Took 0.056 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 11,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 11,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 11,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
bfe9f8f0541cd3c7f803e00b622f0f3b
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
9,5,main]) completed. Took 0.472 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 6,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 6,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 6f04ec2ba9ccdf1871169113269cbd59
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 11,5,main]) completed. Took 0.629 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 11,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build 

Build failed in Jenkins: beam_PerformanceTests_TextIOIT_HDFS #370

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 212.34 KB...]
> Task :beam-sdks-java-io-parquet:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:compileJava' is 
a5e39021fa62782fd44f5225eeaf
Skipping task ':beam-sdks-java-io-parquet:compileJava' as it is up-to-date.
:beam-sdks-java-io-parquet:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.119 secs.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[Task worker for ':' 
Thread 5,5,main]) started.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-parquet:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-hadoop-file-system:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowJar' is 
fa16e949197bd86174dc4a865eaab6f6
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowJar' as it is 
up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[Task worker for ':' 
Thread 5,5,main]) completed. Took 0.005 secs.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
e730704738dc3fcf31dadca0908ea28b
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.011 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 917b5fb4794e8269e0dea815e397521b
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 8,5,main]) completed. Took 0.071 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 8,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 8,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 9,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
257f4df6edffe52fed43ba1cf542e048
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':',5,main]) 
completed. Took 0.292 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':',5,main]) 
started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':',5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':',5,main]) started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':',5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':',5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 580c598238747b5e9008417f16cd4785
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 9,5,main]) completed. Took 0.645 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 9,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task 

Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat #459

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 204.46 KB...]
:beam-sdks-java-core:processTestResources (Thread[main,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[main,5,main]) completed. Took 
0.001 secs.
:beam-sdks-java-core:testClasses (Thread[main,5,main]) started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[main,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
12,5,main]) started.

> Task :beam-sdks-java-io-hadoop-common:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-common:compileJava' is 
04ff7c7c7b2a569b48a998a24b7b6bee
Skipping task ':beam-sdks-java-io-hadoop-common:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-hadoop-common:compileJava (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 0.635 secs.
:beam-sdks-java-io-hadoop-common:classes (Thread[Task worker for ':' Thread 
10,5,main]) started.

> Task :beam-sdks-java-io-hadoop-common:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-hadoop-common:classes' as it has no actions.
:beam-sdks-java-io-hadoop-common:classes (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-hadoop-common:shadowJar (Thread[Task worker for ':' Thread 
10,5,main]) started.

> Task :beam-sdks-java-io-hadoop-common:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-common:shadowJar' is 
e9f951b01c25c2686f5141c6908c0cc8
Caching disabled for task ':beam-sdks-java-io-hadoop-common:shadowJar': Caching 
has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-common:shadowJar' as it is up-to-date.
:beam-sdks-java-io-hadoop-common:shadowJar (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 0.011 secs.
:beam-sdks-java-io-hadoop-input-format:compileJava (Thread[Task worker for ':' 
Thread 10,5,main]) started.

> Task :beam-sdks-java-io-hadoop-input-format:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-input-format:compileJava' 
is e789611ec3f05bbb1aa0d89debc7d6e6
Skipping task ':beam-sdks-java-io-hadoop-input-format:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-hadoop-input-format:compileJava (Thread[Task worker for ':' 
Thread 10,5,main]) completed. Took 0.037 secs.
:beam-sdks-java-io-hadoop-input-format:classes (Thread[Task worker for ':' 
Thread 10,5,main]) started.

> Task :beam-sdks-java-io-hadoop-input-format:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-hadoop-input-format:classes' as it has no 
actions.
:beam-sdks-java-io-hadoop-input-format:classes (Thread[Task worker for ':' 
Thread 10,5,main]) completed. Took 0.0 secs.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 27fd847681754dfecdbe59b92afebaa0
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 14,5,main]) completed. Took 0.734 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 14,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task ':beam-runners-core-java:compileJava' is 
6854cdc8a2d8b63700487aeeb012eae9
Task ':beam-runners-core-java:compileJava' is not up-to-date because:
  Task has failed previously.
Custom actions are attached to task ':beam-runners-core-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-runners-core-java:compileJava FAILED
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
3,5,main]) completed. Took 4.944 secs.

> Task :beam-sdks-java-core:shadowTestJar
Build cache key for task ':beam-sdks-java-core:shadowTestJar' is 
3415d132c4cff97832fc3e1513e70861
Caching disabled for task ':beam-sdks-java-core:shadowTestJar': Caching has not 
been enabled for the task
Task ':beam-sdks-java-core:shadowTestJar' is not up-to-date because:
  No history is available.

> Task 

Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT #183

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 196.72 KB...]

> Task :beam-sdks-java-io-parquet:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:compileJava' is 
6c0103eb6f7029eeeda327d4bde7116c
Skipping task ':beam-sdks-java-io-parquet:compileJava' as it is up-to-date.
:beam-sdks-java-io-parquet:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.077 secs.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-parquet:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.0 secs.

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
285f58aefff9749cfde503c63f75abb3
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 3,5,main]) completed. Took 0.008 secs.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) started.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
3,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
ab3c5247e8194a68a9819bb6b8f2c9e1
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.011 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is bccc786102701abfa48f2784ee3b8c1c
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 5,5,main]) completed. Took 0.067 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 7,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 7,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 7,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
402156e6cd0e4989200dfceb622c44f8
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
11,5,main]) completed. Took 0.581 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
11,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 11,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 11,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 5168c679df06330b56274986fb768139
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 7,5,main]) completed. Took 0.781 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 7,5,main]) started.

> Task 

Build failed in Jenkins: beam_PerformanceTests_TextIOIT #702

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 196.19 KB...]
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 13,5,main]) completed. Took 0.012 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
13,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
df4c13b739017516b80e32221120f26c
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
5,5,main]) completed. Took 0.012 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 917b5fb4794e8269e0dea815e397521b
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 3,5,main]) completed. Took 0.109 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 8,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 8,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 8,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
257f4df6edffe52fed43ba1cf542e048
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 0.716 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
7,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
7,5,main]) completed. Took 0.002 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 7,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 7,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
7,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is f9dbbe355d1302bd15400341d5d65229
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 8,5,main]) completed. Took 0.945 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 8,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task ':beam-runners-core-java:compileJava' is 
d3d98f30f7c32844ac0a86a4722b5647
Task ':beam-runners-core-java:compileJava' is not up-to-date because:
  Task has failed previously.
Custom actions are attached to task ':beam-runners-core-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-runners-core-java:compileJava FAILED
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
13,5,main]) completed. Took 6.754 secs.

> Task :beam-sdks-java-core:shadowTestJar
Build cache key for task ':beam-sdks-java-core:shadowTestJar' is 
148d9182960b24aa2e885bd5a27b885a
Caching disabled for task ':beam-sdks-java-core:shadowTestJar': Caching has not 
been enabled for the task
Task ':beam-sdks-java-core:shadowTestJar' is not up-to-date because:
  No history is available.

> Task 

Build failed in Jenkins: beam_PerformanceTests_TFRecordIOIT #683

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 197.75 KB...]
Caching disabled for task 
':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar' 
as it is up-to-date.
:beam-sdks-java-extensions-google-cloud-platform-core:shadowJar (Thread[Task 
worker for ':' Thread 12,5,main]) completed. Took 0.008 secs.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 12,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
21ebdee57505936e844a9ce391d6e786
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.01 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 917b5fb4794e8269e0dea815e397521b
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 12,5,main]) completed. Took 0.088 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 12,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
257f4df6edffe52fed43ba1cf542e048
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
7,5,main]) completed. Took 0.604 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 2,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 2,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
7,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 50e06491d255d7f6e0e2e42609f7f2a3
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.731 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':' Thread 12,5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task ':beam-runners-core-java:compileJava' is 
d3d98f30f7c32844ac0a86a4722b5647
Task ':beam-runners-core-java:compileJava' is not up-to-date because:
  Task has failed previously.
Custom actions are attached to task ':beam-runners-core-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-runners-core-java:compileJava FAILED
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 5.429 secs.

> Task :beam-sdks-java-core:shadowTestJar
Build cache key for task ':beam-sdks-java-core:shadowTestJar' is 
5803c1114146965b7fdc3a8569d0bb66
Caching disabled for task ':beam-sdks-java-core:shadowTestJar': Caching has not 
been enabled for the task
Task ':beam-sdks-java-core:shadowTestJar' 

Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #359

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 208.96 KB...]
> Task :beam-sdks-java-io-hadoop-file-system:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-hadoop-file-system:classes' as it has no 
actions.
:beam-sdks-java-io-hadoop-file-system:classes (Thread[Task worker for ':' 
Thread 4,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[main,5,main]) started.

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
ff51588d011823659299fc368aa2af4e
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 12,5,main]) completed. Took 0.012 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
12,5,main]) started.

> Task :beam-sdks-java-io-hadoop-file-system:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-hadoop-file-system:shadowJar' is 
9e818f0fa73464426dd2df9e7993042c
Caching disabled for task ':beam-sdks-java-io-hadoop-file-system:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-sdks-java-io-hadoop-file-system:shadowJar' as it is 
up-to-date.
:beam-sdks-java-io-hadoop-file-system:shadowJar (Thread[main,5,main]) 
completed. Took 0.006 secs.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
35b275e4c7f496dca862ea8fc2a0bf0c
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
8,5,main]) completed. Took 0.01 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 3a9abc3c32e52abfb0dfa4d14a770023
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 13,5,main]) completed. Took 0.072 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 13,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 13,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 13,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
cb007917a3cdf9d0334661da4546464e
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
11,5,main]) completed. Took 0.574 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
11,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 11,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 11,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 498437b27c7c05af043568455a8e3b13
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 13,5,main]) completed. Took 0.656 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 

Build failed in Jenkins: beam_PerformanceTests_JDBC #788

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 183.83 KB...]
Build cache key for task 
':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar' is 
376e0a433bdeb5e3e2ecd7b8b488dc33
Caching disabled for task 
':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-extensions-google-cloud-platform-core:shadowJar' 
as it is up-to-date.
:beam-sdks-java-extensions-google-cloud-platform-core:shadowJar (Thread[Task 
worker for ':' Thread 5,5,main]) completed. Took 0.006 secs.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 5,5,main]) started.

> Task :beam-runners-core-construction-java:compileJava UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:compileJava' is 
71d84e66325742a1b8b0088d32824293
Skipping task ':beam-runners-core-construction-java:compileJava' as it is 
up-to-date.
:beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' 
Thread 11,5,main]) completed. Took 0.061 secs.
:beam-runners-core-construction-java:classes (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-runners-core-construction-java:classes UP-TO-DATE
Skipping task ':beam-runners-core-construction-java:classes' as it has no 
actions.
:beam-runners-core-construction-java:classes (Thread[Task worker for ':' Thread 
11,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 11,5,main]) started.

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
0b69268e0fea7b91e1b08068842f19e0
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 11,5,main]) completed. Took 0.009 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 3169da7d4f24cec43dc827324f32a2ce
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 5,5,main]) completed. Took 0.067 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 5,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 5,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' 
Thread 5,5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
bf3c24730ea24394396764587a6427ba
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':',5,main]) 
completed. Took 0.494 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':',5,main]) 
started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':',5,main]) 
completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':',5,main]) started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':',5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is a96646de51d9d5abf95c23dc758d2f6f
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for 

Build failed in Jenkins: beam_PreCommit_Java_Cron #48

2018-06-30 Thread Apache Jenkins Server
See 

--
[...truncated 2.57 MB...]
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit3762410446228983028/output/.temp-beam-2018-06-30_15-07-45-5/ae61809a-9b5f-4b37-8d2c-f2c0e7862cf2
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Opening empty writer fce45337-4c85-4c1c-9c91-23e9ca214771 for 
destination null
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit3762410446228983028/output/.temp-beam-2018-06-30_15-07-45-5/fce45337-4c85-4c1c-9c91-23e9ca214771
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Opening empty writer db517aad-a4b8-49e5-a773-09c325718932 for 
destination null
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit3762410446228983028/output/.temp-beam-2018-06-30_15-07-45-5/db517aad-a4b8-49e5-a773-09c325718932
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Opening empty writer ddcf6242-0737-4c17-995a-a2b7eeca00ef for 
destination null
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit3762410446228983028/output/.temp-beam-2018-06-30_15-07-45-5/ddcf6242-0737-4c17-995a-a2b7eeca00ef

org.apache.beam.sdk.io.FileBasedSinkTest > testFinalizeMultipleCalls 
STANDARD_ERROR
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Finalizing for destination null num shards 3.
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/0,
 shard=0, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit7315791711227148920/output/file-00-of-03.test
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/1,
 shard=1, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit7315791711227148920/output/file-01-of-03.test
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/2,
 shard=2, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit7315791711227148920/output/file-02-of-03.test
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
removeTemporaryFiles
INFO: Will remove known temporary file 
/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/2
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
removeTemporaryFiles
INFO: Will remove known temporary file 
/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/1
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
removeTemporaryFiles
INFO: Will remove known temporary file 
/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/0
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Finalizing for destination null num shards 3.
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/0,
 shard=0, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit7315791711227148920/output/file-00-of-03.test
Jun 30, 2018 3:07:45 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit7315791711227148920/tmp/junit7315791711227148920/temp/1,
 shard=1, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final 

Build failed in Jenkins: beam_PerformanceTests_XmlIOIT #454

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 201.17 KB...]

> Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE
Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 
44f633177d6486136546c17d03f1d64c
Caching disabled for task ':beam-runners-core-construction-java:shadowJar': 
Caching has not been enabled for the task
Skipping task ':beam-runners-core-construction-java:shadowJar' as it is 
up-to-date.
:beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' 
Thread 3,5,main]) completed. Took 0.019 secs.
:beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 
3,5,main]) started.

> Task :beam-sdks-java-io-parquet:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:compileJava' is 
31e8eb4f58042d0487bdccc9594190e3
Skipping task ':beam-sdks-java-io-parquet:compileJava' as it is up-to-date.
:beam-sdks-java-io-parquet:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.11 secs.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-parquet:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions.
:beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is 
13439ee61484ae12f3d1cb1a184c01db
Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has 
not been enabled for the task
Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date.
:beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.014 secs.

> Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' 
is 3169da7d4f24cec43dc827324f32a2ce
Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is 
up-to-date.
:beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for 
':' Thread 8,5,main]) completed. Took 0.107 secs.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 4,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE
Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no 
actions.
:beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' 
Thread 4,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for 
':',5,main]) started.

> Task :beam-sdks-java-core:compileTestJava UP-TO-DATE
Build cache key for task ':beam-sdks-java-core:compileTestJava' is 
bf3c24730ea24394396764587a6427ba
Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
12,5,main]) completed. Took 0.666 secs.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
12,5,main]) started.

> Task :beam-sdks-java-core:processTestResources NO-SOURCE
file or directory 
'
 not found
Skipping task ':beam-sdks-java-core:processTestResources' as it has no source 
files and no previous output files.
:beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 
12,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 12,5,main]) 
started.

> Task :beam-sdks-java-core:testClasses UP-TO-DATE
Skipping task ':beam-sdks-java-core:testClasses' as it has no actions.
:beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 12,5,main]) 
completed. Took 0.0 secs.
:beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 
12,5,main]) started.

> Task :beam-sdks-java-io-google-cloud-platform:shadowJar
Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' 
is 7356465472f1b4a50b88693b4b9d3efc
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': 
Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date 
because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 1 (includes project)
Total Time: 0.0s [0ms]
Average Time/Jar: 0.0s [0.0ms]
***
:beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for 
':',5,main]) completed. Took 0.807 secs.
:beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for 
':',5,main]) started.

> Task :beam-runners-core-java:compileJava
Build cache key for task 

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #1003

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 2.51 MB...]
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit596308109752303/output/.temp-beam-2018-06-30_15-06-36-5/62a6c4ab-4a5c-47d2-a8b2-935bb12934f4
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Opening empty writer d66e3101-3943-43be-a04e-aad01fea850b for 
destination null
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit596308109752303/output/.temp-beam-2018-06-30_15-06-36-5/d66e3101-3943-43be-a04e-aad01fea850b
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Opening empty writer 9ec3db92-bf2c-4fef-be04-8ebe51a6a438 for 
destination null
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit596308109752303/output/.temp-beam-2018-06-30_15-06-36-5/9ec3db92-bf2c-4fef-be04-8ebe51a6a438
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Opening empty writer daf39221-3397-485a-9a8e-46debca6c62a for 
destination null
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file 
/tmp/junit596308109752303/output/.temp-beam-2018-06-30_15-06-36-5/daf39221-3397-485a-9a8e-46debca6c62a

org.apache.beam.sdk.io.FileBasedSinkTest > testFinalizeMultipleCalls 
STANDARD_ERROR
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Finalizing for destination null num shards 3.
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/0,
 shard=0, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit2827908436174738572/output/file-00-of-03.test
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/1,
 shard=1, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit2827908436174738572/output/file-01-of-03.test
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/2,
 shard=2, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit2827908436174738572/output/file-02-of-03.test
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
removeTemporaryFiles
INFO: Will remove known temporary file 
/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/0
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
removeTemporaryFiles
INFO: Will remove known temporary file 
/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/2
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
removeTemporaryFiles
INFO: Will remove known temporary file 
/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/1
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
createMissingEmptyShards
INFO: Finalizing for destination null num shards 3.
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/0,
 shard=0, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to final location 
/tmp/junit2827908436174738572/output/file-00-of-03.test
Jun 30, 2018 3:06:36 PM org.apache.beam.sdk.io.FileBasedSink$WriteOperation 
moveToOutputFiles
INFO: Will copy temporary file 
FileResult{tempFilename=/tmp/junit2827908436174738572/tmp/junit2827908436174738572/temp/1,
 shard=1, 
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@5bf5afcd, 
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, 
onTimeIndex=0}} to 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex_Gradle #923

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 58.78 KB...]
Resolving artifact: [group:io.grpc, name:protoc-gen-grpc-java, version:1.2.0, 
classifier:linux-x86_64, ext:exe]
Resolved artifact: 
/home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe
Resolving artifact: [group:com.google.protobuf, name:protoc, version:3.2.0, 
classifier:linux-x86_64, ext:exe]
Resolved artifact: 
/home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe
[/home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe,
 
-I
 
-I
 
-I
 
--java_out=
 
--grpc_out=
 
--plugin=protoc-gen-grpc=/home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe,
 

 

protoc: stdout: . stderr: 
:beam-model-fn-execution:generateProto (Thread[Task worker for ':',5,main]) 
completed. Took 0.16 secs.
:beam-model-fn-execution:compileJava (Thread[Task worker for ':',5,main]) 
started.

> Task :beam-model-job-management:compileJava FROM-CACHE
file or directory 
'
 not found
file or directory 
'
 not found
Build cache key for task ':beam-model-job-management:compileJava' is 
b5ee5c6a0b460e6d9d0893963f757ec4
Task ':beam-model-job-management:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-model-job-management:compileJava'.
Origin for task ':beam-model-job-management:compileJava': {executionTime=3912, 
hostName=apache-beam-jenkins-slave-group-q3x9, operatingSystem=Linux, 
buildInvocationId=upytv7fn5nb65fltwmrqv6mkoi, creationTime=1530198828519, 
type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, 
gradleVersion=4.8, 
rootPath=
 path=:beam-model-job-management:compileJava}
Unpacked output for task ':beam-model-job-management:compileJava' from cache.
:beam-model-job-management:compileJava (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.212 secs.
:beam-model-job-management:classes (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-model-job-management:classes
Skipping task ':beam-model-job-management:classes' as it has no actions.
:beam-model-job-management:classes (Thread[Task worker for ':' Thread 
2,5,main]) completed. Took 0.0 secs.
:beam-model-job-management:shadowJar (Thread[Task worker for ':' Thread 
2,5,main]) started.

> Task :beam-model-fn-execution:compileJava FROM-CACHE
file or directory 
'
 not found
file or directory 
'
 not found
Build cache key for task ':beam-model-fn-execution:compileJava' is 
de10edcb1322c7b7ab6acf69a8aec536
Task ':beam-model-fn-execution:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-model-fn-execution:compileJava'.
Origin for task ':beam-model-fn-execution:compileJava': {executionTime=6564, 
hostName=apache-beam-jenkins-slave-group-q3x9, operatingSystem=Linux, 
buildInvocationId=upytv7fn5nb65fltwmrqv6mkoi, creationTime=1530198831312, 
type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, 
gradleVersion=4.8, 
rootPath=
 path=:beam-model-fn-execution:compileJava}
Unpacked output for task ':beam-model-fn-execution:compileJava' 

Build failed in Jenkins: beam_PreCommit_Website_Cron #1

2018-06-30 Thread Apache Jenkins Server
See 


--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam14 (beam) in workspace 

Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
 > git init  
 > # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # 
 > timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision d6a3faead5294dfccbbc45e7c0db06549eb0bc6a (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d6a3faead5294dfccbbc45e7c0db06549eb0bc6a
Commit message: "Merge pull request #5545: [BEAM-4076] Import Schema branch 
into master"
First time build. Skipping changelog.
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ 
 
--info --continue --max-workers=16 -Dorg.gradle.jvmargs=-Xmx3328m :jenkinsSetup 
:websitePreCommit
Initialized native services in: /home/jenkins/.gradle/native
To honour the JVM settings for this build a new JVM will be forked. Please 
consider using the daemon: 
https://docs.gradle.org/4.8/userguide/gradle_daemon.html.
Starting process 'Gradle build daemon'. Working directory: 
/home/jenkins/.gradle/daemon/4.8 Command: 
/usr/local/asfpackages/java/jdk1.8.0_152/bin/java -Xmx3328m 
-Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp 
/home/jenkins/.gradle/wrapper/dists/gradle-4.8-bin/divx0s2uj4thofgytb7gf9fsi/gradle-4.8/lib/gradle-launcher-4.8.jar
 org.gradle.launcher.daemon.bootstrap.GradleDaemon 4.8
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.751 secs.
The client will now receive all logging from the daemon (pid: 21701). The 
daemon log file: /home/jenkins/.gradle/daemon/4.8/daemon-21701.out.log
Closing daemon's stdin at end of input.
The daemon will no longer process any standard input.
Daemon will be stopped at the end of the build stopping after processing
Using 16 worker leases.
Starting Build
Parallel execution is an incubating feature.

> Configure project :buildSrc
Evaluating project ':buildSrc' using build file 
'
file or directory 
'
 not found
Selected primary task 'build' from project :
file or directory 
'
 not found
Using local directory build cache for build ':buildSrc' (location = 
/home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
:compileJava (Thread[Task worker for ':buildSrc' Thread 8,5,main]) started.

> Task :buildSrc:compileJava NO-SOURCE
file or directory 
'
 not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous 
output files.
:compileJava (Thread[Task worker for ':buildSrc' Thread 8,5,main]) completed. 
Took 0.014 secs.
:compileGroovy (Thread[Task worker for ':buildSrc' Thread 8,5,main]) started.

> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is 
438bb70aa77fad76d8676056acd3da84
Task ':buildSrc:compileGroovy' is not up-to-date because:
  No history is available.
Origin for task ':buildSrc:compileGroovy': {executionTime=4353, 
hostName=apache-beam-jenkins-slave-group-k24j, operatingSystem=Linux, 
buildInvocationId=owtpyqeiefdj3kdk5nazex44pu, creationTime=1530138575054, 
type=org.gradle.api.tasks.compile.GroovyCompile_Decorated, userName=jenkins, 
gradleVersion=4.8, 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Samza_Gradle #43

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 73.19 KB...]
Task ':beam-model-fn-execution:shadowJar' is not up-to-date because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 2 (includes project)
Total Time: 2.196s [2196ms]
Average Time/Jar: 1.098s [1098.0ms]
***
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
13,5,main]) completed. Took 3.379 secs.

> Task :beam-sdks-java-core:shadowJar
***
GRADLE SHADOW STATS

Total Jars: 6 (includes project)
Total Time: 6.303s [6303ms]
Average Time/Jar: 1.0505s [1050.5ms]
***
:beam-sdks-java-core:shadowJar (Thread[Task worker for ':' Thread 8,5,main]) 
completed. Took 9.124 secs.
:beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' 
Thread 8,5,main]) started.
:beam-sdks-java-core:generateTestAvroProtocol (Thread[Task worker for ':' 
Thread 15,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:compileJava (Thread[Task 
worker for ':' Thread 7,5,main]) started.

> Task :beam-sdks-java-core:generateTestAvroProtocol NO-SOURCE
Skipping task ':beam-sdks-java-core:generateTestAvroProtocol' as it has no 
source files and no previous output files.
:beam-sdks-java-fn-execution:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) started.
:beam-sdks-java-core:generateTestAvroProtocol (Thread[Task worker for ':' 
Thread 15,5,main]) completed. Took 0.002 secs.
:beam-sdks-java-core:generateTestAvroJava (Thread[Task worker for ':' Thread 
15,5,main]) started.

> Task :beam-sdks-java-core:generateTestAvroJava
Build cache key for task ':beam-sdks-java-core:generateTestAvroJava' is 
8a6292e06ef5adacd755c7aa4ad38220
Caching disabled for task ':beam-sdks-java-core:generateTestAvroJava': Caching 
has not been enabled for the task
Task ':beam-sdks-java-core:generateTestAvroJava' is not up-to-date because:
  No history is available.
Found 1 files
Processed src/test/avro/org/apache/beam/sdk/io/user.avsc
:beam-sdks-java-core:generateTestAvroJava (Thread[Task worker for ':' Thread 
15,5,main]) completed. Took 0.585 secs.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
15,5,main]) started.

> Task :beam-runners-core-construction-java:compileJava
Build cache key for task ':beam-runners-core-construction-java:compileJava' is 
000dc8ebd9fc87c783e10c8b1f4a8724
Task ':beam-runners-core-construction-java:compileJava' is not up-to-date 
because:
  No history is available.
Custom actions are attached to task 
':beam-runners-core-construction-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-construction-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-sdks-java-fn-execution:compileJava
Build cache key for task ':beam-sdks-java-fn-execution:compileJava' is 
97ea0b7456f6003c722d752ba30a6592
Task ':beam-sdks-java-fn-execution:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-sdks-java-fn-execution:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-sdks-java-fn-execution:compileJava'.
Compiling with error-prone compiler
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Packing task ':beam-sdks-java-fn-execution:compileJava'
:beam-sdks-java-fn-execution:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 11.604 secs.
:beam-sdks-java-fn-execution:classes (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-fn-execution:classes
Skipping task ':beam-sdks-java-fn-execution:classes' as it has no actions.
:beam-sdks-java-fn-execution:classes (Thread[Task worker for ':' Thread 
11,5,main]) completed. Took 0.012 secs.
:beam-sdks-java-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
11,5,main]) started.

> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava
Build cache key for task 
':beam-sdks-java-extensions-google-cloud-platform-core:compileJava' is 
77d315f93df30acff11d53e15702771c
Task ':beam-sdks-java-extensions-google-cloud-platform-core:compileJava' is not 
up-to-date because:
  No history is available.
Custom actions are attached to task 
':beam-sdks-java-extensions-google-cloud-platform-core:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-sdks-java-extensions-google-cloud-platform-core:compileJava'.
Compiling with error-prone compiler
Packing task ':beam-sdks-java-extensions-google-cloud-platform-core:compileJava'
:beam-sdks-java-extensions-google-cloud-platform-core:compileJava (Thread[Task 
worker for ':' Thread 7,5,main]) completed. Took 13.05 secs.
:beam-sdks-java-extensions-google-cloud-platform-core:classes (Thread[Task 
worker for ':' Thread 9,5,main]) started.

> 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle #122

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 58.38 KB...]
Resolving artifact: [group:io.grpc, name:protoc-gen-grpc-java, version:1.2.0, 
classifier:linux-x86_64, ext:exe]
Resolved artifact: 
/home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe
Resolving artifact: [group:com.google.protobuf, name:protoc, version:3.2.0, 
classifier:linux-x86_64, ext:exe]
Resolved artifact: 
/home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe
[/home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe,
 
-I
 
-I
 
-I
 
--java_out=
 
--grpc_out=
 
--plugin=protoc-gen-grpc=/home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe,
 

 

protoc: stdout: . stderr: 
:beam-model-fn-execution:generateProto (Thread[Task worker for ':' Thread 
9,5,main]) completed. Took 0.229 secs.
:beam-model-fn-execution:compileJava (Thread[Task worker for ':' Thread 
9,5,main]) started.

> Task :beam-model-job-management:compileJava FROM-CACHE
file or directory 
'
 not found
file or directory 
'
 not found
Build cache key for task ':beam-model-job-management:compileJava' is 
b5ee5c6a0b460e6d9d0893963f757ec4
Task ':beam-model-job-management:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-model-job-management:compileJava'.
Origin for task ':beam-model-job-management:compileJava': {executionTime=5314, 
hostName=apache-beam-jenkins-slave-group-rjdl, operatingSystem=Linux, 
buildInvocationId=ptnyf242jre7zjmohmppyfknjm, creationTime=1530159808075, 
type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, 
gradleVersion=4.8, 
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src, 
path=:beam-model-job-management:compileJava}
Unpacked output for task ':beam-model-job-management:compileJava' from cache.
:beam-model-job-management:compileJava (Thread[Task worker for ':',5,main]) 
completed. Took 0.41 secs.
:beam-model-job-management:classes (Thread[Task worker for ':',5,main]) started.

> Task :beam-model-job-management:classes
Skipping task ':beam-model-job-management:classes' as it has no actions.
:beam-model-job-management:classes (Thread[Task worker for ':',5,main]) 
completed. Took 0.0 secs.
:beam-model-job-management:shadowJar (Thread[Task worker for ':',5,main]) 
started.

> Task :beam-model-fn-execution:compileJava FROM-CACHE
file or directory 
'
 not found
file or directory 
'
 not found
Build cache key for task ':beam-model-fn-execution:compileJava' is 
de10edcb1322c7b7ab6acf69a8aec536
Task ':beam-model-fn-execution:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-model-fn-execution:compileJava'.
Origin for task ':beam-model-fn-execution:compileJava': {executionTime=8094, 
hostName=apache-beam-jenkins-slave-group-rjdl, operatingSystem=Linux, 
buildInvocationId=ptnyf242jre7zjmohmppyfknjm, creationTime=1530159810959, 
type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, 
gradleVersion=4.8, 
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src, 
path=:beam-model-fn-execution:compileJava}
Unpacked output for task ':beam-model-fn-execution:compileJava' from 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #976

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 66.41 KB...]
:beam-model-fn-execution:compileJava (Thread[Task worker for ':' Thread 
3,5,main]) completed. Took 0.21 secs.
:beam-model-fn-execution:classes (Thread[Task worker for ':' Thread 3,5,main]) 
started.

> Task :beam-model-fn-execution:classes
Skipping task ':beam-model-fn-execution:classes' as it has no actions.
:beam-model-fn-execution:classes (Thread[Task worker for ':' Thread 3,5,main]) 
completed. Took 0.0 secs.
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
3,5,main]) started.

> Task :beam-sdks-java-core:shadowJar
Build cache key for task ':beam-sdks-java-core:shadowJar' is 
8dab829a9c9c0a089d07bc8dd48f2738
Caching disabled for task ':beam-sdks-java-core:shadowJar': Caching has not 
been enabled for the task
Task ':beam-sdks-java-core:shadowJar' is not up-to-date because:
  No history is available.

> Task :beam-model-job-management:shadowJar
Build cache key for task ':beam-model-job-management:shadowJar' is 
8c2e08f71b6147f399f5a86af6d37b4d
Caching disabled for task ':beam-model-job-management:shadowJar': Caching has 
not been enabled for the task
Task ':beam-model-job-management:shadowJar' is not up-to-date because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 2 (includes project)
Total Time: 2.439s [2439ms]
Average Time/Jar: 1.2195s [1219.5ms]
***
:beam-model-job-management:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 2.888 secs.

> Task :beam-model-fn-execution:shadowJar
Build cache key for task ':beam-model-fn-execution:shadowJar' is 
de52c43fd7a09f8e934fbbc0bafe095f
Caching disabled for task ':beam-model-fn-execution:shadowJar': Caching has not 
been enabled for the task
Task ':beam-model-fn-execution:shadowJar' is not up-to-date because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 2 (includes project)
Total Time: 2.174s [2174ms]
Average Time/Jar: 1.087s [1087.0ms]
***
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
3,5,main]) completed. Took 3.159 secs.

> Task :beam-sdks-java-core:shadowJar
***
GRADLE SHADOW STATS

Total Jars: 6 (includes project)
Total Time: 5.694s [5694ms]
Average Time/Jar: 0.949s [949.0ms]
***
:beam-sdks-java-core:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) 
completed. Took 8.19 secs.
:beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' 
Thread 14,5,main]) started.
:beam-sdks-java-core:generateTestAvroProtocol (Thread[Task worker for ':' 
Thread 6,5,main]) started.
:beam-sdks-java-io-kafka:compileJava (Thread[Task worker for ':' Thread 
7,5,main]) started.

> Task :beam-sdks-java-core:generateTestAvroProtocol NO-SOURCE
Skipping task ':beam-sdks-java-core:generateTestAvroProtocol' as it has no 
source files and no previous output files.
:beam-sdks-java-core:generateTestAvroProtocol (Thread[Task worker for ':' 
Thread 6,5,main]) completed. Took 0.002 secs.
:beam-sdks-java-core:generateTestAvroJava (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-core:generateTestAvroJava
Build cache key for task ':beam-sdks-java-core:generateTestAvroJava' is 
b3071532ce189f33becf79dbce3a691c
Caching disabled for task ':beam-sdks-java-core:generateTestAvroJava': Caching 
has not been enabled for the task
Task ':beam-sdks-java-core:generateTestAvroJava' is not up-to-date because:
  No history is available.
Found 1 files
Processed src/test/avro/org/apache/beam/sdk/io/user.avsc
:beam-sdks-java-core:generateTestAvroJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.474 secs.
:beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-runners-core-construction-java:compileJava
Build cache key for task ':beam-runners-core-construction-java:compileJava' is 
000dc8ebd9fc87c783e10c8b1f4a8724
Task ':beam-runners-core-construction-java:compileJava' is not up-to-date 
because:
  No history is available.
Custom actions are attached to task 
':beam-runners-core-construction-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-construction-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-sdks-java-io-kafka:compileJava
Build cache key for task ':beam-sdks-java-io-kafka:compileJava' is 
9c6ed6d65f8082800063836049a34839
Task ':beam-sdks-java-io-kafka:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-sdks-java-io-kafka:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-sdks-java-io-kafka:compileJava'.
Compiling with error-prone compiler
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Gradle #992

2018-06-30 Thread Apache Jenkins Server
See 


--
[...truncated 73.61 KB...]
Task ':beam-model-fn-execution:shadowJar' is not up-to-date because:
  No history is available.
***
GRADLE SHADOW STATS

Total Jars: 2 (includes project)
Total Time: 2.12s [2120ms]
Average Time/Jar: 1.06s [1060.0ms]
***
:beam-model-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
10,5,main]) completed. Took 3.099 secs.

> Task :beam-sdks-java-core:shadowJar
***
GRADLE SHADOW STATS

Total Jars: 6 (includes project)
Total Time: 5.677s [5677ms]
Average Time/Jar: 0.94617s [946.17ms]
***
:beam-sdks-java-core:shadowJar (Thread[Task worker for ':' Thread 4,5,main]) 
completed. Took 8.052 secs.
:beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' 
Thread 4,5,main]) started.
:beam-sdks-java-core:generateTestAvroProtocol (Thread[Daemon worker,5,main]) 
started.
:beam-sdks-java-extensions-google-cloud-platform-core:compileJava (Thread[Task 
worker for ':',5,main]) started.

> Task :beam-sdks-java-core:generateTestAvroProtocol NO-SOURCE
Skipping task ':beam-sdks-java-core:generateTestAvroProtocol' as it has no 
source files and no previous output files.
:beam-sdks-java-core:generateTestAvroProtocol (Thread[Daemon worker,5,main]) 
completed. Took 0.001 secs.
:beam-sdks-java-fn-execution:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) started.
:beam-sdks-java-core:generateTestAvroJava (Thread[Daemon worker,5,main]) 
started.

> Task :beam-sdks-java-core:generateTestAvroJava
Build cache key for task ':beam-sdks-java-core:generateTestAvroJava' is 
cbac653cd526d6ab82fcc3d1aaf76ffd
Caching disabled for task ':beam-sdks-java-core:generateTestAvroJava': Caching 
has not been enabled for the task
Task ':beam-sdks-java-core:generateTestAvroJava' is not up-to-date because:
  No history is available.
Found 1 files
Processed src/test/avro/org/apache/beam/sdk/io/user.avsc
:beam-sdks-java-core:generateTestAvroJava (Thread[Daemon worker,5,main]) 
completed. Took 0.512 secs.
:beam-sdks-java-core:compileTestJava (Thread[Daemon worker,5,main]) started.

> Task :beam-runners-core-construction-java:compileJava
Build cache key for task ':beam-runners-core-construction-java:compileJava' is 
000dc8ebd9fc87c783e10c8b1f4a8724
Task ':beam-runners-core-construction-java:compileJava' is not up-to-date 
because:
  No history is available.
Custom actions are attached to task 
':beam-runners-core-construction-java:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-runners-core-construction-java:compileJava'.
Compiling with error-prone compiler

> Task :beam-sdks-java-fn-execution:compileJava
Build cache key for task ':beam-sdks-java-fn-execution:compileJava' is 
97ea0b7456f6003c722d752ba30a6592
Task ':beam-sdks-java-fn-execution:compileJava' is not up-to-date because:
  No history is available.
Custom actions are attached to task ':beam-sdks-java-fn-execution:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-sdks-java-fn-execution:compileJava'.
Compiling with error-prone compiler
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Packing task ':beam-sdks-java-fn-execution:compileJava'
:beam-sdks-java-fn-execution:compileJava (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 6.4 secs.
:beam-sdks-java-fn-execution:classes (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-fn-execution:classes
Skipping task ':beam-sdks-java-fn-execution:classes' as it has no actions.
:beam-sdks-java-fn-execution:classes (Thread[Task worker for ':' Thread 
6,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-fn-execution:shadowJar (Thread[Task worker for ':' Thread 
6,5,main]) started.

> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava
Build cache key for task 
':beam-sdks-java-extensions-google-cloud-platform-core:compileJava' is 
77d315f93df30acff11d53e15702771c
Task ':beam-sdks-java-extensions-google-cloud-platform-core:compileJava' is not 
up-to-date because:
  No history is available.
Custom actions are attached to task 
':beam-sdks-java-extensions-google-cloud-platform-core:compileJava'.
All input files are considered out-of-date for incremental task 
':beam-sdks-java-extensions-google-cloud-platform-core:compileJava'.
Compiling with error-prone compiler
Packing task ':beam-sdks-java-extensions-google-cloud-platform-core:compileJava'
:beam-sdks-java-extensions-google-cloud-platform-core:compileJava (Thread[Task 
worker for ':',5,main]) completed. Took 7.033 secs.
:beam-sdks-java-extensions-google-cloud-platform-core:classes (Thread[Task 
worker for ':',5,main]) started.

> Task :beam-sdks-java-extensions-google-cloud-platform-core:classes
Skipping task 

  1   2   >