Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #4228

2018-02-19 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PerformanceTests_TFRecordIOIT #161

2018-02-19 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PerformanceTests_Python #934

2018-02-19 Thread Apache Jenkins Server
See 


Changes:

[github] Updates javadocs of Setup and Teardown

--
[...truncated 502 B...]
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 153f8a8e52f880896ca3dc5c8366d8f003ffaf5a (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 153f8a8e52f880896ca3dc5c8366d8f003ffaf5a
Commit message: "Merge pull request #4711: Updates javadocs of Setup and 
Teardown"
 > git rev-list --no-walk 35f159f5fd13d9a33b5086591905d657ada1d5f8 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins7455564042259349050.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins8507377480322082532.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins877980782831205084.sh
+ virtualenv .env --system-site-packages
New python executable in .env/bin/python
Installing setuptools, pip...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins588576006228146220.sh
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from 
https://pypi.python.org/packages/43/41/033a273f9a25cb63050a390ee8397acbc7eae2159195d85f06f17e7be45a/setuptools-38.5.1-py2.py3-none-any.whl#md5=908b8b5e50bf429e520b2b5fa1b350e5
Downloading/unpacking pip from 
https://pypi.python.org/packages/b6/ac/7015eb97dc749283ffdec1c3a88ddb8ae03b8fad0f0e611408f196358da3/pip-9.0.1-py2.py3-none-any.whl#md5=297dbd16ef53bcef0447d245815f5144
Installing collected packages: setuptools, pip
  Found existing installation: setuptools 2.2
Uninstalling setuptools:
  Successfully uninstalled setuptools
  Found existing installation: pip 1.5.4
Uninstalling pip:
  Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins7750006159676930407.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins4433748894278370058.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages 
(from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
  Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in 
/home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in 

Build failed in Jenkins: beam_PerformanceTests_Compressed_TextIOIT #162

2018-02-19 Thread Apache Jenkins Server
See 


Changes:

[github] Updates javadocs of Setup and Teardown

--
[...truncated 29.89 KB...]
[INFO] Excluding 
org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.4.0-SNAPSHOT from 
the shaded jar.
[INFO] Excluding 
org.apache.beam:beam-sdks-java-extensions-protobuf:jar:2.4.0-SNAPSHOT from the 
shaded jar.
[INFO] Excluding io.grpc:grpc-core:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.errorprone:error_prone_annotations:jar:2.0.15 from 
the shaded jar.
[INFO] Excluding io.grpc:grpc-context:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.instrumentation:instrumentation-api:jar:0.3.0 from 
the shaded jar.
[INFO] Excluding 
com.google.apis:google-api-services-bigquery:jar:v2-rev355-1.22.0 from the 
shaded jar.
[INFO] Excluding com.google.api:gax-grpc:jar:0.20.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.api:api-common:jar:1.0.0-rc2 from the shaded jar.
[INFO] Excluding com.google.auto.value:auto-value:jar:1.5.3 from the shaded jar.
[INFO] Excluding com.google.api:gax:jar:1.3.1 from the shaded jar.
[INFO] Excluding org.threeten:threetenbp:jar:1.3.3 from the shaded jar.
[INFO] Excluding com.google.cloud:google-cloud-core-grpc:jar:1.2.0 from the 
shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java-util:jar:3.2.0 from the 
shaded jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.7 from the shaded jar.
[INFO] Excluding com.google.apis:google-api-services-pubsub:jar:v1-rev10-1.22.0 
from the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-cloud-pubsub-v1:jar:0.1.18 
from the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-cloud-pubsub-v1:jar:0.1.18 
from the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-iam-v1:jar:0.1.18 from the 
shaded jar.
[INFO] Excluding com.google.cloud.datastore:datastore-v1-proto-client:jar:1.4.0 
from the shaded jar.
[INFO] Excluding com.google.http-client:google-http-client-protobuf:jar:1.22.0 
from the shaded jar.
[INFO] Excluding com.google.http-client:google-http-client-jackson:jar:1.22.0 
from the shaded jar.
[INFO] Excluding com.google.cloud.datastore:datastore-v1-protos:jar:1.3.0 from 
the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-common-protos:jar:0.1.9 from 
the shaded jar.
[INFO] Excluding io.grpc:grpc-auth:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-netty:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.netty:netty-codec-http2:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-codec-http:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-handler-proxy:jar:4.1.8.Final from the shaded 
jar.
[INFO] Excluding io.netty:netty-codec-socks:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-handler:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-buffer:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-common:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-transport:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-resolver:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.netty:netty-codec:jar:4.1.8.Final from the shaded jar.
[INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-all:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-okhttp:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.squareup.okhttp:okhttp:jar:2.5.0 from the shaded jar.
[INFO] Excluding com.squareup.okio:okio:jar:1.6.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-nano:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.protobuf.nano:protobuf-javanano:jar:3.0.0-alpha-5 
from the shaded jar.
[INFO] Excluding com.google.cloud:google-cloud-core:jar:1.0.2 from the shaded 
jar.
[INFO] Excluding org.json:json:jar:20160810 from the shaded jar.
[INFO] Excluding com.google.cloud:google-cloud-spanner:jar:0.20.0-beta from the 
shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-v1:jar:0.1.11 
from the shaded jar.
[INFO] Excluding 
com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:jar:0.1.11 
from the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-v1:jar:0.1.11 
from the shaded jar.
[INFO] Excluding 
com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:jar:0.1.11 from 
the shaded jar.
[INFO] Excluding 
com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:jar:0.1.11 from 
the shaded jar.
[INFO] Excluding com.google.api.grpc:grpc-google-longrunning-v1:jar:0.1.11 from 
the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-longrunning-v1:jar:0.1.11 
from the shaded jar.
[INFO] Excluding 

Build failed in Jenkins: beam_PostCommit_Python_Verify #4263

2018-02-19 Thread Apache Jenkins Server
See 


Changes:

[github] Updates javadocs of Setup and Teardown

--
[...truncated 1.40 MB...]
spec {
  spec {
urn: "beam:coder:varint:v1"
  }
}
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_11"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_12"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_13"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_14"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_15"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_16"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_6"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_FastPrimitivesCoder_3"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_7"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_VarIntCoder_8"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
  }
}

root: DEBUG: CONTROL RESPONSE instruction_id: "control_4"
register {
}

root: DEBUG: CONTROL REQUEST instruction_id: "bundle_1210"
process_bundle {
  process_bundle_descriptor_reference: "3"
}

root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: DEBUG: CONTROL RESPONSE instruction_id: "bundle_1210"
process_bundle {
  metrics {
ptransforms {
  key: "assert_that/Group/GroupByKey/Read"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Group/Map(_merge_tagged_vals_under_key)"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Match"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}

[jira] [Assigned] (BEAM-3662) Port MongoDbIOTest off DoFnTester

2018-02-19 Thread Kenneth Knowles (JIRA)

 [ 
https://issues.apache.org/jira/browse/BEAM-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles reassigned BEAM-3662:
-

Assignee: Willy Lulciuc

> Port MongoDbIOTest off DoFnTester
> -
>
> Key: BEAM-3662
> URL: https://issues.apache.org/jira/browse/BEAM-3662
> Project: Beam
>  Issue Type: Sub-task
>  Components: io-java-mongodb
>Reporter: Kenneth Knowles
>Assignee: Willy Lulciuc
>Priority: Major
>  Labels: beginner, newbie, starter
>  Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam] branch setup-teardown deleted (was df5fcec)

2018-02-19 Thread jkff
This is an automated email from the ASF dual-hosted git repository.

jkff pushed a change to branch setup-teardown
in repository https://gitbox.apache.org/repos/asf/beam.git.


 was df5fcec  Updates javadocs of Setup and Teardown

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.

-- 
To stop receiving notification emails like this one, please contact
j...@apache.org.


[beam] 01/01: Merge pull request #4711: Updates javadocs of Setup and Teardown

2018-02-19 Thread jkff
This is an automated email from the ASF dual-hosted git repository.

jkff pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 153f8a8e52f880896ca3dc5c8366d8f003ffaf5a
Merge: 35f159f df5fcec
Author: Eugene Kirpichov 
AuthorDate: Mon Feb 19 19:00:14 2018 -0800

Merge pull request #4711: Updates javadocs of Setup and Teardown

Updates javadocs of Setup and Teardown

 .../java/org/apache/beam/sdk/transforms/DoFn.java  | 45 ++
 1 file changed, 37 insertions(+), 8 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
j...@apache.org.


[beam] branch master updated (35f159f -> 153f8a8)

2018-02-19 Thread jkff
This is an automated email from the ASF dual-hosted git repository.

jkff pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 35f159f  [BEAM-3690] swapping to use mockito-core, hamcrest-core and 
hamcrest-library to solve the dependency conflicts
 add df5fcec  Updates javadocs of Setup and Teardown
 new 153f8a8  Merge pull request #4711: Updates javadocs of Setup and 
Teardown

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../java/org/apache/beam/sdk/transforms/DoFn.java  | 45 ++
 1 file changed, 37 insertions(+), 8 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
j...@apache.org.


Build failed in Jenkins: beam_PerformanceTests_Python #933

2018-02-19 Thread Apache Jenkins Server
See 


--
[...truncated 550 B...]
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 35f159f5fd13d9a33b5086591905d657ada1d5f8 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 35f159f5fd13d9a33b5086591905d657ada1d5f8
Commit message: "[BEAM-3690] swapping to use mockito-core, hamcrest-core and 
hamcrest-library to solve the dependency conflicts"
 > git rev-list --no-walk 35f159f5fd13d9a33b5086591905d657ada1d5f8 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins8343871951509678043.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins6469883914429252399.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins338123852208842499.sh
+ virtualenv .env --system-site-packages
New python executable in .env/bin/python
Installing setuptools, pip...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins2357421648635433449.sh
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from 
https://pypi.python.org/packages/43/41/033a273f9a25cb63050a390ee8397acbc7eae2159195d85f06f17e7be45a/setuptools-38.5.1-py2.py3-none-any.whl#md5=908b8b5e50bf429e520b2b5fa1b350e5
Downloading/unpacking pip from 
https://pypi.python.org/packages/b6/ac/7015eb97dc749283ffdec1c3a88ddb8ae03b8fad0f0e611408f196358da3/pip-9.0.1-py2.py3-none-any.whl#md5=297dbd16ef53bcef0447d245815f5144
Installing collected packages: setuptools, pip
  Found existing installation: setuptools 2.2
Uninstalling setuptools:
  Successfully uninstalled setuptools
  Found existing installation: pip 1.5.4
Uninstalling pip:
  Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins570279946247495499.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins1056863880384247050.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages 
(from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages 
(from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in 
/usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already 

Build failed in Jenkins: beam_PostCommit_Python_Verify #4261

2018-02-19 Thread Apache Jenkins Server
See 


Changes:

[lcwik] [BEAM-3690] swapping to use mockito-core, hamcrest-core and

--
[...truncated 1.40 MB...]
  value {
spec {
  spec {
urn: "beam:coder:varint:v1"
  }
}
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_11"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_12"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_13"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_14"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_15"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_16"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_6"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_FastPrimitivesCoder_3"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_7"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_VarIntCoder_8"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
  }
}

root: DEBUG: CONTROL RESPONSE instruction_id: "control_4"
register {
}

root: DEBUG: CONTROL REQUEST instruction_id: "bundle_1211"
process_bundle {
  process_bundle_descriptor_reference: "3"
}

root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: DEBUG: CONTROL RESPONSE instruction_id: "bundle_1211"
process_bundle {
  metrics {
ptransforms {
  key: "assert_that/Group/GroupByKey/Read"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Group/Map(_merge_tagged_vals_under_key)"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Match"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
 

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #5034

2018-02-19 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PerformanceTests_Python #932

2018-02-19 Thread Apache Jenkins Server
See 


Changes:

[lcwik] [BEAM-3690] swapping to use mockito-core, hamcrest-core and

--
[...truncated 15 B...]
Building remotely on beam7 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 35f159f5fd13d9a33b5086591905d657ada1d5f8 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 35f159f5fd13d9a33b5086591905d657ada1d5f8
Commit message: "[BEAM-3690] swapping to use mockito-core, hamcrest-core and 
hamcrest-library to solve the dependency conflicts"
 > git rev-list --no-walk bb98aa96f78182a177cfe421b2bba04c06b1b094 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins6221507657781058233.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins5621375458671665889.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins7232257008195400136.sh
+ virtualenv .env --system-site-packages
New python executable in 

Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins9188072514808745467.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins6099722907300154576.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins3219473752174687493.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages 
(from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
:318:
 SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name 
Indication) extension to TLS is not available on this platform. This may cause 
the server to present an incorrect TLS certificate, which can cause validation 
failures. You can upgrade to a newer version of Python to solve this. For more 
information, see 
https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
:122:
 InsecurePlatformWarning: A true SSLContext object is not available. This 
prevents urllib3 from configuring SSL appropriately and may cause certain SSL 
connections to fail. You can upgrade to a newer 

[jira] [Commented] (BEAM-3690) Dependency Conflict problems: several conflicting classes exist in different JARs (mockito-all/hamcrest-all)

2018-02-19 Thread Luke Cwik (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369381#comment-16369381
 ] 

Luke Cwik commented on BEAM-3690:
-

Now, all that is needed is to configure the maven enforcer plugin to ban 
hamcrest-all/mockito-all using 
[https://maven.apache.org/enforcer/enforcer-rules/bannedDependencies.html]

 

This will prevent this issue from reoccurring.

> Dependency Conflict problems: several conflicting classes exist in different 
> JARs (mockito-all/hamcrest-all)
> 
>
> Key: BEAM-3690
> URL: https://issues.apache.org/jira/browse/BEAM-3690
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Affects Versions: 2.2.0
>Reporter: PandaMonkey
>Assignee: PandaMonkey
>Priority: Minor
> Fix For: 2.4.0
>
> Attachments: beam_conflicts.txt
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Hi, we found that there are duplicate classes exist in different JARs, and 
> these classes have different features.
> The conflicting JAR pairs are:
> 1. 
> jar-pair:
> 2. 
> jar-pair:
> Some of method only exist in one version of duplicate classes.
> As the JVM only load the classes present first on the classpath and shadow 
> the other duplicate ones with the same names. The dependency conflict problem 
> brings high risks of "*NoSuchMethodException*" or "*NoSuchMethodError*"  
> issues at runtime. The conflicting details are listed in the attachment. 
> Please notice that. Thanks.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (BEAM-3690) Dependency Conflict problems: several conflicting classes exist in different JARs (mockito-all/hamcrest-all)

2018-02-19 Thread Luke Cwik (JIRA)

 [ 
https://issues.apache.org/jira/browse/BEAM-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luke Cwik updated BEAM-3690:

Priority: Minor  (was: Major)

> Dependency Conflict problems: several conflicting classes exist in different 
> JARs (mockito-all/hamcrest-all)
> 
>
> Key: BEAM-3690
> URL: https://issues.apache.org/jira/browse/BEAM-3690
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Affects Versions: 2.2.0
>Reporter: PandaMonkey
>Assignee: PandaMonkey
>Priority: Minor
> Fix For: 2.4.0
>
> Attachments: beam_conflicts.txt
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Hi, we found that there are duplicate classes exist in different JARs, and 
> these classes have different features.
> The conflicting JAR pairs are:
> 1. 
> jar-pair:
> 2. 
> jar-pair:
> Some of method only exist in one version of duplicate classes.
> As the JVM only load the classes present first on the classpath and shadow 
> the other duplicate ones with the same names. The dependency conflict problem 
> brings high risks of "*NoSuchMethodException*" or "*NoSuchMethodError*"  
> issues at runtime. The conflicting details are listed in the attachment. 
> Please notice that. Thanks.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (BEAM-3690) Dependency Conflict problems: several conflicting classes exist in different JARs (mockito-all/hamcrest-all)

2018-02-19 Thread Luke Cwik (JIRA)

 [ 
https://issues.apache.org/jira/browse/BEAM-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luke Cwik updated BEAM-3690:

Summary: Dependency Conflict problems: several conflicting classes exist in 
different JARs (mockito-all/hamcrest-all)  (was: Dependency Conflict problems: 
several conflicting classes exist in different JARs)

> Dependency Conflict problems: several conflicting classes exist in different 
> JARs (mockito-all/hamcrest-all)
> 
>
> Key: BEAM-3690
> URL: https://issues.apache.org/jira/browse/BEAM-3690
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Affects Versions: 2.2.0
>Reporter: PandaMonkey
>Assignee: PandaMonkey
>Priority: Major
> Fix For: 2.4.0
>
> Attachments: beam_conflicts.txt
>
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Hi, we found that there are duplicate classes exist in different JARs, and 
> these classes have different features.
> The conflicting JAR pairs are:
> 1. 
> jar-pair:
> 2. 
> jar-pair:
> Some of method only exist in one version of duplicate classes.
> As the JVM only load the classes present first on the classpath and shadow 
> the other duplicate ones with the same names. The dependency conflict problem 
> brings high risks of "*NoSuchMethodException*" or "*NoSuchMethodError*"  
> issues at runtime. The conflicting details are listed in the attachment. 
> Please notice that. Thanks.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam] branch master updated: [BEAM-3690] swapping to use mockito-core, hamcrest-core and hamcrest-library to solve the dependency conflicts replace mockito-all

2018-02-19 Thread lcwik
This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 88f61a0  [BEAM-3690] swapping to use mockito-core, hamcrest-core and 
hamcrest-library to solve the dependency conflicts replace mockito-all
 new 35f159f  [BEAM-3690] swapping to use mockito-core, hamcrest-core and 
hamcrest-library to solve the dependency conflicts
88f61a0 is described below

commit 88f61a00bb8126c5c8e7673bc3284047343066fe
Author: 1028332163 <1028332...@qq.com>
AuthorDate: Mon Feb 19 12:22:53 2018 +0800

[BEAM-3690] swapping to use mockito-core, hamcrest-core and 
hamcrest-library to solve the dependency conflicts replace mockito-all
---
 examples/java/pom.xml  |  9 +++--
 pom.xml|  4 ++--
 runners/apex/pom.xml   |  9 +++--
 runners/core-construction-java/pom.xml | 10 +++---
 runners/core-java/pom.xml  | 12 ---
 runners/direct-java/pom.xml| 10 --
 runners/flink/pom.xml  | 10 --
 runners/gearpump/pom.xml   |  9 +++--
 runners/google-cloud-dataflow-java/pom.xml | 12 ---
 runners/java-fn-execution/pom.xml  | 10 --
 runners/local-artifact-service-java/pom.xml| 10 --
 runners/local-java/pom.xml |  7 ++-
 runners/reference/java/pom.xml | 10 --
 runners/reference/job-server/pom.xml   |  3 ++-
 runners/spark/pom.xml  | 10 --
 sdks/java/core/pom.xml | 19 +++---
 .../extensions/google-cloud-platform-core/pom.xml  | 10 --
 sdks/java/extensions/jackson/pom.xml   |  8 +++-
 sdks/java/extensions/join-library/pom.xml  |  8 +++-
 sdks/java/extensions/protobuf/pom.xml  | 10 --
 sdks/java/extensions/sketching/pom.xml |  8 +++-
 sdks/java/extensions/sorter/pom.xml| 12 ---
 sdks/java/extensions/sql/pom.xml   |  6 +++---
 sdks/java/fn-execution/pom.xml | 12 ---
 sdks/java/harness/pom.xml  | 10 --
 sdks/java/io/amazon-web-services/pom.xml   | 10 --
 sdks/java/io/amqp/pom.xml  |  9 +++--
 sdks/java/io/cassandra/pom.xml |  6 +++---
 .../elasticsearch-tests-5/pom.xml  | 16 +++
 .../elasticsearch-tests-common/pom.xml |  2 +-
 sdks/java/io/elasticsearch-tests/pom.xml   |  8 +++-
 sdks/java/io/elasticsearch/pom.xml |  2 +-
 sdks/java/io/file-based-io-tests/pom.xml   |  7 ++-
 sdks/java/io/google-cloud-platform/pom.xml | 10 --
 sdks/java/io/hadoop-common/pom.xml |  8 +++-
 sdks/java/io/hadoop-file-system/pom.xml| 10 --
 sdks/java/io/hadoop-input-format/pom.xml   |  9 +++--
 sdks/java/io/hbase/pom.xml |  7 ++-
 sdks/java/io/hcatalog/pom.xml  |  9 +++--
 sdks/java/io/jdbc/pom.xml  |  7 ++-
 sdks/java/io/jms/pom.xml   |  7 ++-
 sdks/java/io/kafka/pom.xml |  8 ++--
 sdks/java/io/kinesis/pom.xml   | 10 +++---
 sdks/java/io/mongodb/pom.xml   |  7 ++-
 sdks/java/io/mqtt/pom.xml  |  7 ++-
 sdks/java/io/redis/pom.xml |  7 ++-
 sdks/java/io/solr/pom.xml  |  6 +++---
 sdks/java/io/tika/pom.xml  | 11 ++-
 sdks/java/io/xml/pom.xml   |  5 +++--
 sdks/java/java8tests/pom.xml   |  8 +++-
 sdks/java/javadoc/pom.xml  |  8 +++-
 .../src/main/resources/archetype-resources/pom.xml | 10 --
 sdks/java/nexmark/pom.xml  | 23 +++---
 53 files changed, 375 insertions(+), 100 deletions(-)

diff --git a/examples/java/pom.xml b/examples/java/pom.xml
index 7504857..46f1f8c 100644
--- a/examples/java/pom.xml
+++ b/examples/java/pom.xml
@@ -511,7 +511,12 @@
 
 
   org.hamcrest
-  hamcrest-all
+  hamcrest-core
+
+
+
+  org.hamcrest
+  hamcrest-library
 
 
 
@@ -539,7 +544,7 @@
 
 
   org.mockito
-  mockito-all
+  mockito-core
   test
 
   
diff --git a/pom.xml b/pom.xml
index 7fe67cb..4b876f7 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1429,7 +1429,7 @@
 
   
 org.hamcrest
-

Build failed in Jenkins: beam_PostCommit_Python_Verify #4260

2018-02-19 Thread Apache Jenkins Server
See 


--
[...truncated 1.40 MB...]
  value {
spec {
  spec {
urn: "beam:coder:varint:v1"
  }
}
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_11"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_12"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_13"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_14"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_15"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_16"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_5"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_6"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_5_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_6_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_5_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_6_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_8"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_FastPrimitivesCoder_3"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_VarIntCoder_10"
component_coder_ids: "ref_Coder_GlobalWindowCoder_4"
  }
}
  }
}

root: DEBUG: CONTROL RESPONSE instruction_id: "control_4"
register {
}

root: DEBUG: CONTROL REQUEST instruction_id: "bundle_1210"
process_bundle {
  process_bundle_descriptor_reference: "3"
}

root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: DEBUG: CONTROL RESPONSE instruction_id: "bundle_1210"
process_bundle {
  metrics {
ptransforms {
  key: "assert_that/Group/GroupByKey/Read"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Group/Map(_merge_tagged_vals_under_key)"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Match"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Unkey"
  value {

[jira] [Created] (BEAM-3717) Problems with download page

2018-02-19 Thread Sebb (JIRA)
Sebb created BEAM-3717:
--

 Summary: Problems with download page
 Key: BEAM-3717
 URL: https://issues.apache.org/jira/browse/BEAM-3717
 Project: Beam
  Issue Type: Bug
  Components: website
Reporter: Sebb
Assignee: Reuven Lax


The download page has some problems:

1) Links to previous releases are broken.
These should either be removed, or be converted to use the archive server, e.g. 
instead of

https://www.apache.org/dyn/closer.cgi?filename=beam/2.2.0/apache-beam-2.2.0-source-release.zip=download

use

https://archive.apache.org/dist/beam/2.2.0/apache-beam-2.2.0-source-release.zip

2) The download page must include links to the signature (.asc) file and hashes 
for all downloads.

These must be linked from https://www.apache.org/dist/beam/... (or 
archive.apache.org for older releases)

3) There should be a link to the KEYS file at
https://archive.apache.org/dist/beam/KEYS

4) There should be instructions on the need to verify downloads.
See for example:
https://tomcat.apache.org/download-70.cgi#Release_Integrity




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (BEAM-3690) Dependency Conflict problems: several conflicting classes exist in different JARs

2018-02-19 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/BEAM-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jean-Baptiste Onofré updated BEAM-3690:
---
Fix Version/s: (was: 2.3.0)
   2.4.0

> Dependency Conflict problems: several conflicting classes exist in different 
> JARs
> -
>
> Key: BEAM-3690
> URL: https://issues.apache.org/jira/browse/BEAM-3690
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Affects Versions: 2.2.0
>Reporter: PandaMonkey
>Assignee: PandaMonkey
>Priority: Major
> Fix For: 2.4.0
>
> Attachments: beam_conflicts.txt
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Hi, we found that there are duplicate classes exist in different JARs, and 
> these classes have different features.
> The conflicting JAR pairs are:
> 1. 
> jar-pair:
> 2. 
> jar-pair:
> Some of method only exist in one version of duplicate classes.
> As the JVM only load the classes present first on the classpath and shadow 
> the other duplicate ones with the same names. The dependency conflict problem 
> brings high risks of "*NoSuchMethodException*" or "*NoSuchMethodError*"  
> issues at runtime. The conflicting details are listed in the attachment. 
> Please notice that. Thanks.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[beam-site] branch asf-site updated (9a06132 -> f75d2fd)

2018-02-19 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


from 9a06132  Prepare repository for deployment.
 add 527683e  Add blog post for the release of Beam 2.3.0
 add f935b9d  This closes #390
 new f75d2fd  Prepare repository for deployment.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../2018/02/19/beam-2.3.0.html}| 104 +-
 content/blog/index.html|  17 +
 content/feed.xml   | 410 +
 content/index.html |  10 +-
 src/_data/authors.yml  |   4 +
 src/_posts/2018-02-19-beam-2.3.0.md|  89 +
 6 files changed, 296 insertions(+), 338 deletions(-)
 copy content/{beam/capability/2016/04/03/presentation-materials.html => 
blog/2018/02/19/beam-2.3.0.html} (55%)
 create mode 100644 src/_posts/2018-02-19-beam-2.3.0.md

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.


[beam-site] 01/01: Prepare repository for deployment.

2018-02-19 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f75d2fdc724312fdb701f07cdb96c5a2346f0884
Author: Mergebot 
AuthorDate: Mon Feb 19 05:30:02 2018 -0800

Prepare repository for deployment.
---
 content/blog/2018/02/19/beam-2.3.0.html | 237 ++
 content/blog/index.html |  17 ++
 content/feed.xml| 410 
 content/index.html  |  10 +-
 4 files changed, 356 insertions(+), 318 deletions(-)

diff --git a/content/blog/2018/02/19/beam-2.3.0.html 
b/content/blog/2018/02/19/beam-2.3.0.html
new file mode 100644
index 000..af8c605
--- /dev/null
+++ b/content/blog/2018/02/19/beam-2.3.0.html
@@ -0,0 +1,237 @@
+
+
+  
+  
+  
+  
+  Apache Beam 2.3.0
+  
+  https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
+  
+  https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
+  
+  
+  
+  
+  
+  https://beam.apache.org/blog/2018/02/19/beam-2.3.0.html; 
data-proofer-ignore>
+  
+  https://beam.apache.org/feed.xml;>
+  
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+  
+
+
+  
+
+
+  
+Toggle navigation
+
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  
+
+  Get Started
+
+
+  Documentation
+
+
+  SDKS
+
+
+  RUNNERS
+
+
+  Contribute
+
+Blog
+  
+  
+
+  https://www.apache.org/foundation/press/kit/feather_small.png; alt="Apache 
Logo" style="height:20px;">
+  
+http://www.apache.org/;>ASF Homepage
+http://www.apache.org/licenses/;>License
+http://www.apache.org/security/;>Security
+http://www.apache.org/foundation/thanks.html;>Thanks
+http://www.apache.org/foundation/sponsorship.html;>Sponsorship
+https://www.apache.org/foundation/policies/conduct;>Code of 
Conduct
+  
+
+  
+
+
+
+
+  
+
+http://schema.org/BlogPosting;>
+
+  
+Apache Beam 2.3.0
+Feb 19, 2018 •  Ismaël Mejía [https://twitter.com/iemejia;>@iemejia]
+
+  
+
+  
+We are glad to present the new 2.3.0 release of Beam. This release 
includes
+multiple fixes and new functionalities.  For more information
+please check the detailed release notes.
+
+New Features / Improvements
+
+Beam moves to Java 8
+
+The supported version of Java for Beam is now Java 8. The code and examples 
have
+been refactored to use multiple of the advantages of the language, e.g. 
lambdas,
+streams, improved type inference, etc.
+
+Spark runner is now based on 
Spark 2.x
+
+Spark runner moves forward into the Spark 2.x development line, this would 
allow
+to benefit of improved performance, as well as open the runner for future
+compatibility with the Structured Streaming APIs. Notice that support for Spark
+1.x is finished with this release.
+
+Amazon Web Services S3 
Filesystem support
+
+Beam already supported AWS S3 via HadoopFileSystem, but this version brings 
a
+native implementation with the corresponding performance advantages of the S3
+filesystem.
+
+General-purpose writing to files
+
+This release contains a new transform, FileIO.write() / writeDynamic() that
+implements a general-purpose fluent and Java8-friendly API for writing to files
+using a FileIO.Sink. This API has similar capabilities to DynamicDestinations
+APIs from Beam 2.2 but is much easier to use and extend. The 
DynamicDestinations
+APIs for writing to files are deprecated by it, as is FileBasedSink.
+
+Splittable DoFn support on 
the Python SDK
+
+This release adds the Splittable DoFn API for Python SDK and adds Splittable
+DoFn support for Python streaming DirectRunner.
+
+Portability
+
+Progress continues to being able to execute Python on runners other then 
Google
+Cloud Dataflow and the Go SDK on any runner.
+
+Miscellaneous Fixes
+
+SDKs
+
+
+  MapElements and FlatMapElements support using side inputs using the new
+interface Contextful.Fn. For library authors, this interface is the
+recommended choice for user-code callbacks that may use side inputs.
+  Introduces the family of Reify transforms for converting between 
explicit and
+implicit representations of various Beam entities.
+  Introduces two transforms for approximate sketching of data: Count-Min 
Sketch
+(approximate element frequency 

[beam-site] 02/02: This closes #390

2018-02-19 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f935b9de8f79ef09970f1843ed2e9cbef235c225
Merge: 9a06132 527683e
Author: Mergebot 
AuthorDate: Mon Feb 19 05:25:42 2018 -0800

This closes #390

 src/_data/authors.yml   |  4 ++
 src/_posts/2018-02-19-beam-2.3.0.md | 89 +
 2 files changed, 93 insertions(+)

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.


[beam-site] 01/01: This closes #381

2018-02-19 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit c8e80d68eabc4aa12b34b85d6d3d97c880b1a468
Merge: 297a3ad 0b005db
Author: Mergebot 
AuthorDate: Mon Feb 19 05:19:16 2018 -0800

This closes #381

 _config.yml| 2 +-
 .../sdks/javadoc/2.3.0/META-INF/MANIFEST.MF| 3 +
 .../sdks/javadoc/2.3.0/allclasses-frame.html   |  1190 +
 .../sdks/javadoc/2.3.0/allclasses-noframe.html |  1190 +
 .../sdks/javadoc/2.3.0/constant-values.html|   875 +
 .../sdks/javadoc/2.3.0/deprecated-list.html|   600 +
 src/documentation/sdks/javadoc/2.3.0/help-doc.html |   223 +
 .../sdks/javadoc/2.3.0/index-all.html  | 23704 +++
 src/documentation/sdks/javadoc/2.3.0/index.html|75 +
 .../LocalFileSystemArtifactStagerService.html  |   327 +
 .../apache/beam/artifact/local/package-frame.html  |20 +
 .../beam/artifact/local/package-summary.html   |   151 +
 .../apache/beam/artifact/local/package-tree.html   |   139 +
 .../beam/runners/apex/ApexPipelineOptions.html |   429 +
 .../apex/ApexRunner.CreateApexPCollectionView.html |   328 +
 .../org/apache/beam/runners/apex/ApexRunner.html   |   412 +
 .../runners/apex/ApexRunnerRegistrar.Options.html  |   284 +
 .../runners/apex/ApexRunnerRegistrar.Runner.html   |   288 +
 .../beam/runners/apex/ApexRunnerRegistrar.html |   227 +
 .../apache/beam/runners/apex/ApexRunnerResult.html |   419 +
 .../apex/ApexYarnLauncher.LaunchParams.html|   315 +
 .../apex/ApexYarnLauncher.ProcessWatcher.html  |   296 +
 .../apache/beam/runners/apex/ApexYarnLauncher.html |   421 +
 .../apache/beam/runners/apex/TestApexRunner.html   |   286 +
 .../apache/beam/runners/apex/package-frame.html|33 +
 .../apache/beam/runners/apex/package-summary.html  |   225 +
 .../org/apache/beam/runners/apex/package-tree.html |   164 +
 ...chStatefulParDoOverrides.BatchStatefulDoFn.html |   351 +
 .../dataflow/BatchStatefulParDoOverrides.html  |   323 +
 .../beam/runners/dataflow/CreateDataflowView.html  |   330 +
 .../beam/runners/dataflow/DataflowClient.html  |   426 +
 .../DataflowJobAlreadyExistsException.html |   286 +
 .../DataflowJobAlreadyUpdatedException.html|   285 +
 .../runners/dataflow/DataflowJobException.html |   273 +
 .../beam/runners/dataflow/DataflowPipelineJob.html |   599 +
 .../DataflowPipelineRegistrar.Options.html |   284 +
 .../dataflow/DataflowPipelineRegistrar.Runner.html |   288 +
 .../dataflow/DataflowPipelineRegistrar.html|   224 +
 ...ataflowPipelineTranslator.JobSpecification.html |   312 +
 .../dataflow/DataflowPipelineTranslator.html   |   360 +
 ...lowRunner.StreamingPCollectionViewWriterFn.html |   326 +
 .../beam/runners/dataflow/DataflowRunner.html  |   477 +
 .../beam/runners/dataflow/DataflowRunnerHooks.html |   283 +
 .../beam/runners/dataflow/DataflowRunnerInfo.html  |   328 +
 .../runners/dataflow/DataflowServiceException.html |   238 +
 .../PrimitiveParDoSingleFactory.ParDoSingle.html   |   388 +
 ...mitiveParDoSingleFactory.PayloadTranslator.html |   321 +
 .../PrimitiveParDoSingleFactory.Registrar.html |   301 +
 .../dataflow/PrimitiveParDoSingleFactory.html  |   331 +
 .../dataflow/TestDataflowPipelineOptions.html  |   347 +
 .../beam/runners/dataflow/TestDataflowRunner.html  |   296 +
 ...TransformTranslator.StepTranslationContext.html |   389 +
 .../TransformTranslator.TranslationContext.html|   382 +
 .../beam/runners/dataflow/TransformTranslator.html |   254 +
 .../dataflow/options/CloudDebuggerOptions.html |   337 +
 ...PipelineDebugOptions.DataflowClientFactory.html |   291 +
 ...DataflowPipelineDebugOptions.StagerFactory.html |   292 +
 .../options/DataflowPipelineDebugOptions.html  |   685 +
 ...flowPipelineOptions.StagingLocationFactory.html |   291 +
 .../dataflow/options/DataflowPipelineOptions.html  |   625 +
 ...WorkerPoolOptions.AutoscalingAlgorithmType.html |   385 +
 ...Options.WorkerHarnessContainerImageFactory.html |   292 +
 .../options/DataflowPipelineWorkerPoolOptions.html |   662 +
 ...ptions.DataflowProfilingAgentConfiguration.html |   301 +
 .../dataflow/options/DataflowProfilingOptions.html |   313 +
 .../options/DataflowWorkerHarnessOptions.html  |   452 +
 .../DataflowWorkerLoggingOptions.Level.html|   410 +
 ...rkerLoggingOptions.WorkerLogLevelOverrides.html |   425 +
 .../options/DataflowWorkerLoggingOptions.html  |   427 +
 .../runners/dataflow/options/package-frame.html|40 +
 .../runners/dataflow/options/package-summary.html  |   261 +
 .../runners/dataflow/options/package-tree.html |   428 +
 .../beam/runners/dataflow/package-frame.html   |52 +
 .../beam/runners/dataflow/package-summary.html |   345 +
 

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Flink #5033

2018-02-19 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PerformanceTests_Python #931

2018-02-19 Thread Apache Jenkins Server
See 


--
[...truncated 15 B...]
Building remotely on beam7 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* 
 > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision bb98aa96f78182a177cfe421b2bba04c06b1b094 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f bb98aa96f78182a177cfe421b2bba04c06b1b094
Commit message: "Merge pull request #4685: [BEAM-2530] More fixes/upgrades for 
Java 9 compatibility"
 > git rev-list --no-walk bb98aa96f78182a177cfe421b2bba04c06b1b094 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins3880537195119747735.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins5665347342927241210.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins322665735162221739.sh
+ virtualenv .env --system-site-packages
New python executable in 

Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins2920136040404852501.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins7546300241012118405.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe 
/tmp/jenkins2983882711761258709.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in 
/usr/local/lib/python2.7/dist-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages 
(from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in 
/home/jenkins/.local/lib/python2.7/site-packages (from -r 
PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
:318:
 SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name 
Indication) extension to TLS is not available on this platform. This may cause 
the server to present an incorrect TLS certificate, which can cause validation 
failures. You can upgrade to a newer version of Python to solve this. For more 
information, see 
https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
:122:
 InsecurePlatformWarning: A true SSLContext object is not available. This 
prevents urllib3 from configuring SSL appropriately and may cause certain SSL 
connections to fail. You can upgrade to a newer version of Python to solve 
this. For more information, see 

Build failed in Jenkins: beam_PostCommit_Python_Verify #4259

2018-02-19 Thread Apache Jenkins Server
See 


--
[...truncated 1.40 MB...]
  value {
spec {
  spec {
urn: "beam:coder:varint:v1"
  }
}
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_11"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_12"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_13"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_14"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_15"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_16"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_1_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_2_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_6"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_FastPrimitivesCoder_3"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_7"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_VarIntCoder_8"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9_bytes"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10_bytes"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
coders {
  key: "ref_Coder_WindowedValueCoder_9_len_prefix"
  value {
spec {
  spec {
urn: "beam:coder:windowed_value:v1"
  }
}
component_coder_ids: "ref_Coder_TupleCoder_10_len_prefix"
component_coder_ids: "ref_Coder_GlobalWindowCoder_5"
  }
}
  }
}

root: DEBUG: CONTROL RESPONSE instruction_id: "control_4"
register {
}

root: DEBUG: CONTROL REQUEST instruction_id: "bundle_1211"
process_bundle {
  process_bundle_descriptor_reference: "3"
}

root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: start 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: INFO: finish 
root: DEBUG: CONTROL RESPONSE instruction_id: "bundle_1211"
process_bundle {
  metrics {
ptransforms {
  key: "assert_that/Group/GroupByKey/Read"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Group/Map(_merge_tagged_vals_under_key)"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Match"
  value {
processed_elements {
  measured {
output_element_counts {
  key: "None"
  value: 1
}
  }
}
  }
}
ptransforms {
  key: "assert_that/Unkey"
  value {