Build failed in Jenkins: beam_PostCommit_Python_Verify #3388

2017-10-18 Thread Apache Jenkins Server
See -- [...truncated 887.02 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py -> apache-beam-2.3.0.dev0/apache_beam/portability/api copying

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4192

2017-10-18 Thread Apache Jenkins Server
See

[jira] [Resolved] (BEAM-2720) Exactly-once Kafka sink

2017-10-18 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi resolved BEAM-2720. Resolution: Fixed Fix Version/s: 2.2.0 > Exactly-once Kafka sink > --- >

[jira] [Updated] (BEAM-2720) Exactly-once Kafka sink

2017-10-18 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated BEAM-2720: --- Summary: Exactly-once Kafka sink (was: Exact-once Kafka sink) > Exactly-once Kafka sink >

[jira] [Commented] (BEAM-3076) support TIMESTAMP in BeamRecordType

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210431#comment-16210431 ] ASF GitHub Bot commented on BEAM-3076: -- GitHub user zangshayang1 opened a pull request:

[GitHub] beam pull request #4015: [BEAM-3076] support TIMESTAMP in BeamRecordType

2017-10-18 Thread zangshayang1
GitHub user zangshayang1 opened a pull request: https://github.com/apache/beam/pull/4015 [BEAM-3076] support TIMESTAMP in BeamRecordType This is to support Timestamp datatype in BeamRecordSqlType.java by introducing TimestampCoder. Previously Timestamp datatype is mapped to Date

[jira] [Created] (BEAM-3076) support TIMESTAMP in BeamRecordType

2017-10-18 Thread Shayang Zang (JIRA)
Shayang Zang created BEAM-3076: -- Summary: support TIMESTAMP in BeamRecordType Key: BEAM-3076 URL: https://issues.apache.org/jira/browse/BEAM-3076 Project: Beam Issue Type: Improvement

Build failed in Jenkins: beam_PerformanceTests_Python #464

2017-10-18 Thread Apache Jenkins Server
See Changes: [rangadi] [BEAM-2720] Update kafka client version to 0.11.0.1 [kenn] Improve GcsFileSystem errors messages slightly [kenn] Add ability to stage explicit file list [kenn] Stage the

Build failed in Jenkins: beam_PostCommit_Python_Verify #3387

2017-10-18 Thread Apache Jenkins Server
See -- [...truncated 885.17 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py -> apache-beam-2.3.0.dev0/apache_beam/portability/api copying

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210201#comment-16210201 ] ASF GitHub Bot commented on BEAM-1542: -- GitHub user mairbek opened a pull request:

[GitHub] beam pull request #4014: [BEAM-1542] SpannerIO: mutation encoding and size e...

2017-10-18 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam/pull/4014 [BEAM-1542] SpannerIO: mutation encoding and size estimation improvements #4013 must be reviewed merged first You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210145#comment-16210145 ] ASF GitHub Bot commented on BEAM-1542: -- GitHub user mairbek opened a pull request:

[GitHub] beam pull request #4013: [BEAM-1542] A transform for reading the Spanner sch...

2017-10-18 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam/pull/4013 [BEAM-1542] A transform for reading the Spanner schema A part of https://github.com/apache/beam/pull/3729. Ideally, spanner schema should be an introspection part of the Cloud Spanner

[GitHub] beam pull request #4012: Pin runner harness also for official BEAM releases.

2017-10-18 Thread tvalentyn
GitHub user tvalentyn opened a pull request: https://github.com/apache/beam/pull/4012 Pin runner harness also for official BEAM releases. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2926) Java SDK support for portable side input

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210096#comment-16210096 ] ASF GitHub Bot commented on BEAM-2926: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #4011: [BEAM-2926] Migrate to using a trivial multimap mat...

2017-10-18 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/4011 [BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure

[jira] [Created] (BEAM-3075) Document getting started for python sdk developers

2017-10-18 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-3075: - Summary: Document getting started for python sdk developers Key: BEAM-3075 URL: https://issues.apache.org/jira/browse/BEAM-3075 Project: Beam Issue Type: Bug

[beam-site] branch mergebot updated (3edd5d2 -> cc8a7a7)

2017-10-18 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 3edd5d2 This closes #322 discard 4d77ab9 Move Elasticsearch v5.x from in-progress to built-in

[beam-site] 01/04: Update IntelliJ Checkstyle instructions

2017-10-18 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 68c9fefffd21553b8cd5219d9145cef88901768e Author: wtanaka.com AuthorDate:

[beam-site] 04/04: This closes #331

2017-10-18 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit cc8a7a7e2141ae16a25cd2f75c97238741135f49 Merge: efdc471 a7159d7 Author: Mergebot

[beam-site] 03/04: Address https://github.com/apache/beam-site/pull/331#discussion_r144906095

2017-10-18 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit a7159d76e181a349c731c71af43ce40fd5695ccc Author: wtanaka.com AuthorDate:

[beam-site] 02/04: Address https://github.com/apache/beam-site/pull/331#discussion_r144115767

2017-10-18 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit a4662c73f62aa97a5c20d3f7fffe8246f85a9a35 Author: wtanaka.com AuthorDate:

[jira] [Resolved] (BEAM-2963) Propagate pipeline protos through Dataflow API from Java

2017-10-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2963. --- Resolution: Fixed Fix Version/s: 2.3.0 > Propagate pipeline protos through Dataflow API

[GitHub] beam pull request #4010: [BEAM-3074] Stage the pipeline in Python DataflowRu...

2017-10-18 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/4010 [BEAM-3074] Stage the pipeline in Python DataflowRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

Build failed in Jenkins: beam_PostCommit_Python_Verify #3386

2017-10-18 Thread Apache Jenkins Server
See Changes: [rangadi] [BEAM-2720] Update kafka client version to 0.11.0.1 [kenn] Improve GcsFileSystem errors messages slightly [kenn] Add ability to stage explicit file list [kenn] Stage the

[jira] [Commented] (BEAM-2963) Propagate pipeline protos through Dataflow API from Java

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209941#comment-16209941 ] ASF GitHub Bot commented on BEAM-2963: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3977: [BEAM-2963] Stage pipeline in DataflowRunner

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3977 ---

[6/7] beam git commit: Remove duplicate mocking in DataflowRunnerTest

2017-10-18 Thread kenn
Remove duplicate mocking in DataflowRunnerTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/128f3a63 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/128f3a63 Diff:

[2/7] beam git commit: Add ability to stage explicit file list

2017-10-18 Thread kenn
Add ability to stage explicit file list Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9b866fef Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9b866fef Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9b866fef

[4/7] beam git commit: Add assertion that valid jobs must have staged pipeline

2017-10-18 Thread kenn
Add assertion that valid jobs must have staged pipeline Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cef997ff Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cef997ff Diff:

[7/7] beam git commit: This closes #3977: [BEAM-2963] Stage pipeline in DataflowRunner

2017-10-18 Thread kenn
This closes #3977: [BEAM-2963] Stage pipeline in DataflowRunner Remove duplicate mocking in DataflowRunnerTest Add assertion that valid jobs must have staged pipeline Stage the pipeline without using a temp file Stage the portable pipeline in Dataflow Add ability to stage explicit file

[1/7] beam git commit: Stage the portable pipeline in Dataflow

2017-10-18 Thread kenn
Repository: beam Updated Branches: refs/heads/master 2acdc747a -> 1974b920e Stage the portable pipeline in Dataflow Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/aea0c601 Tree:

[3/7] beam git commit: Improve GcsFileSystem errors messages slightly

2017-10-18 Thread kenn
Improve GcsFileSystem errors messages slightly Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7409ca04 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7409ca04 Diff:

[5/7] beam git commit: Stage the pipeline without using a temp file

2017-10-18 Thread kenn
Stage the pipeline without using a temp file Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/090c5124 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/090c5124 Diff:

[jira] [Commented] (BEAM-3029) BigTable integration tests failing on Dataflow: UserAgent must not be empty

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209900#comment-16209900 ] ASF GitHub Bot commented on BEAM-3029: -- Github user chamikaramj closed the pull request at:

[GitHub] beam pull request #3998: [BEAM-3029] Sets user agent in BigTableIO.Read.getB...

2017-10-18 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/beam/pull/3998 ---

[GitHub] beam pull request #4009: [BEAM-2720] Update kafka client version to 0.11.0.1

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/4009 ---

[jira] [Commented] (BEAM-2720) Exact-once Kafka sink

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209891#comment-16209891 ] ASF GitHub Bot commented on BEAM-2720: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #4009: [BEAM-2720] Update kafka client version to 0.11.0.1

2017-10-18 Thread kenn
This closes #4009: [BEAM-2720] Update kafka client version to 0.11.0.1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2acdc747 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2acdc747 Diff:

[1/2] beam git commit: [BEAM-2720] Update kafka client version to 0.11.0.1

2017-10-18 Thread kenn
Repository: beam Updated Branches: refs/heads/master 77a4d3e9d -> 2acdc747a [BEAM-2720] Update kafka client version to 0.11.0.1 This was supposed to be in earler PR #3612, but it slipped through. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

Build failed in Jenkins: beam_PerformanceTests_Python #463

2017-10-18 Thread Apache Jenkins Server
See Changes: [tgroh] Update PipelineTest.testReplacedNames -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam3

Build failed in Jenkins: beam_PostCommit_Python_Verify #3385

2017-10-18 Thread Apache Jenkins Server
See Changes: [tgroh] Update PipelineTest.testReplacedNames -- [...truncated 886.08 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py ->

[jira] [Commented] (BEAM-2720) Exact-once Kafka sink

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209703#comment-16209703 ] ASF GitHub Bot commented on BEAM-2720: -- GitHub user rangadi opened a pull request:

[GitHub] beam pull request #4009: [BEAM-2720] Update kafka client version to 0.11.0.1

2017-10-18 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/beam/pull/4009 [BEAM-2720] Update kafka client version to 0.11.0.1 This was supposed to be in earlier PR #3612, but it slipped through. +R: @kennknowles, @iemejia You can merge this pull request into a

[jira] [Resolved] (BEAM-3006) Minor fix in PipelineTest.testReplacedNames()

2017-10-18 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-3006. --- Resolution: Fixed Fix Version/s: Not applicable > Minor fix in PipelineTest.testReplacedNames()

[jira] [Commented] (BEAM-3006) Minor fix in PipelineTest.testReplacedNames()

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209684#comment-16209684 ] ASF GitHub Bot commented on BEAM-3006: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3929: [BEAM-3006] fixing minor issue in PipelineTest#test...

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3929 ---

[1/2] beam git commit: This closes #3929

2017-10-18 Thread tgroh
Repository: beam Updated Branches: refs/heads/master de7cc05cc -> 77a4d3e9d This closes #3929 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77a4d3e9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/77a4d3e9 Diff:

[2/2] beam git commit: Update PipelineTest.testReplacedNames

2017-10-18 Thread tgroh
Update PipelineTest.testReplacedNames Validate that the node has been replaced (via comparing the class of a subnode) rather than just checking names. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1e3bee18 Tree:

Build failed in Jenkins: beam_PostCommit_Python_Verify #3384

2017-10-18 Thread Apache Jenkins Server
See -- [...truncated 882.71 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py -> apache-beam-2.3.0.dev0/apache_beam/portability/api copying

[jira] [Commented] (BEAM-3056) dataflow-runner-integration-tests @ beam-examples-java fail in precommit suite on 2.2.0 branch

2017-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209335#comment-16209335 ] ASF GitHub Bot commented on BEAM-3056: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #4006: Use 2.2.0 container tag for Dataflow

2017-10-18 Thread kenn
This closes #4006: Use 2.2.0 container tag for Dataflow Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/582ddefb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/582ddefb Diff:

[GitHub] beam pull request #4006: [BEAM-3056] Set Dataflow container version to 2.2.0

2017-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/4006 ---

[1/2] beam git commit: Use 2.2.0 container tag for Dataflow

2017-10-18 Thread kenn
Repository: beam Updated Branches: refs/heads/release-2.2.0 09431daeb -> 582ddefbd Use 2.2.0 container tag for Dataflow Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1b10b91d Tree:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Apex #2633

2017-10-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_Python #462

2017-10-18 Thread Apache Jenkins Server
See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace

Build failed in Jenkins: beam_PostCommit_Python_Verify #3383

2017-10-18 Thread Apache Jenkins Server
See -- [...truncated 886.11 KB...] copying apache_beam/portability/api/standard_window_fns_pb2.py -> apache-beam-2.3.0.dev0/apache_beam/portability/api copying

[GitHub] beam pull request #4008: Fix error and warnings on KafkaIO javadoc generatio...

2017-10-18 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/4008 Fix error and warnings on KafkaIO javadoc generation Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-3039) DatastoreIO.Write fails multiple mutations of same entity

2017-10-18 Thread Alexander Hoem Rosbach (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208917#comment-16208917 ] Alexander Hoem Rosbach commented on BEAM-3039: -- In my experience the duplication removal is

[jira] [Comment Edited] (BEAM-3073) Connect to Apache ignite via JdbcIO sdk

2017-10-18 Thread Rick Lin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208867#comment-16208867 ] Rick Lin edited comment on BEAM-3073 at 10/18/17 7:02 AM: -- There are details about

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Apex #2632

2017-10-18 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-3073) Connect to Apache ignite via JdbcIO sdk

2017-10-18 Thread Rick Lin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208867#comment-16208867 ] Rick Lin commented on BEAM-3073: There are details about my run environment *OS:* Distributor ID: Ubuntu

Build failed in Jenkins: beam_PerformanceTests_Python #461

2017-10-18 Thread Apache Jenkins Server
See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam3 (beam) in workspace