[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182782#comment-16182782 ] ASF GitHub Bot commented on BEAM-2724: -- Github user pabloem closed the pull request at:

[GitHub] beam pull request #3786: [BEAM-2724] Preparing statesampler to work with str...

Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/3786 ---

[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182783#comment-16182783 ] ASF GitHub Bot commented on BEAM-2724: -- GitHub user pabloem reopened a pull request:

[GitHub] beam pull request #3786: [BEAM-2724] Preparing statesampler to work with str...

GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/3786 [BEAM-2724] Preparing statesampler to work with structured names You can merge this pull request into a Git repository by running: $ git pull https://github.com/pabloem/incubator-beam

[jira] [Commented] (BEAM-2993) AvroIO.write without specifying a schema

[ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182818#comment-16182818 ] Eugene Kirpichov commented on BEAM-2993: Do you have a more concrete use case? I don't think it's

[jira] [Created] (BEAM-2996) Metric names should not be null or empty

Ben Chambers created BEAM-2996: -- Summary: Metric names should not be null or empty Key: BEAM-2996 URL: https://issues.apache.org/jira/browse/BEAM-2996 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2975) Results of ReadableState.read() should be snapshots of the underlying state

[ https://issues.apache.org/jira/browse/BEAM-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182927#comment-16182927 ] Daniel Mills commented on BEAM-2975: In order for the results of a read() call to be used as output()

Jenkins build is back to normal : beam_PerformanceTests_Python #380

See

[GitHub] beam pull request #3904: [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3904 ---

[jira] [Commented] (BEAM-2959) Fix proto enums to not use 0 for a valid value

[ https://issues.apache.org/jira/browse/BEAM-2959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183085#comment-16183085 ] ASF GitHub Bot commented on BEAM-2959: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3939

See

[GitHub] beam pull request #3913: [BEAM-2959] Encapsulate enums within a message so t...

GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3913 [BEAM-2959] Encapsulate enums within a message so that C++/Python have meaningful namespaces when importing. Follow this checklist to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-2959) Fix proto enums to not use 0 for a valid value

[ https://issues.apache.org/jira/browse/BEAM-2959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183219#comment-16183219 ] ASF GitHub Bot commented on BEAM-2959: -- GitHub user lukecwik opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3940

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3938

See

[jira] [Commented] (BEAM-2992) Remove codepaths for reading unsplit BigQuery sources

[ https://issues.apache.org/jira/browse/BEAM-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183206#comment-16183206 ] ASF GitHub Bot commented on BEAM-2992: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-2802) TextIO should allow specifying a custom delimiter

[ https://issues.apache.org/jira/browse/BEAM-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183062#comment-16183062 ] Davor Bonaci commented on BEAM-2802: [~ryanskraba] and [~echauchot] -- thank you both for making this

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #3167

See

[1/2] beam git commit: [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED" as the first declared enum.

Repository: beam Updated Branches: refs/heads/master 41239d808 -> 87ea0681e [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED" as the first declared enum. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b6c68a6c Tree:

[2/2] beam git commit: [BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED" as the first declared enum.

[BEAM-2959] Fix proto enums to use "YYY_UNSPECIFIED" as the first declared enum. This closes #3904 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/87ea0681 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/87ea0681 Diff:

[jira] [Resolved] (BEAM-2959) Fix proto enums to not use 0 for a valid value

[ https://issues.apache.org/jira/browse/BEAM-2959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2959. - Resolution: Fixed Fix Version/s: 2.2.0 > Fix proto enums to not use 0 for a valid value >

[GitHub] beam pull request #3912: [BEAM-2724] Updating BEAM_CONTAINER_VERSION for new...

GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/3912 [BEAM-2724] Updating BEAM_CONTAINER_VERSION for new worker r: @charlesccychen Updating to a new worker harness that supports structured names for msec counters. You can merge this pull

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Dataflow #4056

See

[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183137#comment-16183137 ] ASF GitHub Bot commented on BEAM-2724: -- GitHub user pabloem opened a pull request:

Build failed in Jenkins: beam_PostCommit_Python_Verify #3226

See -- [...truncated 991.48 KB...] } ], "is_pair_like": true }

[jira] [Created] (BEAM-2997) Encapsulate all proto enum types within a message so that they are namespaced in C++/Python

Luke Cwik created BEAM-2997: --- Summary: Encapsulate all proto enum types within a message so that they are namespaced in C++/Python Key: BEAM-2997 URL: https://issues.apache.org/jira/browse/BEAM-2997

[GitHub] beam pull request #3911: Avoid using beta grpc implementation.

GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3911 Avoid using beta grpc implementation. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[1/2] beam git commit: Removes codepaths for reading unsplit BigQuery sources

Repository: beam Updated Branches: refs/heads/master 87ea0681e -> 7e3f591b2 Removes codepaths for reading unsplit BigQuery sources Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/18d7c296 Tree:

[GitHub] beam pull request #3891: [BEAM-2992] Removes codepaths for reading unsplit B...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3891 ---

[2/2] beam git commit: This closes #3891: [BEAM-2992] Removes codepaths for reading unsplit BigQuery sources

This closes #3891: [BEAM-2992] Removes codepaths for reading unsplit BigQuery sources Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7e3f591b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7e3f591b Diff:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3227

See

[4/4] beam git commit: This closes #3890: Introduces Reshuffle.viaRandomKey()

This closes #3890: Introduces Reshuffle.viaRandomKey() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/393e5631 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/393e5631 Diff:

[1/4] beam git commit: Adds ReadableFile.toString() for debugging

Repository: beam Updated Branches: refs/heads/master 7e3f591b2 -> 393e56310 Adds ReadableFile.toString() for debugging Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a6e20017 Tree:

[3/4] beam git commit: PAssert improvements.

PAssert improvements. - Captures stack trace by introducing a SerializableThrowable. Fixes an incorrect test of this. - PAssert.thatSingletonIterable, thatMap/Multimap/Singleton no longer require that the collection is produced by a trigger that promises a single firing.

[2/4] beam git commit: Introduces Reshuffle.viaRandomKey()

Introduces Reshuffle.viaRandomKey() It's a commonly used pattern for breaking fusion https://cloud.google.com/dataflow/service/dataflow-service-desc#fusion-optimization viaRandomKey() only abstracts away the current commonly used pattern. It has the same caveats as using Reshuffle.of() directly

[GitHub] beam pull request #3890: Introduces Reshuffle.viaRandomKey()

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3890 ---

[jira] [Resolved] (BEAM-2992) Remove codepaths for reading unsplit BigQuery sources

[ https://issues.apache.org/jira/browse/BEAM-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax resolved BEAM-2992. -- Resolution: Fixed > Remove codepaths for reading unsplit BigQuery sources >

[jira] [Commented] (BEAM-2058) BigQuery load job id should be generated at run time, not submission time

[ https://issues.apache.org/jira/browse/BEAM-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183303#comment-16183303 ] Ben Chambers commented on BEAM-2058: Reuven -- it looks like the PR went in to fix this. Should it be

[beam-site] branch asf-site updated (07615ea -> 82cd4ff)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 07615ea Prepare repository for deployment. add 939306f Manually add missing generated files

[beam-site] branch mergebot updated (8c112de -> 82cd4ff)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 8c112de This closes #324 add 07615ea Prepare repository for deployment. new 939306f

[beam-site] 01/02: Manually add missing generated files

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 939306f7540a77298fe08718b3a5afa98b46033b Author: melissa AuthorDate: Mon Sep 25

[beam-site] 02/02: This closes #325

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 82cd4ffbac0dd806aa75b17ff59c5d464e2778e8 Merge: 07615ea 939306f Author: Mergebot

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4897

See

[jira] [Resolved] (BEAM-2794) Failed to run Wordcount example following quick start guide

[ https://issues.apache.org/jira/browse/BEAM-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang resolved BEAM-2794. Resolution: Not A Problem Fix Version/s: Not applicable > Failed to run Wordcount example

[jira] [Commented] (BEAM-2794) Failed to run Wordcount example following quick start guide

[ https://issues.apache.org/jira/browse/BEAM-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183540#comment-16183540 ] Huafeng Wang commented on BEAM-2794: Thanks for your explanation [~jingc]! I can close this one now. >

[jira] [Created] (BEAM-3000) No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?

Rodrigo Benenson created BEAM-3000: -- Summary: No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)? Key: BEAM-3000 URL: https://issues.apache.org/jira/browse/BEAM-3000 Project:

[jira] [Commented] (BEAM-2995) can't read/write hdfs in Flink CLUSTER(Standalone)

[ https://issues.apache.org/jira/browse/BEAM-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183553#comment-16183553 ] huangjianhuang commented on BEAM-2995: -- by the way, my pom.xml is: {code:java} com.joe

[jira] [Created] (BEAM-2999) Split validatesrunner tests from Python postcommit

Mark Liu created BEAM-2999: -- Summary: Split validatesrunner tests from Python postcommit Key: BEAM-2999 URL: https://issues.apache.org/jira/browse/BEAM-2999 Project: Beam Issue Type: Bug

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4060

See

[jira] [Commented] (BEAM-2975) Results of ReadableState.read() should be snapshots of the underlying state

[ https://issues.apache.org/jira/browse/BEAM-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183417#comment-16183417 ] Luke Cwik commented on BEAM-2975: - After thinking this for some more, I don't have a strong opinion on the

[jira] [Commented] (BEAM-2794) Failed to run Wordcount example following quick start guide

[ https://issues.apache.org/jira/browse/BEAM-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183484#comment-16183484 ] Jing Chen commented on BEAM-2794: - Hi Huafeng, I believe it is not a bug. I would suggest you get the word

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3941

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3942

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3943

See

[jira] [Updated] (BEAM-2998) add IT test for SQL

[ https://issues.apache.org/jira/browse/BEAM-2998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2998: - Description: Add IT test for SQL module

[jira] [Created] (BEAM-2998) add IT test for SQL

Xu Mingmin created BEAM-2998: Summary: add IT test for SQL Key: BEAM-2998 URL: https://issues.apache.org/jira/browse/BEAM-2998 Project: Beam Issue Type: Test Components: dsl-sql

[2/2] beam git commit: [BEAM-2606] make WindowFnTestUtils use the value in addition to the timestamp of the elements

[BEAM-2606] make WindowFnTestUtils use the value in addition to the timestamp of the elements This closes #3592 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/da531b7b Tree:

[1/2] beam git commit: [BEAM-2606] make WindowFnTestUtils use the value in addition to the timestamp of the elements

Repository: beam Updated Branches: refs/heads/master 393e56310 -> da531b7bc [BEAM-2606] make WindowFnTestUtils use the value in addition to the timestamp of the elements Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[jira] [Commented] (BEAM-2606) WindowFnTestUtils should allow using the value in addition to the timestamp of the elements

[ https://issues.apache.org/jira/browse/BEAM-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183462#comment-16183462 ] ASF GitHub Bot commented on BEAM-2606: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3592: [BEAM-2606] make WindowFnTestUtils use the value in...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3592 ---

[GitHub] beam pull request #3915: [BEAM-2958] Adding a top-level user agent string to...

GitHub user youngoli opened a pull request: https://github.com/apache/beam/pull/3915 [BEAM-2958] Adding a top-level user agent string to PipelineOptions Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2958) Expose a top level user agent PipelineOption which can be communicated to external services

[ https://issues.apache.org/jira/browse/BEAM-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183491#comment-16183491 ] ASF GitHub Bot commented on BEAM-2958: -- GitHub user youngoli opened a pull request:

[GitHub] beam pull request #3914: [BEAM-2996] Ensure metric names are not null or emp...

GitHub user bjchambers opened a pull request: https://github.com/apache/beam/pull/3914 [BEAM-2996] Ensure metric names are not null or empty Follow this checklist to help us incorporate your contribution quickly and easily: - [*] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2996) Metric names should not be null or empty

[ https://issues.apache.org/jira/browse/BEAM-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183305#comment-16183305 ] ASF GitHub Bot commented on BEAM-2996: -- GitHub user bjchambers opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3936

See

[jira] [Created] (BEAM-2993) AvroIO.write without specifying a schema

Etienne Chauchot created BEAM-2993: -- Summary: AvroIO.write without specifying a schema Key: BEAM-2993 URL: https://issues.apache.org/jira/browse/BEAM-2993 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2993) AvroIO.write without specifying a schema

[ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182143#comment-16182143 ] Etienne Chauchot commented on BEAM-2993: [~jkff] you coded

[jira] [Assigned] (BEAM-2993) AvroIO.write without specifying a schema

[ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2993: -- Assignee: (was: Reuven Lax) > AvroIO.write without specifying a schema >

[jira] [Commented] (BEAM-2975) Results of ReadableState.read() should be snapshots of the underlying state

[ https://issues.apache.org/jira/browse/BEAM-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182151#comment-16182151 ] Aljoscha Krettek commented on BEAM-2975: These changes also broke the PostCommit tests for the

[jira] [Updated] (BEAM-2993) AvroIO.write without specifying a schema

[ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-2993: --- Description: Similarly to https://issues.apache.org/jira/browse/BEAM-2677, we should be able

[GitHub] beam pull request #3909: Adapt Flink StateInternals to new state semantics

GitHub user aljoscha opened a pull request: https://github.com/apache/beam/pull/3909 Adapt Flink StateInternals to new state semantics This was changed in #3876. R: @tgroh (not sure I caught all the places where this needs to change) You can merge this pull request into a

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3224

See

[GitHub] beam pull request #3910: Fix "Writing data to multiple destinations" part of...

GitHub user echauchot opened a pull request: https://github.com/apache/beam/pull/3910 Fix "Writing data to multiple destinations" part of AvroIO javadoc Follow this checklist to help us incorporate your contribution quickly and easily: - [] Make sure there is a [JIRA

[jira] [Assigned] (BEAM-2993) AvroIO.write without specifying a schema

[ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2993: -- Assignee: Etienne Chauchot > AvroIO.write without specifying a schema >

[jira] [Commented] (BEAM-995) Apache Pig DSL

[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182308#comment-16182308 ] Niels Basjes commented on BEAM-995: --- [~xumingming] I was talking about this issue last week with a

[jira] [Comment Edited] (BEAM-2993) AvroIO.write without specifying a schema

[ https://issues.apache.org/jira/browse/BEAM-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182143#comment-16182143 ] Etienne Chauchot edited comment on BEAM-2993 at 9/27/17 11:43 AM: -- I was

[jira] [Commented] (BEAM-995) Apache Pig DSL

[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182502#comment-16182502 ] James Xu commented on BEAM-995: --- [~nielsbasjes] Pig actually is doing the similar thing as Beam: # They both

[jira] [Created] (BEAM-2994) Refactor TikaIO

Sergey Beryozkin created BEAM-2994: -- Summary: Refactor TikaIO Key: BEAM-2994 URL: https://issues.apache.org/jira/browse/BEAM-2994 Project: Beam Issue Type: Task Components:

[jira] [Created] (BEAM-2995) can't read/write hdfs in Flink CLUSTER(Standalone)

huangjianhuang created BEAM-2995: Summary: can't read/write hdfs in Flink CLUSTER(Standalone) Key: BEAM-2995 URL: https://issues.apache.org/jira/browse/BEAM-2995 Project: Beam Issue Type:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3937

See

Build failed in Jenkins: beam_PerformanceTests_Python #379

See Changes: [ekirpichov] Sets a TTL on BigQueryIO.read().fromQuery() temp dataset -- [...truncated 714.23 KB...] for (int i = 0; i < parts.size(); ++i)

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #3166

See