[jira] [Commented] (BEAM-1407) Support multiple Kafka client in KakaIO

[ https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873040#comment-15873040 ] ASF GitHub Bot commented on BEAM-1407: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #2044: [BEAM-1407] Support multiple Kafka client in KakaIO

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2044 [BEAM-1407] Support multiple Kafka client in KakaIO PR for *[Solution 3. Rewrite Consumer method call at runtime].* SpEL is used to hide the difference of Kafka client 0.9/0.10. Additional

[jira] [Commented] (BEAM-1218) De-Googlify Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873029#comment-15873029 ] ASF GitHub Bot commented on BEAM-1218: -- GitHub user aaltay reopened a pull request:

[jira] [Commented] (BEAM-1218) De-Googlify Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873028#comment-15873028 ] ASF GitHub Bot commented on BEAM-1218: -- Github user aaltay closed the pull request at:

[GitHub] beam pull request #2041: [BEAM-1218] Move google specific io clients to vend...

GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/2041 [BEAM-1218] Move google specific io clients to vendor directory. R; @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Al

[GitHub] beam pull request #2041: [BEAM-1218] Move google specific io clients to vend...

Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/2041 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Apex #537

See

[jira] [Commented] (BEAM-1456) Make UnboundedSourceWrapper snapshot to rescalable operator state in Flink Runner

[ https://issues.apache.org/jira/browse/BEAM-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872994#comment-15872994 ] ASF GitHub Bot commented on BEAM-1456: -- GitHub user JingsongLi opened a pull request:

[GitHub] beam pull request #2043: [BEAM-1456] Make UnboundedSourceWrapper snapshot to...

GitHub user JingsongLi opened a pull request: https://github.com/apache/beam/pull/2043 [BEAM-1456] Make UnboundedSourceWrapper snapshot to rescalable operator state in Flink Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily:

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Apex #536

See

[GitHub] beam pull request #2038: Improve check around accumulation mode

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2038 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Improve check around accumulation mode

Repository: beam Updated Branches: refs/heads/master 918c7fa36 -> 01de25575 Improve check around accumulation mode If multiple panes can ever be produced, accumulation mode must be explicitly set, as there is currently no default accumulation mode. A pipeline with allowed lateness and the defa

[2/2] beam git commit: This closes #2038

This closes #2038 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/01de2557 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/01de2557 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/01de2557 Branch: refs/heads/maste

[jira] [Commented] (BEAM-115) Beam Runner API

[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872932#comment-15872932 ] ASF GitHub Bot commented on BEAM-115: - GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #2042: [BEAM-115,BEAM-1195] Build trigger state machine fr...

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2042 [BEAM-115,BEAM-1195] Build trigger state machine from Runner API Trigger proto directly Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Updated] (BEAM-750) Remove StateTag

[ https://issues.apache.org/jira/browse/BEAM-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-750: - Issue Type: Wish (was: Improvement) > Remove StateTag > --- > > Key: BE

[jira] [Updated] (BEAM-750) Remove StateTag

[ https://issues.apache.org/jira/browse/BEAM-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-750: - Priority: Minor (was: Major) > Remove StateTag > --- > > Key: BEAM-750

[jira] [Commented] (BEAM-750) Remove StateTag

[ https://issues.apache.org/jira/browse/BEAM-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872930#comment-15872930 ] Kenneth Knowles commented on BEAM-750: -- StateTag has been moved to runners/core-java. I

[jira] [Updated] (BEAM-750) Remove StateTag

[ https://issues.apache.org/jira/browse/BEAM-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-750: - Component/s: (was: sdk-java-core) runner-core > Remove StateTag > -

[jira] [Commented] (BEAM-197) Incremental join

[ https://issues.apache.org/jira/browse/BEAM-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872929#comment-15872929 ] Kenneth Knowles commented on BEAM-197: -- State is the best way to solve this, and I'm wo

[jira] [Assigned] (BEAM-197) Incremental join

[ https://issues.apache.org/jira/browse/BEAM-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-197: Assignee: Kenneth Knowles (was: Frances Perry) > Incremental join > > >

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Dataflow #2329

See

[jira] [Commented] (BEAM-1218) De-Googlify Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872844#comment-15872844 ] ASF GitHub Bot commented on BEAM-1218: -- GitHub user aaltay opened a pull request:

[jira] [Created] (BEAM-1510) Merge new source and sink Python-specific content into language agnostic page with toggles

Melissa Pashniak created BEAM-1510: -- Summary: Merge new source and sink Python-specific content into language agnostic page with toggles Key: BEAM-1510 URL: https://issues.apache.org/jira/browse/BEAM-1510

[GitHub] beam pull request #2041: [BEAM-1218] Move google specific io clients to vend...

GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2041 [BEAM-1218] Move google specific io clients to vendor directory. R; @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alte

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #2328

See

[GitHub] beam pull request #2040: Inject Sharding Strategy in the Direct Runner

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2040 Inject Sharding Strategy in the Direct Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872818#comment-15872818 ] Chamikara Jayalath commented on BEAM-1440: -- How about https://issues.apache.org/ji

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #2673

See

[jira] [Commented] (BEAM-1432) Write Sharding should have access to the runtime contents of a PCollection.

[ https://issues.apache.org/jira/browse/BEAM-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872795#comment-15872795 ] ASF GitHub Bot commented on BEAM-1432: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #1941: [BEAM-1432] Inject number of Shards as a Side Input...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1941 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: Inject number of Shards as a Side Input to Write

Inject number of Shards as a Side Input to Write This permits users to pass a PTransform from the input elements to the number of shards instead of requiring a constant amount. This enables sharding to be determined based on the input data rather than a constant value. Project: http://git-wip-us

[1/2] beam git commit: This closes #1941

Repository: beam Updated Branches: refs/heads/master 9335738f0 -> 918c7fa36 This closes #1941 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/918c7fa3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/918c7fa3 Diff: htt

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872768#comment-15872768 ] Ibrahim Sharaf ElDen commented on BEAM-1440: Thank you [~chamikara] for replyin

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #2672

See

[jira] [Created] (BEAM-1509) Python sdk pom runs only on unix

Sourabh Bajaj created BEAM-1509: --- Summary: Python sdk pom runs only on unix Key: BEAM-1509 URL: https://issues.apache.org/jira/browse/BEAM-1509 Project: Beam Issue Type: Bug Component

[jira] [Commented] (BEAM-646) Get runners out of the apply()

[ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872696#comment-15872696 ] ASF GitHub Bot commented on BEAM-646: - GitHub user tgroh opened a pull request: htt

[GitHub] beam pull request #2039: [BEAM-646] Use Surgery in the Dataflow Runner

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2039 [BEAM-646] Use Surgery in the Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2037: BEAM-412 DisplayData findbugs serializable

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2037 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: DisplayData findbugs serializable

Repository: beam Updated Branches: refs/heads/master 236a3cd96 -> 9335738f0 DisplayData findbugs serializable Implement serializable on nested classes of DisplayData, removed findbugs filter for the class, and added a test that serializes and deserializes an instance. Project: http://git-wi

[jira] [Commented] (BEAM-412) DisplayData is marked Serializable but contains non-serializable field

[ https://issues.apache.org/jira/browse/BEAM-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872647#comment-15872647 ] ASF GitHub Bot commented on BEAM-412: - Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2037

This closes #2037 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9335738f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9335738f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9335738f Branch: refs/heads/maste

[1/4] beam git commit: Add PTransformMatchers#emptyFlatten

Repository: beam Updated Branches: refs/heads/master 36ed3f6c5 -> 236a3cd96 Add PTransformMatchers#emptyFlatten This matches a Flatten that consumes no inputs. It can be replaced (approximately) with Create.empty(), as it will never produce output. Project: http://git-wip-us.apache.org/repos

[GitHub] beam pull request #2029: Add some Utilities for Pipeline Surgery

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2029 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[4/4] beam git commit: Add UnsupportedOverrideFactory to core-construction

Add UnsupportedOverrideFactory to core-construction This factory throws with a specified message for all of its methods. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f29e4c36 Tree: http://git-wip-us.apache.org/repos/asf/beam

[3/4] beam git commit: This closes #2029

This closes #2029 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/236a3cd9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/236a3cd9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/236a3cd9 Branch: refs/heads/maste

[2/4] beam git commit: Add ParDoWithType PTransform Matcher

Add ParDoWithType PTransform Matcher This matcher matches a ParDo where the contained DoFn matches a provided type. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e75fbe70 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree

[jira] [Created] (BEAM-1508) PInput, POutput#expand should not be ordered

Thomas Groh created BEAM-1508: - Summary: PInput, POutput#expand should not be ordered Key: BEAM-1508 URL: https://issues.apache.org/jira/browse/BEAM-1508 Project: Beam Issue Type: Bug C

[GitHub] beam pull request #2038: Improve check around accumulation mode

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2038 Improve check around accumulation mode Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] beam-site pull request #159: Add Apache in front of initial Beam reference

GitHub user melap opened a pull request: https://github.com/apache/beam-site/pull/159 Add Apache in front of initial Beam reference R: @davorbonaci @aaltay Changes to address PR 157 comments. Removed Beam from title to be consistent with other Python pages, and add Apache in fr

[1/3] beam-site git commit: Add custom sources and sinks for Python page

Repository: beam-site Updated Branches: refs/heads/asf-site b6675d294 -> 940eb0620 Add custom sources and sinks for Python page Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/a7e8b600 Tree: http://git-wip-us.apach

[3/3] beam-site git commit: This closes #157

This closes #157 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/940eb062 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/940eb062 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/940eb062 Branc

[GitHub] beam-site pull request #157: Add custom sources and sinks for Python page

Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/157 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[2/3] beam-site git commit: Regenerate website

Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/83a6e401 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/83a6e401 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/83a6e401 Bra

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #2671

See

[jira] [Commented] (BEAM-1116) Support for new Timer API in Flink runner

[ https://issues.apache.org/jira/browse/BEAM-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872229#comment-15872229 ] Kenneth Knowles commented on BEAM-1116: --- For user-facing timers, all namespaces shoul

[jira] [Commented] (BEAM-412) DisplayData is marked Serializable but contains non-serializable field

[ https://issues.apache.org/jira/browse/BEAM-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872214#comment-15872214 ] ASF GitHub Bot commented on BEAM-412: - GitHub user lbowman opened a pull request: h

[GitHub] beam pull request #2037: BEAM-412 DisplayData findbugs serializable

GitHub user lbowman opened a pull request: https://github.com/apache/beam/pull/2037 BEAM-412 DisplayData findbugs serializable Implement serializable on nested classes of DisplayData, removed findbugs filter for the class, and added a test that serializes and deserializes an

[jira] [Commented] (BEAM-412) DisplayData is marked Serializable but contains non-serializable field

[ https://issues.apache.org/jira/browse/BEAM-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872150#comment-15872150 ] Scott Wegner commented on BEAM-412: --- Yes please! This is marked as a 'starter' bug, meanin

[GitHub] beam pull request #2036: TEST hbase stuff

Github user dhalperi closed the pull request at: https://github.com/apache/beam/pull/2036 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] beam pull request #2036: TEST hbase stuff

GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2036 TEST hbase stuff cc: @iemejia You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam hbase-help Alternatively you can review and apply t

[GitHub] beam pull request #2035: Obtain Flink Views from the Context Output

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2035 Obtain Flink Views from the Context Output Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1492) Avoid potential issue in ASM 5.0

[ https://issues.apache.org/jira/browse/BEAM-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872065#comment-15872065 ] Amit Sela commented on BEAM-1492: - [~kenn] Spark and Apex runners both use Kryo 2.x which t

[jira] [Commented] (BEAM-412) DisplayData is marked Serializable but contains non-serializable field

[ https://issues.apache.org/jira/browse/BEAM-412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872021#comment-15872021 ] Levi Bowman commented on BEAM-412: -- Do we want a PR for this? In an attempt to resolve th

[GitHub] beam pull request #2034: More informative KafkaCheckpointMark toString

GitHub user aviemzur opened a pull request: https://github.com/apache/beam/pull/2034 More informative KafkaCheckpointMark toString Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted l

[jira] [Commented] (BEAM-1294) Long running UnboundedSource Readers via Broadcasts

[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871624#comment-15871624 ] ASF GitHub Bot commented on BEAM-1294: -- GitHub user aviemzur opened a pull request:

[jira] [Updated] (BEAM-1294) Long running UnboundedSource Readers

[ https://issues.apache.org/jira/browse/BEAM-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1294: Summary: Long running UnboundedSource Readers (was: Long running UnboundedSource Readers via Broadcasts) >

[GitHub] beam pull request #2033: [BEAM-1294] Long running UnboundedSource Readers vi...

GitHub user aviemzur opened a pull request: https://github.com/apache/beam/pull/2033 [BEAM-1294] Long running UnboundedSource Readers via Broadcasts Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR ti

[jira] [Commented] (BEAM-1116) Support for new Timer API in Flink runner

[ https://issues.apache.org/jira/browse/BEAM-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871588#comment-15871588 ] ASF GitHub Bot commented on BEAM-1116: -- GitHub user JingsongLi opened a pull request:

[GitHub] beam pull request #2032: [BEAM-1116] Support for new Timer API in Flink runn...

GitHub user JingsongLi opened a pull request: https://github.com/apache/beam/pull/2032 [BEAM-1116] Support for new Timer API in Flink runner (streaming) Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the P

[jira] [Updated] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

[ https://issues.apache.org/jira/browse/BEAM-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1507: -- Component/s: (was: sdk-py) runner-dataflow > java DataflowRunner should warn

[jira] [Assigned] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

[ https://issues.apache.org/jira/browse/BEAM-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1507: - Assignee: (was: Ahmet Altay) > java DataflowRunner should warn if the stagingLocation

[jira] [Created] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

Daniel Halperin created BEAM-1507: - Summary: java DataflowRunner should warn if the stagingLocation has a TTL Key: BEAM-1507 URL: https://issues.apache.org/jira/browse/BEAM-1507 Project: Beam