[jira] [Created] (BEAM-2822) Add support for progress reporting in fn API

Vikas Kedigehalli created BEAM-2822: --- Summary: Add support for progress reporting in fn API Key: BEAM-2822 URL: https://issues.apache.org/jira/browse/BEAM-2822 Project: Beam Issue Type: New

[jira] [Assigned] (BEAM-2820) SDKs should measure time spent for active element

[ https://issues.apache.org/jira/browse/BEAM-2820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli reassigned BEAM-2820: --- Assignee: Vikas Kedigehalli (was: Ahmet Altay) > SDKs should measure time spent for a

[jira] [Created] (BEAM-2820) SDKs should measure time spent for active element

Vikas Kedigehalli created BEAM-2820: --- Summary: SDKs should measure time spent for active element Key: BEAM-2820 URL: https://issues.apache.org/jira/browse/BEAM-2820 Project: Beam Issue Type

[jira] [Resolved] (BEAM-2509) Fn API Runner hangs in grpc controller mode

[ https://issues.apache.org/jira/browse/BEAM-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-2509. - Resolution: Fixed Fix Version/s: 2.1.0 > Fn API Runner hangs in grpc controller mode

[jira] [Commented] (BEAM-2509) Fn API Runner hangs in grpc controller mode

[ https://issues.apache.org/jira/browse/BEAM-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061379#comment-16061379 ] Vikas Kedigehalli commented on BEAM-2509: - cc: [~altay] > Fn API Runner hangs in g

[jira] [Created] (BEAM-2509) Fn API Runner hangs in grpc controller mode

Vikas Kedigehalli created BEAM-2509: --- Summary: Fn API Runner hangs in grpc controller mode Key: BEAM-2509 URL: https://issues.apache.org/jira/browse/BEAM-2509 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2418) Datastore IO does not work out of the box

[ https://issues.apache.org/jira/browse/BEAM-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039467#comment-16039467 ] Vikas Kedigehalli commented on BEAM-2418: - [~bookman_google] could you try running

[jira] [Commented] (BEAM-2418) Datastore IO does not work out of the box

[ https://issues.apache.org/jira/browse/BEAM-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039324#comment-16039324 ] Vikas Kedigehalli commented on BEAM-2418: - Looks like we do include 'beam-sdks-java

[jira] [Created] (BEAM-2286) Improve mobile gaming example user experience

Vikas Kedigehalli created BEAM-2286: --- Summary: Improve mobile gaming example user experience Key: BEAM-2286 URL: https://issues.apache.org/jira/browse/BEAM-2286 Project: Beam Issue Type: Im

[jira] [Commented] (BEAM-2242) Apache Beam Java modules do not correctly shade test artifacts

[ https://issues.apache.org/jira/browse/BEAM-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005157#comment-16005157 ] Vikas Kedigehalli commented on BEAM-2242: - [~lcwik] Let me know if this PR https://

[jira] [Commented] (BEAM-2143) (Mis)Running Dataflow Wordcount gives non-helpful errors

[ https://issues.apache.org/jira/browse/BEAM-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997553#comment-15997553 ] Vikas Kedigehalli commented on BEAM-2143: - Taking a look for Java. > (Mis)Running

[jira] [Assigned] (BEAM-2143) (Mis)Running Dataflow Wordcount gives non-helpful errors

[ https://issues.apache.org/jira/browse/BEAM-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli reassigned BEAM-2143: --- Assignee: Vikas Kedigehalli (was: Sourabh Bajaj) > (Mis)Running Dataflow Wordcount gi

[jira] [Created] (BEAM-2167) Add appropriate display data to BigQueryIO and tests.

Vikas Kedigehalli created BEAM-2167: --- Summary: Add appropriate display data to BigQueryIO and tests. Key: BEAM-2167 URL: https://issues.apache.org/jira/browse/BEAM-2167 Project: Beam Issue

[jira] [Updated] (BEAM-2167) Add appropriate display data to BigQueryIO and tests.

[ https://issues.apache.org/jira/browse/BEAM-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-2167: Affects Version/s: First stable release > Add appropriate display data to BigQueryIO and test

[jira] [Created] (BEAM-2156) Clean up import guards for GCP libraries in the python SDK

Vikas Kedigehalli created BEAM-2156: --- Summary: Clean up import guards for GCP libraries in the python SDK Key: BEAM-2156 URL: https://issues.apache.org/jira/browse/BEAM-2156 Project: Beam I

[jira] [Created] (BEAM-2080) Add custom maven enforcer rules to catch banned classes and dependencies

Vikas Kedigehalli created BEAM-2080: --- Summary: Add custom maven enforcer rules to catch banned classes and dependencies Key: BEAM-2080 URL: https://issues.apache.org/jira/browse/BEAM-2080 Project: B

[jira] [Commented] (BEAM-1631) Flink runner: submit job to a Flink-on-YARN cluster

[ https://issues.apache.org/jira/browse/BEAM-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979634#comment-15979634 ] Vikas Kedigehalli commented on BEAM-1631: - [~aljoscha] I was able to come up with s

[jira] [Resolved] (BEAM-1539) Support unknown length iterables for IterableCoder in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-1539. - Resolution: Fixed Fix Version/s: First stable release > Support unknown length itera

[jira] [Commented] (BEAM-1956) Flatten operation should respect input type hints.

[ https://issues.apache.org/jira/browse/BEAM-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977391#comment-15977391 ] Vikas Kedigehalli commented on BEAM-1956: - The fix https://github.com/apache/beam/p

[jira] [Commented] (BEAM-976) Update examples README.md to fix instructions to run pipelines

[ https://issues.apache.org/jira/browse/BEAM-976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977371#comment-15977371 ] Vikas Kedigehalli commented on BEAM-976: [~davor] Is https://github.com/apache/beam/

[jira] [Resolved] (BEAM-1865) Input Coder of GroupByKey should be a KV Coder in the Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-1865. - Resolution: Fixed Fix Version/s: First stable release > Input Coder of GroupByKey sh

[jira] [Resolved] (BEAM-1895) Create tranform in python sdk should be a custom source

[ https://issues.apache.org/jira/browse/BEAM-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-1895. - Resolution: Fixed Fix Version/s: First stable release > Create tranform in python sd

[jira] [Assigned] (BEAM-1956) Flatten operation should respect input type hints.

[ https://issues.apache.org/jira/browse/BEAM-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli reassigned BEAM-1956: --- Assignee: Ahmet Altay (was: Vikas Kedigehalli) > Flatten operation should respect inp

[jira] [Commented] (BEAM-1910) test_using_slow_impl very flaky locally

[ https://issues.apache.org/jira/browse/BEAM-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973678#comment-15973678 ] Vikas Kedigehalli commented on BEAM-1910: - Yeah most likely related to cleanups. No

[jira] [Commented] (BEAM-1910) test_using_slow_impl very flaky locally

[ https://issues.apache.org/jira/browse/BEAM-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973683#comment-15973683 ] Vikas Kedigehalli commented on BEAM-1910: - Related to discussion in https://lists.

[jira] [Commented] (BEAM-1631) Flink runner: submit job to a Flink-on-YARN cluster

[ https://issues.apache.org/jira/browse/BEAM-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971355#comment-15971355 ] Vikas Kedigehalli commented on BEAM-1631: - [~aljoscha] [~davor] Even if we do this,

[jira] [Commented] (BEAM-1956) Flatten operation should respect input type hints.

[ https://issues.apache.org/jira/browse/BEAM-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966906#comment-15966906 ] Vikas Kedigehalli commented on BEAM-1956: - cc [~lcwik] [~robertwb] [~dhalp...@googl

[jira] [Created] (BEAM-1956) Flatten operation should respect input type hints.

Vikas Kedigehalli created BEAM-1956: --- Summary: Flatten operation should respect input type hints. Key: BEAM-1956 URL: https://issues.apache.org/jira/browse/BEAM-1956 Project: Beam Issue Typ

[jira] [Updated] (BEAM-1951) Add datastoreio integration tests for python.

[ https://issues.apache.org/jira/browse/BEAM-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1951: Fix Version/s: First stable release > Add datastoreio integration tests for python. > --

[jira] [Updated] (BEAM-1952) Add more integration tests for python SDK

[ https://issues.apache.org/jira/browse/BEAM-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1952: Fix Version/s: First stable release > Add more integration tests for python SDK > ---

[jira] [Commented] (BEAM-1952) Add more integration tests for python SDK

[ https://issues.apache.org/jira/browse/BEAM-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966254#comment-15966254 ] Vikas Kedigehalli commented on BEAM-1952: - cc [~sb2nov] [~chamikara] [~charleschen]

[jira] [Created] (BEAM-1952) Add more integration tests for python SDK

Vikas Kedigehalli created BEAM-1952: --- Summary: Add more integration tests for python SDK Key: BEAM-1952 URL: https://issues.apache.org/jira/browse/BEAM-1952 Project: Beam Issue Type: Improv

[jira] [Updated] (BEAM-1952) Add more integration tests for python SDK

[ https://issues.apache.org/jira/browse/BEAM-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1952: Description: This is a tracking ticket for adding more python integration tests. 1. https:/

[jira] [Created] (BEAM-1951) Add datastoreio integration tests for python.

Vikas Kedigehalli created BEAM-1951: --- Summary: Add datastoreio integration tests for python. Key: BEAM-1951 URL: https://issues.apache.org/jira/browse/BEAM-1951 Project: Beam Issue Type: I

[jira] [Created] (BEAM-1895) Create tranform in python sdk should be a custom source

Vikas Kedigehalli created BEAM-1895: --- Summary: Create tranform in python sdk should be a custom source Key: BEAM-1895 URL: https://issues.apache.org/jira/browse/BEAM-1895 Project: Beam Issu

[jira] [Created] (BEAM-1894) Race conditions in python direct runner eager mode

Vikas Kedigehalli created BEAM-1894: --- Summary: Race conditions in python direct runner eager mode Key: BEAM-1894 URL: https://issues.apache.org/jira/browse/BEAM-1894 Project: Beam Issue Typ

[jira] [Created] (BEAM-1865) Input Coder of GroupByKey should be a KV Coder in the Python SDK

Vikas Kedigehalli created BEAM-1865: --- Summary: Input Coder of GroupByKey should be a KV Coder in the Python SDK Key: BEAM-1865 URL: https://issues.apache.org/jira/browse/BEAM-1865 Project: Beam

[jira] [Commented] (BEAM-1800) Can't save datastore objects

[ https://issues.apache.org/jira/browse/BEAM-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940746#comment-15940746 ] Vikas Kedigehalli commented on BEAM-1800: - That is weird because the protobuf messa

[jira] [Commented] (BEAM-976) Update examples README.md to fix instructions to run pipelines

[ https://issues.apache.org/jira/browse/BEAM-976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937746#comment-15937746 ] Vikas Kedigehalli commented on BEAM-976: My bad for not adding more details. IIRC it

[jira] [Updated] (BEAM-1076) DatastoreIO template Options

[ https://issues.apache.org/jira/browse/BEAM-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1076: Fix Version/s: First stable release > DatastoreIO template Options >

[jira] [Updated] (BEAM-1076) DatastoreIO template Options

[ https://issues.apache.org/jira/browse/BEAM-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1076: Fix Version/s: (was: 0.6.0) > DatastoreIO template Options >

[jira] [Resolved] (BEAM-823) Improve DatastoreIO Documentation

[ https://issues.apache.org/jira/browse/BEAM-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-823. Resolution: Fixed Fix Version/s: 0.6.0 > Improve DatastoreIO Documentation > --

[jira] [Resolved] (BEAM-1021) DatastoreIO for python

[ https://issues.apache.org/jira/browse/BEAM-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-1021. - Resolution: Fixed Fix Version/s: 0.6.0 Not applicable > Datastore

[jira] [Resolved] (BEAM-1076) DatastoreIO template Options

[ https://issues.apache.org/jira/browse/BEAM-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-1076. - Resolution: Fixed Fix Version/s: 0.6.0 > DatastoreIO template Options >

[jira] [Updated] (BEAM-1632) Current bigtable protos include google rpc generated classes in its jar

[ https://issues.apache.org/jira/browse/BEAM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1632: Description: bigtable-protos include generated classes like 'com.google.rpc.Code' in its jar

[jira] [Created] (BEAM-1632) Current bigtable protos includes google rpc generated classes that conflict with Datastore dependencies

Vikas Kedigehalli created BEAM-1632: --- Summary: Current bigtable protos includes google rpc generated classes that conflict with Datastore dependencies Key: BEAM-1632 URL: https://issues.apache.org/jira/browse/BE

[jira] [Updated] (BEAM-1632) Current bigtable protos include google rpc generated classes in its jar

[ https://issues.apache.org/jira/browse/BEAM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1632: Summary: Current bigtable protos include google rpc generated classes in its jar (was: Curre

[jira] [Updated] (BEAM-1076) DatastoreIO template Options

[ https://issues.apache.org/jira/browse/BEAM-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1076: Summary: DatastoreIO template Options (was: Datastore Delete template) > DatastoreIO templat

[jira] [Resolved] (BEAM-1538) Add a fast version of BufferedElementCountingOutputStream

[ https://issues.apache.org/jira/browse/BEAM-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli resolved BEAM-1538. - Resolution: Fixed Fix Version/s: Not applicable No longer need this as we embed this

[jira] [Created] (BEAM-1539) Support unknown length iterables for IterableCoder in Python SDK

Vikas Kedigehalli created BEAM-1539: --- Summary: Support unknown length iterables for IterableCoder in Python SDK Key: BEAM-1539 URL: https://issues.apache.org/jira/browse/BEAM-1539 Project: Beam

[jira] [Created] (BEAM-1538) Add a fast version of BufferedElementCountingOutputStream

Vikas Kedigehalli created BEAM-1538: --- Summary: Add a fast version of BufferedElementCountingOutputStream Key: BEAM-1538 URL: https://issues.apache.org/jira/browse/BEAM-1538 Project: Beam Is

[jira] [Created] (BEAM-1537) Report more accurate size estimation for Iterables of unknown length

Vikas Kedigehalli created BEAM-1537: --- Summary: Report more accurate size estimation for Iterables of unknown length Key: BEAM-1537 URL: https://issues.apache.org/jira/browse/BEAM-1537 Project: Beam

[jira] [Commented] (BEAM-1524) Timestamp precision and byte representation should be consistent across SDKs

[ https://issues.apache.org/jira/browse/BEAM-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877044#comment-15877044 ] Vikas Kedigehalli commented on BEAM-1524: - No issues, just that it property wasn't

[jira] [Comment Edited] (BEAM-1524) Timestamp precision and byte representation should be consistent across SDKs

[ https://issues.apache.org/jira/browse/BEAM-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877044#comment-15877044 ] Vikas Kedigehalli edited comment on BEAM-1524 at 2/21/17 11:54 PM: --

[jira] [Updated] (BEAM-1524) Timestamp precision and byte representation should be consistent across SDKs

[ https://issues.apache.org/jira/browse/BEAM-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1524: Summary: Timestamp precision and byte representation should be consistent across SDKs (was:

[jira] [Updated] (BEAM-1524) Timestamp precision and byte representation should be consistent across SDKs

[ https://issues.apache.org/jira/browse/BEAM-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1524: Description: Runners cannot have a timestamp precision that is lesser than what a SDK uses.

[jira] [Created] (BEAM-1524) Timestamp precision should be consistent across SDKs

Vikas Kedigehalli created BEAM-1524: --- Summary: Timestamp precision should be consistent across SDKs Key: BEAM-1524 URL: https://issues.apache.org/jira/browse/BEAM-1524 Project: Beam Issue T

[jira] [Created] (BEAM-1522) Add support for PaneInfo in Python SDK

Vikas Kedigehalli created BEAM-1522: --- Summary: Add support for PaneInfo in Python SDK Key: BEAM-1522 URL: https://issues.apache.org/jira/browse/BEAM-1522 Project: Beam Issue Type: Improveme

[jira] [Created] (BEAM-1504) Python standard coders test doesn't run with setup test

Vikas Kedigehalli created BEAM-1504: --- Summary: Python standard coders test doesn't run with setup test Key: BEAM-1504 URL: https://issues.apache.org/jira/browse/BEAM-1504 Project: Beam Issu

[jira] [Commented] (BEAM-1467) Use well-known coder types for known window coders

[ https://issues.apache.org/jira/browse/BEAM-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15869039#comment-15869039 ] Vikas Kedigehalli commented on BEAM-1467: - WindowedValueCoder implemenation and tes

[jira] [Updated] (BEAM-1467) Use well-known coder types for known window coders

[ https://issues.apache.org/jira/browse/BEAM-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1467: Description: Known window types include: * GlobalWindow * IntervalWindow * WindowedValueCode

[jira] [Commented] (BEAM-1471) Make IterableCoder binary compatible across SDKs

[ https://issues.apache.org/jira/browse/BEAM-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864188#comment-15864188 ] Vikas Kedigehalli commented on BEAM-1471: - Verified that when the iterable length i

[jira] [Created] (BEAM-1471) Make IterableCoder binary compatible across SDKs

Vikas Kedigehalli created BEAM-1471: --- Summary: Make IterableCoder binary compatible across SDKs Key: BEAM-1471 URL: https://issues.apache.org/jira/browse/BEAM-1471 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1448) Coder encode/decode context documentation is lacking

[ https://issues.apache.org/jira/browse/BEAM-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860860#comment-15860860 ] Vikas Kedigehalli commented on BEAM-1448: - Some more discussion on this thread, ht

[jira] [Created] (BEAM-1330) DatastoreIO Writes should flush early when duplicate keys arrive.

Vikas Kedigehalli created BEAM-1330: --- Summary: DatastoreIO Writes should flush early when duplicate keys arrive. Key: BEAM-1330 URL: https://issues.apache.org/jira/browse/BEAM-1330 Project: Beam

[jira] [Commented] (BEAM-1225) Add a ToString transform in Java SDK

[ https://issues.apache.org/jira/browse/BEAM-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786506#comment-15786506 ] Vikas Kedigehalli commented on BEAM-1225: - Common as in for Text based sinks, debug

[jira] [Created] (BEAM-1225) Add a ToString transform in Java SDK

Vikas Kedigehalli created BEAM-1225: --- Summary: Add a ToString transform in Java SDK Key: BEAM-1225 URL: https://issues.apache.org/jira/browse/BEAM-1225 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1216) Python SDK Assert transform should not use side inputs

Vikas Kedigehalli created BEAM-1216: --- Summary: Python SDK Assert transform should not use side inputs Key: BEAM-1216 URL: https://issues.apache.org/jira/browse/BEAM-1216 Project: Beam Issue