[jira] [Resolved] (BEAM-377) BigQueryIO should validate a table or query to read from

2016-06-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-377. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > BigQueryIO should validate a table or q

[jira] [Updated] (BEAM-159) Support fixed number of shards in sinks

2016-06-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-159: - Component/s: (was: beam-model) > Support fixed number of shards in sinks > -

[jira] [Created] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-06-27 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-381: Summary: OffsetBasedReader should construct sources before updating the range tracker Key: BEAM-381 URL: https://issues.apache.org/jira/browse/BEAM-381 Project: Beam

[jira] [Created] (BEAM-382) Audit BoundedReaders for BEAM-381

2016-06-27 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-382: Summary: Audit BoundedReaders for BEAM-381 Key: BEAM-382 URL: https://issues.apache.org/jira/browse/BEAM-382 Project: Beam Issue Type: Bug Componen

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-06-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15352464#comment-15352464 ] Daniel Halperin commented on BEAM-372: -- Sounds good to me! > CoderProperties: Test tha

[jira] [Assigned] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-06-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-372: Assignee: Daniel Halperin > CoderProperties: Test that the coder doesn't consume more bytes t

[jira] [Updated] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-06-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-372: - Assignee: Chandni Singh (was: Daniel Halperin) > CoderProperties: Test that the coder doesn't consu

[jira] [Commented] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353334#comment-15353334 ] Daniel Halperin commented on BEAM-310: -- Note that we should also exercise splitAtFracti

[jira] [Created] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

2016-06-28 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-383: Summary: BigQueryIO: update sink to shard into multiple write jobs Key: BEAM-383 URL: https://issues.apache.org/jira/browse/BEAM-383 Project: Beam Issue Type

[jira] [Resolved] (BEAM-363) CompressedSource splits when it shouldn't

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-363. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > CompressedSource splits when it shouldn

[jira] [Commented] (BEAM-363) CompressedSource splits when it shouldn't

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353947#comment-15353947 ] Daniel Halperin commented on BEAM-363: -- thanks. > CompressedSource splits when it shou

[jira] [Resolved] (BEAM-159) Support fixed number of shards in sinks

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-159. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Support fixed number of shards in sinks

[jira] [Closed] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-365. Resolution: Fixed Fix Version/s: 0.2.0-incubating > TextIO withoutSharding causes Flink to thro

[jira] [Commented] (BEAM-365) TextIO withoutSharding causes Flink to throw IllegalStateException

2016-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353970#comment-15353970 ] Daniel Halperin commented on BEAM-365: -- This is fixed now "the right way" -- by adding

[jira] [Created] (BEAM-388) Update Beam Incubation Status page on main Apache site

2016-06-29 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-388: Summary: Update Beam Incubation Status page on main Apache site Key: BEAM-388 URL: https://issues.apache.org/jira/browse/BEAM-388 Project: Beam Issue Type: I

[jira] [Commented] (BEAM-388) Update Beam Incubation Status page on main Apache site

2016-06-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15355793#comment-15355793 ] Daniel Halperin commented on BEAM-388: -- fyi [~davorbonaci] > Update Beam Incubation St

[jira] [Comment Edited] (BEAM-388) Update Beam Incubation Status page on main Apache site

2016-06-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15355793#comment-15355793 ] Daniel Halperin edited comment on BEAM-388 at 6/29/16 9:17 PM: ---

[jira] [Closed] (BEAM-386) Dataflow runner to support Read.Bounded in streaming mode.

2016-06-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-386. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Dataflow runner to support Read.Bounded in

[jira] [Closed] (BEAM-387) Remove internal file and fix gcsio code path

2016-06-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-387. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Remove internal file and fix gcsio code pat

[jira] [Updated] (BEAM-394) AvroCoder is Serializable with non-serializable fields

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-394: - Labels: findbugs newbie starter (was: findbugs starter) > AvroCoder is Serializable with non-serial

[jira] [Closed] (BEAM-355) Update to Bigtable version 0.3.0

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-355. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Update to Bigtable version 0.3.0 >

[jira] [Created] (BEAM-404) PubsubIO should have a mode that supports maintaining message attributes.

2016-06-30 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-404: Summary: PubsubIO should have a mode that supports maintaining message attributes. Key: BEAM-404 URL: https://issues.apache.org/jira/browse/BEAM-404 Project: Beam

[jira] [Closed] (BEAM-395) KafkaIO tests should be marked 'NeedsRunner'

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-395. Resolution: Fixed Fix Version/s: Not applicable > KafkaIO tests should be marked 'NeedsRunner'

[jira] [Closed] (BEAM-411) Avoid calling BigQuery directly during validation.

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-411. Resolution: Fixed Fix Version/s: Not applicable > Avoid calling BigQuery directly during valida

[jira] [Updated] (BEAM-414) IntraBundleParallelization needs to be removed

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-414: - Labels: newbie starter (was: ) > IntraBundleParallelization needs to be removed > -

[jira] [Closed] (BEAM-403) Support staging SDK packages from PyPI for remote execution

2016-06-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-403. Resolution: Fixed Assignee: Silviu Calinoiu (was: Davor Bonaci) Fix Version/s: 0.2.0-i

[jira] [Commented] (BEAM-371) Backport HDFS IO enhancements from Scio

2016-07-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359939#comment-15359939 ] Daniel Halperin commented on BEAM-371: -- Thanks for the contribution, Neville! > Backpo

[jira] [Closed] (BEAM-371) Backport HDFS IO enhancements from Scio

2016-07-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-371. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Backport HDFS IO enhancements from Scio > -

[jira] [Created] (BEAM-422) AvroSource hits various IOException when using Snappy codec

2016-07-02 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-422: Summary: AvroSource hits various IOException when using Snappy codec Key: BEAM-422 URL: https://issues.apache.org/jira/browse/BEAM-422 Project: Beam Issue T

[jira] [Updated] (BEAM-354) Modify DatastoreIO to use Datastore v1beta3 API

2016-07-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-354: - Affects Version/s: 0.2.0-incubating > Modify DatastoreIO to use Datastore v1beta3 API >

[jira] [Assigned] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-378: Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > Integrate Python SDK in the Maven bu

[jira] [Commented] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364507#comment-15364507 ] Daniel Halperin commented on BEAM-378: -- Also, thanks Sergio -- this looks great! > Int

[jira] [Commented] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364505#comment-15364505 ] Daniel Halperin commented on BEAM-378: -- Hi JB, I think that the Python team needs to be

[jira] [Updated] (BEAM-378) Integrate Python SDK in the Maven build

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-378: - Assignee: Robert Bradshaw (was: Daniel Halperin) > Integrate Python SDK in the Maven build > --

[jira] [Updated] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-400: - Assignee: (was: Daniel Halperin) > Direct/InProcess runner should use Pubsub publish time timest

[jira] [Commented] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365541#comment-15365541 ] Daniel Halperin commented on BEAM-400: -- Runner names are not helpful here. I'm going to

[jira] [Comment Edited] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365541#comment-15365541 ] Daniel Halperin edited comment on BEAM-400 at 7/7/16 3:31 AM: --

[jira] [Comment Edited] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365541#comment-15365541 ] Daniel Halperin edited comment on BEAM-400 at 7/7/16 3:32 AM: --

[jira] [Commented] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365545#comment-15365545 ] Daniel Halperin commented on BEAM-400: -- This is a good starter issue. > Direct/InProce

[jira] [Updated] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-400: - Labels: newbie starter (was: ) > Direct/InProcess runner should use Pubsub publish time timestamp i

[jira] [Updated] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-361: - Assignee: (was: Daniel Halperin) > Batch Pub/Sub sink does not set idLabel > ---

[jira] [Updated] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-361: - Labels: newbie starter (was: ) > Batch Pub/Sub sink does not set idLabel >

[jira] [Commented] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365649#comment-15365649 ] Daniel Halperin commented on BEAM-361: -- This probably requires copying some logic from

[jira] [Comment Edited] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-07-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365649#comment-15365649 ] Daniel Halperin edited comment on BEAM-361 at 7/7/16 5:47 AM: --

[jira] [Updated] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-07-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-381: - Fix Version/s: 0.2.0-incubating > OffsetBasedReader should construct sources before updating the ran

[jira] [Resolved] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-07-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-381. -- Resolution: Fixed > OffsetBasedReader should construct sources before updating the range tracker >

[jira] [Closed] (BEAM-381) OffsetBasedReader should construct sources before updating the range tracker

2016-07-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-381. > OffsetBasedReader should construct sources before updating the range tracker > -

[jira] [Created] (BEAM-432) BigQueryIO javadoc is incorrect

2016-07-08 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-432: Summary: BigQueryIO javadoc is incorrect Key: BEAM-432 URL: https://issues.apache.org/jira/browse/BEAM-432 Project: Beam Issue Type: Improvement Co

[jira] [Commented] (BEAM-432) BigQueryIO javadoc is incorrect

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367909#comment-15367909 ] Daniel Halperin commented on BEAM-432: -- This is a good starter issue. > BigQueryIO jav

[jira] [Updated] (BEAM-432) BigQueryIO javadoc is incorrect

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-432: - Labels: newbie starter (was: ) > BigQueryIO javadoc is incorrect > ---

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368716#comment-15368716 ] Daniel Halperin commented on BEAM-372: -- Another idea: put elements in a list and use a

[jira] [Commented] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-07-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368718#comment-15368718 ] Daniel Halperin commented on BEAM-372: -- [~csingh] have you had any progress or blockers

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370274#comment-15370274 ] Daniel Halperin commented on BEAM-434: -- There can be a very large performance impact fr

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371052#comment-15371052 ] Daniel Halperin commented on BEAM-434: -- It does seem very bad if the DirectRunner produ

[jira] [Created] (BEAM-435) DirectRunner GBK -- task per key?

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-435: Summary: DirectRunner GBK -- task per key? Key: BEAM-435 URL: https://issues.apache.org/jira/browse/BEAM-435 Project: Beam Issue Type: Bug Componen

[jira] [Created] (BEAM-437) Data-dependent BigQueryIO in batch

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-437: Summary: Data-dependent BigQueryIO in batch Key: BEAM-437 URL: https://issues.apache.org/jira/browse/BEAM-437 Project: Beam Issue Type: Bug Compone

[jira] [Created] (BEAM-438) Rename one of PTransform.apply and PInput.apply

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-438: Summary: Rename one of PTransform.apply and PInput.apply Key: BEAM-438 URL: https://issues.apache.org/jira/browse/BEAM-438 Project: Beam Issue Type: Improvem

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371662#comment-15371662 ] Daniel Halperin commented on BEAM-434: -- Proposals: 1. Modify examples to use {{TextIO.

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371665#comment-15371665 ] Daniel Halperin commented on BEAM-434: -- cc [~bchambers]] > When examples write output

[jira] [Commented] (BEAM-434) When examples write output to file it creates many output files instead of one

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371666#comment-15371666 ] Daniel Halperin commented on BEAM-434: -- [~bchambers] confirmed that the Direct Runner i

[jira] [Created] (BEAM-440) Create.values() returns a type-unsafe Coder

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-440: Summary: Create.values() returns a type-unsafe Coder Key: BEAM-440 URL: https://issues.apache.org/jira/browse/BEAM-440 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-440) Create.values() returns a type-unsafe Coder

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-440: - Labels: newbie starter (was: ) > Create.values() returns a type-unsafe Coder >

[jira] [Commented] (BEAM-440) Create.values() returns a type-unsafe Coder

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371738#comment-15371738 ] Daniel Halperin commented on BEAM-440: -- This is a good starter issue. > Create.values(

[jira] [Closed] (BEAM-394) AvroCoder is Serializable with non-serializable fields

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-394. Resolution: Fixed Fix Version/s: 0.2.0-incubating > AvroCoder is Serializable with non-serializ

[jira] [Closed] (BEAM-399) SerializableCoder.equals does not handle null

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-399. Resolution: Fixed Fix Version/s: 0.2.0-incubating > SerializableCoder.equals does not handle nu

[jira] [Created] (BEAM-441) Python postcommit is broken

2016-07-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-441: Summary: Python postcommit is broken Key: BEAM-441 URL: https://issues.apache.org/jira/browse/BEAM-441 Project: Beam Issue Type: Bug Components: sd

[jira] [Commented] (BEAM-404) PubsubIO should have a mode that supports maintaining message attributes.

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372042#comment-15372042 ] Daniel Halperin commented on BEAM-404: -- It's actually a bit deeper than that. PubsubIO

[jira] [Commented] (BEAM-404) PubsubIO should have a mode that supports maintaining message attributes.

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372044#comment-15372044 ] Daniel Halperin commented on BEAM-404: -- Of course instead of {{KV}} this could be somet

[jira] [Closed] (BEAM-69) TextIO/AvroIO numShards may not work in different runners

2016-07-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-69. --- Resolution: Fixed Assignee: Daniel Halperin Fix Version/s: Not applicable > TextIO/AvroIO

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374380#comment-15374380 ] Daniel Halperin commented on BEAM-445: -- The uber jar is not supported by gRPC yet, so w

[jira] [Created] (BEAM-450) Modules are shaded to the same path

2016-07-14 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-450: Summary: Modules are shaded to the same path Key: BEAM-450 URL: https://issues.apache.org/jira/browse/BEAM-450 Project: Beam Issue Type: Bug Compon

[jira] [Updated] (BEAM-450) Modules are shaded to the same path

2016-07-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-450: - Labels: newbie starter (was: ) > Modules are shaded to the same path >

[jira] [Updated] (BEAM-451) When producing bundled jars, service files are not concatenated

2016-07-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-451: - Labels: newbie starter (was: ) > When producing bundled jars, service files are not concatenated >

[jira] [Created] (BEAM-451) When producing bundled jars, service files are not concatenated

2016-07-14 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-451: Summary: When producing bundled jars, service files are not concatenated Key: BEAM-451 URL: https://issues.apache.org/jira/browse/BEAM-451 Project: Beam Iss

[jira] [Created] (BEAM-457) Upgrade Avro

2016-07-15 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-457: Summary: Upgrade Avro Key: BEAM-457 URL: https://issues.apache.org/jira/browse/BEAM-457 Project: Beam Issue Type: Improvement Components: sdk-java-

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379630#comment-15379630 ] Daniel Halperin commented on BEAM-445: -- Thanks -- it's good to make sure everyone invol

[jira] [Resolved] (BEAM-285) Make MinLongFn and MaxLongFn mimic SumLongFn and use BinaryCombineLongFn

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-285. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Make MinLongFn and MaxLongFn mimic SumL

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-445. -- Resolution: Fixed Fix Version/s: Not applicable > Beam-examples-java build failed through l

[jira] [Updated] (BEAM-384) Streaming BigQueryIO should support user-provided IDs

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-384: - Assignee: (was: Daniel Halperin) > Streaming BigQueryIO should support user-provided IDs > -

[jira] [Created] (BEAM-467) Spark flaky tests?

2016-07-18 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-467: Summary: Spark flaky tests? Key: BEAM-467 URL: https://issues.apache.org/jira/browse/BEAM-467 Project: Beam Issue Type: Bug Components: runner-spar

[jira] [Updated] (BEAM-383) BigQueryIO: update sink to shard into multiple write jobs

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-383: - Assignee: Ian Zhou > BigQueryIO: update sink to shard into multiple write jobs > ---

[jira] [Assigned] (BEAM-124) Testing -- End to End WordCount Batch and Streaming Tests

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-124: Assignee: Daniel Halperin (was: Jason Kuster) > Testing -- End to End WordCount Batch and St

[jira] [Updated] (BEAM-124) Testing -- End to End WordCount Batch and Streaming Tests

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-124: - Assignee: Mark Liu (was: Daniel Halperin) > Testing -- End to End WordCount Batch and Streaming Tes

[jira] [Updated] (BEAM-469) NullableCoder should encode using the context given and not always use the nested context

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-469: - Assignee: (was: Davor Bonaci) > NullableCoder should encode using the context given and not alwa

[jira] [Updated] (BEAM-466) QuantileStateCoder should be a StandardCoder

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-466: - Assignee: (was: Davor Bonaci) > QuantileStateCoder should be a StandardCoder > -

[jira] [Commented] (BEAM-461) Create custom Kinesis source

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383130#comment-15383130 ] Daniel Halperin commented on BEAM-461: -- +1 > Create custom Kinesis source > --

[jira] [Resolved] (BEAM-468) NullableCoder should not ask valueCoder isRegisterByteSizeObserverCheap when value is null

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-468. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > NullableCoder should not ask valueCoder

[jira] [Resolved] (BEAM-434) Limit the number of output files a beam-examples execution writes

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-434. -- Resolution: Fixed Assignee: Thomas Groh (was: Amit Sela) Fix Version/s: 0.2.0-incu

[jira] [Resolved] (BEAM-88) DataflowPipelineOptions.tempLocation doesn't really default to stagingLocation

2016-07-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-88. - Resolution: Won't Fix Fix Version/s: Not applicable This is actually working as intended. > D

[jira] [Created] (BEAM-475) High-quality javadoc for Beam

2016-07-19 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-475: Summary: High-quality javadoc for Beam Key: BEAM-475 URL: https://issues.apache.org/jira/browse/BEAM-475 Project: Beam Issue Type: Improvement Comp

[jira] [Created] (BEAM-476) BigQueryIO.Write: schema not known at construction time

2016-07-20 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-476: Summary: BigQueryIO.Write: schema not known at construction time Key: BEAM-476 URL: https://issues.apache.org/jira/browse/BEAM-476 Project: Beam Issue Type:

[jira] [Reopened] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-445: -- > Beam-examples-java build failed through local "mvn install" > --

[jira] [Resolved] (BEAM-316) Support file scheme in TextIO

2016-07-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-316. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Support file scheme in TextIO > ---

[jira] [Updated] (BEAM-458) Support for Flink Metrics

2016-07-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-458: - Component/s: (was: runner-flink) (was: runner-core) beam-mo

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-445. -- Resolution: Fixed > Beam-examples-java build failed through local "mvn install" >

[jira] [Created] (BEAM-486) Cleanup NOTICE file

2016-07-25 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-486: Summary: Cleanup NOTICE file Key: BEAM-486 URL: https://issues.apache.org/jira/browse/BEAM-486 Project: Beam Issue Type: Task Components: project-m

[jira] [Resolved] (BEAM-380) Remove Spark runner dependency on beam-examlpes-java

2016-07-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-380. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Remove Spark runner dependency on beam-

[jira] [Created] (BEAM-487) Add disclaimer to GitHub README.md

2016-07-25 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-487: Summary: Add disclaimer to GitHub README.md Key: BEAM-487 URL: https://issues.apache.org/jira/browse/BEAM-487 Project: Beam Issue Type: Task Compon

[jira] [Created] (BEAM-488) Remove KEYS file

2016-07-25 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-488: Summary: Remove KEYS file Key: BEAM-488 URL: https://issues.apache.org/jira/browse/BEAM-488 Project: Beam Issue Type: Task Components: project-mana

[jira] [Updated] (BEAM-458) Support for Flink Metrics

2016-07-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-458: - Priority: Major (was: Critical) > Support for Flink Metrics > -- > >

<    1   2   3   4   5   6   7   8   9   10   >