[jira] [Assigned] (BEAM-1494) GcsFileSystem should check content encoding when setting IsReadSeekEfficient

2017-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1494: - Assignee: (was: Daniel Halperin) > GcsFileSystem should check content encoding when

[jira] [Assigned] (BEAM-2391) Migrate to gcloud java core for default GCP project id detection

2017-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-2391: - Assignee: (was: Daniel Halperin) > Migrate to gcloud java core for default GCP

[jira] [Assigned] (BEAM-2400) Null pointer exception when creating a template

2017-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-2400: - Assignee: (was: Daniel Halperin) > Null pointer exception when creating a template >

[jira] [Commented] (BEAM-2532) BigQueryIO source should avoid expensive JSON schema parsing for every record

2017-06-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066925#comment-16066925 ] Daniel Halperin commented on BEAM-2532: --- Oh, that is an ugly bug: - We use a String because we can

[jira] [Updated] (BEAM-2373) AvroSource: Premature End of stream Exception on SnappyCompressorInputStream

2017-05-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2373: -- Fix Version/s: 2.1.0 > AvroSource: Premature End of stream Exception on

[jira] [Created] (BEAM-2389) GcpCoreApiSurfaceTest isn't testing right module

2017-05-30 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-2389: - Summary: GcpCoreApiSurfaceTest isn't testing right module Key: BEAM-2389 URL: https://issues.apache.org/jira/browse/BEAM-2389 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2379) SpannerIO tests are failing

2017-05-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029965#comment-16029965 ] Daniel Halperin commented on BEAM-2379: --- Feel free to rollback if fix is not coming quickly.

[jira] [Closed] (BEAM-2372) Only run Apache RAT at root module

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2372. - Resolution: Done > Only run Apache RAT at root module > -- > >

[jira] [Created] (BEAM-2372) Only run Apache RAT at root module

2017-05-26 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-2372: - Summary: Only run Apache RAT at root module Key: BEAM-2372 URL: https://issues.apache.org/jira/browse/BEAM-2372 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-1073) Staged websites have extra whitespace around links

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1073. - Resolution: Fixed Thanks Kenn! This is a nice simple fix to an issue that was, for some reason,

[jira] [Assigned] (BEAM-2370) BigQuery Insert with Partition Decorator throwing error

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-2370: - Assignee: Reuven Lax (was: Daniel Halperin) > BigQuery Insert with Partition Decorator

[jira] [Commented] (BEAM-2370) BigQuery Insert with Partition Decorator throwing error

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026517#comment-16026517 ] Daniel Halperin commented on BEAM-2370: --- [~reuvenlax], can you take a look at this issue? > BigQuery

[jira] [Commented] (BEAM-1073) Staged websites have extra whitespace around links

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026479#comment-16026479 ] Daniel Halperin commented on BEAM-1073: --- The code for this is in the {{beam-site}} repo under the

[jira] [Resolved] (BEAM-2362) Inline code font formatting is applied to the following space when site is staged by Jenkins

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-2362. --- Resolution: Duplicate > Inline code font formatting is applied to the following space when

[jira] [Commented] (BEAM-2362) Inline code font formatting is applied to the following space when site is staged by Jenkins

2017-05-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026432#comment-16026432 ] Daniel Halperin commented on BEAM-2362: --- Found it! [BEAM-1073] (Sorry, should have linked yesterday)

[jira] [Updated] (BEAM-2336) Consider removing the default coder from TfRecordIO

2017-05-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2336: -- Labels: backward-incompatible (was: ) > Consider removing the default coder from TfRecordIO >

[jira] [Closed] (BEAM-2311) Update compatibility matrix Aggregators section for Metrics

2017-05-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2311. - Resolution: Done > Update compatibility matrix Aggregators section for Metrics >

[jira] [Closed] (BEAM-2362) Inline code font formatting is applied to the following space.

2017-05-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2362. - Resolution: Won't Fix Assignee: Kenneth Knowles (was: Davor Bonaci) Fix Version/s:

[jira] [Commented] (BEAM-2362) Inline code font formatting is applied to the following space.

2017-05-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025406#comment-16025406 ] Daniel Halperin commented on BEAM-2362: --- Is this true on the actual Beam site, or only in staged web

[jira] [Updated] (BEAM-2364) PCollectionView should not be a PValue, it should expand to its underlying PCollection

2017-05-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2364: -- Labels: backward-incompatible (was: ) > PCollectionView should not be a PValue, it should

[jira] [Updated] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-05-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1773: -- Labels: backward-incompatible (was: ) > Consider allowing Source#validate() to throw exception

[jira] [Closed] (BEAM-2321) gRPC configuration failure using DataflowRunner and Bigtable

2017-05-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2321. - Resolution: Not A Problem Fix Version/s: Not applicable > gRPC configuration failure using

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023709#comment-16023709 ] Daniel Halperin commented on BEAM-1542: --- Thanks [~guymolinari]! Your original sink has now been

[jira] [Assigned] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1542: - Assignee: Mairbek Khadikov (was: Guy Molinari) > Need Source/Sink for Spanner >

[jira] [Commented] (BEAM-2141) beam_PerformanceTests_JDBC have not passed in weeks

2017-05-23 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021676#comment-16021676 ] Daniel Halperin commented on BEAM-2141: --- Bug is unassigned, please feel free to grab. >

[jira] [Closed] (BEAM-2344) Re-rename fat jar in archetypes

2017-05-23 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2344. - Resolution: Done > Re-rename fat jar in archetypes > --- > >

[jira] [Commented] (BEAM-2321) gRPC configuration failure using DataflowRunner and Bigtable

2017-05-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020097#comment-16020097 ] Daniel Halperin commented on BEAM-2321: --- By the way, the reason I believe this is not a bug in the

[jira] [Commented] (BEAM-2326) Verbose INFO logging with stateful DoFns and Dataflow

2017-05-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020087#comment-16020087 ] Daniel Halperin commented on BEAM-2326: --- [~kenn], maybe you should take a look at this one? >

[jira] [Assigned] (BEAM-2326) Verbose INFO logging with stateful DoFns and Dataflow

2017-05-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-2326: - Assignee: Kenneth Knowles (was: Daniel Halperin) > Verbose INFO logging with stateful

[jira] [Commented] (BEAM-2321) gRPC configuration failure using DataflowRunner and Bigtable

2017-05-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020085#comment-16020085 ] Daniel Halperin commented on BEAM-2321: --- [~nkilmer] Which release of gRPC, protobuf, and

[jira] [Closed] (BEAM-2318) Flake in HBaseIOTest

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2318. - Resolution: Fixed Fix Version/s: 2.1.0 > Flake in HBaseIOTest > > >

[jira] [Commented] (BEAM-2321) gRPC configuration failure using DataflowRunner and Bigtable

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016558#comment-16016558 ] Daniel Halperin commented on BEAM-2321: --- Please post full output of Maven dependency:list > gRPC

[jira] [Closed] (BEAM-1702) Add support for local execution to BigtableIO using the google cloud emulator

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1702. - Resolution: Fixed Fix Version/s: 2.1.0 Thanks Borisa! > Add support for local execution to

[jira] [Closed] (BEAM-1735) Retry 403:rateLimitExceeded in GCS

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1735. - Resolution: Not A Problem Fix Version/s: Not applicable > Retry 403:rateLimitExceeded in

[jira] [Closed] (BEAM-1831) Checking of containment in createdTables may have race condition in StreamingWriteFn

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1831. - Resolution: Not A Bug Fix Version/s: Not applicable > Checking of containment in

[jira] [Closed] (BEAM-1024) upgrade to protobuf-3.1.0

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1024. - Resolution: Not A Problem Fix Version/s: Not applicable > upgrade to protobuf-3.1.0 >

[jira] [Commented] (BEAM-1016) Use Content-Type and Content-Encoding (as opposed to overriding Content-Type) for compressed files

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016365#comment-16016365 ] Daniel Halperin commented on BEAM-1016: --- This would actually be terrible, as when the files are

[jira] [Closed] (BEAM-1016) Use Content-Type and Content-Encoding (as opposed to overriding Content-Type) for compressed files

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1016. - Resolution: Won't Fix Fix Version/s: Not applicable > Use Content-Type and Content-Encoding

[jira] [Commented] (BEAM-923) Add support for local execution to DatastoreIO using the google cloud emulator

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016361#comment-16016361 ] Daniel Halperin commented on BEAM-923: -- [~iemejia] I think I have heard that DatastoreIO with local

[jira] [Assigned] (BEAM-1187) GCP Transport not performing timed backoff after connection failure

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1187: - Assignee: (was: Pei He) > GCP Transport not performing timed backoff after connection

[jira] [Commented] (BEAM-1252) BigQueryIO.Read: validate exported files with GCS glob.

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016358#comment-16016358 ] Daniel Halperin commented on BEAM-1252: --- It looks like this is handled correctly:

[jira] [Closed] (BEAM-1252) BigQueryIO.Read: validate exported files with GCS glob.

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1252. - Resolution: Not A Problem Fix Version/s: Not applicable > BigQueryIO.Read: validate

[jira] [Closed] (BEAM-209) PCollection-to-batched-gcs-files PTransform

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-209. Resolution: Duplicate Fix Version/s: Not applicable [~reuvenlax] added windowed sink support

[jira] [Commented] (BEAM-2272) Test scope & runtime dependencies need reevaluation

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016350#comment-16016350 ] Daniel Halperin commented on BEAM-2272: --- This issue slipped from 2.0.0, but does need work for next

[jira] [Updated] (BEAM-2272) Test scope & runtime dependencies need reevaluation

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2272: -- Fix Version/s: 2.1.0 > Test scope & runtime dependencies need reevaluation >

[jira] [Closed] (BEAM-1078) Modifying the links in JavaDocs to point to the Beam github repo rather than GCP

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1078. - Resolution: Fixed > Modifying the links in JavaDocs to point to the Beam github repo rather than

[jira] [Closed] (BEAM-1851) Sample.fixedSizedGlobally documentation should include single worker memory constraint

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1851. - Resolution: Fixed Fix Version/s: 2.0.0 > Sample.fixedSizedGlobally documentation should

[jira] [Closed] (BEAM-1978) Avoid repackaging bigtable classes in Dataflow runner jar

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1978. - Resolution: Fixed Fix Version/s: Not applicable > Avoid repackaging bigtable classes in

[jira] [Commented] (BEAM-1909) BigQuery read transform fails for DirectRunner when querying non-US regions

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016342#comment-16016342 ] Daniel Halperin commented on BEAM-1909: --- [~chamikara] Is this issue fixed? Can it be closed now? >

[jira] [Commented] (BEAM-1938) Side Inputs should be part of the expanded inputs

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016343#comment-16016343 ] Daniel Halperin commented on BEAM-1938: --- [~tgroh] can this issue be closed? > Side Inputs should be

[jira] [Closed] (BEAM-2066) Strip IOChannel validation calls from file based IOs

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2066. - Resolution: Fixed Fix Version/s: Not applicable > Strip IOChannel validation calls from

[jira] [Closed] (BEAM-1040) Hadoop InputFormat - IO Transform for reads

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1040. - Resolution: Fixed Fix Version/s: 2.0.0 Thanks Dipti! > Hadoop InputFormat - IO Transform

[jira] [Closed] (BEAM-1083) Deleting the Weblink for the DatastoreWordCount based on BEAM-498

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1083. - Resolution: Fixed > Deleting the Weblink for the DatastoreWordCount based on BEAM-498 >

[jira] [Commented] (BEAM-1946) Add IO module for restful api

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016323#comment-16016323 ] Daniel Halperin commented on BEAM-1946: --- I've been talking to some folks at ApacheCon with related

[jira] [Assigned] (BEAM-1946) Add IO module for restful api

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1946: - Assignee: (was: Jean-Baptiste Onofré) > Add IO module for restful api >

[jira] [Closed] (BEAM-951) Cleanup FileBasedSink to prepare IOChannelFactory redesign.

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-951. Resolution: Fixed Fix Version/s: Not applicable IOChannelFactory is gone, so this must be

[jira] [Closed] (BEAM-978) Support bulk get file sizes in GcsUtil

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-978. Resolution: Fixed Fix Version/s: 0.4.0 > Support bulk get file sizes in GcsUtil >

[jira] [Closed] (BEAM-1071) Support pre-existing tables with streaming BigQueryIO

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1071. - Resolution: Fixed Fix Version/s: 2.0.0 Implemented in 2.0.0 > Support pre-existing tables

[jira] [Commented] (BEAM-788) Execute ReduceFn directly, not via OldDoFn wrapper

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016268#comment-16016268 ] Daniel Halperin commented on BEAM-788: -- [~jkff] is this done now? > Execute ReduceFn directly, not via

[jira] [Closed] (BEAM-684) De-Dataflow Beam

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-684. Resolution: Fixed Fix Version/s: Not applicable There has been many copies of this issue, but

[jira] [Assigned] (BEAM-788) Execute ReduceFn directly, not via OldDoFn wrapper

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-788: Assignee: Eugene Kirpichov (was: Daniel Halperin) > Execute ReduceFn directly, not via

[jira] [Assigned] (BEAM-788) Execute ReduceFn directly, not via OldDoFn wrapper

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-788: Assignee: Daniel Halperin > Execute ReduceFn directly, not via OldDoFn wrapper >

[jira] [Closed] (BEAM-597) Provide type information from Coders

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-597. Resolution: Fixed Fix Version/s: 0.5.0 > Provide type information from Coders >

[jira] [Closed] (BEAM-1497) Refactor Hadoop/HDFS IO

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1497. - Resolution: Fixed Fix Version/s: (was: Not applicable) 0.6.0 Thanks

[jira] [Closed] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-230. Resolution: Won't Fix I believe this is now a WontFix issue as the first stable release went out with

[jira] [Commented] (BEAM-39) Audit trigger implementations to ensure they prefetch appropriately

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-39?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016231#comment-16016231 ] Daniel Halperin commented on BEAM-39: - [~scwhittle] Is this issue resolved? If not, are you working on

[jira] [Closed] (BEAM-1858) improve error message when Create.of() is called with an empty iterator

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1858. - Resolution: Fixed Fix Version/s: 2.0.0 > improve error message when Create.of() is called

[jira] [Closed] (BEAM-1990) Window.Assign should not be public since it is not meant to be used publicly

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1990. - Resolution: Fixed Fix Version/s: 2.0.0 > Window.Assign should not be public since it is not

[jira] [Closed] (BEAM-1992) Count.perElement javadoc refers to Count.PerElement, but Count.PerElement is private

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1992. - Resolution: Fixed Fix Version/s: 2.0.0 > Count.perElement javadoc refers to

[jira] [Commented] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016222#comment-16016222 ] Daniel Halperin commented on BEAM-308: -- [~swegner]: Is this issue resolved? If not, are still you

[jira] [Closed] (BEAM-404) PubsubIO should have a mode that supports maintaining message attributes.

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-404. Resolution: Fixed Fix Version/s: 2.0.0 > PubsubIO should have a mode that supports maintaining

[jira] [Updated] (BEAM-1897) Remove Sink

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1897: -- Issue Type: Improvement (was: Bug) > Remove Sink > --- > > Key:

[jira] [Closed] (BEAM-2122) Writing to partitioned BigQuery tables from Dataflow is causing errors

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2122. - Resolution: Fixed Fix Version/s: 2.0.0 > Writing to partitioned BigQuery tables from

[jira] [Closed] (BEAM-1897) Remove Sink

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1897. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove Sink > --- > > Key:

[jira] [Closed] (BEAM-1873) Javadoc in BigQueryIO doesn't reflect recent changes

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1873. - Resolution: Fixed Fix Version/s: 2.0.0 > Javadoc in BigQueryIO doesn't reflect recent

[jira] [Closed] (BEAM-437) Data-dependent BigQueryIO in batch

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-437. Resolution: Fixed Fix Version/s: 2.0.0 > Data-dependent BigQueryIO in batch >

[jira] [Closed] (BEAM-1908) Allow setting CREATE_NEVER when using a tablespec in BigQueryIO

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1908. - Resolution: Fixed Fix Version/s: 2.0.0 > Allow setting CREATE_NEVER when using a tablespec

[jira] [Closed] (BEAM-1228) Improve Regex

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1228. - Resolution: Fixed Fix Version/s: 0.5.0 > Improve Regex > - > >

[jira] [Closed] (BEAM-1460) Change ToString Method Name

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1460. - Resolution: Fixed Fix Version/s: 0.6.0 > Change ToString Method Name >

[jira] [Commented] (BEAM-2316) GcsUtil matches GCS glob * as though it is **

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015856#comment-16015856 ] Daniel Halperin commented on BEAM-2316: --- It sounds like Devon and I were not perfect in the new

[jira] [Updated] (BEAM-123) Skip header row from csv

2017-05-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-123: - Labels: newbie starter (was: ) > Skip header row from csv > - > >

[jira] [Created] (BEAM-2311) Update compatibility matrix Aggregators section for Metrics

2017-05-17 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-2311: - Summary: Update compatibility matrix Aggregators section for Metrics Key: BEAM-2311 URL: https://issues.apache.org/jira/browse/BEAM-2311 Project: Beam

[jira] [Closed] (BEAM-2110) HDFSFileSource throws IndexOutOfBoundsException when trying to read big file (gaming_data1.csv)

2017-05-16 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2110. - Resolution: Not A Problem Fix Version/s: Not applicable > HDFSFileSource throws

[jira] [Commented] (BEAM-2110) HDFSFileSource throws IndexOutOfBoundsException when trying to read big file (gaming_data1.csv)

2017-05-16 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013330#comment-16013330 ] Daniel Halperin commented on BEAM-2110: --- {{HDFSFileSource}} has been deleted in version 2.0.0, as all

[jira] [Closed] (BEAM-2290) CompressedSource doesn't forward timestamps from the underlying Source's output

2017-05-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2290. - Resolution: Fixed Assignee: Davor Bonaci (was: Daniel Halperin) Fix Version/s:

[jira] [Closed] (BEAM-2277) IllegalArgumentException when using Hadoop file system for WordCount example.

2017-05-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2277. - Resolution: Fixed > IllegalArgumentException when using Hadoop file system for WordCount example.

[jira] [Commented] (BEAM-2277) IllegalArgumentException when using Hadoop file system for WordCount example.

2017-05-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008904#comment-16008904 ] Daniel Halperin commented on BEAM-2277: --- Using the latest version on relesae-2.0.0 branch

[jira] [Closed] (BEAM-2279) Hadoop file system support should be included in examples/archetype profiles of Spark runner.

2017-05-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2279. - Resolution: Fixed Hopefully fixed for real this time. > Hadoop file system support should be

[jira] [Reopened] (BEAM-2279) Hadoop file system support should be included in examples/archetype profiles of Spark runner.

2017-05-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reopened BEAM-2279: --- Introduced a new breakage in the archetypes > Hadoop file system support should be included in

[jira] [Closed] (BEAM-2279) Hadoop file system support should be included in examples/archetype profiles of Spark runner.

2017-05-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2279. - Resolution: Fixed Thanks Aviem! > Hadoop file system support should be included in

[jira] [Updated] (BEAM-2024) Python and Java SDKs differ on name of AfterCount

2017-05-12 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2024: -- Summary: Python and Java SDKs differ on name of AfterCount (was: Python and Java Dataflow refer

[jira] [Created] (BEAM-2272) Test scope & runtime dependencies need reevaluation

2017-05-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-2272: - Summary: Test scope & runtime dependencies need reevaluation Key: BEAM-2272 URL: https://issues.apache.org/jira/browse/BEAM-2272 Project: Beam Issue Type:

[jira] [Created] (BEAM-2271) Release guide or pom.xml needs update to avoid releasing Python binary artifacts

2017-05-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-2271: - Summary: Release guide or pom.xml needs update to avoid releasing Python binary artifacts Key: BEAM-2271 URL: https://issues.apache.org/jira/browse/BEAM-2271

[jira] [Closed] (BEAM-2260) When using WindowedWrites and default FilenamePolicy, TextIO should throw at construction time

2017-05-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2260. - Resolution: Fixed > When using WindowedWrites and default FilenamePolicy, TextIO should throw at

[jira] [Created] (BEAM-2260) When using WindowedWrites and default FilenamePolicy, TextIO should throw at construction time

2017-05-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-2260: - Summary: When using WindowedWrites and default FilenamePolicy, TextIO should throw at construction time Key: BEAM-2260 URL: https://issues.apache.org/jira/browse/BEAM-2260

[jira] [Commented] (BEAM-2259) Reshuffle may set watermark holds past the end of time

2017-05-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006671#comment-16006671 ] Daniel Halperin commented on BEAM-2259: --- Marking as 2.0.0 fix. > Reshuffle may set watermark holds

[jira] [Updated] (BEAM-2259) Reshuffle may set watermark holds past the end of time

2017-05-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2259: -- Fix Version/s: 2.0.0 > Reshuffle may set watermark holds past the end of time >

[jira] [Commented] (BEAM-2256) mongodb sdk MongoDbIO.BoundedMongoDbSource.splitKeysToFilters incorrect

2017-05-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006633#comment-16006633 ] Daniel Halperin commented on BEAM-2256: --- FYI [~jbonofre] to confirm existence of issue and possible

[jira] [Updated] (BEAM-2256) mongodb sdk MongoDbIO.BoundedMongoDbSource.splitKeysToFilters incorrect

2017-05-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-2256: -- Fix Version/s: 2.0.0 > mongodb sdk MongoDbIO.BoundedMongoDbSource.splitKeysToFilters incorrect >

[jira] [Commented] (BEAM-2256) mongodb sdk MongoDbIO.BoundedMongoDbSource.splitKeysToFilters incorrect

2017-05-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006625#comment-16006625 ] Daniel Halperin commented on BEAM-2256: --- [~hongmin] wow, thanks for finding this issue and the

  1   2   3   4   5   6   7   >