[jira] [Resolved] (BEAM-8745) More fine-grained controls for the size of a BigQuery Load job

2020-01-12 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved BEAM-8745. --- Fix Version/s: 2.19.0 Resolution: Fixed > More fine-grained controls for the size of a

[jira] [Assigned] (BEAM-8745) More fine-grained controls for the size of a BigQuery Load job

2020-01-03 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas reassigned BEAM-8745: - Assignee: Jeff Klukas (was: Pablo Estrada) > More fine-grained controls for the size of a

[jira] [Resolved] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-11-18 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved BEAM-8393. --- Resolution: Fixed > Java BigQueryIO clustering support breaks on multiple partitions >

[jira] [Commented] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-11-18 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976837#comment-16976837 ] Jeff Klukas commented on BEAM-8393: --- Yes, now marked as fixed. > Java BigQueryIO clustering support

[jira] [Created] (BEAM-8540) Fix CSVSink example in FileIO docs

2019-11-01 Thread Jeff Klukas (Jira)
Jeff Klukas created BEAM-8540: - Summary: Fix CSVSink example in FileIO docs Key: BEAM-8540 URL: https://issues.apache.org/jira/browse/BEAM-8540 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-10-23 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-8393: -- I'm marking this as a blocker for 2.17 as the current code may cause load failures without the fix, but I

[jira] [Updated] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-10-23 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-8393: -- Priority: Blocker (was: Major) > Java BigQueryIO clustering support breaks on multiple partitions >

[jira] [Updated] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-10-23 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-8393: -- Fix Version/s: 2.17.0 > Java BigQueryIO clustering support breaks on multiple partitions >

[jira] [Created] (BEAM-8393) Java BigQueryIO clustering support breaks on multiple partitions

2019-10-14 Thread Jeff Klukas (Jira)
Jeff Klukas created BEAM-8393: - Summary: Java BigQueryIO clustering support breaks on multiple partitions Key: BEAM-8393 URL: https://issues.apache.org/jira/browse/BEAM-8393 Project: Beam Issue

[jira] [Comment Edited] (BEAM-1891) Java @Autovalue: currently doesn't have a good coder

2019-09-18 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932537#comment-16932537 ] Jeff Klukas edited comment on BEAM-1891 at 9/18/19 3:09 PM: Yes; at least for

[jira] [Commented] (BEAM-1891) Java @Autovalue: currently doesn't have a good coder

2019-09-18 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932537#comment-16932537 ] Jeff Klukas commented on BEAM-1891: --- Yes; at least for AutoValue classes that a user has control over

[jira] [Created] (BEAM-8100) Add exception handling to Json transforms in Java SDK

2019-08-27 Thread Jeff Klukas (Jira)
Jeff Klukas created BEAM-8100: - Summary: Add exception handling to Json transforms in Java SDK Key: BEAM-8100 URL: https://issues.apache.org/jira/browse/BEAM-8100 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-5638) Add exception handling to single message transforms in Java SDK

2019-08-27 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved BEAM-5638. --- Fix Version/s: 2.12.0 Resolution: Fixed Broke off Filter support to

[jira] [Created] (BEAM-8099) Add exception handling to Filter in Java SDK

2019-08-27 Thread Jeff Klukas (Jira)
Jeff Klukas created BEAM-8099: - Summary: Add exception handling to Filter in Java SDK Key: BEAM-8099 URL: https://issues.apache.org/jira/browse/BEAM-8099 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-5638) Add exception handling to single message transforms in Java SDK

2019-08-27 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916689#comment-16916689 ] Jeff Klukas commented on BEAM-5638: --- Breaking out Filter to a separate issue:

[jira] [Commented] (BEAM-8023) Allow specifying BigQuery Storage API readOptions at runtime

2019-08-22 Thread Jeff Klukas (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913498#comment-16913498 ] Jeff Klukas commented on BEAM-8023: --- I would send a PR for this _eventually_, but it may be several

[jira] [Created] (BEAM-8023) Allow specifying BigQuery Storage API readOptions at runtime

2019-08-21 Thread Jeff Klukas (Jira)
Jeff Klukas created BEAM-8023: - Summary: Allow specifying BigQuery Storage API readOptions at runtime Key: BEAM-8023 URL: https://issues.apache.org/jira/browse/BEAM-8023 Project: Beam Issue

[jira] [Resolved] (BEAM-5191) Add support for writing to BigQuery clustered tables

2019-07-23 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved BEAM-5191. --- Resolution: Fixed Assignee: Jeff Klukas (was: Wout Scheepers) Fix Version/s: 2.15.0

[jira] [Commented] (BEAM-6770) Correct zstd-jni dependency scope to optional

2019-03-08 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788159#comment-16788159 ] Jeff Klukas commented on BEAM-6770: --- I plan to pick up this issue, but note I will be out of office next

[jira] [Commented] (BEAM-6770) Correct zstd-jni dependency scope to optional

2019-03-06 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785789#comment-16785789 ] Jeff Klukas commented on BEAM-6770: --- Correct that the dependency is not required to compile. The class

[jira] [Commented] (BEAM-6770) Correct zstd-jni dependency scope to optional

2019-03-06 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785679#comment-16785679 ] Jeff Klukas commented on BEAM-6770: --- We did have some discussion in the PR about how the dependency

[jira] [Closed] (BEAM-6680) Fix {@literal @} that shows up in Javadoc code examples

2019-02-15 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas closed BEAM-6680. - Resolution: Duplicate Fix Version/s: Not applicable > Fix {@literal @} that shows up in Javadoc

[jira] [Created] (BEAM-6679) Clean up GroupIntoBatches Javadoc

2019-02-15 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-6679: - Summary: Clean up GroupIntoBatches Javadoc Key: BEAM-6679 URL: https://issues.apache.org/jira/browse/BEAM-6679 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-6680) Fix {@literal @} that shows up in Javadoc code examples

2019-02-15 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-6680: - Summary: Fix {@literal @} that shows up in Javadoc code examples Key: BEAM-6680 URL: https://issues.apache.org/jira/browse/BEAM-6680 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-4822) Beam FileIO should support versioned file systems

2019-02-01 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758248#comment-16758248 ] Jeff Klukas commented on BEAM-4822: --- It's unfortunate that we're going to end up stuffing info from a

[jira] [Commented] (BEAM-4822) Beam FileIO should support versioned file systems

2019-01-31 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757435#comment-16757435 ] Jeff Klukas commented on BEAM-4822: --- Does schema-based coding handle evolution of types? I'm wondering

[jira] [Resolved] (BEAM-6386) Add named variant of PTransform::compose

2019-01-22 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved BEAM-6386. --- Resolution: Fixed Fix Version/s: 2.11.0 > Add named variant of PTransform::compose >

[jira] [Updated] (BEAM-6399) FileIO errors on unbounded input with nondefault trigger

2019-01-09 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-6399: -- Description: {{In a pipeline with unbounded input, if a user defines a custom trigger and does not

[jira] [Commented] (BEAM-6399) FileIO errors on unbounded input with nondefault trigger

2019-01-09 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738883#comment-16738883 ] Jeff Klukas commented on BEAM-6399: --- I previously thought this problem occurred only when a

[jira] [Updated] (BEAM-6399) FileIO errors on unbounded input with nondefault trigger

2019-01-09 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-6399: -- Description: {{In a pipeline with unbounded input, if a user defines a custom trigger and calls

[jira] [Updated] (BEAM-6399) FileIO errors on unbounded input with nondefault trigger

2019-01-09 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-6399: -- Description: {{In a pipeline with unbounded input, if a user defines a custom trigger and calls

[jira] [Created] (BEAM-6399) FileIO errors on unbounded input with nondefault trigger

2019-01-09 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-6399: - Summary: FileIO errors on unbounded input with nondefault trigger Key: BEAM-6399 URL: https://issues.apache.org/jira/browse/BEAM-6399 Project: Beam Issue Type:

[jira] [Created] (BEAM-6386) Add named variant of PTransform::compose

2019-01-08 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-6386: - Summary: Add named variant of PTransform::compose Key: BEAM-6386 URL: https://issues.apache.org/jira/browse/BEAM-6386 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-6150) Provide alternatives to SerializableFunction and SimpleFunction that may declare exceptions

2019-01-03 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas resolved BEAM-6150. --- Resolution: Fixed > Provide alternatives to SerializableFunction and SimpleFunction that may >

[jira] [Updated] (BEAM-6150) Provide alternatives to SerializableFunction and SimpleFunction that may declare exceptions

2019-01-03 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-6150: -- Fix Version/s: 2.10.0 > Provide alternatives to SerializableFunction and SimpleFunction that may >

[jira] [Updated] (BEAM-6365) Add ZStandard compression support for Java SDK

2019-01-03 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas updated BEAM-6365: -- Labels: has-pr (was: ) > Add ZStandard compression support for Java SDK >

[jira] [Created] (BEAM-6365) Add ZStandard compression support for Java SDK

2019-01-03 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-6365: - Summary: Add ZStandard compression support for Java SDK Key: BEAM-6365 URL: https://issues.apache.org/jira/browse/BEAM-6365 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-3616) Ensure coders are updatable partially in a cluster (aka add versions to coders)

2018-12-27 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729615#comment-16729615 ] Jeff Klukas commented on BEAM-3616: --- Here's an additional relevant thread that discusses the need for

[jira] [Created] (BEAM-6150) Provide alternatives to SerializableFunction and SimpleFunction that may declare exceptions

2018-11-29 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-6150: - Summary: Provide alternatives to SerializableFunction and SimpleFunction that may declare exceptions Key: BEAM-6150 URL: https://issues.apache.org/jira/browse/BEAM-6150

[jira] [Commented] (BEAM-1891) Java @Autovalue: currently doesn't have a good coder

2018-11-09 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681854#comment-16681854 ] Jeff Klukas commented on BEAM-1891: --- Perhaps a better path is to write an AutoValueExtension that

[jira] [Commented] (BEAM-1891) Java @Autovalue: currently doesn't have a good coder

2018-11-09 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681626#comment-16681626 ] Jeff Klukas commented on BEAM-1891: --- Looks like the AutoValueExtension path won't work due to the fact

[jira] [Commented] (BEAM-1891) Java @Autovalue: currently doesn't have a good coder

2018-11-08 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680115#comment-16680115 ] Jeff Klukas commented on BEAM-1891: --- AvroCoder appears to be a great solution except for the current

[jira] [Closed] (BEAM-5413) Add method for defining composite transforms as lambda expressions

2018-10-30 Thread Jeff Klukas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Klukas closed BEAM-5413. - > Add method for defining composite transforms as lambda expressions >

[jira] [Created] (BEAM-5922) Common base class for FlatMapElements, MapElements, and Filter

2018-10-30 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-5922: - Summary: Common base class for FlatMapElements, MapElements, and Filter Key: BEAM-5922 URL: https://issues.apache.org/jira/browse/BEAM-5922 Project: Beam Issue

[jira] [Created] (BEAM-5910) FileSystems should retrieve lastModified time

2018-10-29 Thread Jeff Klukas (JIRA)
Jeff Klukas created BEAM-5910: - Summary: FileSystems should retrieve lastModified time Key: BEAM-5910 URL: https://issues.apache.org/jira/browse/BEAM-5910 Project: Beam Issue Type: Improvement