[jira] [Updated] (BEAM-6740) Combine.globally translation is never called

2019-03-21 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6740: --- Description: Beam translates Combine.Globally as a composite transform composed of: * Map

[jira] [Resolved] (BEAM-2296) HBase IO should use AutoValue

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-2296. Resolution: Won't Fix Fix Version/s: Not applicable HBaseIO only uses three parameters so

[jira] [Resolved] (BEAM-934) Findbugs doesn't pass in Java8 Examples

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-934. --- Resolution: Fixed Fix Version/s: Not applicable > Findbugs doesn't pass in Java8 Examp

[jira] [Updated] (BEAM-928) Spotbugs doesn't pass in Kafka

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-928: -- Summary: Spotbugs doesn't pass in Kafka (was: Findbugs doesn't pass in Kafka) > Spotbugs doesn't p

[jira] [Resolved] (BEAM-3147) Nexmark in SQL

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-3147. Resolution: Fixed Fix Version/s: Not applicable > Nexmark in

[jira] [Updated] (BEAM-5658) Enable SpotBugs in dataflow java worker code

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-5658: --- Issue Type: Sub-task (was: Test) Parent: BEAM-1129 > Enable SpotBugs in dataflow java wor

[jira] [Updated] (BEAM-928) Enable Spotbugs in KafkaIO

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-928: -- Summary: Enable Spotbugs in KafkaIO (was: Spotbugs doesn't pass in Kafka) > Enable Spotbugs in Kafk

[jira] [Assigned] (BEAM-2296) HBase IO should use AutoValue

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-2296: -- Assignee: (was: Borisa Zivkovic) > HBase IO should use AutoVa

[jira] [Commented] (BEAM-3816) [nexmark] Something is slightly off with Query 6

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799069#comment-16799069 ] Ismaël Mejía commented on BEAM-3816: Is this still an issue [~apilloud]? > [nexmark] Someth

[jira] [Updated] (BEAM-5658) Enable SpotBugs in dataflow java worker code

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-5658: --- Summary: Enable SpotBugs in dataflow java worker code (was: Enable FindBugs in dataflow java worker

[jira] [Created] (BEAM-6888) Enable SpotBugs in JdbcIO

2019-03-22 Thread JIRA
Ismaël Mejía created BEAM-6888: -- Summary: Enable SpotBugs in JdbcIO Key: BEAM-6888 URL: https://issues.apache.org/jira/browse/BEAM-6888 Project: Beam Issue Type: Sub-task Components

[jira] [Updated] (BEAM-1129) Umbrella JIRA for Fixing Findbugs

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1129: --- Labels: findbugs spotbugs (was: findbugs) > Umbrella JIRA for Fixing Findb

[jira] [Updated] (BEAM-928) Spotbugs doesn't pass in Kafka

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-928: -- Issue Type: Sub-task (was: Bug) Parent: BEAM-1129 > Spotbugs doesn't pass in Ka

[jira] [Updated] (BEAM-1129) Umbrella JIRA to fix/enable Findbugs/Spotbugs

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1129: --- Summary: Umbrella JIRA to fix/enable Findbugs/Spotbugs (was: Umbrella JIRA for Fixing Findbugs

[jira] [Commented] (BEAM-4669) Re-enable checkstyle LineLength

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799078#comment-16799078 ] Ismaël Mejía commented on BEAM-4669: Is this still an issue [~kenn]? > Re-enable checkst

[jira] [Created] (BEAM-6889) Enable SpotBugs in Google Cloud Platform (GCPIO) module

2019-03-22 Thread JIRA
Ismaël Mejía created BEAM-6889: -- Summary: Enable SpotBugs in Google Cloud Platform (GCPIO) module Key: BEAM-6889 URL: https://issues.apache.org/jira/browse/BEAM-6889 Project: Beam Issue Type

[jira] [Assigned] (BEAM-6890) CassandraIO uses a non-vendored Guava import

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6890: -- Assignee: Shahar Frank > CassandraIO uses a non-vendored Guava imp

[jira] [Resolved] (BEAM-6890) CassandraIO uses a non-vendored Guava import

2019-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6890. Resolution: Fixed Fix Version/s: 2.12.0 > CassandraIO uses a non-vendored Guava imp

[jira] [Resolved] (BEAM-6436) Gradle local SNAPSHOT publication is not detected correctly by maven

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6436. Resolution: Workaround Fix Version/s: Not applicable > Gradle local SNAPSHOT publicat

[jira] [Resolved] (BEAM-6422) Create an extensible mechanism for file (de)compresion

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6422. Resolution: Won't Fix Fix Version/s: Not applicable After thinking a bit about

[jira] [Resolved] (BEAM-6423) Refactor current file compressors as extensions

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6423. Resolution: Fixed Fix Version/s: Not applicable SInce BEAM-6422 was closed this does

[jira] [Resolved] (BEAM-4783) Add bundleSize parameter to control splitting of Spark sources (useful for Dynamic Allocation)

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-4783. Resolution: Fixed Fix Version/s: (was: 2.9.0) (was: 2.8.0

[jira] [Resolved] (BEAM-6631) Update commons-compress to version 1.18

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6631. Resolution: Fixed Fix Version/s: 2.11.0 > Update commons-compress to version 1

[jira] [Resolved] (BEAM-6365) Add ZStandard compression support for Java SDK

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6365. Resolution: Fixed Fix Version/s: 2.11.0 > Add ZStandard compression support for Java

[jira] [Created] (BEAM-6631) Update commons-compress to version 1.18

2019-02-08 Thread JIRA
Ismaël Mejía created BEAM-6631: -- Summary: Update commons-compress to version 1.18 Key: BEAM-6631 URL: https://issues.apache.org/jira/browse/BEAM-6631 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-6620) Do not relocate guava

2019-02-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6620: --- Summary: Do not relocate guava (was: Stop relocating guava) > Do not relocate gu

[jira] [Created] (BEAM-6620) Stop relocating guava

2019-02-06 Thread JIRA
Ismaël Mejía created BEAM-6620: -- Summary: Stop relocating guava Key: BEAM-6620 URL: https://issues.apache.org/jira/browse/BEAM-6620 Project: Beam Issue Type: Sub-task Components

[jira] [Updated] (BEAM-5987) Cache side inputs on Spark runner for performance

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-5987: --- Summary: Cache side inputs on Spark runner for performance (was: Spark SideInputReader performance

[jira] [Created] (BEAM-6633) Spark's Validates Runner StreamingSourceMetricsTest testUnboundedSourceMetrics takes too long to complete

2019-02-08 Thread JIRA
Ismaël Mejía created BEAM-6633: -- Summary: Spark's Validates Runner StreamingSourceMetricsTest testUnboundedSourceMetrics takes too long to complete Key: BEAM-6633 URL: https://issues.apache.org/jira/browse/BEAM-6633

[jira] [Resolved] (BEAM-6637) [PreCommit] Findbug fails build

2019-02-08 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6637. Resolution: Fixed Fix Version/s: Not applicable > [PreCommit] Findbug fails bu

[jira] [Assigned] (BEAM-4567) Can't use mongo connector with Atlas MongoDB

2019-02-17 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-4567: -- Assignee: Ahmed El.Hussaini > Can't use mongo connector with Atlas Mong

[jira] [Commented] (BEAM-3310) Push metrics to a backend in an runner agnostic way

2019-02-13 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767420#comment-16767420 ] Ismaël Mejía commented on BEAM-3310: This ticket was still open because not all of the sub-tasks have

[jira] [Updated] (BEAM-6670) Option to disable reparallelization in JdbcIO.Read

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6670: --- Component/s: (was: sdk-java-core) io-java-jdbc > Option to disa

[jira] [Updated] (BEAM-5723) CassandraIO is broken because of use of bad relocation of guava

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-5723: --- Affects Version/s: 2.11.0 > CassandraIO is broken because of use of bad relocation of gu

[jira] [Updated] (BEAM-5723) CassandraIO is broken because of use of bad relocation of guava

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-5723: --- Fix Version/s: (was: 2.11.0) 2.12.0 > CassandraIO is broken because of

[jira] [Commented] (BEAM-6654) Support SDF within ElasticsearchIO

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769386#comment-16769386 ] Ismaël Mejía commented on BEAM-6654: Excellent [~tmoulton] I assigned the issue to you, feel free

[jira] [Commented] (BEAM-5723) CassandraIO is broken because of use of bad relocation of guava

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769354#comment-16769354 ] Ismaël Mejía commented on BEAM-5723: This one is partially blocked by BEAM-6620 so better to move

[jira] [Updated] (BEAM-6620) Do not relocate guava

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6620: --- Fix Version/s: 2.12.0 > Do not relocate guava > - > >

[jira] [Assigned] (BEAM-6654) Support SDF within ElasticsearchIO

2019-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6654: -- Assignee: Tony Moulton > Support SDF within Elasticsearc

[jira] [Resolved] (BEAM-6426) Enforce ban of non-vendored Guava, with exceptions

2019-02-07 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6426. Resolution: Fixed > Enforce ban of non-vendored Guava, with excepti

[jira] [Resolved] (BEAM-6601) Fix wrong command to run Hadoop InputFormat integration test in Javadoc

2019-02-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6601. Resolution: Fixed Fix Version/s: 2.11.0 > Fix wrong command to run Hadoop InputFor

[jira] [Created] (BEAM-6605) Deprecate TextIO.readAll() and TextIO.ReadAll transform

2019-02-06 Thread JIRA
Ismaël Mejía created BEAM-6605: -- Summary: Deprecate TextIO.readAll() and TextIO.ReadAll transform Key: BEAM-6605 URL: https://issues.apache.org/jira/browse/BEAM-6605 Project: Beam Issue Type

[jira] [Created] (BEAM-6606) Deprecate AvroIO.readAll() and AvroIO.ReadAll transform

2019-02-06 Thread JIRA
Ismaël Mejía created BEAM-6606: -- Summary: Deprecate AvroIO.readAll() and AvroIO.ReadAll transform Key: BEAM-6606 URL: https://issues.apache.org/jira/browse/BEAM-6606 Project: Beam Issue Type

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755129#comment-16755129 ] Ismaël Mejía commented on BEAM-6517: Mmm I like the idea of having a separate module for Avro

[jira] [Resolved] (BEAM-6302) Allow setting compression codec in ParquetIO write

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6302. Resolution: Fixed Fix Version/s: 2.11.0 > Allow setting compression codec in ParquetIO wr

[jira] [Updated] (BEAM-4904) Beam Dependency Update Request: de.flapdoodle.embed:de.flapdoodle.embed.mongo 2.2.0

2019-01-28 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-4904: --- Summary: Beam Dependency Update Request: de.flapdoodle.embed:de.flapdoodle.embed.mongo 2.2.0

[jira] [Created] (BEAM-6526) Add ReadFiles transform for AvroIO

2019-01-28 Thread JIRA
Ismaël Mejía created BEAM-6526: -- Summary: Add ReadFiles transform for AvroIO Key: BEAM-6526 URL: https://issues.apache.org/jira/browse/BEAM-6526 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-6494) We do not sync pipeline with server at bundle end, only during teardown

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6494. Resolution: Fixed Fix Version/s: 2.11.0 > We do not sync pipeline with server at bundle

[jira] [Assigned] (BEAM-6305) Upgrade CassandraIO to use Cassandra java driver 3.6.0

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6305: -- Assignee: Ismaël Mejía > Upgrade CassandraIO to use Cassandra java driver 3.

[jira] [Updated] (BEAM-6526) Add ReadFiles transform for AvroIO

2019-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6526: --- Description: AvroIO lacks the `readFiles()` method to make it fully composable with FileIO as other

[jira] [Assigned] (BEAM-6207) extend "Data insertion Pipeline" with Kafka IO

2019-01-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6207: -- Assignee: Michal Walenia (was: Lukasz Gajowy) > extend "Data insertion Pipeline&quo

[jira] [Updated] (BEAM-3291) Add Kinesis Write transform

2019-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-3291: --- Component/s: (was: z-do-not-use-sdk-java-extensions) io-java-kinesis >

[jira] [Reopened] (BEAM-5723) CassandraIO is broken because of use of bad relocation of guava

2019-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reopened BEAM-5723: This is still broken, apparently the shadowing plugin is still rewriting the bytecode to use

[jira] [Commented] (BEAM-4822) Beam FileIO should support versioned file systems

2019-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757715#comment-16757715 ] Ismaël Mejía commented on BEAM-4822: Well when I talk about the Map version is only for the optional

[jira] [Assigned] (BEAM-6426) Enforce ban of non-vendored Guava, with exceptions

2019-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6426: -- Assignee: Ismaël Mejía > Enforce ban of non-vendored Guava, with excepti

[jira] [Resolved] (BEAM-6426) Enforce ban of non-vendored Guava, with exceptions

2019-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6426. Resolution: Fixed Fix Version/s: Not applicable > Enforce ban of non-vendored Gu

[jira] [Reopened] (BEAM-6426) Enforce ban of non-vendored Guava, with exceptions

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reopened BEAM-6426: Reopening because I found some issues. > Enforce ban of non-vendored Guava, with excepti

[jira] [Updated] (BEAM-6167) Create a Class to read content of a file keeping track of the file path (python)

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6167: --- Fix Version/s: (was: Not applicable) 2.10.0 > Create a Class to read cont

[jira] [Updated] (BEAM-6270) XmlIO documentation example should return Pcollection of Record Class not String

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6270: --- Fix Version/s: 2.10.0 > XmlIO documentation example should return Pcollection of Record Cl

[jira] [Commented] (BEAM-5115) Inconsistent use of ValueProvider between XmlSource and XmlIO

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758392#comment-16758392 ] Ismaël Mejía commented on BEAM-5115: [~Sardtok] Interested to contribute a fix for this one

[jira] [Resolved] (BEAM-6167) Create a Class to read content of a file keeping track of the file path (python)

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6167. Resolution: Fixed > Create a Class to read content of a file keeping track of the file p

[jira] [Commented] (BEAM-3082) TextIO.withoutSharding sets shard template name to empty string instead of null

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758397#comment-16758397 ] Ismaël Mejía commented on BEAM-3082: [~sivu] Interested to contribute a fix for this one

[jira] [Resolved] (BEAM-2513) TextIO should support watching files for new entries

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-2513. Resolution: Duplicate Fix Version/s: Not applicable > TextIO should support watching fi

[jira] [Assigned] (BEAM-1879) PTransform style guide should discuss display data

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-1879: -- Assignee: (was: Eugene Kirpichov) > PTransform style guide should discuss display d

[jira] [Assigned] (BEAM-5257) Java TextIO should accept an optional Encoding parameter

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-5257: -- Assignee: (was: Eugene Kirpichov) > Java TextIO should accept an optional Encod

[jira] [Assigned] (BEAM-3082) TextIO.withoutSharding sets shard template name to empty string instead of null

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-3082: -- Assignee: (was: Eugene Kirpichov) > TextIO.withoutSharding sets shard template n

[jira] [Updated] (BEAM-2483) SplittableDoFnTest should not explicitly setStreaming(true)

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2483: --- Component/s: (was: sdk-java-core) runner-dataflow > SplittableDoFnTest sho

[jira] [Resolved] (BEAM-2483) SplittableDoFnTest should not explicitly setStreaming(true)

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-2483. Resolution: Fixed Fix Version/s: Not applicable > SplittableDoFnTest should not explici

[jira] [Resolved] (BEAM-6270) XmlIO documentation example should return Pcollection of Record Class not String

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-6270. Resolution: Fixed > XmlIO documentation example should return Pcollection of Record Cl

[jira] [Commented] (BEAM-5677) LocalFileSystem.matchNewResource fails to handle file scheme in URIs

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758383#comment-16758383 ] Ismaël Mejía commented on BEAM-5677: [~ulzha] Interested to contribute a fix for this one

[jira] [Assigned] (BEAM-6270) XmlIO documentation example should return Pcollection of Record Class not String

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6270: -- Assignee: Theodore Siu (was: Eugene Kirpichov) > XmlIO documentation example should ret

[jira] [Assigned] (BEAM-5115) Inconsistent use of ValueProvider between XmlSource and XmlIO

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-5115: -- Assignee: (was: Eugene Kirpichov) > Inconsistent use of ValueProvider between XmlSou

[jira] [Assigned] (BEAM-5677) LocalFileSystem.matchNewResource fails to handle file scheme in URIs

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-5677: -- Assignee: (was: Eugene Kirpichov) > LocalFileSystem.matchNewResource fails to handle f

[jira] [Assigned] (BEAM-6167) Create a Class to read content of a file keeping track of the file path (python)

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6167: -- Assignee: Lorenzo Caggioni (was: Eugene Kirpichov) > Create a Class to read content of a f

[jira] [Assigned] (BEAM-1979) Outputting to an undeclared side output TupleTag should throw

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-1979: -- Assignee: (was: Eugene Kirpichov) > Outputting to an undeclared side output Tuple

[jira] [Assigned] (BEAM-2716) AvroReader should refuse dynamic splits while in the last block

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-2716: -- Assignee: (was: Eugene Kirpichov) > AvroReader should refuse dynamic splits wh

[jira] [Updated] (BEAM-2716) AvroReader should refuse dynamic splits while in the last block

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2716: --- Component/s: (was: sdk-java-core) io-java-avro > AvroReader should ref

[jira] [Resolved] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-375. --- Resolution: Fixed Fix Version/s: Not applicable > HadoopIO and runners-spark confl

[jira] [Assigned] (BEAM-76) FileBasedSource should take a list of files/globs

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-76: Assignee: (was: Pei He) > FileBasedSource should take a list of files/gl

[jira] [Assigned] (BEAM-375) HadoopIO and runners-spark conflict with hadoop.version

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-375: - Assignee: (was: Pei He) > HadoopIO and runners-spark conflict with hadoop.vers

[jira] [Resolved] (BEAM-76) FileBasedSource should take a list of files/globs

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-76. -- Resolution: Fixed Fix Version/s: Not applicable This is solved by FileIO. > FileBasedSou

[jira] [Updated] (BEAM-2483) SplittableDoFnTest should not explicitly setStreaming(true)

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2483: --- Component/s: (was: runner-dataflow) sdk-java-core > SplittableDoFnTest sho

[jira] [Resolved] (BEAM-66) Unbounded source for directory/file scanning

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-66. -- Resolution: Fixed Fix Version/s: Not applicable Resolved via `.watchForNewFiles()` > Unboun

[jira] [Updated] (BEAM-656) Add support for side inputs/outputs to Java 8 lambdas in MapElements

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-656: -- Environment: (was: Java 8) > Add support for side inputs/outputs to Java 8 lambdas in MapEleme

[jira] [Resolved] (BEAM-949) Need tests for HDFSFileSink

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-949. --- Resolution: Fixed Fix Version/s: Not applicable > Need tests for HDFSFileS

[jira] [Assigned] (BEAM-6574) SQL DDL links to commons-csv CSVFormat, but Javadoc is not appropriate for pure SQL docs

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6574: -- Assignee: Ismaël Mejía (was: Kenneth Knowles) > SQL DDL links to commons-csv CSVFor

[jira] [Assigned] (BEAM-6574) SQL DDL links to commons-csv CSVFormat, but Javadoc is not appropriate for pure SQL docs

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6574: -- Assignee: Kenneth Knowles (was: Ismaël Mejía) > SQL DDL links to commons-csv CSVFor

[jira] [Assigned] (BEAM-352) Add DisplayData to HDFS Sources

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-352: - Assignee: (was: James Malone) > Add DisplayData to HDFS Sour

[jira] [Assigned] (BEAM-303) Add Machine Learning DSL and dedicated functions

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-303: - Assignee: (was: James Malone) > Add Machine Learning DSL and dedicated functi

[jira] [Assigned] (BEAM-106) Native support for conditional iteration

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-106: - Assignee: (was: James Malone) > Native support for conditional iterat

[jira] [Assigned] (BEAM-949) Need tests for HDFSFileSink

2019-02-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-949: - Assignee: (was: James Malone) > Need tests for HDFSFileS

[jira] [Comment Edited] (BEAM-4822) Beam FileIO should support versioned file systems

2019-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757017#comment-16757017 ] Ismaël Mejía edited comment on BEAM-4822 at 1/31/19 10:50 AM: -- I know

[jira] [Commented] (BEAM-4822) Beam FileIO should support versioned file systems

2019-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757017#comment-16757017 ] Ismaël Mejía commented on BEAM-4822: I know this is not beamish, but I am wondering if we sould add

[jira] [Created] (BEAM-6589) SDKs::Java::Extensions::Kryo is incorrectly shaded

2019-02-05 Thread JIRA
Jan Lukavský created BEAM-6589: -- Summary: SDKs::Java::Extensions::Kryo is incorrectly shaded Key: BEAM-6589 URL: https://issues.apache.org/jira/browse/BEAM-6589 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-4890) Beam Dependency Update Request: org.apache.cassandra

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-4890: -- Assignee: Ismaël Mejía > Beam Dependency Update Request: org.apache.cassan

[jira] [Updated] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-6517: --- Component/s: (was: runner-spark) io-java-avro > Pipeline fa

[jira] [Assigned] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-6517: -- Assignee: (was: Vu Ho) > Pipeline fails with deserializing lambda function on Sp

[jira] [Resolved] (BEAM-5723) CassandraIO is broken because of use of bad relocation of guava

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-5723. Resolution: Fixed > CassandraIO is broken because of use of bad relocation of gu

[jira] [Commented] (BEAM-6517) Pipeline fails with deserializing lambda function on Spark (MapElements)

2019-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754887#comment-16754887 ] Ismaël Mejía commented on BEAM-6517: Thanks for the details [~vho] . This looks more like you have

[jira] [Created] (BEAM-6521) Deprecate/Remove MongoDb `withFilter` because its contract is broken

2019-01-28 Thread JIRA
Ismaël Mejía created BEAM-6521: -- Summary: Deprecate/Remove MongoDb `withFilter` because its contract is broken Key: BEAM-6521 URL: https://issues.apache.org/jira/browse/BEAM-6521 Project: Beam

<    1   2   3   4   5   6   7   8   9   10   >