[jira] [Comment Edited] (BEAM-683) Make BZIP compressed files splittable

[ https://issues.apache.org/jira/browse/BEAM-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531719#comment-15531719 ] Tim Sears edited comment on BEAM-683 at 9/29/16 4:24 AM: - I worked on this a bit,

[jira] [Comment Edited] (BEAM-683) Make BZIP compressed files splittable

[ https://issues.apache.org/jira/browse/BEAM-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531719#comment-15531719 ] Tim Sears edited comment on BEAM-683 at 9/29/16 4:10 AM: - I worked on this a bit,

[jira] [Comment Edited] (BEAM-683) Make BZIP compressed files splittable

[ https://issues.apache.org/jira/browse/BEAM-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531719#comment-15531719 ] Tim Sears edited comment on BEAM-683 at 9/29/16 4:10 AM: - I worked on this a bitt,

[jira] [Comment Edited] (BEAM-683) Make BZIP compressed files splittable

[ https://issues.apache.org/jira/browse/BEAM-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531719#comment-15531719 ] Tim Sears edited comment on BEAM-683 at 9/29/16 4:09 AM: - I worked on this a bitt,

[jira] [Commented] (BEAM-55) Allow users to compress FileBasedSink output files

[ https://issues.apache.org/jira/browse/BEAM-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531516#comment-15531516 ] Jeffrey Payne commented on BEAM-55: --- We too prefer to use binary file formats like Avro or Parquet, for

[jira] [Comment Edited] (BEAM-55) Allow users to compress FileBasedSink output files

[ https://issues.apache.org/jira/browse/BEAM-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531314#comment-15531314 ] Daniel Halperin edited comment on BEAM-55 at 9/29/16 12:09 AM: --- Hi Florian,

[jira] [Commented] (BEAM-55) Allow users to compress FileBasedSink output files

[ https://issues.apache.org/jira/browse/BEAM-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531314#comment-15531314 ] Daniel Halperin commented on BEAM-55: - Hi Florian, AvroIO should support compression via Avro codec's.

[jira] [Commented] (BEAM-55) Allow users to compress FileBasedSink output files

[ https://issues.apache.org/jira/browse/BEAM-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531312#comment-15531312 ] Daniel Halperin commented on BEAM-55: - Note that there is a good reason this was not originally

[jira] [Commented] (BEAM-147) Introduce an easy API pipeline metrics

[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531303#comment-15531303 ] ASF GitHub Bot commented on BEAM-147: - GitHub user bjchambers opened a pull request:

[GitHub] incubator-beam pull request #1024: [BEAM-147] Prototype of Metrics API for J...

GitHub user bjchambers opened a pull request: https://github.com/apache/incubator-beam/pull/1024 [BEAM-147] Prototype of Metrics API for Java DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [*] Make sure

[jira] [Created] (BEAM-693) pydoc is not working

Ahmet Altay created BEAM-693: Summary: pydoc is not working Key: BEAM-693 URL: https://issues.apache.org/jira/browse/BEAM-693 Project: Beam Issue Type: Bug Components: sdk-py

[GitHub] incubator-beam pull request #1023: Deduplicates the 3 in-memory TimerInterna...

GitHub user jkff opened a pull request: https://github.com/apache/incubator-beam/pull/1023 Deduplicates the 3 in-memory TimerInternals There were 3 implementations of TimerInternals doing basically the same thing: - TestTimerInternals in ReduceFnTester -

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1232

See

[jira] [Commented] (BEAM-632) FlattenWithMultipleInputs broke GoogleCloudDataflow_RunnableOnService tests

[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531073#comment-15531073 ] ASF GitHub Bot commented on BEAM-632: - Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: Closes #1022

Closes #1022 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/efb2b83f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/efb2b83f Diff:

[GitHub] incubator-beam pull request #1022: [BEAM-632] Suppress Flatten Tests in Data...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1022 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Suppress Flatten Tests in Dataflow

Repository: incubator-beam Updated Branches: refs/heads/master 759b6cada -> efb2b83ff Suppress Flatten Tests in Dataflow Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b1519b0b Tree:

[jira] [Commented] (BEAM-147) Introduce an easy API pipeline metrics

[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530952#comment-15530952 ] Ben Chambers commented on BEAM-147: --- Repurposing this issue to track the actual goal of having an

[jira] [Updated] (BEAM-147) Introduce an easy API pipeline metrics

[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Description: The existing Aggregators are confusing both because of their name and because they serve

[jira] [Updated] (BEAM-147) Introduce an easy API pipeline metrics

[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Description: The existing Aggregators are confusing both because of their name and because they serve

[jira] [Updated] (BEAM-147) Introduce an easy API pipeline metrics

[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Summary: Introduce an easy API pipeline metrics (was: Rename Aggregator to [P]Metric) > Introduce an

[jira] [Created] (BEAM-692) DisplayData integration tests don't exercise branches in runner pipeline translation

Scott Wegner created BEAM-692: - Summary: DisplayData integration tests don't exercise branches in runner pipeline translation Key: BEAM-692 URL: https://issues.apache.org/jira/browse/BEAM-692 Project:

[jira] [Created] (BEAM-691) AvroIO missing display data for Dataflow runner in streaming mode

Scott Wegner created BEAM-691: - Summary: AvroIO missing display data for Dataflow runner in streaming mode Key: BEAM-691 URL: https://issues.apache.org/jira/browse/BEAM-691 Project: Beam Issue

[GitHub] incubator-beam pull request #1022: Suppress Flatten Tests in Dataflow

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1022 Suppress Flatten Tests in Dataflow Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] incubator-beam-site pull request #41: minor: remove duplicate words

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam-site/pull/41 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/3] incubator-beam-site git commit: minor: remove duplicate words

Repository: incubator-beam-site Updated Branches: refs/heads/asf-site ab1f700ca -> 976b0302a minor: remove duplicate words Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/6a5a0b3c Tree:

[2/3] incubator-beam-site git commit: Closes #41

Closes #41 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/13f62315 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/13f62315 Diff:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1230

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1228

See

[2/2] incubator-beam git commit: Refactor BundleFactory methods

Refactor BundleFactory methods Remove the inputBundle parameter to createBundle and createKeyedBundle. This parameter is unless the model is capable of propagating keys between PTransforms. Remove the PCollection parameter to createRootBundle. createRootBundle should be a par Make

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1227

See

[jira] [Created] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

Thomas Groh created BEAM-690: Summary: Backoff in the DirectRunner Monitor if no work is Available Key: BEAM-690 URL: https://issues.apache.org/jira/browse/BEAM-690 Project: Beam Issue Type:

[2/2] incubator-beam git commit: This closes #1021

This closes #1021 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a1ac Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a1ac Diff:

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530210#comment-15530210 ] Scott Wegner commented on BEAM-688: --- Yes, [~dhalp...@google.com] and [~jbonofre] you both seem to be

[jira] [Commented] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530201#comment-15530201 ] ASF GitHub Bot commented on BEAM-615: - Github user asfgit closed the pull request at:

[jira] [Updated] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-615: Fix Version/s: 0.3.0-incubating > Add Support for Processing-Time Timers in FlinkRunner

[jira] [Resolved] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-615. - Resolution: Fixed Added with a1acdca13f6902faad30f37a877c1e6fb218 > Add Support for

[GitHub] incubator-beam pull request #1021: [BEAM-615] Add Support for Processing-Tim...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1021 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner Window Operator

Repository: incubator-beam Updated Branches: refs/heads/master b5853a624 -> a1acd [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner Window Operator Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

incubator-beam git commit: Upgrade maven-compiler-plugin to fix incremental build

Repository: incubator-beam Updated Branches: refs/heads/master 307d592d2 -> b5853a624 Upgrade maven-compiler-plugin to fix incremental build We are hitting an issue with AutoValue and the current version of maven-compiler-plugin which breaks incremental build. See:

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530113#comment-15530113 ] Jean-Baptiste Onofré commented on BEAM-688: --- I think it's more the dependency-plugin which check

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530111#comment-15530111 ] Jean-Baptiste Onofré commented on BEAM-688: --- I can reproduce the issue. A simple workaround is to

[jira] [Created] (BEAM-689) Remove getPCollection from (Un)CommittedBundle

Thomas Groh created BEAM-689: Summary: Remove getPCollection from (Un)CommittedBundle Key: BEAM-689 URL: https://issues.apache.org/jira/browse/BEAM-689 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530100#comment-15530100 ] Daniel Halperin commented on BEAM-688: -- Something related to the {{ignoreNonCompile}} setting being

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530082#comment-15530082 ] Scott Wegner commented on BEAM-688: --- I began seeing symptoms of this when upgrading the

[jira] [Created] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

Scott Wegner created BEAM-688: - Summary: Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error Key: BEAM-688 URL: https://issues.apache.org/jira/browse/BEAM-688

[jira] [Commented] (BEAM-674) Add GridFS support to MongoDB IO

[ https://issues.apache.org/jira/browse/BEAM-674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530050#comment-15530050 ] ASF GitHub Bot commented on BEAM-674: - Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-674) Add GridFS support to MongoDB IO

[ https://issues.apache.org/jira/browse/BEAM-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-674. --- Resolution: Fixed > Add GridFS support to MongoDB IO >

[1/2] incubator-beam git commit: [BEAM-674] Add GridFS support to MongoDbIO

Repository: incubator-beam Updated Branches: refs/heads/master 3879db036 -> 307d592d2 [BEAM-674] Add GridFS support to MongoDbIO Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/68c8c787 Tree:

[2/2] incubator-beam git commit: [BEAM-674] This closes #1003

[BEAM-674] This closes #1003 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/307d592d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/307d592d Diff:

[GitHub] incubator-beam pull request #1003: [BEAM-674] Source part of GridFS IO

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1003 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1226

See

[jira] [Assigned] (BEAM-214) Parquet IO

[ https://issues.apache.org/jira/browse/BEAM-214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-214: - Assignee: Jean-Baptiste Onofré > Parquet IO > -- > > Key:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1225

See

[GitHub] incubator-beam-site pull request #41: minor: remove duplicate words

GitHub user terrencehan opened a pull request: https://github.com/apache/incubator-beam-site/pull/41 minor: remove duplicate words You can merge this pull request into a Git repository by running: $ git pull https://github.com/terrencehan/incubator-beam-site asf-site

[GitHub] incubator-beam pull request #1021: [BEAM-615] Add Support for Processing-Tim...

GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1021 [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner This adds support for processing-time timers that are checkpointed. There are no tests for this yet but I ran this

[jira] [Commented] (BEAM-283) CheckpointMark.finalize() is not called in Flink Source Wrapper

[ https://issues.apache.org/jira/browse/BEAM-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529028#comment-15529028 ] ASF GitHub Bot commented on BEAM-283: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #967: [BEAM-283] finalize CheckpointMarks upon c...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/967 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Resolved] (BEAM-283) CheckpointMark.finalize() is not called in Flink Source Wrapper

[ https://issues.apache.org/jira/browse/BEAM-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-283. - Resolution: Fixed Fix Version/s: 0.3.0-incubating Fixed with

[3/3] incubator-beam git commit: This closes #967

This closes #967 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3879db03 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3879db03 Diff:

[2/3] incubator-beam git commit: fix potential NPE in checkpointing of UnboundedSourceWrapper

fix potential NPE in checkpointing of UnboundedSourceWrapper This moves all the initialization code to the open() method which ensures that no snapshot can occur before the state has been initialized correctly. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/3] incubator-beam git commit: [BEAM-283] finalize CheckpointMarks upon completed checkpoint

Repository: incubator-beam Updated Branches: refs/heads/master db47c63ab -> 3879db036 [BEAM-283] finalize CheckpointMarks upon completed checkpoint Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Assigned] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-615: - Assignee: Aljoscha Krettek (was: Kenneth Knowles) > Add Support for Processing-Time

[jira] [Commented] (BEAM-687) Repeated 'mvn install' fails with "java.lang.IllegalStateException: endPosTable already set"

[ https://issues.apache.org/jira/browse/BEAM-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528936#comment-15528936 ] Jean-Baptiste Onofré commented on BEAM-687: --- By the way, I'm always using {{mvn clean install}},

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1224

See