[jira] [Commented] (BEAM-456) Add MongoDBIO

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380486#comment-15380486 ] ASF GitHub Bot commented on BEAM-456: - GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request #671: [BEAM-456] Add MongoDbIO

2016-07-15 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/671 [BEAM-456] Add MongoDbIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like:

[GitHub] incubator-beam pull request #652: Added cy_combiners.py to the list of Cytho...

2016-07-15 Thread mdvorsky
Github user mdvorsky closed the pull request at: https://github.com/apache/incubator-beam/pull/652 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featu

[GitHub] incubator-beam pull request #638: Clarify RequiresWindowAccess error message

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/638 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: Clarify RequiresWindowAccess error message

2016-07-15 Thread dhalperi
Clarify RequiresWindowAccess error message An error message is printed when a DoFn needs access to the window but does not implement RequiresWindowAccess. This PR changes to the error message to print the interface name instead of just "RequiresWindow", which makes it more clear which interface th

[1/2] incubator-beam git commit: Closes #638

2016-07-15 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 7a945a741 -> a0afd6665 Closes #638 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a0afd666 Tree: http://git-wip-us.apache.org/repos/asf/incu

[1/2] incubator-beam git commit: Make step encodings consistently use WindowedValueCoders

2016-07-15 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 1305c108a -> b8e3a7b52 Make step encodings consistently use WindowedValueCoders This change is needed for size-estimation aggregators. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip

[GitHub] incubator-beam pull request #669: Make step encodings consistently use Windo...

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/669 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: Closes #669

2016-07-15 Thread dhalperi
Closes #669 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b8e3a7b5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b8e3a7b5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[GitHub] incubator-beam pull request #670: Clarifies that 'TextFileSource' only suppo...

2016-07-15 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/incubator-beam/pull/670 Clarifies that 'TextFileSource' only supports UTF-8 and ASCII encodings. You can merge this pull request into a Git repository by running: $ git pull https://github.com/chamikaramj

[jira] [Resolved] (BEAM-457) Upgrade Avro

2016-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-457. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Upgrade Avro > > > Key

[jira] [Commented] (BEAM-457) Upgrade Avro

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380294#comment-15380294 ] ASF GitHub Bot commented on BEAM-457: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: Upgrade to Avro 1.8.1

2016-07-15 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 695247138 -> 7a945a741 Upgrade to Avro 1.8.1 This version has some important fixes for potential memory leaks. (It does not have a fix for [AVRO-607] yet, but still has good fixes.) Project: http://git-wip-us.apache.org/repos/as

[GitHub] incubator-beam pull request #664: [BEAM-457] Upgrade to Avro 1.8.1

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/664 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: [BEAM-457] Upgrade to Avro 1.8.1

2016-07-15 Thread lcwik
[BEAM-457] Upgrade to Avro 1.8.1 This closes #664 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7a945a74 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7a945a74 Diff: http://git-wip-us.ap

[GitHub] incubator-beam pull request #669: Make step encodings consistently use Windo...

2016-07-15 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/incubator-beam/pull/669 Make step encodings consistently use WindowedValueCoders This change is needed for size-estimation aggregators. You can merge this pull request into a Git repository by running:

[GitHub] incubator-beam pull request #644: Fix typo in Dataflow runner monitoring mes...

2016-07-15 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/incubator-beam/pull/644 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (BEAM-460) Implement Python support for size-estimation aggregators

2016-07-15 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-460: -- Summary: Implement Python support for size-estimation aggregators (was: Implement support for size-estima

[jira] [Updated] (BEAM-460) Implement support for size-estimation aggregators

2016-07-15 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-460: -- Component/s: sdk-py > Implement support for size-estimation aggregators >

[jira] [Created] (BEAM-460) Implement support for size-estimation aggregators

2016-07-15 Thread Charles Chen (JIRA)
Charles Chen created BEAM-460: - Summary: Implement support for size-estimation aggregators Key: BEAM-460 URL: https://issues.apache.org/jira/browse/BEAM-460 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-439) The start_bundle/finish_bundle should not allow side inputs

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380101#comment-15380101 ] ASF GitHub Bot commented on BEAM-439: - GitHub user silviulica opened a pull request:

[GitHub] incubator-beam pull request #668: [BEAM-439] Remove optional args from start...

2016-07-15 Thread silviulica
GitHub user silviulica opened a pull request: https://github.com/apache/incubator-beam/pull/668 [BEAM-439] Remove optional args from start/finish bundle methods @robertwb can you please take a look? (take II -- I abandoned previous PR due to bad merge on my part) Techn

[jira] [Assigned] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Anderson reassigned BEAM-459: --- Assignee: Jesse Anderson > Add BigInteger to TypeDescriptors >

[jira] [Commented] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380023#comment-15380023 ] Jesse Anderson commented on BEAM-459: - Sure > Add BigInteger to TypeDescriptors > -

[jira] [Commented] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380020#comment-15380020 ] Kenneth Knowles commented on BEAM-459: -- [~eljefe6aa] want to take this one? > Add BigI

[jira] [Updated] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-210: - Description: Today, ON_TIME panes are emitted whether or not they are empty. We had decided that for

[jira] [Updated] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-210: - Summary: Allow control of empty ON_TIME panes analogous to final panes (was: Be consistent with emi

[jira] [Assigned] (BEAM-210) Be consistent with emitting final empty panes

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-210: Assignee: Kenneth Knowles (was: Mark Shields) > Be consistent with emitting final empty pane

[jira] [Created] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Jesse Anderson (JIRA)
Jesse Anderson created BEAM-459: --- Summary: Add BigInteger to TypeDescriptors Key: BEAM-459 URL: https://issues.apache.org/jira/browse/BEAM-459 Project: Beam Issue Type: Bug Reporter

[jira] [Created] (BEAM-458) Support for Flink Metrics

2016-07-15 Thread Sumit Chawla (JIRA)
Sumit Chawla created BEAM-458: - Summary: Support for Flink Metrics Key: BEAM-458 URL: https://issues.apache.org/jira/browse/BEAM-458 Project: Beam Issue Type: New Feature Components: r

[jira] [Updated] (BEAM-384) Streaming BigQueryIO should support user-provided IDs

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-384: - Assignee: (was: Daniel Halperin) > Streaming BigQueryIO should support user-provided IDs > -

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-445. -- Resolution: Fixed Fix Version/s: Not applicable > Beam-examples-java build failed through l

[jira] [Resolved] (BEAM-285) Make MinLongFn and MaxLongFn mimic SumLongFn and use BinaryCombineLongFn

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-285. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Make MinLongFn and MaxLongFn mimic SumL

[jira] [Commented] (BEAM-455) Implement a test harness for verifying correctness of custom sources

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379826#comment-15379826 ] ASF GitHub Bot commented on BEAM-455: - GitHub user chamikaramj opened a pull request:

[GitHub] incubator-beam pull request #667: [BEAM-455] Adds a test harnesses and utili...

2016-07-15 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/incubator-beam/pull/667 [BEAM-455] Adds a test harnesses and utilities framework for sources. Helper functions and test harnesses for checking correctness of source (``iobase.BoundedSource``) and range tracker

[jira] [Closed] (BEAM-430) Introducing gcpTempLocation that default to tempLocation

2016-07-15 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-430. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Introducing gcpTempLocation that default to tempLocation > --

[GitHub] incubator-beam pull request #666: Make TransformEvaluatorFactory reuse Expli...

2016-07-15 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/666 Make TransformEvaluatorFactory reuse Explicit Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is forma

[jira] [Commented] (BEAM-360) Add a framework for creating Python-SDK sources for new file types

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379759#comment-15379759 ] ASF GitHub Bot commented on BEAM-360: - Github user chamikaramj closed the pull request a

[GitHub] incubator-beam pull request #599: [BEAM-360] Some updates related to dynamic...

2016-07-15 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/599 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-beam pull request #665: Shade everything but a whitelist in core J...

2016-07-15 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/665 Shade everything but a whitelist in core Java SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure tests pass

[jira] [Commented] (BEAM-37) Run DoFnWithContext without conversion to vanilla DoFn

2016-07-15 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379728#comment-15379728 ] Ben Chambers commented on BEAM-37: -- Notes on remaining tasks to complete this: 1. Modify Do

[2/2] incubator-beam git commit: Fixes several issues related to 'filebasedsource'.

2016-07-15 Thread robertwb
Fixes several issues related to 'filebasedsource'. Adds a method 'fileio.ChannelFactory.size_in_bytes()' that can be used to determine the size of a single file. Implements this method for 'ChannelFactory' implementations for GCS and local files. Updates 'filebasedsource' to use this method when

[1/2] incubator-beam git commit: Closes #599

2016-07-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk d898d56ae -> 1305c108a Closes #599 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1305c108 Tree: http://git-wip-us.apache.org/repos/asf/

[jira] [Closed] (BEAM-391) Exceptions in gcsio upload thread causes pipeline to stall

2016-07-15 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay closed BEAM-391. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Exceptions in gcsio upload thread causes pipeline t

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379630#comment-15379630 ] Daniel Halperin commented on BEAM-445: -- Thanks -- it's good to make sure everyone invol

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Scott Wegner (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379622#comment-15379622 ] Scott Wegner commented on BEAM-445: --- I've opened an issue with Bigtable to see if they can

[jira] [Created] (BEAM-457) Upgrade Avro

2016-07-15 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-457: Summary: Upgrade Avro Key: BEAM-457 URL: https://issues.apache.org/jira/browse/BEAM-457 Project: Beam Issue Type: Improvement Components: sdk-java-

[GitHub] incubator-beam pull request #664: Upgrade to Avro 1.8.1

2016-07-15 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/664 Upgrade to Avro 1.8.1 This version has some important fixes for potential memory leaks. (It does not have a fix for [AVRO-607] yet, but still has good fixes.) You can merge this pu

[jira] [Assigned] (BEAM-450) Modules are shaded to the same path

2016-07-15 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang reassigned BEAM-450: --- Assignee: Manu Zhang > Modules are shaded to the same path > --- > >

[GitHub] incubator-beam pull request #663: [BEAM-328] uses SerializableCoder for `T e...

2016-07-15 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/incubator-beam/pull/663 [BEAM-328] uses SerializableCoder for `T extends Serializable` Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[jira] [Commented] (BEAM-328) CoderRegistry does not provide SerializableCoder for `T extends Serializable`

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379536#comment-15379536 ] ASF GitHub Bot commented on BEAM-328: - GitHub user manuzhang opened a pull request:

[jira] [Updated] (BEAM-456) Add MongoDBIO

2016-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-456: -- Summary: Add MongoDBIO (was: Add MongoIO) > Add MongoDBIO > - > >

[jira] [Created] (BEAM-456) Add MongoIO

2016-07-15 Thread JIRA
Jean-Baptiste Onofré created BEAM-456: - Summary: Add MongoIO Key: BEAM-456 URL: https://issues.apache.org/jira/browse/BEAM-456 Project: Beam Issue Type: New Feature Components:

[jira] [Updated] (BEAM-455) Implement a test harness for verifying correctness of custom sources

2016-07-15 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-455: Summary: Implement a test harness for verifying correctness of custom sources (was: Implement

[jira] [Created] (BEAM-455) Implement a test harness for verifying correcness of custom sources

2016-07-15 Thread Chamikara Jayalath (JIRA)
Chamikara Jayalath created BEAM-455: --- Summary: Implement a test harness for verifying correcness of custom sources Key: BEAM-455 URL: https://issues.apache.org/jira/browse/BEAM-455 Project: Beam