[jira] [Commented] (BEAM-1640) data file missing when submit a job on Flink

2017-04-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953191#comment-15953191 ] Aljoscha Krettek commented on BEAM-1640: [~mingmxu] Thanks for letting us know! > data file

[GitHub] beam pull request #2406: Add to javadoc of getCheckpointMark

2017-04-03 Thread wtanaka
GitHub user wtanaka opened a pull request: https://github.com/apache/beam/pull/2406 Add to javadoc of getCheckpointMark Based on looking through various implementations of this method You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-1850) Improve interplay between PusbackSideInputRunner and GroupAlsoByWindowViaWindowSetDoFn

2017-04-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953219#comment-15953219 ] Aljoscha Krettek commented on BEAM-1850: FYI: [~tgroh] [~kenn] > Improve interplay between

[GitHub] beam-site pull request #199: Docker server command should run non-incrementa...

2017-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/199 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (BEAM-1870) ByteKey / ByteKeyRangeTracker should not use ByteString on public API surface

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1870: -- Description: We don't want these Google Protocol Buffer dependencies on the public API. We

[jira] [Created] (BEAM-1870) ByteKey / ByteKeyRangeTracker should not use ByteString on public API surface

2017-04-03 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1870: - Summary: ByteKey / ByteKeyRangeTracker should not use ByteString on public API surface Key: BEAM-1870 URL: https://issues.apache.org/jira/browse/BEAM-1870 Project:

[jira] [Commented] (BEAM-1823) TimedOutException in postcommit

2017-04-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954342#comment-15954342 ] Mark Liu commented on BEAM-1823: I'm okay with this trick before the issue is fixed in nosetest side, since

[GitHub] beam pull request #2412: [BEAM-1866] DataflowRunner: disable PAssert use of ...

2017-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2412 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2412

2017-04-03 Thread dhalperi
This closes #2412 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/69706329 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/69706329 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/69706329 Branch:

[jira] [Commented] (BEAM-1534) Create a dockerized developer environment for Beam

2017-04-03 Thread Ekrem Aksoy (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954448#comment-15954448 ] Ekrem Aksoy commented on BEAM-1534: --- I'll start with single Docker image for corresponding BEAM codebase.

[jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954429#comment-15954429 ] ASF GitHub Bot commented on BEAM-1148: -- GitHub user pabloem opened a pull request:

[jira] [Created] (BEAM-1871) Thin Java SDK Core

2017-04-03 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1871: - Summary: Thin Java SDK Core Key: BEAM-1871 URL: https://issues.apache.org/jira/browse/BEAM-1871 Project: Beam Issue Type: Improvement

[GitHub] beam pull request #2417: [BEAM-1148] Port PAssert away from Aggregators

2017-04-03 Thread pabloem
GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/2417 [BEAM-1148] Port PAssert away from Aggregators Still running into trouble with the direct runner, but unit tests in other runners are passing. You can merge this pull request into a Git repository

[jira] [Created] (BEAM-1872) implement Reshuffle transform

2017-04-03 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1872: - Summary: implement Reshuffle transform Key: BEAM-1872 URL: https://issues.apache.org/jira/browse/BEAM-1872 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-564) Update source framework so that remaining and consumed number of split points can be reported

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954547#comment-15954547 ] Ahmet Altay commented on BEAM-564: -- Is it fixed? > Update source framework so that remaining and consumed

[jira] [Resolved] (BEAM-564) Update source framework so that remaining and consumed number of split points can be reported

2017-04-03 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-564. - Resolution: Fixed Fix Version/s: Not applicable > Update source framework so that

[GitHub] beam pull request #2402: Add example to BoundedCountingInput javadoc

2017-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2402 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1823) TimedOutException in postcommit

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954347#comment-15954347 ] Ahmet Altay commented on BEAM-1823: --- That also works, we can just print job id from there. (Although I

[2/2] beam-site git commit: This closes #199

2017-04-03 Thread altay
This closes #199 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/56d16cd7 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/56d16cd7 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/56d16cd7

[1/2] beam-site git commit: Docker server command should run non-incremental build

2017-04-03 Thread altay
Repository: beam-site Updated Branches: refs/heads/asf-site 5359c3294 -> 56d16cd79 Docker server command should run non-incremental build Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/e311e06d Tree:

Build failed in Jenkins: beam_PerformanceTests_Dataflow #266

2017-04-03 Thread Apache Jenkins Server
See Changes: [tgroh] Remove Direct Runner "doneness" configuration [tgroh] Use Batch Replacement in the Flink Runner [klk] JavaDoc for function `PaneInfo.getTiming()` [altay] [BEAM-1719] Remove

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1726

2017-04-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1869) getProducingTransformInternal should not be available on any PValue

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954329#comment-15954329 ] ASF GitHub Bot commented on BEAM-1869: -- GitHub user tgroh opened a pull request:

[jira] [Commented] (BEAM-1866) FnAPI support for Metrics

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954384#comment-15954384 ] ASF GitHub Bot commented on BEAM-1866: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2416: Remove getProducingTransformInternal

2017-04-03 Thread kenn
This closes #2416: Remove getProducingTransformInternal Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2dc61f63 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2dc61f63 Diff:

[jira] [Commented] (BEAM-1869) getProducingTransformInternal should not be available on any PValue

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954416#comment-15954416 ] ASF GitHub Bot commented on BEAM-1869: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2416: [BEAM-1869] Remove GetProducingTransformInternal

2017-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2416 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Remove GetProducingTransformInternal

2017-04-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master 697063297 -> 2dc61f637 Remove GetProducingTransformInternal This isn't part of the PValue API, so remove from POutputValueBase. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1493

2017-04-03 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3150

2017-04-03 Thread Apache Jenkins Server
See Changes: [tgroh] Remove GetProducingTransformInternal -- [...truncated 718.69 KB...] --- Running

[jira] [Commented] (BEAM-460) Implement Python support for size-estimation aggregators

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954543#comment-15954543 ] Ahmet Altay commented on BEAM-460: -- Can we close this? > Implement Python support for size-estimation

[jira] [Commented] (BEAM-524) Description of "type" argument in Aggregator is incorrect

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954544#comment-15954544 ] Ahmet Altay commented on BEAM-524: -- Closing this since aggregator API is removed. > Description of "type"

[jira] [Resolved] (BEAM-524) Description of "type" argument in Aggregator is incorrect

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-524. -- Resolution: Fixed Fix Version/s: Not applicable > Description of "type" argument in Aggregator is

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1494

2017-04-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1872) implement Reshuffle transform

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954454#comment-15954454 ] Ahmet Altay commented on BEAM-1872: --- Similar to the

Build failed in Jenkins: beam_PostCommit_Python_Verify #1725

2017-04-03 Thread Apache Jenkins Server
See -- [...truncated 223.39 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted] (none)

[jira] [Created] (BEAM-1873) Javadoc in BigQueryIO doesn't reflect recent changes

2017-04-03 Thread Reuven Lax (JIRA)
Reuven Lax created BEAM-1873: Summary: Javadoc in BigQueryIO doesn't reflect recent changes Key: BEAM-1873 URL: https://issues.apache.org/jira/browse/BEAM-1873 Project: Beam Issue Type: Bug

[GitHub] beam pull request #2418: [BEAM-437]

2017-04-03 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/2418 [BEAM-437] Properly address new API for dynamic table writes. R: @jkff You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-437) Data-dependent BigQueryIO in batch

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954482#comment-15954482 ] ASF GitHub Bot commented on BEAM-437: - GitHub user reuvenlax opened a pull request:

[jira] [Commented] (BEAM-1812) Allow configuring checkpoints in Flink Runner PipelineOptions

2017-04-03 Thread Jins George (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954561#comment-15954561 ] Jins George commented on BEAM-1812: --- Hi [~aljoscha], Can you assign this ticket to me. I have analyzed

[1/2] beam git commit: Add example to BoundedCountingInput javadoc

2017-04-03 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 2dc61f637 -> de36e8398 Add example to BoundedCountingInput javadoc Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/65b03ebe Tree:

[2/2] beam git commit: This closes #2402

2017-04-03 Thread dhalperi
This closes #2402 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/de36e839 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/de36e839 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/de36e839 Branch:

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2726

2017-04-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1719) Test modules are included in generated documentation

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954021#comment-15954021 ] ASF GitHub Bot commented on BEAM-1719: -- GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #2374: Quickfix: JavaDoc for function `PaneInfo.getTiming(...

2017-04-03 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2374 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: JavaDoc for function `PaneInfo.getTiming()`

2017-04-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master 8b119bcdf -> 8a8dbcfc5 JavaDoc for function `PaneInfo.getTiming()` Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5959110a Tree:

[jira] [Updated] (BEAM-1030) DoFnSignatures should validate StateSpec against key type

2017-04-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1030: -- Fix Version/s: First stable release > DoFnSignatures should validate StateSpec against key type

[jira] [Commented] (BEAM-1719) Test modules are included in generated documentation

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954081#comment-15954081 ] ASF GitHub Bot commented on BEAM-1719: -- Github user asfgit closed the pull request at:

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3143

2017-04-03 Thread Apache Jenkins Server
See

[GitHub] beam-site pull request #201: [BEAM-1711] Add information about extra require...

2017-04-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/201 [BEAM-1711] Add information about extra requires in Python Quickstart R: @aaltay PTAL You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-503) FileBasedSource should take a list of files/globs

2017-04-03 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954154#comment-15954154 ] Chamikara Jayalath commented on BEAM-503: - We currently don't have any plans to do this. This

[jira] [Closed] (BEAM-503) FileBasedSource should take a list of files/globs

2017-04-03 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath closed BEAM-503. --- Resolution: Won't Fix Fix Version/s: Not applicable > FileBasedSource should take a list

[jira] [Commented] (BEAM-1823) TimedOutException in postcommit

2017-04-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954156#comment-15954156 ] Ahmet Altay commented on BEAM-1823: --- Should we do the `-s` trick in our tests, does it have any other

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-04-03 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953584#comment-15953584 ] Neville Li commented on BEAM-302: - We prefer to keep it separate for now mainly for logistics reasons: - we

[jira] [Comment Edited] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952662#comment-15952662 ] Ted Yu edited comment on BEAM-1773 at 4/3/17 3:13 PM: -- [~j...@nanthrax.net]: If you

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1481

2017-04-03 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-1861) ORC support

2017-04-03 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated BEAM-1861: - Description: Add support for Optimized Row Columnar (ORC) file format: https://orc.apache.org/ As ORC

[jira] [Commented] (BEAM-1261) State API should allow state to be managed in different windows

2017-04-03 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953449#comment-15953449 ] Etienne Chauchot commented on BEAM-1261: Well, actually, the original query in the PR was

Build failed in Jenkins: beam_PerformanceTests_Dataflow #264

2017-04-03 Thread Apache Jenkins Server
See -- [...truncated 237.41 KB...] * [new ref] refs/pull/2291/merge -> origin/pr/2291/merge * [new ref] refs/pull/2292/head -> origin/pr/2292/head * [new

[jira] [Created] (BEAM-1861) ORC support

2017-04-03 Thread Tibor Kiss (JIRA)
Tibor Kiss created BEAM-1861: Summary: ORC support Key: BEAM-1861 URL: https://issues.apache.org/jira/browse/BEAM-1861 Project: Beam Issue Type: Bug Components: sdk-java-extensions

[jira] [Commented] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953653#comment-15953653 ] Jean-Baptiste Onofré commented on BEAM-1773: [~tedyu] I'm not on it right now, so, no problem

[jira] [Commented] (BEAM-1847) Read.Unbounded can't specify both max records and max duration.

2017-04-03 Thread Ryan Skraba (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953692#comment-15953692 ] Ryan Skraba commented on BEAM-1847: --- My mistake, it's KafkaIO that ignores `withMaxReadTime()` when

[jira] [Created] (BEAM-1862) SplittableDoFnOperator should close the ScheduledExecutorService

2017-04-03 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1862: -- Summary: SplittableDoFnOperator should close the ScheduledExecutorService Key: BEAM-1862 URL: https://issues.apache.org/jira/browse/BEAM-1862 Project: Beam

[GitHub] beam pull request #2407: DataflowRunner: automatically determine container i...

2017-04-03 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2407 DataflowRunner: automatically determine container image type Even if user supplies a base container image policy. Of course, preserve the ability of the user to fully override the image.

[jira] [Commented] (BEAM-848) Shuffle input read-values to get maximum parallelism.

2017-04-03 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953748#comment-15953748 ] Aviem Zur commented on BEAM-848: Now that BEAM-1074 is resolved a user can improve parallelism simply by

[jira] [Commented] (BEAM-848) Shuffle input read-values to get maximum parallelism.

2017-04-03 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953760#comment-15953760 ] Amit Sela commented on BEAM-848: Agree. closed as invalid. If use cases prove the need, we can consider a

[jira] [Updated] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-1773: - Attachment: beam-1773.v1.patch > Consider allowing Source#validate() to throw exception >

[jira] [Assigned] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned BEAM-1773: Assignee: Ted Yu (was: Jean-Baptiste Onofré) > Consider allowing Source#validate() to throw exception >

[jira] [Assigned] (BEAM-1197) Slowly-changing external data as a side input

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1197: - Assignee: (was: Frances Perry) > Slowly-changing external data as a side input >

[jira] [Assigned] (BEAM-1616) Gauge Metric type

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1616: - Assignee: (was: Ben Chambers) > Gauge Metric type > - > >

[jira] [Updated] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-1773: - Attachment: beam-1773.v1.patch > Consider allowing Source#validate() to throw exception >

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953812#comment-15953812 ] Daniel Halperin commented on BEAM-644: -- [~jkff] any update here w.r.t. {{SplittableDoFn}}? > Primitive

[jira] [Updated] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-1773: - Attachment: (was: beam-1773.v1.patch) > Consider allowing Source#validate() to throw exception >

[jira] [Updated] (BEAM-1811) Extract common class for WithTimestamps.AddTimestampsDoFn and Create.TimestampedValues.ConvertTimestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1811: -- Component/s: (was: beam-model) sdk-java-core > Extract common class for

[jira] [Updated] (BEAM-1811) Extract common class for WithTimestamps.AddTimestampsDoFn and Create.TimestampedValues.ConvertTimestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1811: -- Labels: newbie starter (was: ) > Extract common class for WithTimestamps.AddTimestampsDoFn and

[jira] [Assigned] (BEAM-1811) Extract common class for WithTimestamps.AddTimestampsDoFn and Create.TimestampedValues.ConvertTimestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1811: - Assignee: (was: Frances Perry) > Extract common class for

[jira] [Commented] (BEAM-1760) Potential null dereference in HDFSFileSink#doFinalize

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953657#comment-15953657 ] Ted Yu commented on BEAM-1760: -- [~davor]: Mind taking a look ? > Potential null dereference in

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #2167

2017-04-03 Thread Apache Jenkins Server
See -- [...truncated 791.43 KB...] 2017-04-03T16:50:05.230 [INFO] Downloading:

[jira] [Resolved] (BEAM-1471) Make IterableCoder binary compatible across SDKs

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1471. --- Resolution: Fixed Fix Version/s: 0.6.0 > Make IterableCoder binary compatible across

[jira] [Commented] (BEAM-1782) BigQuery read transform fails for DirectRunner when reading empty repeated fields

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953808#comment-15953808 ] ASF GitHub Bot commented on BEAM-1782: -- Github user chamikaramj closed the pull request at:

[jira] [Updated] (BEAM-1847) Read.Unbounded can't specify both max records and max duration.

2017-04-03 Thread Ryan Skraba (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Skraba updated BEAM-1847: -- Description: Some Beam IOs that expose the ability to turn an unbounded source into a bounded source.

[jira] [Created] (BEAM-1863) Allow users to override the base container image but still choose image type

2017-04-03 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1863: - Summary: Allow users to override the base container image but still choose image type Key: BEAM-1863 URL: https://issues.apache.org/jira/browse/BEAM-1863 Project:

[jira] [Resolved] (BEAM-1848) GroupByKey stuck with more than one worker on Dataflow

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1848. --- Resolution: Fixed Fix Version/s: Not applicable > GroupByKey stuck with more than one

[jira] [Commented] (BEAM-197) Incremental join

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953795#comment-15953795 ] Daniel Halperin commented on BEAM-197: -- Should this issue be closed now that the state blog post is

[jira] [Commented] (BEAM-1264) Python ChannelFactory Raise Inconsistent Error for Local FS and GCS

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953801#comment-15953801 ] Daniel Halperin commented on BEAM-1264: --- [~markflyhigh] [~sb2nov] Should this issue be resolved? >

[jira] [Updated] (BEAM-1264) Python ChannelFactory Raise Inconsistent Error for Local FS and GCS

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1264: -- Component/s: (was: beam-model) > Python ChannelFactory Raise Inconsistent Error for Local FS

[jira] [Assigned] (BEAM-1613) Meter metric type

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1613: - Assignee: (was: Ben Chambers) > Meter metric type > - > >

[jira] [Commented] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953809#comment-15953809 ] Ted Yu commented on BEAM-1773: -- I want to get some opinion on the method signature for PTransform#expand(). Is

[GitHub] beam pull request #2289: [BEAM-1782] Updates BigQuery read transform to corr...

2017-04-03 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/beam/pull/2289 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2397: [BEAM-1684] Add unit tests for iobase.py.

2017-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2397 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-1684] Add unit tests for iobase.py.

2017-04-03 Thread chamikara
Repository: beam Updated Branches: refs/heads/master 9beb04ed7 -> af8f586b6 [BEAM-1684] Add unit tests for iobase.py. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/beb75954 Tree:

[2/2] beam git commit: This closes #2397

2017-04-03 Thread chamikara
This closes #2397 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/af8f586b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/af8f586b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/af8f586b Branch:

[jira] [Updated] (BEAM-1847) Read.Unbounded can't specify both max records and max duration.

2017-04-03 Thread Ryan Skraba (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Skraba updated BEAM-1847: -- Component/s: (was: beam-model) sdk-java-extensions > Read.Unbounded can't specify

[2/2] beam git commit: Add a Dataflow-specific primitive for creating a view

2017-04-03 Thread tgroh
Add a Dataflow-specific primitive for creating a view Allows overrides of CreatePCollectionView to work with the batch override API. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1ce88e1d Tree:

[1/2] beam git commit: This closes #2387

2017-04-03 Thread tgroh
Repository: beam Updated Branches: refs/heads/master fe1d4124e -> 9beb04ed7 This closes #2387 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9beb04ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9beb04ed Diff:

[GitHub] beam pull request #2387: [BEAM-1579] Add a Dataflow-specific primitive for c...

2017-04-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2387 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1579) Runners should verify that PT overrides converged

2017-04-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953724#comment-15953724 ] ASF GitHub Bot commented on BEAM-1579: -- Github user asfgit closed the pull request at:

[jira] [Updated] (BEAM-1287) Give new DoFn the ability to output to a particular window

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1287: -- Component/s: sdk-py > Give new DoFn the ability to output to a particular window >

[jira] [Updated] (BEAM-26) Model for validation of user state upon pipeline update

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-26: Component/s: (was: beam-model-runner-api) (was: beam-model)

[jira] [Assigned] (BEAM-1808) Repeatedly.java javadoc refers to old method name isPastEndOfWindow

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1808: - Assignee: Wesley Tanaka (was: Frances Perry) > Repeatedly.java javadoc refers to old

  1   2   3   >