[jira] [Created] (BEAM-2601) FileBasedSink produces incorrect shards when writing to multiple destinations

2017-07-11 Thread Reuven Lax (JIRA)
Reuven Lax created BEAM-2601: Summary: FileBasedSink produces incorrect shards when writing to multiple destinations Key: BEAM-2601 URL: https://issues.apache.org/jira/browse/BEAM-2601 Project: Beam

[2/2] beam git commit: [BEAM-2574] This closes #3530

2017-07-11 Thread takidau
[BEAM-2574] This closes #3530 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b8fa0add Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b8fa0add Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b8fa0add Branch:

[1/2] beam git commit: Test unsupported/invalid cases in DSL tests.

2017-07-11 Thread takidau
Repository: beam Updated Branches: refs/heads/DSL_SQL ca2bc723d -> b8fa0addc Test unsupported/invalid cases in DSL tests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/794f1901 Tree:

[jira] [Created] (BEAM-2602) Fully support dropwizard metrics in beam and runners

2017-07-11 Thread Cody (JIRA)
Cody created BEAM-2602: -- Summary: Fully support dropwizard metrics in beam and runners Key: BEAM-2602 URL: https://issues.apache.org/jira/browse/BEAM-2602 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2600) Artifact for Python SDK harness that can be referenced in pipeline definition

2017-07-11 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083343#comment-16083343 ] Ahmet Altay commented on BEAM-2600: --- cc: [~tvalentyn] We might consider generalizing the dataflow runner

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2711

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2574) test unsupported/invalid cases in DSL

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083436#comment-16083436 ] ASF GitHub Bot commented on BEAM-2574: -- Github user XuMingmin closed the pull request at:

[GitHub] beam pull request #3530: [BEAM-2574] test unsupported/invalid cases in DSL

2017-07-11 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3530 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #1961

2017-07-11 Thread Apache Jenkins Server
See -- [...truncated 270.43 KB...] 2017-07-11T12:14:50.242 [INFO] Copying 2 resources 2017-07-11T12:14:50.244 [INFO] Copying 3 resources 2017-07-11T12:14:50.333

[jira] [Assigned] (BEAM-934) Findbugs doesn't pass in Java8 Examples

2017-07-11 Thread Almas Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almas Shaikh reassigned BEAM-934: - Assignee: Almas Shaikh (was: Jean-Baptiste Onofré) > Findbugs doesn't pass in Java8 Examples >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2605

2017-07-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3371

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2580) Cleanup dist.apache.org and use archive.apache.org for "old" releases

2017-07-11 Thread JIRA
Jean-Baptiste Onofré created BEAM-2580: -- Summary: Cleanup dist.apache.org and use archive.apache.org for "old" releases Key: BEAM-2580 URL: https://issues.apache.org/jira/browse/BEAM-2580

[jira] [Commented] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-07-11 Thread Kamil Szewczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082100#comment-16082100 ] Kamil Szewczyk commented on BEAM-1286: -- DataflowRunner allows to filesToStage to be missing, but then

[jira] [Comment Edited] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-07-11 Thread Kamil Szewczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082100#comment-16082100 ] Kamil Szewczyk edited comment on BEAM-1286 at 7/11/17 11:56 AM:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4349

2017-07-11 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3540: BEAM-2581: KinesisClientProvider interface needs to...

2017-07-11 Thread nawaidshamim
GitHub user nawaidshamim opened a pull request: https://github.com/apache/beam/pull/3540 BEAM-2581: KinesisClientProvider interface needs to be public Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082248#comment-16082248 ] ASF GitHub Bot commented on BEAM-2581: -- GitHub user nawaidshamim opened a pull request:

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. _KinesisIO_ provides two overloaded methods -

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods -

[jira] [Commented] (BEAM-2429) Conflicting filesystems with used of HadoopFileSystem

2017-07-11 Thread Manoj Mathai (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082354#comment-16082354 ] Manoj Mathai commented on BEAM-2429: Hi François Thanks a lot for your reply I tired that. I am able

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4350

2017-07-11 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #1962

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
Nawaid Shamim created BEAM-2581: --- Summary: KinesisClientProvider interface needs to be public Key: BEAM-2581 URL: https://issues.apache.org/jira/browse/BEAM-2581 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Component/s: beam-model > KinesisClientProvider interface needs to be public >

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. _KinesisIO_ provides two overloaded methods -

[jira] [Updated] (BEAM-2582) KinesisIO incorrectly handles closed shards

2017-07-11 Thread adam gray (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] adam gray updated BEAM-2582: Summary: KinesisIO incorrectly handles closed shards (was: KinesisIO incorrectly handles closed shareds) >

[jira] [Created] (BEAM-2582) KinesisIO incorrectly handles closed shareds

2017-07-11 Thread adam gray (JIRA)
adam gray created BEAM-2582: --- Summary: KinesisIO incorrectly handles closed shareds Key: BEAM-2582 URL: https://issues.apache.org/jira/browse/BEAM-2582 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-2582) KinesisIO incorrectly handles closed shareds

2017-07-11 Thread adam gray (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] adam gray updated BEAM-2582: Description: The KinesisIO throws an exception when consuming closed Kinesis shards, which return null from

[jira] [Commented] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082273#comment-16082273 ] Nawaid Shamim commented on BEAM-2581: - PR on Github - https://issues.apache.org/jira/browse/BEAM-2581

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2606

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-995) Apache Pig DSL

2017-07-11 Thread Niels Basjes (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082290#comment-16082290 ] Niels Basjes commented on BEAM-995: --- I see at least these two directions of implementing this: * Put the

[jira] [Comment Edited] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082273#comment-16082273 ] Nawaid Shamim edited comment on BEAM-2581 at 7/11/17 2:23 PM: -- PR on Github -

[2/4] beam git commit: Reformatting Kinesis IO to comply with official code style

2017-07-11 Thread jbonofre
http://git-wip-us.apache.org/repos/asf/beam/blob/21fd3028/sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/SimplifiedKinesisClient.java -- diff --git

[1/4] beam git commit: Reformatting Kinesis IO to comply with official code style

2017-07-11 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master af08f5352 -> 138641f14 http://git-wip-us.apache.org/repos/asf/beam/blob/21fd3028/sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/ShardRecordsIteratorTest.java

[3/4] beam git commit: Reformatting Kinesis IO to comply with official code style

2017-07-11 Thread jbonofre
Reformatting Kinesis IO to comply with official code style Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/21fd3028 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/21fd3028 Diff:

[4/4] beam git commit: This closes #3389

2017-07-11 Thread jbonofre
This closes #3389 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/138641f1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/138641f1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/138641f1 Branch:

[GitHub] beam pull request #3389: Reformatting Kinesis IO to comply with official cod...

2017-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3389 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3372

2017-07-11 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3542: Remove dead (and wrong) viewFromProto overload

2017-07-11 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3542 Remove dead (and wrong) viewFromProto overload Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Created] (BEAM-2584) Create a JCache based IO

2017-07-11 Thread JIRA
Ismaël Mejía created BEAM-2584: -- Summary: Create a JCache based IO Key: BEAM-2584 URL: https://issues.apache.org/jira/browse/BEAM-2584 Project: Beam Issue Type: New Feature

[jira] [Resolved] (BEAM-115) Beam Runner API

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-115. -- Resolution: Resolved Fix Version/s: Not applicable I think this umbrella ticket is no

[jira] [Commented] (BEAM-2583) Exceptions in expand() corrupt the TransformHierarchy

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082486#comment-16082486 ] Kenneth Knowles commented on BEAM-2583: --- Is it a bug to catch an exception and continue to use the

[jira] [Commented] (BEAM-2556) Client-side throttling for Datastore connector

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082489#comment-16082489 ] ASF GitHub Bot commented on BEAM-2556: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082463#comment-16082463 ] Kenneth Knowles commented on BEAM-2571: --- OK, I was wrong. Dataflow and Beam agree. We had an

[jira] [Commented] (BEAM-2583) Exceptions in expand() corrupt the TransformHierarchy

2017-07-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082464#comment-16082464 ] Thomas Groh commented on BEAM-2583: --- Specifically, this only happens if, during a call to {{expand}}, the

[2/2] beam git commit: [BEAM-2556] Add client-side throttling.

2017-07-11 Thread lcwik
[BEAM-2556] Add client-side throttling. This closes #3507 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a22f1a05 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a22f1a05 Diff:

[1/2] beam git commit: Add client-side throttling.

2017-07-11 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 138641f14 -> a22f1a05a Add client-side throttling. The approach used is as described in https://landing.google.com/sre/book/chapters/handling-overload.html#client-side-throttling-a7sYUg . By backing off individual workers in response to

[GitHub] beam pull request #3507: [BEAM-2556] Add client-side throttling.

2017-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3507 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (BEAM-2584) Create a JCache based IO

2017-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-2584: -- Assignee: Ismaël Mejía (was: Davor Bonaci) > Create a JCache based IO >

[jira] [Commented] (BEAM-92) Data-dependent sinks

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082458#comment-16082458 ] ASF GitHub Bot commented on BEAM-92: GitHub user reuvenlax opened a pull request:

[GitHub] beam pull request #3541: [BEAM-92] Support value-dependent files in AvroIO.

2017-07-11 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/3541 [BEAM-92] Support value-dependent files in AvroIO. Extends the FileBasedSink dynamic filename support to AvroIO. In addition to allowing dynamic destinations, we also allow per-destination AVRO

[jira] [Created] (BEAM-2583) Exceptions in expand() corrupt the TransformHierarchy

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2583: - Summary: Exceptions in expand() corrupt the TransformHierarchy Key: BEAM-2583 URL: https://issues.apache.org/jira/browse/BEAM-2583 Project: Beam Issue

[jira] [Commented] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-07-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082439#comment-16082439 ] Luke Cwik commented on BEAM-1286: - I think the point is that if there is nothing to stage (even after

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3373

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2558) Add a CombineFnTester

2017-07-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082503#comment-16082503 ] Thomas Groh commented on BEAM-2558: --- The linked file is also only in the Testing JAR, so user's can't use

[GitHub] beam pull request #3543: [BEAM-2586] Accommodate custom delimiters in TextIO

2017-07-11 Thread ChristophHebert
GitHub user ChristophHebert opened a pull request: https://github.com/apache/beam/pull/3543 [BEAM-2586] Accommodate custom delimiters in TextIO You can merge this pull request into a Git repository by running: $ git pull https://github.com/ChristophHebert/beam modifiedTextIO

[jira] [Created] (BEAM-2587) Build fails due to python sdk

2017-07-11 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-2587: - Summary: Build fails due to python sdk Key: BEAM-2587 URL: https://issues.apache.org/jira/browse/BEAM-2587 Project: Beam Issue Type: Bug Components:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4351

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2586) Accommodate custom delimiters in TextIO

2017-07-11 Thread Christopher Hebert (JIRA)
Christopher Hebert created BEAM-2586: Summary: Accommodate custom delimiters in TextIO Key: BEAM-2586 URL: https://issues.apache.org/jira/browse/BEAM-2586 Project: Beam Issue Type: New

[jira] [Updated] (BEAM-2585) add math function RAND_INTEGER and RAND

2017-07-11 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2585: - Issue Type: Sub-task (was: Task) Parent: BEAM-2160 > add math function RAND_INTEGER and RAND >

[jira] [Assigned] (BEAM-2562) Add integration test for logical operators

2017-07-11 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2562: Assignee: Xu Mingmin > Add integration test for logical operators >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3374

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2585) add math function RAND_INTEGER and RAND

2017-07-11 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2585: Summary: add math function RAND_INTEGER and RAND Key: BEAM-2585 URL: https://issues.apache.org/jira/browse/BEAM-2585 Project: Beam Issue Type: Task

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4352

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2573) Better filesystem discovery mechanism in Python SDK

2017-07-11 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082872#comment-16082872 ] Ahmet Altay commented on BEAM-2573: --- Thank you [~demeshchuk]. I agree with documenting this feature.

[jira] [Assigned] (BEAM-2563) Add integration test for math operators

2017-07-11 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2563: Assignee: Xu Mingmin > Add integration test for math operators >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2608

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2586) Accommodate custom delimiters in TextIO

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082716#comment-16082716 ] ASF GitHub Bot commented on BEAM-2586: -- GitHub user ChristophHebert opened a pull request:

[jira] [Commented] (BEAM-2573) Better filesystem discovery mechanism in Python SDK

2017-07-11 Thread Dmitry Demeshchuk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082850#comment-16082850 ] Dmitry Demeshchuk commented on BEAM-2573: - Finally, after some fighting dependency issues, made it

[jira] [Updated] (BEAM-2430) Java FnApiDoFnRunner to share across runners

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2430: -- Labels: beam-python-everywhere (was: ) > Java FnApiDoFnRunner to share across runners >

[1/2] beam git commit: Remove dead (and wrong) viewFromProto overload

2017-07-11 Thread kenn
Repository: beam Updated Branches: refs/heads/master a22f1a05a -> 011e2796d Remove dead (and wrong) viewFromProto overload Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/aaffe15e Tree:

[jira] [Resolved] (BEAM-2430) Java FnApiDoFnRunner to share across runners

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2430. --- Resolution: Implemented Fix Version/s: 2.1.0 > Java FnApiDoFnRunner to share across

[2/2] beam git commit: This closes #3542: Remove dead (and wrong) viewFromProto overload

2017-07-11 Thread kenn
This closes #3542: Remove dead (and wrong) viewFromProto overload Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/011e2796 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/011e2796 Diff:

[jira] [Created] (BEAM-2591) Python shim for submitting to FlinkRunner

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2591: - Summary: Python shim for submitting to FlinkRunner Key: BEAM-2591 URL: https://issues.apache.org/jira/browse/BEAM-2591 Project: Beam Issue Type: New

[jira] [Created] (BEAM-2594) Python shim for submitting to Java DirectRunner

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2594: - Summary: Python shim for submitting to Java DirectRunner Key: BEAM-2594 URL: https://issues.apache.org/jira/browse/BEAM-2594 Project: Beam Issue Type: New

[GitHub] beam pull request #3544: Cleanup and fix ptransform_fn decorator.

2017-07-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3544 Cleanup and fix ptransform_fn decorator. Previously CallablePTransform was being used both as the factory and the transform itself, which could result in state getting carried between

[jira] [Created] (BEAM-2588) FlinkRunner shim for serving Job API

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2588: - Summary: FlinkRunner shim for serving Job API Key: BEAM-2588 URL: https://issues.apache.org/jira/browse/BEAM-2588 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2589) ApexRunner shim for Job API

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2589: - Summary: ApexRunner shim for Job API Key: BEAM-2589 URL: https://issues.apache.org/jira/browse/BEAM-2589 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2590) SparkRunner shim for Job API

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2590: - Summary: SparkRunner shim for Job API Key: BEAM-2590 URL: https://issues.apache.org/jira/browse/BEAM-2590 Project: Beam Issue Type: New Feature

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3375

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2593) Python shim for submitting to SparkRunner

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2593: - Summary: Python shim for submitting to SparkRunner Key: BEAM-2593 URL: https://issues.apache.org/jira/browse/BEAM-2593 Project: Beam Issue Type: New

[jira] [Assigned] (BEAM-2430) Java FnApiDoFnRunner to share across runners

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-2430: - Assignee: Luke Cwik > Java FnApiDoFnRunner to share across runners >

[jira] [Updated] (BEAM-2594) Python shim for submitting to Java DirectRunner

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2594: -- Component/s: (was: runner-spark) runner-direct > Python shim for submitting

[jira] [Commented] (BEAM-2572) Implement an S3 filesystem for Python SDK

2017-07-11 Thread Dmitry Demeshchuk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083108#comment-16083108 ] Dmitry Demeshchuk commented on BEAM-2572: - For example, in my particular case, it would be

[jira] [Commented] (BEAM-2572) Implement an S3 filesystem for Python SDK

2017-07-11 Thread Dmitry Demeshchuk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083113#comment-16083113 ] Dmitry Demeshchuk commented on BEAM-2572: - Or, alternatively, we could state that filesystem

[jira] [Commented] (BEAM-2572) Implement an S3 filesystem for Python SDK

2017-07-11 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083088#comment-16083088 ] Robert Bradshaw commented on BEAM-2572: --- It should be noted that there was recently a huge effort to

[jira] [Comment Edited] (BEAM-2572) Implement an S3 filesystem for Python SDK

2017-07-11 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082887#comment-16082887 ] Sourabh Bajaj edited comment on BEAM-2572 at 7/11/17 8:16 PM: -- I think overall

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3370

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-933) Findbugs doesn't pass in Java Examples

2017-07-11 Thread Almas Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almas Shaikh reassigned BEAM-933: - Assignee: Almas Shaikh > Findbugs doesn't pass in Java Examples >

[jira] [Assigned] (BEAM-2578) DebuggingWordCountTest Fails on Windows

2017-07-11 Thread Almas Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almas Shaikh reassigned BEAM-2578: -- Assignee: Almas Shaikh (was: Frances Perry) > DebuggingWordCountTest Fails on Windows >

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4347

2017-07-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2604

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1939) Serialize more coders via URN + Class name

2017-07-11 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081751#comment-16081751 ] Innocent commented on BEAM-1939: Hi Thomas, I think this ticket needs to be update to reflect the current

svn commit: r20401 - in /dev/beam/2.1.0: ./ apache-beam-2.1.0-python.zip apache-beam-2.1.0-source-release.zip apache-beam-2.1.0-source-release.zip.asc

2017-07-11 Thread jbonofre
Author: jbonofre Date: Tue Jul 11 08:13:26 2017 New Revision: 20401 Log: Apache Beam, version 2.1.0, release candidate 1 Added: dev/beam/2.1.0/ dev/beam/2.1.0/apache-beam-2.1.0-python.zip (with props) dev/beam/2.1.0/apache-beam-2.1.0-source-release.zip (with props)

[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081817#comment-16081817 ] Aljoscha Krettek commented on BEAM-2571: What's the problem in Dataflow? In the real world this

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4348

2017-07-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2607

2017-07-11 Thread Apache Jenkins Server
See

  1   2   >