[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-11 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082463#comment-16082463 ] Kenneth Knowles commented on BEAM-2571: --- OK, I was wrong. Dataflow and Beam agree. We had an

[jira] [Created] (BEAM-2583) Exceptions in expand() corrupt the TransformHierarchy

2017-07-11 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2583: - Summary: Exceptions in expand() corrupt the TransformHierarchy Key: BEAM-2583 URL: https://issues.apache.org/jira/browse/BEAM-2583 Project: Beam Issue

[jira] [Commented] (BEAM-92) Data-dependent sinks

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082458#comment-16082458 ] ASF GitHub Bot commented on BEAM-92: GitHub user reuvenlax opened a pull request:

[GitHub] beam pull request #3541: [BEAM-92] Support value-dependent files in AvroIO.

2017-07-11 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/3541 [BEAM-92] Support value-dependent files in AvroIO. Extends the FileBasedSink dynamic filename support to AvroIO. In addition to allowing dynamic destinations, we also allow per-destination AVRO

[jira] [Commented] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-07-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082439#comment-16082439 ] Luke Cwik commented on BEAM-1286: - I think the point is that if there is nothing to stage (even after

[jira] [Created] (BEAM-2582) KinesisIO incorrectly handles closed shareds

2017-07-11 Thread adam gray (JIRA)
adam gray created BEAM-2582: --- Summary: KinesisIO incorrectly handles closed shareds Key: BEAM-2582 URL: https://issues.apache.org/jira/browse/BEAM-2582 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-2582) KinesisIO incorrectly handles closed shareds

2017-07-11 Thread adam gray (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] adam gray updated BEAM-2582: Description: The KinesisIO throws an exception when consuming closed Kinesis shards, which return null from

[jira] [Updated] (BEAM-2582) KinesisIO incorrectly handles closed shards

2017-07-11 Thread adam gray (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] adam gray updated BEAM-2582: Summary: KinesisIO incorrectly handles closed shards (was: KinesisIO incorrectly handles closed shareds) >

[jira] [Commented] (BEAM-2429) Conflicting filesystems with used of HadoopFileSystem

2017-07-11 Thread Manoj Mathai (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082354#comment-16082354 ] Manoj Mathai commented on BEAM-2429: Hi François Thanks a lot for your reply I tired that. I am able

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4350

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-995) Apache Pig DSL

2017-07-11 Thread Niels Basjes (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082290#comment-16082290 ] Niels Basjes commented on BEAM-995: --- I see at least these two directions of implementing this: * Put the

[jira] [Commented] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082273#comment-16082273 ] Nawaid Shamim commented on BEAM-2581: - PR on Github - https://issues.apache.org/jira/browse/BEAM-2581

[jira] [Comment Edited] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082273#comment-16082273 ] Nawaid Shamim edited comment on BEAM-2581 at 7/11/17 2:23 PM: -- PR on Github -

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. _KinesisIO_ provides two overloaded methods -

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods -

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Component/s: beam-model > KinesisClientProvider interface needs to be public >

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. _KinesisIO_ provides two overloaded methods -

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2606

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to

[jira] [Updated] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nawaid Shamim updated BEAM-2581: Description: Using Beam to read from kinesis stream. `KinesisIO` provides two overloaded methods to

[jira] [Commented] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082248#comment-16082248 ] ASF GitHub Bot commented on BEAM-2581: -- GitHub user nawaidshamim opened a pull request:

[GitHub] beam pull request #3540: BEAM-2581: KinesisClientProvider interface needs to...

2017-07-11 Thread nawaidshamim
GitHub user nawaidshamim opened a pull request: https://github.com/apache/beam/pull/3540 BEAM-2581: KinesisClientProvider interface needs to be public Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3372

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-07-11 Thread Nawaid Shamim (JIRA)
Nawaid Shamim created BEAM-2581: --- Summary: KinesisClientProvider interface needs to be public Key: BEAM-2581 URL: https://issues.apache.org/jira/browse/BEAM-2581 Project: Beam Issue Type: Bug

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #1962

2017-07-11 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3389: Reformatting Kinesis IO to comply with official cod...

2017-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3389 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/4] beam git commit: Reformatting Kinesis IO to comply with official code style

2017-07-11 Thread jbonofre
http://git-wip-us.apache.org/repos/asf/beam/blob/21fd3028/sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/SimplifiedKinesisClient.java -- diff --git

[4/4] beam git commit: This closes #3389

2017-07-11 Thread jbonofre
This closes #3389 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/138641f1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/138641f1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/138641f1 Branch:

[1/4] beam git commit: Reformatting Kinesis IO to comply with official code style

2017-07-11 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master af08f5352 -> 138641f14 http://git-wip-us.apache.org/repos/asf/beam/blob/21fd3028/sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/ShardRecordsIteratorTest.java

[3/4] beam git commit: Reformatting Kinesis IO to comply with official code style

2017-07-11 Thread jbonofre
Reformatting Kinesis IO to comply with official code style Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/21fd3028 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/21fd3028 Diff:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4349

2017-07-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2605

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-934) Findbugs doesn't pass in Java8 Examples

2017-07-11 Thread Almas Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almas Shaikh reassigned BEAM-934: - Assignee: Almas Shaikh (was: Jean-Baptiste Onofré) > Findbugs doesn't pass in Java8 Examples >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3371

2017-07-11 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #1961

2017-07-11 Thread Apache Jenkins Server
See -- [...truncated 270.43 KB...] 2017-07-11T12:14:50.242 [INFO] Copying 2 resources 2017-07-11T12:14:50.244 [INFO] Copying 3 resources 2017-07-11T12:14:50.333

[jira] [Created] (BEAM-2580) Cleanup dist.apache.org and use archive.apache.org for "old" releases

2017-07-11 Thread JIRA
Jean-Baptiste Onofré created BEAM-2580: -- Summary: Cleanup dist.apache.org and use archive.apache.org for "old" releases Key: BEAM-2580 URL: https://issues.apache.org/jira/browse/BEAM-2580

[jira] [Commented] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-07-11 Thread Kamil Szewczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082100#comment-16082100 ] Kamil Szewczyk commented on BEAM-1286: -- DataflowRunner allows to filesToStage to be missing, but then

[jira] [Comment Edited] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-07-11 Thread Kamil Szewczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082100#comment-16082100 ] Kamil Szewczyk edited comment on BEAM-1286 at 7/11/17 11:56 AM:

svn commit: r20401 - in /dev/beam/2.1.0: ./ apache-beam-2.1.0-python.zip apache-beam-2.1.0-source-release.zip apache-beam-2.1.0-source-release.zip.asc

2017-07-11 Thread jbonofre
Author: jbonofre Date: Tue Jul 11 08:13:26 2017 New Revision: 20401 Log: Apache Beam, version 2.1.0, release candidate 1 Added: dev/beam/2.1.0/ dev/beam/2.1.0/apache-beam-2.1.0-python.zip (with props) dev/beam/2.1.0/apache-beam-2.1.0-source-release.zip (with props)

[jira] [Commented] (BEAM-2571) Flink ValidatesRunner failing CombineTest.testSlidingWindowsCombineWithContext

2017-07-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081817#comment-16081817 ] Aljoscha Krettek commented on BEAM-2571: What's the problem in Dataflow? In the real world this

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4348

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1939) Serialize more coders via URN + Class name

2017-07-11 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081751#comment-16081751 ] Innocent commented on BEAM-1939: Hi Thomas, I think this ticket needs to be update to reflect the current

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2604

2017-07-11 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4347

2017-07-11 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-933) Findbugs doesn't pass in Java Examples

2017-07-11 Thread Almas Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almas Shaikh reassigned BEAM-933: - Assignee: Almas Shaikh > Findbugs doesn't pass in Java Examples >

[jira] [Assigned] (BEAM-2578) DebuggingWordCountTest Fails on Windows

2017-07-11 Thread Almas Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Almas Shaikh reassigned BEAM-2578: -- Assignee: Almas Shaikh (was: Frances Perry) > DebuggingWordCountTest Fails on Windows >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3370

2017-07-11 Thread Apache Jenkins Server
See

<    1   2