[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1342#issuecomment-155719584 Thank you for the testing and the patch. I would like to merge this soon. --- If your project is set up for it, you can reply to this email and have your reply appear on

[jira] [Commented] (FLINK-2380) Allow to configure default FS for file inputs

2015-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000171#comment-15000171 ] Stephan Ewen commented on FLINK-2380: - Is this still interesting? If yes, we should add this for 1.0,

[jira] [Commented] (FLINK-2977) Cannot access HBase in a Kerberos secured Yarn cluster

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000170#comment-15000170 ] ASF GitHub Bot commented on FLINK-2977: --- Github user mxm commented on the pull request:

[jira] [Created] (FLINK-3002) Add an EitherType to the Java API

2015-11-11 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3002: --- Summary: Add an EitherType to the Java API Key: FLINK-3002 URL: https://issues.apache.org/jira/browse/FLINK-3002 Project: Flink Issue Type: New Feature

[jira] [Commented] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000191#comment-15000191 ] ASF GitHub Bot commented on FLINK-2978: --- Github user sachingoel0101 commented on the pull request:

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-11-11 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-155726578 @rmetzger I have pushed a fix. Can you check this again? I apologize if this takes one two more iterations to get right since I cannot check this myself. ---

[jira] [Commented] (FLINK-7) [GitHub] Enable Range Partitioner

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000243#comment-15000243 ] ASF GitHub Bot commented on FLINK-7: Github user ChengXiangLi commented on a diff in the pull request:

[GitHub] flink pull request: [FLINK-7] [Runtime] Enable Range Partitioner.

2015-11-11 Thread ChengXiangLi
Github user ChengXiangLi commented on a diff in the pull request: https://github.com/apache/flink/pull/1255#discussion_r44522180 --- Diff: flink-optimizer/src/main/java/org/apache/flink/optimizer/traversals/RangePartitionRewriter.java --- @@ -0,0 +1,194 @@ +/* + *

[jira] [Commented] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000245#comment-15000245 ] ASF GitHub Bot commented on FLINK-2978: --- Github user sachingoel0101 commented on the pull request:

[jira] [Commented] (FLINK-2993) Set default DelayBetweenExecutionRetries to 0

2015-11-11 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000134#comment-15000134 ] Ufuk Celebi commented on FLINK-2993: I agree that 100 seconds default is too high. Let's go for

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-11-11 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-155713026 Thank you. I've tested it on a YARN cluster, but the URL it is showing is not correct. It seems to me that you are just using the current hostname + ip of the web

[jira] [Commented] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000153#comment-15000153 ] ASF GitHub Bot commented on FLINK-2978: --- Github user rmetzger commented on the pull request:

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-11 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-155719774 Why is it `AdaptiveTableSource` and `StaticTableSource`? Aren't static sources a subset of adaptive sources that just don't adapt? I don't think we need to

[jira] [Commented] (FLINK-2828) Add interfaces for Table API input formats

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000172#comment-15000172 ] ASF GitHub Bot commented on FLINK-2828: --- Github user aljoscha commented on the pull request:

[jira] [Created] (FLINK-3001) Add Support for Java 8 Optional type

2015-11-11 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3001: --- Summary: Add Support for Java 8 Optional type Key: FLINK-3001 URL: https://issues.apache.org/jira/browse/FLINK-3001 Project: Flink Issue Type: New Feature

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-11-11 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-155740233 That's not a problem. You can test at your own convenience. There's no hurry. :) --- If your project is set up for it, you can reply to this email and have your

[jira] [Commented] (FLINK-2977) Cannot access HBase in a Kerberos secured Yarn cluster

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000127#comment-15000127 ] ASF GitHub Bot commented on FLINK-2977: --- Github user nielsbasjes commented on the pull request:

[jira] [Commented] (FLINK-2828) Add interfaces for Table API input formats

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000160#comment-15000160 ] ASF GitHub Bot commented on FLINK-2828: --- Github user aljoscha commented on a diff in the pull

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000161#comment-15000161 ] ASF GitHub Bot commented on FLINK-2797: --- Github user sachingoel0101 commented on the pull request:

[jira] [Commented] (FLINK-2380) Allow to configure default FS for file inputs

2015-11-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000211#comment-15000211 ] Maximilian Michels commented on FLINK-2380: --- I think it makes sense to let the user replace the

[GitHub] flink pull request: fix pos assignment of instance

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1345#issuecomment-155735166 This looks like a bug you fixed. Do you have a case where this bug kicked in that you could add as a test? --- If your project is set up for it, you can reply to

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-11-11 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-155738270 Sure. :) It's probably best you didn't. There was still a minor thing to hash out. :') --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-3001) Add Support for Java 8 Optional type

2015-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000208#comment-15000208 ] Stephan Ewen commented on FLINK-3001: - That is all up to us to define. I would say yes to both, and

[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread nielsbasjes
Github user nielsbasjes commented on the pull request: https://github.com/apache/flink/pull/1342#issuecomment-155708227 I created a test topology that puts the current time in an HBase cell several times per second. In the cluster I did this on HBase is configured to use Kerberos

[jira] [Created] (FLINK-2999) Support connected keyed streams

2015-11-11 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-2999: Summary: Support connected keyed streams Key: FLINK-2999 URL: https://issues.apache.org/jira/browse/FLINK-2999 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3003) Add container allocation timeout to YARN CLI

2015-11-11 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3003: -- Summary: Add container allocation timeout to YARN CLI Key: FLINK-3003 URL: https://issues.apache.org/jira/browse/FLINK-3003 Project: Flink Issue Type:

[jira] [Commented] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000248#comment-15000248 ] ASF GitHub Bot commented on FLINK-2978: --- Github user rmetzger commented on the pull request:

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-11 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r44515720 --- Diff: flink-scala/src/main/scala/org/apache/flink/api/scala/ExecutionEnvironment.scala --- @@ -64,15 +62,19 @@ import scala.reflect.ClassTag *

[jira] [Commented] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000218#comment-15000218 ] ASF GitHub Bot commented on FLINK-2978: --- Github user rmetzger commented on the pull request:

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-11-11 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-155732014 Thank you. Sadly, I've shut down the cluster a few minutes ago, because I was finished with the release testing. I'll try soon... --- If your project is set up

[jira] [Created] (FLINK-3000) Add ShutdownHook to YARN CLI to prevent lingering sessions

2015-11-11 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3000: -- Summary: Add ShutdownHook to YARN CLI to prevent lingering sessions Key: FLINK-3000 URL: https://issues.apache.org/jira/browse/FLINK-3000 Project: Flink Issue

[jira] [Commented] (FLINK-3001) Add Support for Java 8 Optional type

2015-11-11 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000181#comment-15000181 ] Fabian Hueske commented on FLINK-3001: -- Do we want to support Option types as keys? If yes, what will

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-11-11 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-155738690 I know. The problem is that MS Azure cloud needs 30 minutes to deploy a small hortonworks cluster. Google handles that in a few minutes. But I can use another

[jira] [Commented] (FLINK-2942) Dangling operators in web UI's program visualization (non-deterministic)

2015-11-11 Thread Piotr Godek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000282#comment-15000282 ] Piotr Godek commented on FLINK-2942: OK will fix that soon. > Dangling operators in web UI's program

[jira] [Commented] (FLINK-2989) Job Cancel button doesn't work on Yarn

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000301#comment-15000301 ] ASF GitHub Bot commented on FLINK-2989: --- Github user rmetzger commented on the pull request:

[GitHub] flink pull request: [FLINK-2692] Untangle CsvInputFormat

2015-11-11 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/pull/1266#issuecomment-155764846 @fhueske I've addressed your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[jira] [Commented] (FLINK-2977) Cannot access HBase in a Kerberos secured Yarn cluster

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000307#comment-15000307 ] ASF GitHub Bot commented on FLINK-2977: --- Github user rmetzger commented on the pull request:

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000310#comment-15000310 ] ASF GitHub Bot commented on FLINK-2797: --- Github user sachingoel0101 commented on the pull request:

[GitHub] flink pull request: [FLINK-2989] job cancel button doesn't work on...

2015-11-11 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1344#issuecomment-155764939 +1 for the integration test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-2692) Untangle CsvInputFormat into PojoTypeCsvInputFormat and TupleTypeCsvInputFormat

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000309#comment-15000309 ] ASF GitHub Bot commented on FLINK-2692: --- Github user zentol commented on the pull request:

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-11-11 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-155764884 Okay. Figured it out. The Parallelism in the `ContextEnvironment` wasn't being respected in `StreamContextEnvironment`. Passes on my local machine now; waiting

[jira] [Commented] (FLINK-2977) Cannot access HBase in a Kerberos secured Yarn cluster

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000323#comment-15000323 ] ASF GitHub Bot commented on FLINK-2977: --- Github user rmetzger commented on the pull request:

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44529482 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/StreamingRuntimeContext.java --- @@ -173,4 +174,12 @@ public void

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44530703 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000348#comment-15000348 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44530755 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000347#comment-15000347 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000365#comment-15000365 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request: [FLINK-2947] [scala shell] Add color support t...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1337#issuecomment-155789414 BTW: You have pull request number 1337 ;-) +1 also from my side. Take of colors is different for everyone,. If this is Scala's default scheme, let's take it

[jira] [Commented] (FLINK-2947) Coloured Scala Shell

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000388#comment-15000388 ] ASF GitHub Bot commented on FLINK-2947: --- Github user StephanEwen commented on the pull request:

[GitHub] flink pull request: minor document fix.

2015-11-11 Thread mjsax
Github user mjsax commented on the pull request: https://github.com/apache/flink/pull/1325#issuecomment-155797348 +1 for merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request:

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/commit/976bacc65908cc35382ddbbcdc80249a700bc2d3#commitcomment-1496 In flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java: In

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-11-11 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-155842188 There is a merge conflict. Looks good otherwise. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000652#comment-15000652 ] ASF GitHub Bot commented on FLINK-2797: --- Github user mxm commented on the pull request:

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-11-11 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-155861149 @mxm , rebased. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000790#comment-15000790 ] ASF GitHub Bot commented on FLINK-2797: --- Github user sachingoel0101 commented on the pull request:

[GitHub] flink pull request: fix pos assignment of instance

2015-11-11 Thread fangmu
Github user fangmu commented on the pull request: https://github.com/apache/flink/pull/1345#issuecomment-155810945 I found this when learning codes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[jira] [Resolved] (FLINK-2994) Client sysout logging does not report exceptions

2015-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2994. - Resolution: Fixed Client now prints the exception when program switched to FAILING. Fixed via

[jira] [Closed] (FLINK-2994) Client sysout logging does not report exceptions

2015-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2994. --- > Client sysout logging does not report exceptions > > >

[jira] [Commented] (FLINK-2942) Dangling operators in web UI's program visualization (non-deterministic)

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000447#comment-15000447 ] ASF GitHub Bot commented on FLINK-2942: --- Github user fhueske commented on the pull request:

[GitHub] flink pull request: FLINK-2826 transformed is modified in Broadcas...

2015-11-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1339 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [refactor] Rename OperatorState to ValueState,...

2015-11-11 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1347#issuecomment-155826667 This does not touch the documentation yet. I would adapt it once we come to the consensus that we want these refactorings. --- If your project is set up for it, you

[jira] [Updated] (FLINK-2380) Allow to configure default FS for file inputs

2015-11-11 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-2380: -- Fix Version/s: (was: 0.10) 1.0 > Allow to configure default FS

[jira] [Commented] (FLINK-2989) Job Cancel button doesn't work on Yarn

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000311#comment-15000311 ] ASF GitHub Bot commented on FLINK-2989: --- Github user mxm commented on the pull request:

[GitHub] flink pull request: Out-of-core state backend for JDBC databases

2015-11-11 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1305#issuecomment-155765000 Should we do a final iteration over this and merge this to contrib? The description got slightly out of date when I changed this back so that it stores the state

[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1342#discussion_r44527912 --- Diff: flink-yarn/pom.xml --- @@ -63,6 +63,11 @@ under the License. test + +

[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1342#issuecomment-155768292 Thanks a lot for working on this issue! It doesn't happen everyday that users identify issues, fix them and verify the fix so properly :) I would really like

[GitHub] flink pull request: [FLINK-2624]: RabbitMQSource now extends Messa...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1243#issuecomment-155783584 I would like to look over this in the next days and merge it if it looks good. @HilmiYildirim Do you know of any simple way to run an embedded RabbitMQ

[jira] [Commented] (FLINK-2996) Add config entry to define BlobServer port

2015-11-11 Thread Chiwan Park (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000402#comment-15000402 ] Chiwan Park commented on FLINK-2996: +1 This is really necessary. > Add config entry to define

[GitHub] flink pull request: Fixed FLINK-2942

2015-11-11 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1346#issuecomment-155800525 Thanks for the patch @iampeter! I tried the fix on the broken plans and they look good! ![screen shot 2015-11-11 at 15 40

[GitHub] flink pull request: [refactor] Rename OperatorState to ValueState,...

2015-11-11 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/1347 [refactor] Rename OperatorState to ValueState, add ListState ValueState behaves exactly the same as OperatorState. ListState is a stateful list to which elements can be added and for which the

[GitHub] flink pull request:

2015-11-11 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/commit/976bacc65908cc35382ddbbcdc80249a700bc2d3#commitcomment-14333154 In flink-clients/src/main/java/org/apache/flink/client/CliFrontend.java: In

[jira] [Commented] (FLINK-2826) transformed is modified in BroadcastVariableMaterialization#decrementReferenceInternal without proper locking

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000528#comment-15000528 ] ASF GitHub Bot commented on FLINK-2826: --- Github user asfgit closed the pull request at:

[jira] [Closed] (FLINK-2826) transformed is modified in BroadcastVariableMaterialization#decrementReferenceInternal without proper locking

2015-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2826. --- > transformed is modified in > BroadcastVariableMaterialization#decrementReferenceInternal without

[GitHub] flink pull request: [FLINK-2624]: RabbitMQSource now extends Messa...

2015-11-11 Thread HilmiYildirim
Github user HilmiYildirim commented on the pull request: https://github.com/apache/flink/pull/1243#issuecomment-155820098 Unfortunately, I do not know a simple way to run an embedded RabbitMQ broker --- If your project is set up for it, you can reply to this email and have your reply

[jira] [Commented] (FLINK-2624) RabbitMQ source / sink should participate in checkpointing

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000532#comment-15000532 ] ASF GitHub Bot commented on FLINK-2624: --- Github user HilmiYildirim commented on the pull request:

[jira] [Resolved] (FLINK-2826) transformed is modified in BroadcastVariableMaterialization#decrementReferenceInternal without proper locking

2015-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2826. - Resolution: Fixed Fix Version/s: 1.0 Fixed via 6019f085f0d3dadc20a11f900784ce2796a89ce0

[jira] [Assigned] (FLINK-3002) Add an EitherType to the Java API

2015-11-11 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasia Kalavri reassigned FLINK-3002: Assignee: Vasia Kalavri > Add an EitherType to the Java API >

[GitHub] flink pull request: [FLINK-7] [Runtime] Enable Range Partitioner.

2015-11-11 Thread ChengXiangLi
Github user ChengXiangLi commented on a diff in the pull request: https://github.com/apache/flink/pull/1255#discussion_r44521192 --- Diff: flink-optimizer/src/main/java/org/apache/flink/optimizer/operators/GroupReduceWithCombineProperties.java --- @@ -121,6 +121,9 @@ public

[jira] [Commented] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000257#comment-15000257 ] ASF GitHub Bot commented on FLINK-2978: --- Github user sachingoel0101 commented on the pull request:

[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1342#issuecomment-155764769 The tests on travis are failing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1342#issuecomment-155769960 Robert has a good point. Right now, if some one uses HBase, the HBase dependency is part of the user program JAR. It would be nice to keep HBase out of the core JAR

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000354#comment-15000354 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44531013 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1341#issuecomment-155785654 I think this breaks the checkpoint atomicity. The fetcher (which emits the data to the source context) will not lock on the checkpoint lock any more, but on an

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000360#comment-15000360 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on the pull request:

[jira] [Commented] (FLINK-2671) Instable Test StreamCheckpointNotifierITCase

2015-11-11 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000435#comment-15000435 ] Matthias J. Sax commented on FLINK-2671: Occurred again:

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000355#comment-15000355 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000372#comment-15000372 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on the pull request:

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1341#issuecomment-155786742 Can you also move the periodic offset committer into the `run()` methods? Saves another field that may have concurrent access. The run methods can make sure it

[GitHub] flink pull request: [FLINK-2977] Added support for accessing a Ker...

2015-11-11 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1342#issuecomment-155770210 I was thinking about something like a reflection-based mechanism. Not sure though if this will work across different versions. Probably the API didn't change much in this

[jira] [Commented] (FLINK-2977) Cannot access HBase in a Kerberos secured Yarn cluster

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000326#comment-15000326 ] ASF GitHub Bot commented on FLINK-2977: --- Github user mxm commented on the pull request:

[jira] [Commented] (FLINK-2977) Cannot access HBase in a Kerberos secured Yarn cluster

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000325#comment-15000325 ] ASF GitHub Bot commented on FLINK-2977: --- Github user StephanEwen commented on the pull request:

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000331#comment-15000331 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000351#comment-15000351 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000350#comment-15000350 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44530920 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44530770 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@

[GitHub] flink pull request: [FLINK-2974] Add periodic offset committer for...

2015-11-11 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/1341#discussion_r44532032 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@

[jira] [Commented] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled

2015-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000367#comment-15000367 ] ASF GitHub Bot commented on FLINK-2974: --- Github user StephanEwen commented on a diff in the pull

  1   2   >