[GitHub] flink pull request #3417: [FLINK-5907] [java api] [WIP] Fix trailing empty f...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103197368 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/io/RowCsvInputFormatTest.java --- @@ -311,7 +317,7 @@ public void

[GitHub] flink pull request #3417: [FLINK-5907] [java api] [WIP] Fix trailing empty f...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103200986 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/io/RowCsvInputFormat.java --- @@ -197,6 +197,14 @@ protected boolean parseRecord(Object[]

[GitHub] flink pull request #3417: [FLINK-5907] [java api] [WIP] Fix trailing empty f...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103197216 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/io/CsvInputFormatTest.java --- @@ -400,7 +400,7 @@ public void readMixedQuotedStringFields() {

[GitHub] flink pull request #3417: [FLINK-5907] [java api] [WIP] Fix trailing empty f...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103203254 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/GenericCsvInputFormat.java --- @@ -392,12 +395,17 @@ protected boolean

[jira] [Commented] (FLINK-5844) jobmanager was killed when disk less 10% and restart fail

2017-02-27 Thread lining (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885810#comment-15885810 ] lining commented on FLINK-5844: --- I just update version ! My problem is why restart fail in 1.1.3? >

[jira] [Commented] (FLINK-5917) Remove MapState.size()

2017-02-27 Thread Xiaogang Shi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887094#comment-15887094 ] Xiaogang Shi commented on FLINK-5917: - [~StephanEwen] We just use the cache to avoid the costly

[jira] [Commented] (FLINK-4422) Convert all time interval measurements to System.nanoTime()

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887161#comment-15887161 ] ASF GitHub Bot commented on FLINK-4422: --- Github user jinmingjian commented on a diff in the pull

[GitHub] flink pull request #3420: [FLINK-4422] Convert all time interval measurement...

2017-02-27 Thread jinmingjian
Github user jinmingjian commented on a diff in the pull request: https://github.com/apache/flink/pull/3420#discussion_r103196536 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/ClosableBlockingQueue.java ---

[jira] [Commented] (FLINK-4422) Convert all time interval measurements to System.nanoTime()

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887162#comment-15887162 ] ASF GitHub Bot commented on FLINK-4422: --- Github user jinmingjian commented on a diff in the pull

[GitHub] flink pull request #3420: [FLINK-4422] Convert all time interval measurement...

2017-02-27 Thread jinmingjian
Github user jinmingjian commented on a diff in the pull request: https://github.com/apache/flink/pull/3420#discussion_r103195631 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/KillerWatchDog.java --- @@

[jira] [Assigned] (FLINK-5818) change checkpoint dir permission to 700 for security reason

2017-02-27 Thread shijinkui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shijinkui reassigned FLINK-5818: Assignee: Tao Wang > change checkpoint dir permission to 700 for security reason >

[GitHub] flink issue #3426: [FLINK-5414] [table] Bump up Calcite version to 1.11

2017-02-27 Thread wuchong
Github user wuchong commented on the issue: https://github.com/apache/flink/pull/3426 Hi @haohui , the code looks very good to me. Thanks for investigating this, waiting for the CI pass. @twalthr , I think you would like to have a look. --- If your project is set up for it,

[jira] [Commented] (FLINK-5414) Bump up Calcite version to 1.11

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887104#comment-15887104 ] ASF GitHub Bot commented on FLINK-5414: --- Github user wuchong commented on the issue:

[GitHub] flink pull request #3389: [FLINK-5881] [table] ScalarFunction(UDF) should su...

2017-02-27 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3389#discussion_r103361639 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/functions/utils/UserDefinedFunctionUtils.scala --- @@ -140,6 +138,24 @@ object

[jira] [Commented] (FLINK-5881) ScalarFunction(UDF) should support variable types and variable arguments

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887126#comment-15887126 ] ASF GitHub Bot commented on FLINK-5881: --- Github user wuchong commented on a diff in the pull

[jira] [Commented] (FLINK-5881) ScalarFunction(UDF) should support variable types and variable arguments

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887127#comment-15887127 ] ASF GitHub Bot commented on FLINK-5881: --- Github user wuchong commented on a diff in the pull

[GitHub] flink pull request #3389: [FLINK-5881] [table] ScalarFunction(UDF) should su...

2017-02-27 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3389#discussion_r103366163 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/functions/utils/ScalarSqlFunction.scala --- @@ -114,7 +114,9 @@ object

[jira] [Updated] (FLINK-5752) Support push down projections for HBaseTableSource

2017-02-27 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-5752: -- Description: This is after the discussion to create

[jira] [Commented] (FLINK-5803) Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887374#comment-15887374 ] ASF GitHub Bot commented on FLINK-5803: --- Github user sunjincheng121 commented on the issue:

[GitHub] flink issue #3397: [FLINK-5803][TableAPI] Add [partitioned] processing t...

2017-02-27 Thread sunjincheng121
Github user sunjincheng121 commented on the issue: https://github.com/apache/flink/pull/3397 @fhueske thanks for the PR(#3425). I have rebased the code, and add timeMode check. I'm appreciated if you can look at this PR. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-5921) Adapt time mode indicator functions return custom data types

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887417#comment-15887417 ] Haohui Mai commented on FLINK-5921: --- My understanding is that there should be no need for code

[GitHub] flink pull request #3389: [FLINK-5881] [table] ScalarFunction(UDF) should su...

2017-02-27 Thread clarkyzl
Github user clarkyzl commented on a diff in the pull request: https://github.com/apache/flink/pull/3389#discussion_r103369181 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/functions/utils/UserDefinedFunctionUtils.scala --- @@ -140,6 +138,24 @@ object

[jira] [Commented] (FLINK-5881) ScalarFunction(UDF) should support variable types and variable arguments

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887167#comment-15887167 ] ASF GitHub Bot commented on FLINK-5881: --- Github user clarkyzl commented on a diff in the pull

[jira] [Commented] (FLINK-5921) Adapt time mode indicator functions return custom data types

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887370#comment-15887370 ] ASF GitHub Bot commented on FLINK-5921: --- Github user sunjincheng121 commented on a diff in the pull

[GitHub] flink pull request #3425: [FLINK-5921] [table] Add custom data types for row...

2017-02-27 Thread sunjincheng121
Github user sunjincheng121 commented on a diff in the pull request: https://github.com/apache/flink/pull/3425#discussion_r103384285 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/codegen/calls/FunctionGenerator.scala --- @@ -327,6 +329,15 @@ object

[GitHub] flink issue #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner support ...

2017-02-27 Thread sunjincheng121
Github user sunjincheng121 commented on the issue: https://github.com/apache/flink/pull/3418 @fhueske thanks for your review. I have updated the PR. IMO. The main purpose of doing this PR is to enhance the function of Flat/MapRunner. In addition, my next plan is: Use CODE-GEN

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887474#comment-15887474 ] ASF GitHub Bot commented on FLINK-5776: --- Github user sunjincheng121 commented on the issue:

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103224327 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/io/CsvInputFormatTest.java --- @@ -957,6 +964,42 @@ public void

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885898#comment-15885898 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[GitHub] flink pull request #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner s...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3418#discussion_r103206651 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/runtime/FlatMapRunner.scala --- @@ -43,7 +45,13 @@ class FlatMapRunner[IN,

[jira] [Commented] (FLINK-5586) Extend TableProgramsTestBase for object reuse modes

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885923#comment-15885923 ] ASF GitHub Bot commented on FLINK-5586: --- Github user KurtYoung commented on the issue:

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103225144 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/io/RowCsvInputFormatTest.java --- @@ -311,7 +317,7 @@ public void

[jira] [Updated] (FLINK-5808) Missing verification for setParallelism and setMaxParallelism

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-5808: Fix Version/s: 1.2.1 1.3.0 > Missing verification for setParallelism and

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885908#comment-15885908 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885909#comment-15885909 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[jira] [Commented] (FLINK-5524) Support early out for code generated conjunctive conditions

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885926#comment-15885926 ] ASF GitHub Bot commented on FLINK-5524: --- Github user KurtYoung commented on the issue:

[jira] [Commented] (FLINK-5928) Externalized checkpoints overwritting each other

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886022#comment-15886022 ] ASF GitHub Bot commented on FLINK-5928: --- GitHub user uce opened a pull request:

[GitHub] flink pull request #3424: [FLINK-5928] [checkpoints] Use custom metadata fil...

2017-02-27 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/3424 [FLINK-5928] [checkpoints] Use custom metadata file for externalized checkpoints - Adds a checkpoint coordinator test for externalized checkpoints. This was covered only in unit tests for the involved

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885895#comment-15885895 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103224286 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/io/CsvInputFormatTest.java --- @@ -400,7 +400,7 @@ public void readMixedQuotedStringFields()

[jira] [Updated] (FLINK-5808) Missing verification for setParallelism and setMaxParallelism

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-5808: Affects Version/s: 1.2.0 > Missing verification for setParallelism and setMaxParallelism >

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885904#comment-15885904 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885917#comment-15885917 ] ASF GitHub Bot commented on FLINK-5776: --- Github user fhueske commented on a diff in the pull

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885915#comment-15885915 ] ASF GitHub Bot commented on FLINK-5776: --- Github user fhueske commented on a diff in the pull

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885916#comment-15885916 ] ASF GitHub Bot commented on FLINK-5776: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner s...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3418#discussion_r103226511 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/codegen/CodeGenerator.scala --- @@ -1562,6 +1561,39 @@ class CodeGenerator(

[GitHub] flink pull request #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner s...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3418#discussion_r103206923 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/runtime/MapRunner.scala --- @@ -41,7 +43,13 @@ class MapRunner[IN, OUT](

[GitHub] flink issue #3340: [FLINK-5703][runtime] ExecutionGraph recovery via reconci...

2017-02-27 Thread zhijiangW
Github user zhijiangW commented on the issue: https://github.com/apache/flink/pull/3340 @StephanEwen , thanks for professional reviews! I attached the design doc in this jira for the implementation consideration.

[jira] [Commented] (FLINK-3674) Add an interface for Time aware User Functions

2017-02-27 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885891#comment-15885891 ] Jaromir Vanek commented on FLINK-3674: -- Hi, I am wondering what was the intention behind not

[GitHub] flink issue #3372: [FLINK-5524] [table] Support early out for code generated...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/3372 hey @twalthr, any more comments or this can be merged --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #3423: [FLINK-5768] [table] Apply new aggregation functions for ...

2017-02-27 Thread shaoxuan-wang
Github user shaoxuan-wang commented on the issue: https://github.com/apache/flink/pull/3423 I think we could further remove AggregateMapFunction and DataSetWindowAggregateMapFunction for windowedDataSet and DataSet, and let reduce function directly accumulator the input values. But

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103226814 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/GenericCsvInputFormat.java --- @@ -392,12 +395,17 @@ protected boolean

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103225729 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/io/RowCsvInputFormat.java --- @@ -197,6 +197,14 @@ protected boolean parseRecord(Object[]

[jira] [Commented] (FLINK-5768) Apply new aggregation functions for datastream and dataset tables

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885864#comment-15885864 ] ASF GitHub Bot commented on FLINK-5768: --- Github user shaoxuan-wang commented on the issue:

[jira] [Commented] (FLINK-3674) Add an interface for Time aware User Functions

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885951#comment-15885951 ] Aljoscha Krettek commented on FLINK-3674: - The main reason was not wanting to expose to much

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886378#comment-15886378 ] Shannon Carey commented on FLINK-5929: -- Just to clarify, you're referring to the state from

[GitHub] flink issue #3417: [FLINK-5907] [java api] Fix trailing empty fields in CsvI...

2017-02-27 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/3417 Thanks for the fast update @KurtYoung. +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Comment Edited] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886378#comment-15886378 ] Shannon Carey edited comment on FLINK-5929 at 2/27/17 7:40 PM: --- Just to

[jira] [Commented] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886438#comment-15886438 ] Haohui Mai commented on FLINK-5931: --- I have confirmed with [~gtCarrera9] (a YARN committer and Hadoop

[jira] [Commented] (FLINK-3679) DeserializationSchema should handle zero or more outputs for every input

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886445#comment-15886445 ] ASF GitHub Bot commented on FLINK-3679: --- Github user haohui commented on the issue:

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2017-02-27 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3314 @rmetzger ping... just wondering what do you think about all the approaches we have discussed here? Your comments are appreciated. --- If your project is set up for it, you can reply to this

[jira] [Created] (FLINK-5930) Allow Access to Job Id from Runtime Context

2017-02-27 Thread Seth Wiesman (JIRA)
Seth Wiesman created FLINK-5930: --- Summary: Allow Access to Job Id from Runtime Context Key: FLINK-5930 URL: https://issues.apache.org/jira/browse/FLINK-5930 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Bill Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886220#comment-15886220 ] Bill Liu edited comment on FLINK-5668 at 2/27/17 5:55 PM: -- [~rmetzger]

[jira] [Commented] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Bill Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886220#comment-15886220 ] Bill Liu commented on FLINK-5668: - [~rmetzger] [~wheat9]] and I are working on implementing a flink job

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886342#comment-15886342 ] Haohui Mai edited comment on FLINK-5668 at 2/27/17 7:37 PM: [~rmetzger] --

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886342#comment-15886342 ] Haohui Mai edited comment on FLINK-5668 at 2/27/17 7:37 PM: [~rmetzger] --

[jira] [Created] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5931: - Summary: Make Flink highly available even if defaultFS is unavailable Key: FLINK-5931 URL: https://issues.apache.org/jira/browse/FLINK-5931 Project: Flink Issue

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886419#comment-15886419 ] Shannon Carey commented on FLINK-5929: -- If I understand correctly, I agree this would be useful.

[jira] [Updated] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated FLINK-5931: -- Description: In order to use Flink in mission-critical environments, Flink must be available even if

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886446#comment-15886446 ] Seth Wiesman commented on FLINK-5929: - [~aljoscha] Yes this does look like what we were discussing.

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886450#comment-15886450 ] Seth Wiesman commented on FLINK-5929: - [~rehevkor5] Yes, state for individual window panes. > Allow

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886379#comment-15886379 ] ASF GitHub Bot commented on FLINK-5907: --- Github user fhueske commented on the issue:

[jira] [Commented] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886404#comment-15886404 ] Haohui Mai commented on FLINK-5668: --- [~bill.liu8904] I believe that the title of the jira is confusing.

[jira] [Comment Edited] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886378#comment-15886378 ] Shannon Carey edited comment on FLINK-5929 at 2/27/17 7:38 PM: --- Just to

[jira] [Commented] (FLINK-5706) Implement Flink's own S3 filesystem

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886417#comment-15886417 ] Seth Wiesman commented on FLINK-5706: - [~StephanEwen] To expand on our conversation from the mailing

[jira] [Created] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-5929: --- Summary: Allow Access to Per-Window State in ProcessWindowFunction Key: FLINK-5929 URL: https://issues.apache.org/jira/browse/FLINK-5929 Project: Flink

[GitHub] flink issue #3378: [FLINK-5849] [kafka] Move FlinkKafkaConsumer start offset...

2017-02-27 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3378 Thanks for the review @rmetzger! For the moving of `open()` to before `run()`, I've included that as the commit tagged with FLINK-5849. For the star import fix, I'm going to include that

[jira] [Updated] (FLINK-5930) Allow Access to Job Id from Runtime Context

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Wiesman updated FLINK-5930: Affects Version/s: (was: 1.2.1) (was: 1.3.0) > Allow Access to Job

[jira] [Commented] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886122#comment-15886122 ] ASF GitHub Bot commented on FLINK-5849: --- Github user tzulitai commented on the issue:

[jira] [Commented] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886214#comment-15886214 ] ASF GitHub Bot commented on FLINK-5849: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-5917) Remove MapState.size()

2017-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886157#comment-15886157 ] Stephan Ewen commented on FLINK-5917: - Doesn't the cache compromise the "out-of-core" capabilities of

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Bill Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886220#comment-15886220 ] Bill Liu edited comment on FLINK-5668 at 2/27/17 6:00 PM: -- [~rmetzger]

[jira] [Commented] (FLINK-4364) Implement TaskManager side of heartbeat from JobManager

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885870#comment-15885870 ] ASF GitHub Bot commented on FLINK-4364: --- Github user zhijiangW commented on the issue:

[GitHub] flink issue #3339: [FLINK-5586] [table] Extend TableProgramsClusterTestBase ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/3339 hey @fhueske can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Commented] (FLINK-2922) Add Queryable Window Operator

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885949#comment-15885949 ] Aljoscha Krettek commented on FLINK-2922: - By the way, it would be as easy as adding {code}

[GitHub] flink issue #3391: [FLINK-5758] [yarn] support port range for web monitor

2017-02-27 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3391 @barcahead Thansk for contributing this. I can try and get to this later this week. Big pull request backlog right now ;-) --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886210#comment-15886210 ] ASF GitHub Bot commented on FLINK-5849: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #3378: [FLINK-5849] [kafka] Move FlinkKafkaConsumer start offset...

2017-02-27 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3378 Tests pass, merging .. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[jira] [Resolved] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-5849. Resolution: Fixed Fix Version/s: 1.3.0 Resolved for {{master}} via

[GitHub] flink pull request #3378: [FLINK-5849] [kafka] Move FlinkKafkaConsumer start...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3378 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-5703) ExecutionGraph recovery based on reconciliation with TaskManager reports

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885860#comment-15885860 ] ASF GitHub Bot commented on FLINK-5703: --- Github user zhijiangW commented on the issue:

[GitHub] flink issue #3151: [FLINK-4364][runtime] Implement TaskManager side of heart...

2017-02-27 Thread zhijiangW
Github user zhijiangW commented on the issue: https://github.com/apache/flink/pull/3151 Hi, @tillrohrmann , thanks for so detail reviews! I got all the points and may submit the modifications tomorrow, then I will ping you! --- If your project is set up for it, you can reply to this

[jira] [Updated] (FLINK-5808) Missing verification for setParallelism and setMaxParallelism

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-5808: Priority: Blocker (was: Major) > Missing verification for setParallelism and

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885905#comment-15885905 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103226821 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/GenericCsvInputFormat.java --- @@ -358,24 +358,27 @@ protected boolean

[jira] [Commented] (FLINK-5758) Port-range for the web interface via YARN

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886235#comment-15886235 ] ASF GitHub Bot commented on FLINK-5758: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-5923) Test instability in SavepointITCase testTriggerSavepointAndResume

2017-02-27 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886298#comment-15886298 ] Nico Kruber commented on FLINK-5923: I guess the following error may also originate from that race

[jira] [Commented] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886342#comment-15886342 ] Haohui Mai commented on FLINK-5668: --- [~rmetzger] -- just want to clarify FLINK-5631 here. YARN

[GitHub] flink issue #3385: [FLINK-5501] JM use running job registry to determine whe...

2017-02-27 Thread shuai-xu
Github user shuai-xu commented on the issue: https://github.com/apache/flink/pull/3385 hi @StephanEwen , thank for you review, I modify it according to your comments, add getJobSchedulingStatus to it and add tests. --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-5501) Determine whether the job starts from last JobManager failure

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885338#comment-15885338 ] ASF GitHub Bot commented on FLINK-5501: --- Github user shuai-xu commented on the issue:

<    1   2   3   >