[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887474#comment-15887474 ] ASF GitHub Bot commented on FLINK-5776: --- Github user sunjincheng121 commented on the issue:

[GitHub] flink issue #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner support ...

2017-02-27 Thread sunjincheng121
Github user sunjincheng121 commented on the issue: https://github.com/apache/flink/pull/3418 @fhueske thanks for your review. I have updated the PR. IMO. The main purpose of doing this PR is to enhance the function of Flat/MapRunner. In addition, my next plan is: Use CODE-GEN

[jira] [Assigned] (FLINK-5818) change checkpoint dir permission to 700 for security reason

2017-02-27 Thread shijinkui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shijinkui reassigned FLINK-5818: Assignee: Tao Wang > change checkpoint dir permission to 700 for security reason >

[jira] [Commented] (FLINK-5921) Adapt time mode indicator functions return custom data types

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887417#comment-15887417 ] Haohui Mai commented on FLINK-5921: --- My understanding is that there should be no need for code

[GitHub] flink issue #3397: [FLINK-5803][TableAPI] Add [partitioned] processing t...

2017-02-27 Thread sunjincheng121
Github user sunjincheng121 commented on the issue: https://github.com/apache/flink/pull/3397 @fhueske thanks for the PR(#3425). I have rebased the code, and add timeMode check. I'm appreciated if you can look at this PR. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-5803) Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887374#comment-15887374 ] ASF GitHub Bot commented on FLINK-5803: --- Github user sunjincheng121 commented on the issue:

[jira] [Commented] (FLINK-5921) Adapt time mode indicator functions return custom data types

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887370#comment-15887370 ] ASF GitHub Bot commented on FLINK-5921: --- Github user sunjincheng121 commented on a diff in the pull

[GitHub] flink pull request #3425: [FLINK-5921] [table] Add custom data types for row...

2017-02-27 Thread sunjincheng121
Github user sunjincheng121 commented on a diff in the pull request: https://github.com/apache/flink/pull/3425#discussion_r103384285 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/codegen/calls/FunctionGenerator.scala --- @@ -327,6 +329,15 @@ object

[jira] [Updated] (FLINK-5752) Support push down projections for HBaseTableSource

2017-02-27 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-5752: -- Description: This is after the discussion to create

[jira] [Commented] (FLINK-5881) ScalarFunction(UDF) should support variable types and variable arguments

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887167#comment-15887167 ] ASF GitHub Bot commented on FLINK-5881: --- Github user clarkyzl commented on a diff in the pull

[GitHub] flink pull request #3389: [FLINK-5881] [table] ScalarFunction(UDF) should su...

2017-02-27 Thread clarkyzl
Github user clarkyzl commented on a diff in the pull request: https://github.com/apache/flink/pull/3389#discussion_r103369181 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/functions/utils/UserDefinedFunctionUtils.scala --- @@ -140,6 +138,24 @@ object

[jira] [Commented] (FLINK-4422) Convert all time interval measurements to System.nanoTime()

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887161#comment-15887161 ] ASF GitHub Bot commented on FLINK-4422: --- Github user jinmingjian commented on a diff in the pull

[jira] [Commented] (FLINK-4422) Convert all time interval measurements to System.nanoTime()

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887162#comment-15887162 ] ASF GitHub Bot commented on FLINK-4422: --- Github user jinmingjian commented on a diff in the pull

[GitHub] flink pull request #3420: [FLINK-4422] Convert all time interval measurement...

2017-02-27 Thread jinmingjian
Github user jinmingjian commented on a diff in the pull request: https://github.com/apache/flink/pull/3420#discussion_r103195631 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/KillerWatchDog.java --- @@

[GitHub] flink pull request #3420: [FLINK-4422] Convert all time interval measurement...

2017-02-27 Thread jinmingjian
Github user jinmingjian commented on a diff in the pull request: https://github.com/apache/flink/pull/3420#discussion_r103196536 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/ClosableBlockingQueue.java ---

[jira] [Commented] (FLINK-5881) ScalarFunction(UDF) should support variable types and variable arguments

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887126#comment-15887126 ] ASF GitHub Bot commented on FLINK-5881: --- Github user wuchong commented on a diff in the pull

[jira] [Commented] (FLINK-5881) ScalarFunction(UDF) should support variable types and variable arguments

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887127#comment-15887127 ] ASF GitHub Bot commented on FLINK-5881: --- Github user wuchong commented on a diff in the pull

[GitHub] flink pull request #3389: [FLINK-5881] [table] ScalarFunction(UDF) should su...

2017-02-27 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3389#discussion_r103361639 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/functions/utils/UserDefinedFunctionUtils.scala --- @@ -140,6 +138,24 @@ object

[GitHub] flink pull request #3389: [FLINK-5881] [table] ScalarFunction(UDF) should su...

2017-02-27 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3389#discussion_r103366163 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/functions/utils/ScalarSqlFunction.scala --- @@ -114,7 +114,9 @@ object

[GitHub] flink issue #3426: [FLINK-5414] [table] Bump up Calcite version to 1.11

2017-02-27 Thread wuchong
Github user wuchong commented on the issue: https://github.com/apache/flink/pull/3426 Hi @haohui , the code looks very good to me. Thanks for investigating this, waiting for the CI pass. @twalthr , I think you would like to have a look. --- If your project is set up for it,

[jira] [Commented] (FLINK-5414) Bump up Calcite version to 1.11

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887104#comment-15887104 ] ASF GitHub Bot commented on FLINK-5414: --- Github user wuchong commented on the issue:

[jira] [Commented] (FLINK-5917) Remove MapState.size()

2017-02-27 Thread Xiaogang Shi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887094#comment-15887094 ] Xiaogang Shi commented on FLINK-5917: - [~StephanEwen] We just use the cache to avoid the costly

[jira] [Closed] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-5907. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Fixed for 1.2.1 with

[jira] [Closed] (FLINK-3475) DISTINCT aggregate function support for SQL queries

2017-02-27 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-3475. Resolution: Implemented Fix Version/s: 1.3.0 Implemented for 1.3.0 with

[jira] [Commented] (FLINK-3475) DISTINCT aggregate function support for SQL queries

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886763#comment-15886763 ] ASF GitHub Bot commented on FLINK-3475: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3417 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886762#comment-15886762 ] ASF GitHub Bot commented on FLINK-5907: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #3111: [FLINK-3475] [Table] DISTINCT aggregate function s...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3111 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #3314: [FLINK-3679] DeserializationSchema should handle z...

2017-02-27 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3314#discussion_r103339489 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/util/serialization/RichKeyedDeserializationSchema.java --- @@

[jira] [Commented] (FLINK-3679) DeserializationSchema should handle zero or more outputs for every input

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886750#comment-15886750 ] ASF GitHub Bot commented on FLINK-3679: --- Github user haohui commented on a diff in the pull request:

[jira] [Commented] (FLINK-5133) Support to set resource for operator in DataStream and DataSet

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886691#comment-15886691 ] ASF GitHub Bot commented on FLINK-5133: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3303: [FLINK-5133][core] Support to set resource for operator i...

2017-02-27 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3303 I have merged this to my local repository. There were some issues left, partly in the commented out code. In particular `checkNotNull(variable !=null) does not work, because

[jira] [Commented] (FLINK-5501) Determine whether the job starts from last JobManager failure

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886688#comment-15886688 ] ASF GitHub Bot commented on FLINK-5501: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3385: [FLINK-5501] JM use running job registry to determine whe...

2017-02-27 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3385 One test case seemed to be failing in this PR: I have merged the PR to my local repository, fixed the test, and added some fixes/cleanups on top. Will merge back to Flink master

[jira] [Commented] (FLINK-5414) Bump up Calcite version to 1.11

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886650#comment-15886650 ] ASF GitHub Bot commented on FLINK-5414: --- GitHub user haohui opened a pull request:

[GitHub] flink pull request #3426: [FLINK-5414] [table] Bump up Calcite version to 1....

2017-02-27 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3426 [FLINK-5414] [table] Bump up Calcite version to 1.11 This PR resembles #3338 except that it canonizes the nullable types. @wuchong can you please take a look? You can merge this pull

[jira] [Commented] (FLINK-5803) Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886579#comment-15886579 ] ASF GitHub Bot commented on FLINK-5803: --- Github user fhueske commented on the issue:

[GitHub] flink issue #3397: [FLINK-5803][TableAPI] Add [partitioned] processing t...

2017-02-27 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/3397 Hi @sunjincheng121, I opened PR #3425, which adds custom data types for `proctime()` and `rowtime()` and replaces the functions during translation with constants. You can rebase your commit

[jira] [Commented] (FLINK-5921) Adapt time mode indicator functions return custom data types

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886575#comment-15886575 ] ASF GitHub Bot commented on FLINK-5921: --- GitHub user fhueske opened a pull request:

[GitHub] flink pull request #3425: [FLINK-5921] [table] Add custom data types for row...

2017-02-27 Thread fhueske
GitHub user fhueske opened a pull request: https://github.com/apache/flink/pull/3425 [FLINK-5921] [table] Add custom data types for rowtime and proctime. We add a custom data type for the result of the `rowtime()` and `proctime()` marker functions to easier identify the chosen time

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886552#comment-15886552 ] ASF GitHub Bot commented on FLINK-5907: --- Github user fhueske commented on the issue:

[GitHub] flink issue #3417: [FLINK-5907] [java api] Fix trailing empty fields in CsvI...

2017-02-27 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/3417 Merging --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (FLINK-3475) DISTINCT aggregate function support for SQL queries

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886551#comment-15886551 ] ASF GitHub Bot commented on FLINK-3475: --- Github user fhueske commented on the issue:

[GitHub] flink issue #3111: [FLINK-3475] [Table] DISTINCT aggregate function support ...

2017-02-27 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/3111 Merging --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (FLINK-5570) Support register external catalog to table environment

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886524#comment-15886524 ] Haohui Mai commented on FLINK-5570: --- Thanks [~fhueske] for the pointer. Just took a very quick skim --

[GitHub] flink issue #3424: [FLINK-5928] [checkpoints] Use custom metadata file for e...

2017-02-27 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3424 Thanks, good and critical fix! Looking at this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[jira] [Commented] (FLINK-5928) Externalized checkpoints overwritting each other

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886521#comment-15886521 ] ASF GitHub Bot commented on FLINK-5928: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886446#comment-15886446 ] Seth Wiesman commented on FLINK-5929: - [~aljoscha] Yes this does look like what we were discussing.

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886450#comment-15886450 ] Seth Wiesman commented on FLINK-5929: - [~rehevkor5] Yes, state for individual window panes. > Allow

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2017-02-27 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3314 @rmetzger ping... just wondering what do you think about all the approaches we have discussed here? Your comments are appreciated. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-3679) DeserializationSchema should handle zero or more outputs for every input

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886445#comment-15886445 ] ASF GitHub Bot commented on FLINK-3679: --- Github user haohui commented on the issue:

[jira] [Commented] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886438#comment-15886438 ] Haohui Mai commented on FLINK-5931: --- I have confirmed with [~gtCarrera9] (a YARN committer and Hadoop

[jira] [Updated] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated FLINK-5931: -- Description: In order to use Flink in mission-critical environments, Flink must be available even if

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886419#comment-15886419 ] Shannon Carey commented on FLINK-5929: -- If I understand correctly, I agree this would be useful.

[jira] [Created] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5931: - Summary: Make Flink highly available even if defaultFS is unavailable Key: FLINK-5931 URL: https://issues.apache.org/jira/browse/FLINK-5931 Project: Flink Issue

[jira] [Commented] (FLINK-5706) Implement Flink's own S3 filesystem

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886417#comment-15886417 ] Seth Wiesman commented on FLINK-5706: - [~StephanEwen] To expand on our conversation from the mailing

[jira] [Commented] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886404#comment-15886404 ] Haohui Mai commented on FLINK-5668: --- [~bill.liu8904] I believe that the title of the jira is confusing.

[jira] [Comment Edited] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886378#comment-15886378 ] Shannon Carey edited comment on FLINK-5929 at 2/27/17 7:40 PM: --- Just to

[jira] [Comment Edited] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886378#comment-15886378 ] Shannon Carey edited comment on FLINK-5929 at 2/27/17 7:38 PM: --- Just to

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886379#comment-15886379 ] ASF GitHub Bot commented on FLINK-5907: --- Github user fhueske commented on the issue:

[jira] [Commented] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Shannon Carey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886378#comment-15886378 ] Shannon Carey commented on FLINK-5929: -- Just to clarify, you're referring to the state from

[GitHub] flink issue #3417: [FLINK-5907] [java api] Fix trailing empty fields in CsvI...

2017-02-27 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/3417 Thanks for the fast update @KurtYoung. +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886342#comment-15886342 ] Haohui Mai edited comment on FLINK-5668 at 2/27/17 7:37 PM: [~rmetzger] --

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886342#comment-15886342 ] Haohui Mai edited comment on FLINK-5668 at 2/27/17 7:37 PM: [~rmetzger] --

[jira] [Commented] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886342#comment-15886342 ] Haohui Mai commented on FLINK-5668: --- [~rmetzger] -- just want to clarify FLINK-5631 here. YARN

[jira] [Commented] (FLINK-5923) Test instability in SavepointITCase testTriggerSavepointAndResume

2017-02-27 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886298#comment-15886298 ] Nico Kruber commented on FLINK-5923: I guess the following error may also originate from that race

[jira] [Commented] (FLINK-5758) Port-range for the web interface via YARN

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886235#comment-15886235 ] ASF GitHub Bot commented on FLINK-5758: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3391: [FLINK-5758] [yarn] support port range for web monitor

2017-02-27 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3391 @barcahead Thansk for contributing this. I can try and get to this later this week. Big pull request backlog right now ;-) --- If your project is set up for it, you can reply to this email

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Bill Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886220#comment-15886220 ] Bill Liu edited comment on FLINK-5668 at 2/27/17 6:00 PM: -- [~rmetzger]

[jira] [Comment Edited] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Bill Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886220#comment-15886220 ] Bill Liu edited comment on FLINK-5668 at 2/27/17 5:55 PM: -- [~rmetzger]

[jira] [Commented] (FLINK-5668) Reduce dependency on HDFS at job startup time

2017-02-27 Thread Bill Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886220#comment-15886220 ] Bill Liu commented on FLINK-5668: - [~rmetzger] [~wheat9]] and I are working on implementing a flink job

[jira] [Updated] (FLINK-5930) Allow Access to Job Id from Runtime Context

2017-02-27 Thread Seth Wiesman (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Wiesman updated FLINK-5930: Affects Version/s: (was: 1.2.1) (was: 1.3.0) > Allow Access to Job

[jira] [Resolved] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-5849. Resolution: Fixed Fix Version/s: 1.3.0 Resolved for {{master}} via

[GitHub] flink pull request #3378: [FLINK-5849] [kafka] Move FlinkKafkaConsumer start...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3378 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886214#comment-15886214 ] ASF GitHub Bot commented on FLINK-5849: --- Github user asfgit closed the pull request at:

[GitHub] flink issue #3378: [FLINK-5849] [kafka] Move FlinkKafkaConsumer start offset...

2017-02-27 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3378 Tests pass, merging .. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[jira] [Commented] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886210#comment-15886210 ] ASF GitHub Bot commented on FLINK-5849: --- Github user tzulitai commented on the issue:

[jira] [Commented] (FLINK-5917) Remove MapState.size()

2017-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886157#comment-15886157 ] Stephan Ewen commented on FLINK-5917: - Doesn't the cache compromise the "out-of-core" capabilities of

[jira] [Created] (FLINK-5930) Allow Access to Job Id from Runtime Context

2017-02-27 Thread Seth Wiesman (JIRA)
Seth Wiesman created FLINK-5930: --- Summary: Allow Access to Job Id from Runtime Context Key: FLINK-5930 URL: https://issues.apache.org/jira/browse/FLINK-5930 Project: Flink Issue Type:

[jira] [Commented] (FLINK-5849) Kafka Consumer checkpointed state may contain undefined offsets

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886122#comment-15886122 ] ASF GitHub Bot commented on FLINK-5849: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #3378: [FLINK-5849] [kafka] Move FlinkKafkaConsumer start offset...

2017-02-27 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3378 Thanks for the review @rmetzger! For the moving of `open()` to before `run()`, I've included that as the commit tagged with FLINK-5849. For the star import fix, I'm going to include that

[jira] [Created] (FLINK-5929) Allow Access to Per-Window State in ProcessWindowFunction

2017-02-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-5929: --- Summary: Allow Access to Per-Window State in ProcessWindowFunction Key: FLINK-5929 URL: https://issues.apache.org/jira/browse/FLINK-5929 Project: Flink

[jira] [Commented] (FLINK-5928) Externalized checkpoints overwritting each other

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886022#comment-15886022 ] ASF GitHub Bot commented on FLINK-5928: --- GitHub user uce opened a pull request:

[GitHub] flink pull request #3424: [FLINK-5928] [checkpoints] Use custom metadata fil...

2017-02-27 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/3424 [FLINK-5928] [checkpoints] Use custom metadata file for externalized checkpoints - Adds a checkpoint coordinator test for externalized checkpoints. This was covered only in unit tests for the involved

[jira] [Commented] (FLINK-3674) Add an interface for Time aware User Functions

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885951#comment-15885951 ] Aljoscha Krettek commented on FLINK-3674: - The main reason was not wanting to expose to much

[jira] [Commented] (FLINK-2922) Add Queryable Window Operator

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885949#comment-15885949 ] Aljoscha Krettek commented on FLINK-2922: - By the way, it would be as easy as adding {code}

[jira] [Commented] (FLINK-5524) Support early out for code generated conjunctive conditions

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885926#comment-15885926 ] ASF GitHub Bot commented on FLINK-5524: --- Github user KurtYoung commented on the issue:

[GitHub] flink issue #3372: [FLINK-5524] [table] Support early out for code generated...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/3372 hey @twalthr, any more comments or this can be merged --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-5586) Extend TableProgramsTestBase for object reuse modes

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885923#comment-15885923 ] ASF GitHub Bot commented on FLINK-5586: --- Github user KurtYoung commented on the issue:

[GitHub] flink issue #3339: [FLINK-5586] [table] Extend TableProgramsClusterTestBase ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/3339 hey @fhueske can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner s...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3418#discussion_r103206651 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/runtime/FlatMapRunner.scala --- @@ -43,7 +45,13 @@ class FlatMapRunner[IN,

[GitHub] flink pull request #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner s...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3418#discussion_r103226511 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/codegen/CodeGenerator.scala --- @@ -1562,6 +1561,39 @@ class CodeGenerator(

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885916#comment-15885916 ] ASF GitHub Bot commented on FLINK-5776: --- Github user fhueske commented on a diff in the pull

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885917#comment-15885917 ] ASF GitHub Bot commented on FLINK-5776: --- Github user fhueske commented on a diff in the pull

[jira] [Commented] (FLINK-5776) Improve XXMapRunner support create instance by carrying constructor parameters

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885915#comment-15885915 ] ASF GitHub Bot commented on FLINK-5776: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request #3418: [FLINK-5776][Table API & SQL]Improve XXMapRunner s...

2017-02-27 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/3418#discussion_r103206923 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/runtime/MapRunner.scala --- @@ -41,7 +43,13 @@ class MapRunner[IN, OUT](

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103226821 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/io/GenericCsvInputFormat.java --- @@ -358,24 +358,27 @@ protected boolean

[jira] [Commented] (FLINK-5907) RowCsvInputFormat bug on parsing tsv

2017-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885905#comment-15885905 ] ASF GitHub Bot commented on FLINK-5907: --- Github user KurtYoung commented on a diff in the pull

[jira] [Updated] (FLINK-5808) Missing verification for setParallelism and setMaxParallelism

2017-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-5808: Priority: Blocker (was: Major) > Missing verification for setParallelism and

[GitHub] flink pull request #3417: [FLINK-5907] [java api] Fix trailing empty fields ...

2017-02-27 Thread KurtYoung
Github user KurtYoung commented on a diff in the pull request: https://github.com/apache/flink/pull/3417#discussion_r103225729 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/io/RowCsvInputFormat.java --- @@ -197,6 +197,14 @@ protected boolean parseRecord(Object[]

  1   2   3   >