[jira] [Commented] (FLINK-20833) Expose pluggable interface for exception analysis and metrics reporting in Execution Graph

2021-01-17 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266945#comment-17266945 ] Zhenqiu Huang commented on FLINK-20833: --- [~rmetzger] [[~trohrmann]] Thanks for these suggestions.

[jira] [Comment Edited] (FLINK-20833) Expose pluggable interface for exception analysis and metrics reporting in Execution Graph

2021-01-15 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265795#comment-17265795 ] Zhenqiu Huang edited comment on FLINK-20833 at 1/15/21, 8:07 AM: -

[jira] [Commented] (FLINK-20833) Expose pluggable interface for exception analysis and metrics reporting in Execution Graph

2021-01-15 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265795#comment-17265795 ] Zhenqiu Huang commented on FLINK-20833: --- [~rmetzger] Thanks for these suggestions. 1) I think the

[jira] [Commented] (FLINK-20811) Support HTTP paths for yarn ship files/archives

2021-01-14 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265760#comment-17265760 ] Zhenqiu Huang commented on FLINK-20811: --- [~xintongsong] Currently, Flink master branch is still

[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager doesn't use maximum-failed-containers as limit of resource acquirement

2021-01-08 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261775#comment-17261775 ] Zhenqiu Huang commented on FLINK-10868: --- [~xintongsong] Thanks for the reply. No hurry. I am also

[jira] [Commented] (FLINK-20867) Support ship files from local/remote path to k8s pod

2021-01-06 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259909#comment-17259909 ] Zhenqiu Huang commented on FLINK-20867: --- [~jiang7chengzitc] I think this task is related to

[jira] [Commented] (FLINK-20833) Expose pluggable interface for exception analysis and metrics reporting in Execution Graph

2021-01-05 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259457#comment-17259457 ] Zhenqiu Huang commented on FLINK-20833: --- [~trohrmann] Thanks for the suggestion. As

[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager doesn't use maximum-failed-containers as limit of resource acquirement

2021-01-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258635#comment-17258635 ] Zhenqiu Huang commented on FLINK-10868: --- [~xintongsong] Happy new year. I just rebased master and

[jira] [Commented] (FLINK-20833) Expose pluggable interface for exception analysis and metrics reporting in Execution Graph

2021-01-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258517#comment-17258517 ] Zhenqiu Huang commented on FLINK-20833: --- [~xintongsong] [~trohrmann] How do you think this

[jira] [Created] (FLINK-20833) Expose pluggable interface for exception analysis and metrics reporting in Execution Graph

2021-01-03 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-20833: - Summary: Expose pluggable interface for exception analysis and metrics reporting in Execution Graph Key: FLINK-20833 URL: https://issues.apache.org/jira/browse/FLINK-20833

[jira] [Commented] (FLINK-20811) Support HTTP paths for yarn ship files/archives

2021-01-02 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257677#comment-17257677 ] Zhenqiu Huang commented on FLINK-20811: --- [~fly_in_gis] Echo to Xintong's questions. If the

[jira] [Commented] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

2020-12-27 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255285#comment-17255285 ] Zhenqiu Huang commented on FLINK-14055: --- [~jark] I would like to work on this. Shall we create a

[jira] [Commented] (FLINK-20461) YARNFileReplicationITCase.testPerJobModeWithDefaultFileReplication

2020-12-26 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255156#comment-17255156 ] Zhenqiu Huang commented on FLINK-20461: --- [~xintongsong] [~hxbks2ks] Tried run the test class 100

[jira] [Commented] (FLINK-20461) YARNFileReplicationITCase.testPerJobModeWithDefaultFileReplication

2020-12-24 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254750#comment-17254750 ] Zhenqiu Huang commented on FLINK-20461: --- [~hxbks2ks] [~xintongsong] Looks like the issue doesn't

[jira] [Commented] (FLINK-20505) Yarn provided lib does not work with http paths.

2020-12-24 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254692#comment-17254692 ] Zhenqiu Huang commented on FLINK-20505: --- [~zoucao] Echo to [~fly_in_gis]'s opinion, we don't need

[jira] [Commented] (FLINK-20505) Yarn provided lib does not work with http paths.

2020-12-23 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254401#comment-17254401 ] Zhenqiu Huang commented on FLINK-20505: --- [~zoucao] For your use case, probably you should use

[jira] [Comment Edited] (FLINK-20461) YARNFileReplicationITCase.testPerJobModeWithDefaultFileReplication

2020-12-23 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254397#comment-17254397 ] Zhenqiu Huang edited comment on FLINK-20461 at 12/24/20, 4:21 AM: --

[jira] [Commented] (FLINK-20461) YARNFileReplicationITCase.testPerJobModeWithDefaultFileReplication

2020-12-23 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254397#comment-17254397 ] Zhenqiu Huang commented on FLINK-20461: --- [~rmetzger] The log in Azure is exactly the same as what

[jira] [Commented] (FLINK-20505) Yarn provided lib does not work with http paths.

2020-12-23 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254395#comment-17254395 ] Zhenqiu Huang commented on FLINK-20505: --- [~zoucao] Looks like providedLibDirs assume all of the

[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager doesn't use maximum-failed-containers as limit of resource acquirement

2020-12-20 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252628#comment-17252628 ] Zhenqiu Huang commented on FLINK-10868: --- After looking into the Kubernetes driver implementation,

[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager doesn't use maximum-failed-containers as limit of resource acquirement

2020-12-20 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252354#comment-17252354 ] Zhenqiu Huang commented on FLINK-10868: --- [~xintongsong] I updated the PR accordingly. As the jira

[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager doesn't use maximum-failed-containers as limit of resource acquirement

2020-12-19 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252334#comment-17252334 ] Zhenqiu Huang commented on FLINK-10868: --- [~xintongsong] "record the failure for all containers

[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager doesn't use maximum-failed-containers as limit of resource acquirement

2020-12-17 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251539#comment-17251539 ] Zhenqiu Huang commented on FLINK-10868: --- Hi [~xintongsong] I just found you commented on the jira

[jira] [Comment Edited] (FLINK-20505) Yarn provided lib does not work with http paths.

2020-12-10 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247626#comment-17247626 ] Zhenqiu Huang edited comment on FLINK-20505 at 12/11/20, 4:41 AM: --

[jira] [Commented] (FLINK-20505) Yarn provided lib does not work with http paths.

2020-12-10 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247626#comment-17247626 ] Zhenqiu Huang commented on FLINK-20505: --- [~xintongsong] Sorry for the late response. We use HTTP

[jira] [Commented] (FLINK-20461) YARNFileReplicationITCase.testPerJobModeWithDefaultFileReplication

2020-12-06 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244951#comment-17244951 ] Zhenqiu Huang commented on FLINK-20461: --- [~hxbks2ks] I checked in master. Both test cases of

[jira] [Commented] (FLINK-20505) Yarn provided lib does not work with http paths.

2020-12-06 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244942#comment-17244942 ] Zhenqiu Huang commented on FLINK-20505: --- It should not be a flink bug. It is just missing the

[jira] [Commented] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

2020-11-22 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236877#comment-17236877 ] Zhenqiu Huang commented on FLINK-14055: --- [~twalthr] I have some time to work on it this week. Will

[jira] [Commented] (FLINK-20248) `ParquetSchemaConverter` can not convert Array type to parquet Type

2020-11-22 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236876#comment-17236876 ] Zhenqiu Huang commented on FLINK-20248: --- [~zouyunhe] I created a PR to fix it. Would you please

[jira] [Commented] (FLINK-20248) `ParquetSchemaConverter` can not convert Array type to parquet Type

2020-11-19 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235717#comment-17235717 ] Zhenqiu Huang commented on FLINK-20248: --- [~zouyunhe] Thanks for reporting the issue. It is kind of

[jira] [Created] (FLINK-20054) 3 Level List is not supported in ParquetInputFormat

2020-11-08 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-20054: - Summary: 3 Level List is not supported in ParquetInputFormat Key: FLINK-20054 URL: https://issues.apache.org/jira/browse/FLINK-20054 Project: Flink Issue

[jira] [Commented] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

2020-07-15 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158763#comment-17158763 ] Zhenqiu Huang commented on FLINK-14055: --- [~phoenixjiangnan] [~twalthr] I am going to add this

[jira] [Commented] (FLINK-15416) Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel

2020-06-19 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140649#comment-17140649 ] Zhenqiu Huang commented on FLINK-15416: --- [~roman_khachatryan] Good question. Link doesn't bind to

[jira] [Closed] (FLINK-14982) YARN IT Test Case log config is mistakenly disabled

2020-05-19 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang closed FLINK-14982. - Resolution: Fixed > YARN IT Test Case log config is mistakenly disabled >

[jira] [Commented] (FLINK-14982) YARN IT Test Case log config is mistakenly disabled

2020-05-19 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111330#comment-17111330 ] Zhenqiu Huang commented on FLINK-14982: --- [~fly_in_gis] [~trohrmann] Sorry for the late reply.

[jira] [Commented] (FLINK-15416) Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel

2020-03-30 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071305#comment-17071305 ] Zhenqiu Huang commented on FLINK-15416: --- [~pnowojski] I updated the PR accordingly. Would you

[jira] [Commented] (FLINK-15416) Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel

2020-03-27 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068980#comment-17068980 ] Zhenqiu Huang commented on FLINK-15416: --- [~pnowojski] I created a PR would you please take a

[jira] [Updated] (FLINK-16005) Support yarn and hadoop config override

2020-03-26 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-16005: -- Summary: Support yarn and hadoop config override (was: Propagate yarn.application.classpath

[jira] [Commented] (FLINK-15416) Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel

2020-03-26 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068086#comment-17068086 ] Zhenqiu Huang commented on FLINK-15416: --- [~pnowojski] I think it can be a config to let users to

[jira] [Commented] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-03-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051846#comment-17051846 ] Zhenqiu Huang commented on FLINK-16005: --- [~trohrmann][~fly_in_gis] We are on the same page now.

[jira] [Commented] (FLINK-14837) Support Function DDL in TableEnvironment

2020-03-03 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050383#comment-17050383 ] Zhenqiu Huang commented on FLINK-14837: --- [~yesorno] Yes, it is already shipped in release 1.10.

[jira] [Commented] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-03-02 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049461#comment-17049461 ] Zhenqiu Huang commented on FLINK-16005: --- [~trohrmann] Yes you are right.

[jira] [Commented] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-02-24 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043708#comment-17043708 ] Zhenqiu Huang commented on FLINK-16005: --- [~trohrmann] I think we can leverage the

[jira] [Commented] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-02-19 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040528#comment-17040528 ] Zhenqiu Huang commented on FLINK-16005: --- [~trohrmann] I feel specifying the yarn config key

[jira] [Commented] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-02-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039261#comment-17039261 ] Zhenqiu Huang commented on FLINK-16005: --- [~fly_in_gis] Good suggestion. It is similar with

[jira] [Commented] (FLINK-16006) Add host blacklist support for Flink YarnResourceManager

2020-02-17 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038672#comment-17038672 ] Zhenqiu Huang commented on FLINK-16006: --- [~rmetzger] Thanks for the feedback. blocklist should be

[jira] [Commented] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-02-16 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038101#comment-17038101 ] Zhenqiu Huang commented on FLINK-16005: --- [~fly_in_gis] Spark actually support the end to end

[jira] [Created] (FLINK-16006) Add host blacklist support for Flink YarnResourceManager

2020-02-11 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-16006: - Summary: Add host blacklist support for Flink YarnResourceManager Key: FLINK-16006 URL: https://issues.apache.org/jira/browse/FLINK-16006 Project: Flink

[jira] [Created] (FLINK-16005) Propagate yarn.application.classpath from client to TaskManager Classpath

2020-02-11 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-16005: - Summary: Propagate yarn.application.classpath from client to TaskManager Classpath Key: FLINK-16005 URL: https://issues.apache.org/jira/browse/FLINK-16005 Project:

[jira] [Commented] (FLINK-12343) Allow set file.replication in Yarn Configuration

2020-01-30 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027222#comment-17027222 ] Zhenqiu Huang commented on FLINK-12343: --- [~trohrmann] I created a new PR for this ticket. Please

[jira] [Created] (FLINK-15768) Consolidate executor related class into same module in flink-clients

2020-01-24 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-15768: - Summary: Consolidate executor related class into same module in flink-clients Key: FLINK-15768 URL: https://issues.apache.org/jira/browse/FLINK-15768 Project:

[jira] [Updated] (FLINK-15768) Consolidate executor related class into same module in flink-clients

2020-01-24 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-15768: -- Priority: Minor (was: Major) > Consolidate executor related class into same module in

[jira] [Commented] (FLINK-15644) Add support for SQL query validation

2020-01-17 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018217#comment-17018217 ] Zhenqiu Huang commented on FLINK-15644: --- It is a very useful feature. Looking forward to it. >

[jira] [Commented] (FLINK-15126) migrate "show functions" from sql cli to sql parser

2020-01-14 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015275#comment-17015275 ] Zhenqiu Huang commented on FLINK-15126: --- [~phoenixjiangnan] I will start to work on it. Is there

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2020-01-14 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015197#comment-17015197 ] Zhenqiu Huang commented on FLINK-11899: --- [~lzljs3620320] It looks like you already finished the

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2020-01-13 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014906#comment-17014906 ] Zhenqiu Huang commented on FLINK-11899: --- [~lzljs3620320] I want to leverage existing

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2020-01-11 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013666#comment-17013666 ] Zhenqiu Huang commented on FLINK-11899: --- [~lzljs3620320] it looks all of the vector related

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2020-01-09 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012157#comment-17012157 ] Zhenqiu Huang commented on FLINK-11899: --- [~phoenixjiangnan][~ykt836] I am working on some

[jira] [Commented] (FLINK-8497) KafkaConsumer throws NPE if topic doesn't exist

2020-01-05 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008533#comment-17008533 ] Zhenqiu Huang commented on FLINK-8497: -- [~tzulitai] It is obviously a null point exception thrown

[jira] [Commented] (FLINK-15416) Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel

2019-12-27 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004273#comment-17004273 ] Zhenqiu Huang commented on FLINK-15416: --- [~pnowojski] Would you please review this ticket? If it

[jira] [Created] (FLINK-15416) Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel

2019-12-26 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-15416: - Summary: Add Retry Mechanism for PartitionRequestClientFactory.ConnectingChannel Key: FLINK-15416 URL: https://issues.apache.org/jira/browse/FLINK-15416 Project:

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2019-12-10 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992740#comment-16992740 ] Zhenqiu Huang commented on FLINK-11899: --- [~ykt836] Sure. I will follow what is achieved in ORC. >

[jira] [Commented] (FLINK-14953) Parquet table source should use schema type to build FilterPredicate

2019-12-09 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992190#comment-16992190 ] Zhenqiu Huang commented on FLINK-14953: --- [~ykt836] Would you please help to merge this PR

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2019-12-09 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992133#comment-16992133 ] Zhenqiu Huang commented on FLINK-11899: --- [~lzljs3620320][~ykt836] As I am maintaining

[jira] [Created] (FLINK-15165) Flink Hive Upsert Support

2019-12-09 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-15165: - Summary: Flink Hive Upsert Support Key: FLINK-15165 URL: https://issues.apache.org/jira/browse/FLINK-15165 Project: Flink Issue Type: Wish

[jira] [Updated] (FLINK-15164) Introduce ParquetColumnarRowSplitReader to parquet format

2019-12-09 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-15164: -- Description: With ParquetColumnarRowSplitReader support, the hive connector can directly read

[jira] [Created] (FLINK-15164) Introduce ParquetColumnarRowSplitReader to parquet format

2019-12-09 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-15164: - Summary: Introduce ParquetColumnarRowSplitReader to parquet format Key: FLINK-15164 URL: https://issues.apache.org/jira/browse/FLINK-15164 Project: Flink

[jira] [Commented] (FLINK-14906) create and drop temp system functions from DDL to FunctionCatalog

2019-12-07 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990543#comment-16990543 ] Zhenqiu Huang commented on FLINK-14906: --- [~phoenixjiangnan] We should throw validation exception

[jira] [Commented] (FLINK-14953) Parquet table source should use schema type to build FilterPredicate

2019-12-03 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987009#comment-16987009 ] Zhenqiu Huang commented on FLINK-14953: --- [~danny0405] Would you please help to review this PR?

[jira] [Updated] (FLINK-14912) register, drop, and alter catalog functions from DDL via catalog

2019-12-02 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14912: -- External issue URL: https://github.com/apache/flink/pull/10388 Labels:

[jira] [Updated] (FLINK-14953) Parquet table source should use schema type to build FilterPredicate

2019-11-30 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14953: -- Created pull request. https://github.com/apache/flink/pull/10371 > Parquet table source should

[jira] [Created] (FLINK-14982) YARN IT Test Case log config is mistakenly disabled

2019-11-27 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14982: - Summary: YARN IT Test Case log config is mistakenly disabled Key: FLINK-14982 URL: https://issues.apache.org/jira/browse/FLINK-14982 Project: Flink Issue

[jira] [Updated] (FLINK-14953) Parquet table source should use schema type to build FilterPredicate

2019-11-26 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14953: -- Description: The issue happens when the data type of value in predicate inferred from SQL

[jira] [Created] (FLINK-14953) Parquet table source should use schema type to build FilterPredicate

2019-11-26 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14953: - Summary: Parquet table source should use schema type to build FilterPredicate Key: FLINK-14953 URL: https://issues.apache.org/jira/browse/FLINK-14953 Project:

[jira] [Updated] (FLINK-14906) Add function related method in CatalogManager

2019-11-21 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14906: -- Description: 1) Add a temporary function hashmap to store temporary functions 2) Add create,

[jira] [Updated] (FLINK-14906) Add function related method in CatalogManager

2019-11-21 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14906: -- Description: 1) Add a temporary function hashmap to store temporary functions 2) Add create,

[jira] [Created] (FLINK-14906) Add function related method in CatalogManager

2019-11-21 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14906: - Summary: Add function related method in CatalogManager Key: FLINK-14906 URL: https://issues.apache.org/jira/browse/FLINK-14906 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-14841) Add create and drop function DDL in parser

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976692#comment-16976692 ] Zhenqiu Huang edited comment on FLINK-14841 at 11/18/19 5:06 PM: - The PR

[jira] [Commented] (FLINK-14841) Add create and drop function DDL in parser

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976692#comment-16976692 ] Zhenqiu Huang commented on FLINK-14841: --- The PR for this ticket

[jira] [Updated] (FLINK-14841) Add create and drop function DDL in parser

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14841: -- Labels: table-api (was: ) > Add create and drop function DDL in parser >

[jira] [Commented] (FLINK-14841) Add create and drop function DDL in parser

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976689#comment-16976689 ] Zhenqiu Huang commented on FLINK-14841: --- [~dwysakowicz] [~rmetzger] It is a sub ticket of support

[jira] [Created] (FLINK-14841) Add create and drop function DDL in parser

2019-11-18 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14841: - Summary: Add create and drop function DDL in parser Key: FLINK-14841 URL: https://issues.apache.org/jira/browse/FLINK-14841 Project: Flink Issue Type:

[jira] [Updated] (FLINK-7151) Support function DDL

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-7151: - Summary: Support function DDL (was: Add create and drop function DDL in SQL Parser) > Support

[jira] [Updated] (FLINK-7151) Add create and drop function DDL in SQL Parser

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-7151: - Summary: Add create and drop function DDL in SQL Parser (was: Add a basic function SQL DDL) >

[jira] [Created] (FLINK-14837) Support Function DDL in TableEnvironment

2019-11-18 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14837: - Summary: Support Function DDL in TableEnvironment Key: FLINK-14837 URL: https://issues.apache.org/jira/browse/FLINK-14837 Project: Flink Issue Type:

[jira] [Updated] (FLINK-14711) Add Alter Function and Show Functions in SQL Parser

2019-11-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated FLINK-14711: -- Summary: Add Alter Function and Show Functions in SQL Parser (was: Create Alter Function and

[jira] [Commented] (FLINK-14711) Create Alter Function and Show Functions DDL

2019-11-16 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975932#comment-16975932 ] Zhenqiu Huang commented on FLINK-14711: --- [~Terry1897] [~phoenixjiangnan] [~xuefuz] Please this PR.

[jira] [Commented] (FLINK-7151) Add a basic function SQL DDL

2019-11-16 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975904#comment-16975904 ] Zhenqiu Huang commented on FLINK-7151: -- [~Terry1897] [~phoenixjiangnan] [~xuefuz] Would you please

[jira] [Created] (FLINK-14711) Create Alter Function and Show Functions DDL

2019-11-11 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14711: - Summary: Create Alter Function and Show Functions DDL Key: FLINK-14711 URL: https://issues.apache.org/jira/browse/FLINK-14711 Project: Flink Issue Type:

[jira] [Commented] (FLINK-7151) Add a basic function SQL DDL

2019-10-15 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952041#comment-16952041 ] Zhenqiu Huang commented on FLINK-7151: -- [~twalthr][~phoenixjiangnan][~jark][~dian.fu] I created a

[jira] [Commented] (FLINK-7151) Add a basic function SQL DDL

2019-10-13 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950699#comment-16950699 ] Zhenqiu Huang commented on FLINK-7151: -- [~dian.fu] Thanks for the input. I think language definitely

[jira] [Commented] (FLINK-7151) Add a basic function SQL DDL

2019-10-10 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948706#comment-16948706 ] Zhenqiu Huang commented on FLINK-7151: -- [~twalthr][~phoenixjiangnan] I can't agree more. After

[jira] [Comment Edited] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

2019-10-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944601#comment-16944601 ] Zhenqiu Huang edited comment on FLINK-14055 at 10/4/19 3:43 PM: [~50man]

[jira] [Commented] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

2019-10-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944601#comment-16944601 ] Zhenqiu Huang commented on FLINK-14055: --- [~50man] If you already finished the jar registration in

[jira] [Commented] (FLINK-7151) Add a basic function SQL DDL

2019-10-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944599#comment-16944599 ] Zhenqiu Huang commented on FLINK-7151: -- [~twalthr] Thanks for bringing this up. I join the

[jira] [Commented] (FLINK-14055) Add advanced function DDL syntax "USING JAR/FILE/ACHIVE"

2019-10-04 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944598#comment-16944598 ] Zhenqiu Huang commented on FLINK-14055: --- [~twalthr] Sure. I can't agree more. I think we should

[jira] [Commented] (FLINK-7151) Add a basic function SQL DDL

2019-10-02 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942925#comment-16942925 ] Zhenqiu Huang commented on FLINK-7151: -- [~phoenixjiangnan][~danny0405][~suez1224] Resolved comments

[jira] [Created] (FLINK-14215) Add Docs for TM and JM Environment Variable Setting

2019-09-25 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-14215: - Summary: Add Docs for TM and JM Environment Variable Setting Key: FLINK-14215 URL: https://issues.apache.org/jira/browse/FLINK-14215 Project: Flink Issue

[jira] [Commented] (FLINK-14033) Distributed caches are not registered in Yarn Per Job Cluster Mode

2019-09-18 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933057#comment-16933057 ] Zhenqiu Huang commented on FLINK-14033: --- [~trohrmann][~fly_in_gis] Would you please take a look at

[jira] [Commented] (FLINK-14033) Distributed caches are not registered in Yarn Per Job Cluster Mode

2019-09-17 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931732#comment-16931732 ] Zhenqiu Huang commented on FLINK-14033: --- Agree. It is not for a jar. The issue happens on another

<    1   2   3   >