[jira] [Commented] (FLINK-13437) Add Hive SQL E2E test

2019-12-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994265#comment-16994265 ] Jingsong Lee commented on FLINK-13437: -- [~twalthr] is right. Unfortunately, without E2E test, we

[jira] [Comment Edited] (FLINK-13437) Add Hive SQL E2E test

2019-12-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994265#comment-16994265 ] Jingsong Lee edited comment on FLINK-13437 at 12/12/19 6:13 AM:

[jira] [Updated] (FLINK-15185) Hive sink can not run in standalone mode

2019-12-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15185: - Description: Now in hive HadoopFileSystemFactory, we use 

[jira] [Created] (FLINK-14543) Support partition for temporary table

2019-10-28 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14543: Summary: Support partition for temporary table Key: FLINK-14543 URL: https://issues.apache.org/jira/browse/FLINK-14543 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-14517) Handle escape characters for partition path

2019-10-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14517: - Fix Version/s: (was: 1.10.0) > Handle escape characters for partition path >

[jira] [Created] (FLINK-14517) Handle escape characters for partition path

2019-10-24 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14517: Summary: Handle escape characters for partition path Key: FLINK-14517 URL: https://issues.apache.org/jira/browse/FLINK-14517 Project: Flink Issue Type:

[jira] [Commented] (FLINK-14135) Introduce vectorized orc InputFormat for blink runtime

2019-10-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961663#comment-16961663 ] Jingsong Lee commented on FLINK-14135: -- [~jark] Can you assign this ticket to me? > Introduce

[jira] [Created] (FLINK-14552) Enable partition statistics in blink planner

2019-10-29 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14552: Summary: Enable partition statistics in blink planner Key: FLINK-14552 URL: https://issues.apache.org/jira/browse/FLINK-14552 Project: Flink Issue Type:

[jira] [Updated] (FLINK-14512) Introduce listPartitionsByFilter to Catalog

2019-10-23 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14512: - Fix Version/s: 1.10.0 > Introduce listPartitionsByFilter to Catalog >

[jira] [Created] (FLINK-14513) Implement listPartitionsByFilter to HiveCatalog

2019-10-23 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14513: Summary: Implement listPartitionsByFilter to HiveCatalog Key: FLINK-14513 URL: https://issues.apache.org/jira/browse/FLINK-14513 Project: Flink Issue Type:

[jira] [Created] (FLINK-14515) Implement LimitableTableSource for FileSystemTableFactory

2019-10-23 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14515: Summary: Implement LimitableTableSource for FileSystemTableFactory Key: FLINK-14515 URL: https://issues.apache.org/jira/browse/FLINK-14515 Project: Flink

[jira] [Updated] (FLINK-14249) Rework table partition support

2019-10-23 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14249: - Description: A partition is a division of a logical database or its constituent elements into

[jira] [Created] (FLINK-14512) Introduce listPartitionsByFilter to Catalog

2019-10-23 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14512: Summary: Introduce listPartitionsByFilter to Catalog Key: FLINK-14512 URL: https://issues.apache.org/jira/browse/FLINK-14512 Project: Flink Issue Type:

[jira] [Updated] (FLINK-14849) Can not submit job when use hive connector

2019-11-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14849: - Description: {code:java} With: org.apache.hive hive-exec 3.1.1 Caused by:

[jira] [Created] (FLINK-14849) Can not submit job when use hive connector

2019-11-18 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14849: Summary: Can not submit job when use hive connector Key: FLINK-14849 URL: https://issues.apache.org/jira/browse/FLINK-14849 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-14848) BaseRowSerializer.toBinaryRow wrongly process null for objects with variable-length part

2019-11-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977162#comment-16977162 ] Jingsong Lee commented on FLINK-14848: -- Hi [~docete], I think you should explain it clearer. And

[jira] [Commented] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978019#comment-16978019 ] Jingsong Lee commented on FLINK-14845: -- [~sewen] Sorry for misunderstanding. What I want to say is

[jira] [Comment Edited] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977096#comment-16977096 ] Jingsong Lee edited comment on FLINK-14845 at 11/20/19 2:10 AM: Big +1

[jira] [Commented] (FLINK-13943) Provide api to convert flink table to java List (e.g. Table#collect)

2019-11-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977071#comment-16977071 ] Jingsong Lee commented on FLINK-13943: -- +1 to use {{DataStreamUtil#collect}}. Agree with Jark, for

[jira] [Commented] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977096#comment-16977096 ] Jingsong Lee commented on FLINK-14845: -- Big +1 for this feature. There will be a lot of shuffles

[jira] [Updated] (FLINK-14875) Blink planner should pass the right ExecutionConfig to the creation of serializer

2019-11-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14875: - Summary: Blink planner should pass the right ExecutionConfig to the creation of serializer

[jira] [Commented] (FLINK-14875) Set Unmodifiable collection serializer of Kryo in Flink code

2019-11-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978311#comment-16978311 ] Jingsong Lee commented on FLINK-14875: -- Hi [~jinyu.zj], I think there are some methods to set

[jira] [Commented] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978175#comment-16978175 ] Jingsong Lee commented on FLINK-14845: -- Thanks [~kevin.cyj] A little confuse about point 8, Are

[jira] [Commented] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978343#comment-16978343 ] Jingsong Lee commented on FLINK-14845: -- > doesn't Blink work on batches of records? Couldn't the

[jira] [Commented] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978257#comment-16978257 ] Jingsong Lee commented on FLINK-14845: -- [~pnowojski] put forward a good thought for the future. I

[jira] [Created] (FLINK-14860) Provide a new InputSplitAssigner that consider page cache utilization ratio

2019-11-19 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14860: Summary: Provide a new InputSplitAssigner that consider page cache utilization ratio Key: FLINK-14860 URL: https://issues.apache.org/jira/browse/FLINK-14860 Project:

[jira] [Updated] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-11-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14845: - Parent: FLINK-14133 Issue Type: Sub-task (was: Improvement) > Introduce data

[jira] [Updated] (FLINK-14860) Provide a new InputSplitAssigner that consider page cache utilization ratio

2019-11-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14860: - Parent: FLINK-14133 Issue Type: Sub-task (was: New Feature) > Provide a new

[jira] [Updated] (FLINK-14249) Rework table partition support

2019-12-02 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14249: - Fix Version/s: (was: 1.10.0) > Rework table partition support >

[jira] [Closed] (FLINK-14387) Insert into catalog table failed when catalog table not implement table source factory

2019-12-02 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-14387. Resolution: Invalid > Insert into catalog table failed when catalog table not implement table >

[jira] [Created] (FLINK-15006) Add option to close shuffle when dynamic partition inserting

2019-12-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15006: Summary: Add option to close shuffle when dynamic partition inserting Key: FLINK-15006 URL: https://issues.apache.org/jira/browse/FLINK-15006 Project: Flink

[jira] [Closed] (FLINK-15002) Add catalog API to get partition by filter

2019-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-15002. > Add catalog API to get partition by filter > -- > >

[jira] [Resolved] (FLINK-15002) Add catalog API to get partition by filter

2019-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee resolved FLINK-15002. -- Resolution: Duplicate > Add catalog API to get partition by filter >

[jira] [Commented] (FLINK-15002) Add catalog API to get partition by filter

2019-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985792#comment-16985792 ] Jingsong Lee commented on FLINK-15002: -- Hi [~lirui] , this is duplicate to 

[jira] [Created] (FLINK-15003) Use embedded mode to improve hive test performance

2019-12-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15003: Summary: Use embedded mode to improve hive test performance Key: FLINK-15003 URL: https://issues.apache.org/jira/browse/FLINK-15003 Project: Flink Issue

[jira] [Commented] (FLINK-14872) Potential deadlock for task reading from blocking ResultPartition.

2019-11-21 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979921#comment-16979921 ] Jingsong Lee commented on FLINK-14872: -- Thanks [~kevin.cyj] and [~pnowojski], I provide some test 

[jira] [Commented] (FLINK-14924) CsvTableSource can not config empty column as null

2019-11-21 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979943#comment-16979943 ] Jingsong Lee commented on FLINK-14924: -- FYI: `CsvRowDeserializationSchema.Builder.setNullLiteral`.

[jira] [Commented] (FLINK-14924) CsvTableSource can not config empty column as null

2019-11-21 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979940#comment-16979940 ] Jingsong Lee commented on FLINK-14924: -- Just curious: I'm not sure if we should add `this empty

[jira] [Commented] (FLINK-14902) JDBCTableSource support AsyncLookupFunction

2019-11-21 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979912#comment-16979912 ] Jingsong Lee commented on FLINK-14902: -- Hi [~hailong wang], I am very glad you can have a try. As

[jira] [Commented] (FLINK-13702) BaseMapSerializerTest.testDuplicate fails on Travis

2019-10-31 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963897#comment-16963897 ] Jingsong Lee commented on FLINK-13702: -- Hi [~dwysakowicz] , I think maybe we don't need to make it

[jira] [Commented] (FLINK-13702) BaseMapSerializerTest.testDuplicate fails on Travis

2019-10-31 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963903#comment-16963903 ] Jingsong Lee commented on FLINK-13702: -- About BinaryGeneric: I have considered pass type

[jira] [Commented] (FLINK-13702) BaseMapSerializerTest.testDuplicate fails on Travis

2019-10-31 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963955#comment-16963955 ] Jingsong Lee commented on FLINK-13702: -- > There is one problem with entirely removing the

[jira] [Commented] (FLINK-14676) Introduce parallelism inference for InputFormatTableSource

2019-11-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972044#comment-16972044 ] Jingsong Lee commented on FLINK-14676: -- Hi [~jark], thanks for you explain. > let connectors to

[jira] [Created] (FLINK-14714) BytesHashMap should not warn invoking stack when it want to spill

2019-11-11 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14714: Summary: BytesHashMap should not warn invoking stack when it want to spill Key: FLINK-14714 URL: https://issues.apache.org/jira/browse/FLINK-14714 Project: Flink

[jira] [Updated] (FLINK-14710) Decide column nullability according to Hive constraints

2019-11-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14710: - Fix Version/s: 1.10.0 > Decide column nullability according to Hive constraints >

[jira] [Commented] (FLINK-11899) Introduce vectorized parquet InputFormat for blink runtime

2019-09-23 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935595#comment-16935595 ] Jingsong Lee commented on FLINK-11899: -- [~docete] We already has VectorizedColumnBatch and etc. We

[jira] [Commented] (FLINK-13869) Hive functions can not work in blink planner stream mode

2019-09-22 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935547#comment-16935547 ] Jingsong Lee commented on FLINK-13869: -- Still need fix, 1.9 should work, but master code has some

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-23 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935797#comment-16935797 ] Jingsong Lee commented on FLINK-12122: -- +1 to fix this issue,  In our batch job testing, slots

[jira] [Comment Edited] (FLINK-13740) TableAggregateITCase.testNonkeyedFlatAggregate failed on Travis

2019-09-25 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937657#comment-16937657 ] Jingsong Lee edited comment on FLINK-13740 at 9/25/19 12:20 PM: Hi

[jira] [Commented] (FLINK-13740) TableAggregateITCase.testNonkeyedFlatAggregate failed on Travis

2019-09-25 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937657#comment-16937657 ] Jingsong Lee commented on FLINK-13740: -- Hi [~hequn8128] and [~jark] , In my opinion, TypeSerializer

[jira] [Comment Edited] (FLINK-13740) TableAggregateITCase.testNonkeyedFlatAggregate failed on Travis

2019-09-25 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937657#comment-16937657 ] Jingsong Lee edited comment on FLINK-13740 at 9/25/19 11:51 AM: Hi

[jira] [Commented] (FLINK-13740) TableAggregateITCase.testNonkeyedFlatAggregate failed on Travis

2019-09-25 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937681#comment-16937681 ] Jingsong Lee commented on FLINK-13740: -- No, I mean use this BinaryGenericSerializer, this 

[jira] [Comment Edited] (FLINK-13740) TableAggregateITCase.testNonkeyedFlatAggregate failed on Travis

2019-09-25 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937681#comment-16937681 ] Jingsong Lee edited comment on FLINK-13740 at 9/25/19 12:21 PM: No, I

[jira] [Commented] (FLINK-14359) Create a module called flink-sql-connector-hbase to shade HBase

2019-10-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948166#comment-16948166 ] Jingsong Lee commented on FLINK-14359: -- [~openinx] Good~ feel free to take this ticket. > Create a

[jira] [Closed] (FLINK-14352) Dependencies section in Connect page of Table is broken

2019-10-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-14352. Resolution: Invalid > Dependencies section in Connect page of Table is broken >

[jira] [Commented] (FLINK-14352) Dependencies section in Connect page of Table is broken

2019-10-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948132#comment-16948132 ] Jingsong Lee commented on FLINK-14352: -- [~karmagyz] Ah.. you are right, unstable version has no 

[jira] [Created] (FLINK-14359) Create a module called flink-sql-connector-hbase to shade HBase

2019-10-09 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14359: Summary: Create a module called flink-sql-connector-hbase to shade HBase Key: FLINK-14359 URL: https://issues.apache.org/jira/browse/FLINK-14359 Project: Flink

[jira] [Created] (FLINK-14361) Decorrelate subQuery fail when multi correlate in project

2019-10-10 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14361: Summary: Decorrelate subQuery fail when multi correlate in project Key: FLINK-14361 URL: https://issues.apache.org/jira/browse/FLINK-14361 Project: Flink

[jira] [Created] (FLINK-14364) Allow comments fail when not ignore parse errors in CsvRowDeserializationSchema

2019-10-10 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14364: Summary: Allow comments fail when not ignore parse errors in CsvRowDeserializationSchema Key: FLINK-14364 URL: https://issues.apache.org/jira/browse/FLINK-14364

[jira] [Commented] (FLINK-14364) Allow comments fail when not ignore parse errors in CsvRowDeserializationSchema

2019-10-10 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949111#comment-16949111 ] Jingsong Lee commented on FLINK-14364: -- CC: [~twalthr] > Allow comments fail when not ignore parse

[jira] [Commented] (FLINK-14364) Allow comments fail when not ignore parse errors in CsvRowDeserializationSchema

2019-10-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949243#comment-16949243 ] Jingsong Lee commented on FLINK-14364: -- {code:java} String string = "#Test,12,Test"; final

[jira] [Updated] (FLINK-14254) Introduce FileSystemOutputFormat for batch

2019-10-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14254: - Summary: Introduce FileSystemOutputFormat for batch (was: Introduce BatchFileSystemSink) >

[jira] [Updated] (FLINK-14254) Introduce FileSystemOutputFormat for batch

2019-10-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14254: - Description: Introduce FileSystemOutputFormat to support all table file system connector with

[jira] [Created] (FLINK-14352) Dependencies section in Connect page of Table is broken

2019-10-09 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14352: Summary: Dependencies section in Connect page of Table is broken Key: FLINK-14352 URL: https://issues.apache.org/jira/browse/FLINK-14352 Project: Flink

[jira] [Created] (FLINK-14381) Partition field names should be got from CatalogTable instead of source/sink

2019-10-11 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14381: Summary: Partition field names should be got from CatalogTable instead of source/sink Key: FLINK-14381 URL: https://issues.apache.org/jira/browse/FLINK-14381

[jira] [Commented] (FLINK-14387) Insert into catalog table failed when catalog table not implement table source factory

2019-10-14 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950741#comment-16950741 ] Jingsong Lee commented on FLINK-14387: -- CC: [~jark] [~danny0405] > Insert into catalog table

[jira] [Created] (FLINK-14387) Insert into catalog table failed when catalog table not implement table source factory

2019-10-14 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-14387: Summary: Insert into catalog table failed when catalog table not implement table source factory Key: FLINK-14387 URL: https://issues.apache.org/jira/browse/FLINK-14387

[jira] [Commented] (FLINK-14266) Introduce RowCsvInputFormat to new CSV module

2019-10-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949378#comment-16949378 ] Jingsong Lee commented on FLINK-14266: -- Thanks [~fhueske] , I think there are two choices: #

[jira] [Comment Edited] (FLINK-14266) Introduce RowCsvInputFormat to new CSV module

2019-10-11 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949378#comment-16949378 ] Jingsong Lee edited comment on FLINK-14266 at 10/11/19 11:27 AM: - Thanks

[jira] [Commented] (FLINK-15313) Can not insert decimal with precision into sink using TypeInformation

2019-12-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998988#comment-16998988 ] Jingsong Lee commented on FLINK-15313: -- CC: [~jark] > Can not insert decimal with precision into

[jira] [Created] (FLINK-15313) Can not insert decimal with precision into sink using TypeInformation

2019-12-18 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15313: Summary: Can not insert decimal with precision into sink using TypeInformation Key: FLINK-15313 URL: https://issues.apache.org/jira/browse/FLINK-15313 Project: Flink

[jira] [Created] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-18 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15311: Summary: Lz4BlockCompressionFactory should use native compressor instead of java unsafe Key: FLINK-15311 URL: https://issues.apache.org/jira/browse/FLINK-15311

[jira] [Commented] (FLINK-15348) Fix orc optimization for version less than 2.3 by introducing orc shim

2019-12-22 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002063#comment-17002063 ] Jingsong Lee commented on FLINK-15348: -- PR: [https://github.com/apache/flink/pull/10618] > Fix orc

[jira] [Closed] (FLINK-12844) Use default conversion class LocalDate/LocalTime/LocalDateTime for DateType/TimeType/TimestampType in blink

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-12844. Resolution: Fixed > Use default conversion class LocalDate/LocalTime/LocalDateTime for >

[jira] [Closed] (FLINK-13238) Reduce blink planner's testing time

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-13238. Resolution: Fixed > Reduce blink planner's testing time > --- > >

[jira] [Commented] (FLINK-11951) Enhance UserDefinedFunction interface to allow more user defined types

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000737#comment-17000737 ] Jingsong Lee commented on FLINK-11951: -- It will resolved by new Type inference of UDF, so close it

[jira] [Closed] (FLINK-13381) BinaryHashTableTest and BinaryExternalSorterTest is crashed on Travis

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-13381. Resolution: Fixed > BinaryHashTableTest and BinaryExternalSorterTest is crashed on Travis >

[jira] [Closed] (FLINK-13330) Remove unnecessary tests to reduce testing time in blink

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-13330. Resolution: Invalid > Remove unnecessary tests to reduce testing time in blink >

[jira] [Closed] (FLINK-13201) Unstable sql time udf test

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-13201. Resolution: Fixed > Unstable sql time udf test > -- > >

[jira] [Closed] (FLINK-11951) Enhance UserDefinedFunction interface to allow more user defined types

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-11951. Resolution: Invalid > Enhance UserDefinedFunction interface to allow more user defined types >

[jira] [Updated] (FLINK-15015) add documentation for using HiveVectorizedOrcSplitReader in hive connector

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15015: - Component/s: Connectors / Hive > add documentation for using HiveVectorizedOrcSplitReader in

[jira] [Closed] (FLINK-15015) add documentation for using HiveVectorizedOrcSplitReader in hive connector

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-15015. Resolution: Fixed > add documentation for using HiveVectorizedOrcSplitReader in hive connector >

[jira] [Commented] (FLINK-15015) add documentation for using HiveVectorizedOrcSplitReader in hive connector

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000739#comment-17000739 ] Jingsong Lee commented on FLINK-15015: -- Fixed in 

[jira] [Closed] (FLINK-12270) SortDistinctAggregateITCase fails on Travis

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-12270. Resolution: Fixed > SortDistinctAggregateITCase fails on Travis >

[jira] [Created] (FLINK-15344) Update limitations in hive udf document

2019-12-20 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15344: Summary: Update limitations in hive udf document Key: FLINK-15344 URL: https://issues.apache.org/jira/browse/FLINK-15344 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998943#comment-16998943 ] Jingsong Lee commented on FLINK-15311: -- CC: [~kevin.cyj] > Lz4BlockCompressionFactory should use

[jira] [Updated] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-18 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15311: - Description: According to: [https://lz4.github.io/lz4-java/1.7.0/lz4-compression-benchmark/]

[jira] [Updated] (FLINK-15287) Vectorized orc reader fails with Hive 2.0.1

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15287: - Priority: Blocker (was: Major) > Vectorized orc reader fails with Hive 2.0.1 >

[jira] [Updated] (FLINK-15287) Vectorized orc reader fails with Hive 2.0.1

2019-12-20 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15287: - Priority: Major (was: Blocker) > Vectorized orc reader fails with Hive 2.0.1 >

[jira] [Updated] (FLINK-14764) The final Explicit conversion matrix we should support in our planner

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14764: - Issue Type: Task (was: Improvement) > The final Explicit conversion matrix we should support

[jira] [Updated] (FLINK-14849) Can not submit job when use hive connector

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14849: - Component/s: Documentation > Can not submit job when use hive connector >

[jira] [Updated] (FLINK-14849) Documentation wrong hive dependents

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14849: - Summary: Documentation wrong hive dependents (was: Can not submit job when use hive connector)

[jira] [Updated] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15311: - Priority: Blocker (was: Critical) > Lz4BlockCompressionFactory should use native compressor

[jira] [Updated] (FLINK-14386) Support computed column for create table statement

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14386: - Priority: Major (was: Blocker) > Support computed column for create table statement >

[jira] [Updated] (FLINK-14764) The final Explicit conversion matrix we should support in our planner

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14764: - Priority: Major (was: Blocker) > The final Explicit conversion matrix we should support in our

[jira] [Commented] (FLINK-15326) Add document description for DECIMAL(38, 18) when the sink table uses json schema

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1644#comment-1644 ] Jingsong Lee commented on FLINK-15326: -- Thanks [~hehuiyuan] for reporting, we will fix this in 

[jira] [Commented] (FLINK-15290) Need a way to turn off vectorized orc reader for SQL CLI

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1605#comment-1605 ] Jingsong Lee commented on FLINK-15290: -- I think yes, this is a temporary way. In the future, I

[jira] [Commented] (FLINK-15310) A timestamp result get by a select sql and a csvsink sql is different

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1639#comment-1639 ] Jingsong Lee commented on FLINK-15310: -- This is duplicated to FLINK-15313 , so I mark this a major,

[jira] [Updated] (FLINK-15310) A timestamp result get by a select sql and a csvsink sql is different

2019-12-19 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15310: - Priority: Major (was: Critical) > A timestamp result get by a select sql and a csvsink sql is

[jira] [Updated] (FLINK-15066) Cannot run multiple `insert into csvTable values ()`

2019-12-24 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-15066: - Fix Version/s: (was: 1.10.0) 1.11.0 > Cannot run multiple `insert into

<    1   2   3   4   5   6   7   8   9   10   >