[jira] [Updated] (KYLIN-1768) NDCuboidMapper throws ArrayIndexOutOfBoundsException when dimension is fixed length encoded to more than 256 bytes

2016-06-06 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1768: - Description: When user defined a dimension which is fixed length encoded to more than 256 bytes, "Build

[jira] [Created] (KYLIN-1768) NDCuboidMapper throws ArrayIndexOutOfBoundsException when dimension is fixed length encoded to more than 256 bytes

2016-06-06 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1768: Summary: NDCuboidMapper throws ArrayIndexOutOfBoundsException when dimension is fixed length encoded to more than 256 bytes Key: KYLIN-1768 URL:

[jira] [Created] (KYLIN-1770) Can't use PreparedStatement with "between and" expression

2016-06-07 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1770: Summary: Can't use PreparedStatement with "between and" expression Key: KYLIN-1770 URL: https://issues.apache.org/jira/browse/KYLIN-1770 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-1752) Add an option to fail cube build job when source table is empty

2016-06-06 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1752: - Attachment: KYLIN-1752.patch.1 uploaded KYLIN-1752.patch.1 according to Shaofeng's suggestion. > Add an

[jira] [Commented] (KYLIN-1677) Distribute source data by certain columns when creating flat table

2016-06-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319955#comment-15319955 ] Dayue Gao commented on KYLIN-1677: -- Hi Shaofeng, Here's the test result of using hive view as fact

[jira] [Commented] (KYLIN-1758) createLookupHiveViewMaterializationStep will create intermediate table for fact table

2016-06-03 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315319#comment-15315319 ] Dayue Gao commented on KYLIN-1758: -- Hi Shaofeng, Please also note that

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-25 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300145#comment-15300145 ] Dayue Gao commented on KYLIN-1656: -- Hi Shaofeng, We choose 500K to increase parallelism and reduce total

[jira] [Commented] (KYLIN-1677) Distribute source data by certain columns when creating flat table

2016-05-25 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300164#comment-15300164 ] Dayue Gao commented on KYLIN-1677: -- Thanks for the reply. I'll test master branch on hive view tomorrow

[jira] [Updated] (KYLIN-1752) Add an option to fail cube build job when source table is empty

2016-06-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1752: - Description: For non-incremental build cube, it's valuable to be able to fail the build job as long as

[jira] [Updated] (KYLIN-1752) Add an option to fail cube build job when source table is empty

2016-06-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1752: - Attachment: KYLIN-1752.patch Here's the patch, tested internally. [~Shaofengshi] Could you please take a

[jira] [Commented] (KYLIN-1706) Allow cube to override MR job configuration by properties

2016-06-04 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315482#comment-15315482 ] Dayue Gao commented on KYLIN-1706: -- This is one of the small but very helpful improvements I'd like to

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-31 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309184#comment-15309184 ] Dayue Gao commented on KYLIN-1656: -- Hi Shaofeng, {quote} did you observe the source file of the

[jira] [Created] (KYLIN-1752) Add an option to fail cube build job when source table is empty

2016-05-31 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1752: Summary: Add an option to fail cube build job when source table is empty Key: KYLIN-1752 URL: https://issues.apache.org/jira/browse/KYLIN-1752 Project: Kylin Issue

[jira] [Commented] (KYLIN-1657) Add new configuration kylin.job.mapreduce.min.reducer.number

2016-05-26 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303443#comment-15303443 ] Dayue Gao commented on KYLIN-1657: -- can we merge this? > Add new configuration

[jira] [Commented] (KYLIN-1694) make multiply coefficient configurable when estimating cuboid size

2016-05-26 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303446#comment-15303446 ] Dayue Gao commented on KYLIN-1694: -- can we merge this? > make multiply coefficient configurable when

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-06-01 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309376#comment-15309376 ] Dayue Gao commented on KYLIN-1656: -- no problem :-) > Improve performance of MRv2 engine by making each

[jira] [Commented] (KYLIN-1694) make multiply coefficient configurable when estimating cuboid size

2016-05-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284236#comment-15284236 ] Dayue Gao commented on KYLIN-1694: -- Hi shaofeng, we have cherry-picked that patch and verified it's not

[jira] [Commented] (KYLIN-1323) Improve performance of converting data to hfile

2016-05-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272072#comment-15272072 ] Dayue Gao commented on KYLIN-1323: -- Hi [~Shaofengshi], what's the progress of this on 1.5.x? > Improve

[jira] [Created] (KYLIN-1657) Add new configuration kylin.job.mapreduce.min.reducer.number

2016-05-05 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1657: Summary: Add new configuration kylin.job.mapreduce.min.reducer.number Key: KYLIN-1657 URL: https://issues.apache.org/jira/browse/KYLIN-1657 Project: Kylin Issue

[jira] [Updated] (KYLIN-1657) Add new configuration kylin.job.mapreduce.min.reducer.number

2016-05-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1657: - Attachment: KYLIN-1657.patch Added a new kylin configuration "kylin.job.mapreduce.min.reducer.number"

[jira] [Created] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-04 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1656: Summary: Improve performance of MRv2 engine by making each mapper handles a configured number of records Key: KYLIN-1656 URL: https://issues.apache.org/jira/browse/KYLIN-1656

[jira] [Updated] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1656: - Attachment: KYLIN-1656.patch Please review the patch. This adds a new kylin configuration named

[jira] [Updated] (KYLIN-1662) tableName got truncated during request mapping for /tables/tableName

2016-05-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1662: - Attachment: KYLIN-1662.patch attach patch. > tableName got truncated during request mapping for

[jira] [Commented] (KYLIN-1656) Improve performance of MRv2 engine by making each mapper handles a configured number of records

2016-05-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276344#comment-15276344 ] Dayue Gao commented on KYLIN-1656: -- Didn't get the time to create the branch, thank you Shaofeng! >

[jira] [Commented] (KYLIN-1898) Upgrade to Avatica 1.8 or higher

2016-07-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385511#comment-15385511 ] Dayue Gao commented on KYLIN-1898: -- I've relocated kylin-jdbc dependencies in KYLIN-1846, hopefully it

[jira] [Created] (KYLIN-1849) add basic search capability at model UI

2016-07-04 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1849: Summary: add basic search capability at model UI Key: KYLIN-1849 URL: https://issues.apache.org/jira/browse/KYLIN-1849 Project: Kylin Issue Type: New Feature

[jira] [Created] (KYLIN-1848) Can't sort cubes by any field in Web UI

2016-07-04 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1848: Summary: Can't sort cubes by any field in Web UI Key: KYLIN-1848 URL: https://issues.apache.org/jira/browse/KYLIN-1848 Project: Kylin Issue Type: Bug

[jira] [Updated] (KYLIN-1846) minimize dependencies of JDBC driver

2016-07-04 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-1846: - Attachment: KYLIN-1846.patch upload patch, which was tested and solved several classloading problems

[jira] [Commented] (KYLIN-1846) minimize dependencies of JDBC driver

2016-07-10 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370115#comment-15370115 ] Dayue Gao commented on KYLIN-1846: -- [~Shaofengshi] I committed 9c578e7 to shade httpcomponents. >

[jira] [Created] (KYLIN-1846) minimize dependencies of JDBC driver

2016-07-04 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-1846: Summary: minimize dependencies of JDBC driver Key: KYLIN-1846 URL: https://issues.apache.org/jira/browse/KYLIN-1846 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2437) collect number of bytes scanned to query metrics

2017-02-08 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2437: Summary: collect number of bytes scanned to query metrics Key: KYLIN-2437 URL: https://issues.apache.org/jira/browse/KYLIN-2437 Project: Kylin Issue Type:

[jira] [Created] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

2017-02-07 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2436: Summary: add a configuration knob to disable spilling of aggregation cache Key: KYLIN-2436 URL: https://issues.apache.org/jira/browse/KYLIN-2436 Project: Kylin

[jira] [Resolved] (KYLIN-2058) Make Kylin more resilient to bad queries

2017-02-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2058. -- Resolution: Fixed Fix Version/s: v1.6.0 There are still works to be done to defend Kylin against

[jira] [Closed] (KYLIN-1455) HBase ScanMetrics are not properly logged in query log

2017-02-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-1455. Resolution: Won't Fix > HBase ScanMetrics are not properly logged in query log >

[jira] [Created] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2438: Summary: replace scan threshold with max scan bytes Key: KYLIN-2438 URL: https://issues.apache.org/jira/browse/KYLIN-2438 Project: Kylin Issue Type: Improvement

[jira] [Updated] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2438: - Description: In order to guard against bad queries that can consume lots of memory and potentially crash

[jira] [Updated] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2438: - Description: In order to guard against bad queries that can consume lots of memory and potentially crash

[jira] [Updated] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2438: - Description: In order to guard against bad queries that can consume lots of memory and potentially crash

[jira] [Resolved] (KYLIN-2412) Unclosed DataOutputStream in RoaringBitmapCounter#write()

2017-01-21 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2412. -- Resolution: Fixed commit

[jira] [Commented] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-22 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878043#comment-15878043 ] Dayue Gao commented on KYLIN-2457: -- +1. Hi [~zhengd], it would be better if you update the comments of

[jira] [Commented] (KYLIN-2451) Set HBASE_RPC_TIMEOUT according to kylin.storage.hbase.coprocessor-timeout-seconds

2017-02-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874279#comment-15874279 ] Dayue Gao commented on KYLIN-2451: -- LGTM  > Set HBASE_RPC_TIMEOUT according to >

[jira] [Commented] (KYLIN-2451) Set HBASE_RPC_TIMEOUT according to kylin.storage.hbase.coprocessor-timeout-seconds

2017-02-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871127#comment-15871127 ] Dayue Gao commented on KYLIN-2451: -- Hi [~liyang.g...@gmail.com], how is this possible? Haven't we already

[jira] [Commented] (KYLIN-2451) Set HBASE_RPC_TIMEOUT according to kylin.storage.hbase.coprocessor-timeout-seconds

2017-02-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874211#comment-15874211 ] Dayue Gao commented on KYLIN-2451: -- Hi [~liyang.g...@gmail.com], I see what's the difference. Our goal

[jira] [Commented] (KYLIN-2443) Report coprocessor error information back to client

2017-02-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862616#comment-15862616 ] Dayue Gao commented on KYLIN-2443: -- Commit

[jira] [Resolved] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2436. -- Resolution: Fixed Fix Version/s: v2.0.0 > add a configuration knob to disable spilling of

[jira] [Commented] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860703#comment-15860703 ] Dayue Gao commented on KYLIN-2436: -- commit

[jira] [Resolved] (KYLIN-2443) Report coprocessor error information back to client

2017-02-14 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2443. -- Resolution: Fixed Fix Version/s: v2.0.0 > Report coprocessor error information back to client >

[jira] [Resolved] (KYLIN-2437) collect number of bytes scanned to query metrics

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2437. -- Resolution: Fixed commit

[jira] [Updated] (KYLIN-2437) collect number of bytes scanned to query metrics

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2437: - Fix Version/s: v2.0.0 > collect number of bytes scanned to query metrics >

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-18 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829485#comment-15829485 ] Dayue Gao commented on KYLIN-2387: -- Choosing mutable or immutable bitmaps is implementation details,

[jira] [Closed] (KYLIN-2398) CubeSegmentScanner generated inaccurate

2017-01-15 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-2398. Resolution: Duplicate Fix Version/s: (was: Future) > CubeSegmentScanner generated inaccurate >

[jira] [Closed] (KYLIN-2399) CubeSegmentScanner generated inaccurate

2017-01-15 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-2399. Resolution: Duplicate > CubeSegmentScanner generated inaccurate > --- >

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825703#comment-15825703 ] Dayue Gao commented on KYLIN-2387: -- ImmutableRoaringBitmap.bitmapOf is only used in test, so it's

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825814#comment-15825814 ] Dayue Gao commented on KYLIN-2387: -- Commit

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825749#comment-15825749 ] Dayue Gao commented on KYLIN-2387: -- OK, I'll remove the usage of ImmutableRoaringBitmap.bitmapOf. But I'm

[jira] [Resolved] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2457. -- Resolution: Fixed Assignee: zhengdong > Should copy the latest dictionaries on dimension tables

[jira] [Commented] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887881#comment-15887881 ] Dayue Gao commented on KYLIN-2457: -- Merged to master

[jira] [Updated] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2457: - Fix Version/s: v2.0.0 > Should copy the latest dictionaries on dimension tables in a batch merge job >

[jira] [Updated] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2457: - Affects Version/s: v1.6.0 > Should copy the latest dictionaries on dimension tables in a batch merge job

[jira] [Updated] (KYLIN-2007) CUBOID_CACHE is not cleared when rebuilding ALL cache

2016-09-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2007: - Attachment: KYLIN-2007.patch patch uploaded > CUBOID_CACHE is not cleared when rebuilding ALL cache >

[jira] [Created] (KYLIN-2007) CUBOID_CACHE is not cleared when rebuilding ALL cache

2016-09-11 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2007: Summary: CUBOID_CACHE is not cleared when rebuilding ALL cache Key: KYLIN-2007 URL: https://issues.apache.org/jira/browse/KYLIN-2007 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2013) more robust approach to hive schema changes

2016-09-13 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2013: Summary: more robust approach to hive schema changes Key: KYLIN-2013 URL: https://issues.apache.org/jira/browse/KYLIN-2013 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2012) more robust approach to hive schema changes

2016-09-13 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2012: Summary: more robust approach to hive schema changes Key: KYLIN-2012 URL: https://issues.apache.org/jira/browse/KYLIN-2012 Project: Kylin Issue Type: Bug

[jira] [Commented] (KYLIN-2013) more robust approach to hive schema changes

2016-09-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489140#comment-15489140 ] Dayue Gao commented on KYLIN-2013: -- Ah... I have no idea why it got created twice. > more robust

[jira] [Commented] (KYLIN-2013) more robust approach to hive schema changes

2016-09-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489097#comment-15489097 ] Dayue Gao commented on KYLIN-2013: -- Hi [~yimingliu], could you point to me to the jira it's duplicated

[jira] [Commented] (KYLIN-2007) CUBOID_CACHE is not cleared when rebuilding ALL cache

2016-09-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489189#comment-15489189 ] Dayue Gao commented on KYLIN-2007: -- committed to master > CUBOID_CACHE is not cleared when rebuilding

[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes

2016-09-14 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489712#comment-15489712 ] Dayue Gao commented on KYLIN-2012: -- commit 17569f6 to master. SchemaChecker is the main workhorse, it

[jira] [Comment Edited] (KYLIN-2012) more robust approach to hive schema changes

2016-09-14 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489712#comment-15489712 ] Dayue Gao edited comment on KYLIN-2012 at 9/14/16 7:52 AM: --- commit 17569f6 to

[jira] [Closed] (KYLIN-2007) CUBOID_CACHE is not cleared when rebuilding ALL cache

2016-09-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-2007. Resolution: Fixed Fix Version/s: v1.6.0 > CUBOID_CACHE is not cleared when rebuilding ALL cache >

[jira] [Created] (KYLIN-2058) Make Kylin more resilient to bad queries

2016-09-28 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2058: Summary: Make Kylin more resilient to bad queries Key: KYLIN-2058 URL: https://issues.apache.org/jira/browse/KYLIN-2058 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-09 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2173: Summary: push down limit leads to wrong answer when filter is loosened Key: KYLIN-2173 URL: https://issues.apache.org/jira/browse/KYLIN-2173 Project: Kylin Issue

[jira] [Commented] (KYLIN-1609) Push down undefined Count Distinct aggregation to storage

2016-11-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650757#comment-15650757 ] Dayue Gao commented on KYLIN-1609: -- Hi [~lidong_sjtu], is there further plan on this? What's the

[jira] [Commented] (KYLIN-2159) Redistribution Hive Table Step always requires row_count filename as 000000_0

2016-11-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15639870#comment-15639870 ] Dayue Gao commented on KYLIN-2159: -- We also run into this problem once, should find target file for

[jira] [Created] (KYLIN-2115) some extended column query returns wrong answer

2016-10-20 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2115: Summary: some extended column query returns wrong answer Key: KYLIN-2115 URL: https://issues.apache.org/jira/browse/KYLIN-2115 Project: Kylin Issue Type: Bug

[jira] [Resolved] (KYLIN-2115) some extended column query returns wrong answer

2016-10-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2115. -- Resolution: Fixed Fix Version/s: v1.6.0 fixed in

[jira] [Commented] (KYLIN-2105) add QueryId

2016-10-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591776#comment-15591776 ] Dayue Gao commented on KYLIN-2105: -- [~liyang.g...@gmail.com], thank you for your suggestions. The

[jira] [Created] (KYLIN-2105) add QueryId

2016-10-18 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2105: Summary: add QueryId Key: KYLIN-2105 URL: https://issues.apache.org/jira/browse/KYLIN-2105 Project: Kylin Issue Type: Sub-task Components: Query Engine,

[jira] [Commented] (KYLIN-2105) add QueryId

2016-10-18 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587203#comment-15587203 ] Dayue Gao commented on KYLIN-2105: -- commit

[jira] [Commented] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-14 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663899#comment-15663899 ] Dayue Gao commented on KYLIN-2173: -- commit to master and v1.6.0-rc2. UT seems to be broken by previous

[jira] [Commented] (KYLIN-2221) rethink on KYLIN-1684

2016-11-21 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685855#comment-15685855 ] Dayue Gao commented on KYLIN-2221: -- +1. If we can improve the way how empty segment is determined, even

[jira] [Updated] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2200: - Attachment: KYLIN-2200.patch patch uploaded. There is no ITs for UNION/UNION_ALL right now. Let me add

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673043#comment-15673043 ] Dayue Gao commented on KYLIN-2200: -- Union also fails to remove duplicates. {code:sql} select count(*),

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672620#comment-15672620 ] Dayue Gao commented on KYLIN-2200: -- Still got problem on the following query {code:sql} select count(*)

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669839#comment-15669839 ] Dayue Gao commented on KYLIN-2200: -- I believe it's not a bug in calcite. Because OLAPTableScan returns

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669833#comment-15669833 ] Dayue Gao commented on KYLIN-2200: -- Here is calcite generated code {code:java} /* 1 */ public static

[jira] [Created] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2200: Summary: CompileException on UNION ALL query when result only contains one column Key: KYLIN-2200 URL: https://issues.apache.org/jira/browse/KYLIN-2200 Project: Kylin

[jira] [Commented] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-19 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678992#comment-15678992 ] Dayue Gao commented on KYLIN-2173: -- {quote} how about the test result? {quote} Problem should be fixed.

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-19 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678953#comment-15678953 ] Dayue Gao commented on KYLIN-2200: -- Thanks Julian. I'll figure out whether it's a calcite bug or not. And

[jira] [Commented] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-19 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678999#comment-15678999 ] Dayue Gao commented on KYLIN-2173: -- BTW, could we build a shared CI infrastructure? Running IT in my

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669874#comment-15669874 ] Dayue Gao commented on KYLIN-2200: -- The root cause is for the second OLAPTableScan, it returns CUSTOM as

[jira] [Commented] (KYLIN-2085) PrepareStatement return incorrect result in some cases

2016-11-01 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625281#comment-15625281 ] Dayue Gao commented on KYLIN-2085: -- Encountered the same problem after upgrading to 1.5.4.1. Found this

[jira] [Commented] (KYLIN-2079) add explicit configuration knob for coprocessor timeout

2016-10-30 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15619993#comment-15619993 ] Dayue Gao commented on KYLIN-2079: -- [~mahongbin] , the way Kylin avoids retrying coprocessor call in

[jira] [Resolved] (KYLIN-2079) add explicit configuration knob for coprocessor timeout

2016-10-30 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2079. -- Resolution: Fixed Committed to master and v1.6.0-rc1. The default coprocessor timeout is set to

[jira] [Created] (KYLIN-2083) more RAM estimation test for MeasureAggregator and GTAggregateScanner

2016-10-11 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2083: Summary: more RAM estimation test for MeasureAggregator and GTAggregateScanner Key: KYLIN-2083 URL: https://issues.apache.org/jira/browse/KYLIN-2083 Project: Kylin

[jira] [Updated] (KYLIN-2083) more RAM estimation test for MeasureAggregator and GTAggregateScanner

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2083: - Description: Current RAM estimations for MeasureAggregator and GTAggregateScanner are based on test

[jira] [Commented] (KYLIN-2083) more RAM estimation test for MeasureAggregator and GTAggregateScanner

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565404#comment-15565404 ] Dayue Gao commented on KYLIN-2083: -- Play with it for a while, refactored AggregationCacheMemSizeTest *

[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571375#comment-15571375 ] Dayue Gao commented on KYLIN-2012: --

[jira] [Resolved] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2012. -- Resolution: Fixed > more robust approach to hive schema changes >

[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571341#comment-15571341 ] Dayue Gao commented on KYLIN-2012: -- I found that even after KYLIN-1985, we can only allow user to append

[jira] [Comment Edited] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571511#comment-15571511 ] Dayue Gao edited comment on KYLIN-2012 at 10/13/16 10:17 AM: - oops, didn't

  1   2   >