[jira] [Updated] (KYLIN-2847) avoid doing useless work by checking query deadline

2017-10-18 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2847: - Attachment: KYLIN-2847.patch.1 patch updated, make "deadline" a local variable of CubeVisitService. >

[jira] [Commented] (KYLIN-2847) avoid doing useless work by checking query deadline

2017-09-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156762#comment-16156762 ] Dayue Gao commented on KYLIN-2847: -- [~mahongbin] could you take a look and review the patch? > avoid

[jira] [Updated] (KYLIN-2847) avoid doing useless work by checking query deadline

2017-09-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2847: - Attachment: KYLIN-2847.patch patch uploaded, please review > avoid doing useless work by checking query

[jira] [Created] (KYLIN-2847) avoid doing useless work by checking query deadline

2017-09-05 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2847: Summary: avoid doing useless work by checking query deadline Key: KYLIN-2847 URL: https://issues.apache.org/jira/browse/KYLIN-2847 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-2844) override max-visit-scanrange and max-fuzzykey-scan at cube level

2017-09-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2844: - Attachment: KYLIN-2844.patch patch uploaded, please review > override max-visit-scanrange and

[jira] [Created] (KYLIN-2844) override max-visit-scanrange and max-fuzzykey-scan at cube level

2017-09-04 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2844: Summary: override max-visit-scanrange and max-fuzzykey-scan at cube level Key: KYLIN-2844 URL: https://issues.apache.org/jira/browse/KYLIN-2844 Project: Kylin

[jira] [Reopened] (KYLIN-2165) Use hive table statistics data to get the total count

2017-04-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao reopened KYLIN-2165: -- Hi [~Shaofengshi], After deploying this feature in our production env, I found two bugs # JobEngineConfig

[jira] [Resolved] (KYLIN-2192) More Robust Global Dictionary

2017-03-29 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2192. -- Resolution: Fixed Future works are being done in KYLIN-2506. > More Robust Global Dictionary >

[jira] [Updated] (KYLIN-2501) Stream Aggregate GTRecords at Query Server

2017-03-22 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2501: - Attachment: KYLIN-2501.patch Pass CI,patch uploaded. > Stream Aggregate GTRecords at Query Server >

[jira] [Commented] (KYLIN-2501) Stream Aggregate GTRecords at Query Server

2017-03-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929370#comment-15929370 ] Dayue Gao commented on KYLIN-2501: -- Code pushed to KYLIN-2501 branch, ready to be review. [~mahongbin] >

[jira] [Commented] (KYLIN-2483) SortedIteratorMergerWithLimit could be slower when number of total merge rows is small

2017-03-10 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906107#comment-15906107 ] Dayue Gao commented on KYLIN-2483: -- Hi [~mahongbin], I think the overhead could come from record clone in

[jira] [Updated] (KYLIN-2501) Stream Aggregate GTRecords at Query Server

2017-03-10 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2501: - Description: *Problem* When query server needs to handle millions of records, CubeTupleConverter could

[jira] [Created] (KYLIN-2501) Stream Aggregate GTRecords at Query Server

2017-03-10 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2501: Summary: Stream Aggregate GTRecords at Query Server Key: KYLIN-2501 URL: https://issues.apache.org/jira/browse/KYLIN-2501 Project: Kylin Issue Type: Improvement

[jira] [Resolved] (KYLIN-2387) A new BitmapCounter with better performance

2017-03-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2387. -- Resolution: Fixed Fix Version/s: v2.0.0 > A new BitmapCounter with better performance >

[jira] [Resolved] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2457. -- Resolution: Fixed Assignee: zhengdong > Should copy the latest dictionaries on dimension tables

[jira] [Updated] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2457: - Fix Version/s: v2.0.0 > Should copy the latest dictionaries on dimension tables in a batch merge job >

[jira] [Updated] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2457: - Affects Version/s: v1.6.0 > Should copy the latest dictionaries on dimension tables in a batch merge job

[jira] [Commented] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887881#comment-15887881 ] Dayue Gao commented on KYLIN-2457: -- Merged to master

[jira] [Commented] (KYLIN-2457) Should copy the latest dictionaries on dimension tables in a batch merge job

2017-02-22 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878043#comment-15878043 ] Dayue Gao commented on KYLIN-2457: -- +1. Hi [~zhengd], it would be better if you update the comments of

[jira] [Commented] (KYLIN-2451) Set HBASE_RPC_TIMEOUT according to kylin.storage.hbase.coprocessor-timeout-seconds

2017-02-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874279#comment-15874279 ] Dayue Gao commented on KYLIN-2451: -- LGTM  > Set HBASE_RPC_TIMEOUT according to >

[jira] [Commented] (KYLIN-2451) Set HBASE_RPC_TIMEOUT according to kylin.storage.hbase.coprocessor-timeout-seconds

2017-02-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874211#comment-15874211 ] Dayue Gao commented on KYLIN-2451: -- Hi [~liyang.g...@gmail.com], I see what's the difference. Our goal

[jira] [Commented] (KYLIN-2451) Set HBASE_RPC_TIMEOUT according to kylin.storage.hbase.coprocessor-timeout-seconds

2017-02-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871127#comment-15871127 ] Dayue Gao commented on KYLIN-2451: -- Hi [~liyang.g...@gmail.com], how is this possible? Haven't we already

[jira] [Resolved] (KYLIN-2443) Report coprocessor error information back to client

2017-02-14 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2443. -- Resolution: Fixed Fix Version/s: v2.0.0 > Report coprocessor error information back to client >

[jira] [Commented] (KYLIN-2443) Report coprocessor error information back to client

2017-02-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862616#comment-15862616 ] Dayue Gao commented on KYLIN-2443: -- Commit

[jira] [Updated] (KYLIN-2437) collect number of bytes scanned to query metrics

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2437: - Fix Version/s: v2.0.0 > collect number of bytes scanned to query metrics >

[jira] [Resolved] (KYLIN-2437) collect number of bytes scanned to query metrics

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2437. -- Resolution: Fixed commit

[jira] [Resolved] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2436. -- Resolution: Fixed Fix Version/s: v2.0.0 > add a configuration knob to disable spilling of

[jira] [Commented] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

2017-02-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860703#comment-15860703 ] Dayue Gao commented on KYLIN-2436: -- commit

[jira] [Updated] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2438: - Description: In order to guard against bad queries that can consume lots of memory and potentially crash

[jira] [Updated] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2438: - Description: In order to guard against bad queries that can consume lots of memory and potentially crash

[jira] [Updated] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2438: - Description: In order to guard against bad queries that can consume lots of memory and potentially crash

[jira] [Created] (KYLIN-2438) replace scan threshold with max scan bytes

2017-02-08 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2438: Summary: replace scan threshold with max scan bytes Key: KYLIN-2438 URL: https://issues.apache.org/jira/browse/KYLIN-2438 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2437) collect number of bytes scanned to query metrics

2017-02-08 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2437: Summary: collect number of bytes scanned to query metrics Key: KYLIN-2437 URL: https://issues.apache.org/jira/browse/KYLIN-2437 Project: Kylin Issue Type:

[jira] [Created] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

2017-02-07 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2436: Summary: add a configuration knob to disable spilling of aggregation cache Key: KYLIN-2436 URL: https://issues.apache.org/jira/browse/KYLIN-2436 Project: Kylin

[jira] [Closed] (KYLIN-1455) HBase ScanMetrics are not properly logged in query log

2017-02-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-1455. Resolution: Won't Fix > HBase ScanMetrics are not properly logged in query log >

[jira] [Resolved] (KYLIN-2058) Make Kylin more resilient to bad queries

2017-02-07 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2058. -- Resolution: Fixed Fix Version/s: v1.6.0 There are still works to be done to defend Kylin against

[jira] [Resolved] (KYLIN-2412) Unclosed DataOutputStream in RoaringBitmapCounter#write()

2017-01-21 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2412. -- Resolution: Fixed commit

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-18 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829485#comment-15829485 ] Dayue Gao commented on KYLIN-2387: -- Choosing mutable or immutable bitmaps is implementation details,

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825814#comment-15825814 ] Dayue Gao commented on KYLIN-2387: -- Commit

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825749#comment-15825749 ] Dayue Gao commented on KYLIN-2387: -- OK, I'll remove the usage of ImmutableRoaringBitmap.bitmapOf. But I'm

[jira] [Commented] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825703#comment-15825703 ] Dayue Gao commented on KYLIN-2387: -- ImmutableRoaringBitmap.bitmapOf is only used in test, so it's

[jira] [Closed] (KYLIN-2398) CubeSegmentScanner generated inaccurate

2017-01-15 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-2398. Resolution: Duplicate Fix Version/s: (was: Future) > CubeSegmentScanner generated inaccurate >

[jira] [Closed] (KYLIN-2399) CubeSegmentScanner generated inaccurate

2017-01-15 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-2399. Resolution: Duplicate > CubeSegmentScanner generated inaccurate > --- >

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Description: We found the old BitmapCounter does not perform very well on very large bitmap. The

[jira] [Updated] (KYLIN-2387) A new BitmapCounter with better performance

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2387: - Summary: A new BitmapCounter with better performance (was: Improve BitmapCounter performance by avoiding

[jira] [Resolved] (KYLIN-2386) Revert KYLIN-2349 and KYLIN-2353

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2386. -- Resolution: Fixed Fix Version/s: v2.0.0 commit

[jira] [Updated] (KYLIN-2386) Revert KYLIN-2349 and KYLIN-2353

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2386: - Description: In KYLIN-2349 and KYLIN-2353, we changed the storage format of BitmapCounter for better

[jira] [Created] (KYLIN-2387) Improve BitmapCounter performance by avoiding expensive deserialize

2017-01-13 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2387: Summary: Improve BitmapCounter performance by avoiding expensive deserialize Key: KYLIN-2387 URL: https://issues.apache.org/jira/browse/KYLIN-2387 Project: Kylin

[jira] [Updated] (KYLIN-2386) Revert KYLIN-2349 and KYLIN-2353

2017-01-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2386: - Description: In KYLIN-2349 and KYLIN-2353, we optimized performance of BitmapCounter by changing its

[jira] [Created] (KYLIN-2386) Revert KYLIN-2349 and KYLIN-2353

2017-01-13 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2386: Summary: Revert KYLIN-2349 and KYLIN-2353 Key: KYLIN-2386 URL: https://issues.apache.org/jira/browse/KYLIN-2386 Project: Kylin Issue Type: Task

[jira] [Updated] (KYLIN-2328) Reduce the size of metadata uploaded to distributed cache

2016-12-28 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2328: - Attachment: KYLIN-2328.patch Patch uploaded. Have tested batch build and merge. It seems that

[jira] [Updated] (KYLIN-2328) Reduce the size of metadata uploaded to distributed cache

2016-12-27 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2328: - Description: Currently, each MR job uploads all the metadata belonging to a cube to distributed cache.

[jira] [Created] (KYLIN-2328) Reduce the size of metadata uploaded to distributed cache

2016-12-27 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2328: Summary: Reduce the size of metadata uploaded to distributed cache Key: KYLIN-2328 URL: https://issues.apache.org/jira/browse/KYLIN-2328 Project: Kylin Issue Type:

[jira] [Commented] (KYLIN-2266) Reduce memory usage for building global dict

2016-12-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15739860#comment-15739860 ] Dayue Gao commented on KYLIN-2266: -- A better way would be refine AppendTrieDictionary to get rid of

[jira] [Commented] (KYLIN-2192) More Robust Global Dictionary

2016-12-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735518#comment-15735518 ] Dayue Gao commented on KYLIN-2192: -- Found a bug in AppendTrieDictionary, which cause Kylin to load all

[jira] [Commented] (KYLIN-2253) sql union did not remove duplicated records (distinct)

2016-12-08 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731699#comment-15731699 ] Dayue Gao commented on KYLIN-2253: -- Hi [~zhoudegao], it's due to a bug described in CALCITE-1501 > sql

[jira] [Commented] (KYLIN-2180) Add project config and make config priority become "cube > project > server"

2016-11-26 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699198#comment-15699198 ] Dayue Gao commented on KYLIN-2180: -- The problem here is we don't know which project a CubeDesc belongs to

[jira] [Commented] (KYLIN-2221) rethink on KYLIN-1684

2016-11-21 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685855#comment-15685855 ] Dayue Gao commented on KYLIN-2221: -- +1. If we can improve the way how empty segment is determined, even

[jira] [Commented] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-19 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678999#comment-15678999 ] Dayue Gao commented on KYLIN-2173: -- BTW, could we build a shared CI infrastructure? Running IT in my

[jira] [Commented] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-19 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678992#comment-15678992 ] Dayue Gao commented on KYLIN-2173: -- {quote} how about the test result? {quote} Problem should be fixed.

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-19 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678953#comment-15678953 ] Dayue Gao commented on KYLIN-2200: -- Thanks Julian. I'll figure out whether it's a calcite bug or not. And

[jira] [Updated] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-17 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2200: - Attachment: KYLIN-2200.patch patch uploaded. There is no ITs for UNION/UNION_ALL right now. Let me add

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673043#comment-15673043 ] Dayue Gao commented on KYLIN-2200: -- Union also fails to remove duplicates. {code:sql} select count(*),

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672620#comment-15672620 ] Dayue Gao commented on KYLIN-2200: -- Still got problem on the following query {code:sql} select count(*)

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669874#comment-15669874 ] Dayue Gao commented on KYLIN-2200: -- The root cause is for the second OLAPTableScan, it returns CUSTOM as

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669839#comment-15669839 ] Dayue Gao commented on KYLIN-2200: -- I believe it's not a bug in calcite. Because OLAPTableScan returns

[jira] [Commented] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669833#comment-15669833 ] Dayue Gao commented on KYLIN-2200: -- Here is calcite generated code {code:java} /* 1 */ public static

[jira] [Created] (KYLIN-2200) CompileException on UNION ALL query when result only contains one column

2016-11-16 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2200: Summary: CompileException on UNION ALL query when result only contains one column Key: KYLIN-2200 URL: https://issues.apache.org/jira/browse/KYLIN-2200 Project: Kylin

[jira] [Commented] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-14 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15663899#comment-15663899 ] Dayue Gao commented on KYLIN-2173: -- commit to master and v1.6.0-rc2. UT seems to be broken by previous

[jira] [Commented] (KYLIN-1609) Push down undefined Count Distinct aggregation to storage

2016-11-09 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650757#comment-15650757 ] Dayue Gao commented on KYLIN-1609: -- Hi [~lidong_sjtu], is there further plan on this? What's the

[jira] [Created] (KYLIN-2173) push down limit leads to wrong answer when filter is loosened

2016-11-09 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2173: Summary: push down limit leads to wrong answer when filter is loosened Key: KYLIN-2173 URL: https://issues.apache.org/jira/browse/KYLIN-2173 Project: Kylin Issue

[jira] [Commented] (KYLIN-2159) Redistribution Hive Table Step always requires row_count filename as 000000_0

2016-11-05 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15639870#comment-15639870 ] Dayue Gao commented on KYLIN-2159: -- We also run into this problem once, should find target file for

[jira] [Commented] (KYLIN-2085) PrepareStatement return incorrect result in some cases

2016-11-01 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625281#comment-15625281 ] Dayue Gao commented on KYLIN-2085: -- Encountered the same problem after upgrading to 1.5.4.1. Found this

[jira] [Resolved] (KYLIN-2079) add explicit configuration knob for coprocessor timeout

2016-10-30 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2079. -- Resolution: Fixed Committed to master and v1.6.0-rc1. The default coprocessor timeout is set to

[jira] [Commented] (KYLIN-2079) add explicit configuration knob for coprocessor timeout

2016-10-30 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15619993#comment-15619993 ] Dayue Gao commented on KYLIN-2079: -- [~mahongbin] , the way Kylin avoids retrying coprocessor call in

[jira] [Commented] (KYLIN-2105) add QueryId

2016-10-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591776#comment-15591776 ] Dayue Gao commented on KYLIN-2105: -- [~liyang.g...@gmail.com], thank you for your suggestions. The

[jira] [Resolved] (KYLIN-2115) some extended column query returns wrong answer

2016-10-20 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2115. -- Resolution: Fixed Fix Version/s: v1.6.0 fixed in

[jira] [Created] (KYLIN-2115) some extended column query returns wrong answer

2016-10-20 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2115: Summary: some extended column query returns wrong answer Key: KYLIN-2115 URL: https://issues.apache.org/jira/browse/KYLIN-2115 Project: Kylin Issue Type: Bug

[jira] [Commented] (KYLIN-2105) add QueryId

2016-10-18 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587203#comment-15587203 ] Dayue Gao commented on KYLIN-2105: -- commit

[jira] [Created] (KYLIN-2105) add QueryId

2016-10-18 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2105: Summary: add QueryId Key: KYLIN-2105 URL: https://issues.apache.org/jira/browse/KYLIN-2105 Project: Kylin Issue Type: Sub-task Components: Query Engine,

[jira] [Comment Edited] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571511#comment-15571511 ] Dayue Gao edited comment on KYLIN-2012 at 10/13/16 10:17 AM: - oops, didn't

[jira] [Resolved] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2012. -- Resolution: Fixed > more robust approach to hive schema changes >

[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571375#comment-15571375 ] Dayue Gao commented on KYLIN-2012: --

[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes

2016-10-13 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571341#comment-15571341 ] Dayue Gao commented on KYLIN-2012: -- I found that even after KYLIN-1985, we can only allow user to append

[jira] [Commented] (KYLIN-2083) more RAM estimation test for MeasureAggregator and GTAggregateScanner

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565404#comment-15565404 ] Dayue Gao commented on KYLIN-2083: -- Play with it for a while, refactored AggregationCacheMemSizeTest *

[jira] [Updated] (KYLIN-2083) more RAM estimation test for MeasureAggregator and GTAggregateScanner

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2083: - Description: Current RAM estimations for MeasureAggregator and GTAggregateScanner are based on test

[jira] [Created] (KYLIN-2083) more RAM estimation test for MeasureAggregator and GTAggregateScanner

2016-10-11 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2083: Summary: more RAM estimation test for MeasureAggregator and GTAggregateScanner Key: KYLIN-2083 URL: https://issues.apache.org/jira/browse/KYLIN-2083 Project: Kylin

[jira] [Commented] (KYLIN-2074) Error happens when click the "SQL" section of cube

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564905#comment-15564905 ] Dayue Gao commented on KYLIN-2074: -- I think it's duplicated to KYLIN-2078, which I'm going to fix,

[jira] [Updated] (KYLIN-2079) add explicit configuration knob for coprocessor timeout

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao updated KYLIN-2079: - Attachment: KYLIN-2079.patch patch attached. [~liyang.g...@gmail.com] [~mahongbin] wants you see your

[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564619#comment-15564619 ] Dayue Gao commented on KYLIN-2012: -- Hi Billy, I'll update rules for lookup table and finish this jira

[jira] [Reopened] (KYLIN-2078) Can't see generated SQL at Web UI

2016-10-11 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao reopened KYLIN-2078: -- Breaks CI and not working for partitioned cube, needs more work > Can't see generated SQL at Web UI >

[jira] [Created] (KYLIN-2079) add explicit configuration knob for coprocessor timeout

2016-10-11 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2079: Summary: add explicit configuration knob for coprocessor timeout Key: KYLIN-2079 URL: https://issues.apache.org/jira/browse/KYLIN-2079 Project: Kylin Issue Type:

[jira] [Resolved] (KYLIN-2078) Can't see generated SQL at Web UI

2016-10-10 Thread Dayue Gao (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao resolved KYLIN-2078. -- Resolution: Fixed commit 94a9f38 to master > Can't see generated SQL at Web UI >

[jira] [Created] (KYLIN-2058) Make Kylin more resilient to bad queries

2016-09-28 Thread Dayue Gao (JIRA)
Dayue Gao created KYLIN-2058: Summary: Make Kylin more resilient to bad queries Key: KYLIN-2058 URL: https://issues.apache.org/jira/browse/KYLIN-2058 Project: Kylin Issue Type: Improvement

  1   2   >