[jira] [Commented] (KYLIN-3497) Make JDBC Module more testable
[ https://issues.apache.org/jira/browse/KYLIN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579134#comment-16579134 ] Billy Liu commented on KYLIN-3497: -- +1. If you need any help, please let the community know. > Make JDBC Module more testable > -- > > Key: KYLIN-3497 > URL: https://issues.apache.org/jira/browse/KYLIN-3497 > Project: Kylin > Issue Type: Improvement > Components: Driver - JDBC >Reporter: Ian Hu >Assignee: Ian Hu >Priority: Minor > > While I am trying my work about KYLIN-3496, I found it is difficult to test. > I would offer a work to make it more testable. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3497) Make JDBC Module more testable
Ian Hu created KYLIN-3497: - Summary: Make JDBC Module more testable Key: KYLIN-3497 URL: https://issues.apache.org/jira/browse/KYLIN-3497 Project: Kylin Issue Type: Improvement Components: Driver - JDBC Reporter: Ian Hu Assignee: Ian Hu While I am trying my work about KYLIN-3496, I found it is difficult to test. I would offer a work to make it more testable. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3496) Make calcite extras props available in JDBC Driver
[ https://issues.apache.org/jira/browse/KYLIN-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Hu updated KYLIN-3496: -- Summary: Make calcite extras props available in JDBC Driver (was: Make calcite extras options available in JDBC Driver) > Make calcite extras props available in JDBC Driver > -- > > Key: KYLIN-3496 > URL: https://issues.apache.org/jira/browse/KYLIN-3496 > Project: Kylin > Issue Type: Improvement > Components: Driver - JDBC, Query Engine >Affects Versions: v2.4.0 >Reporter: Ian Hu >Assignee: Ian Hu >Priority: Minor > Labels: features > > Like #KYLIN-3475 , calcite can be configured in the server by > `kylin.properties`, while the JDBC Driver is closer with the real query sql > generation, and if calcite can be configured by jdbc client there would be > more flexable to various situation. Like quoting as mysql or use > mysql-specified SQL grammer. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3496) Make calcite extras options available in JDBC Driver
Ian Hu created KYLIN-3496: - Summary: Make calcite extras options available in JDBC Driver Key: KYLIN-3496 URL: https://issues.apache.org/jira/browse/KYLIN-3496 Project: Kylin Issue Type: Improvement Components: Driver - JDBC, Query Engine Affects Versions: v2.4.0 Reporter: Ian Hu Assignee: Ian Hu Like #KYLIN-3475 , calcite can be configured in the server by `kylin.properties`, while the JDBC Driver is closer with the real query sql generation, and if calcite can be configured by jdbc client there would be more flexable to various situation. Like quoting as mysql or use mysql-specified SQL grammer. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3095) Use ArrayDeque instead of LinkedList for queue implementation
[
https://issues.apache.org/jira/browse/KYLIN-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu updated KYLIN-3095:
--
Description:
Use ArrayDeque instead of LinkedList for queue implementation where thread
safety is not needed.
>From https://docs.oracle.com/javase/7/docs/api/java/util/ArrayDeque.html
{quote}
Resizable-array implementation of the Deque interface. Array deques have no
capacity restrictions; they grow as necessary to support usage. They are not
thread-safe; in the absence of external synchronization, they do not support
concurrent access by multiple threads. Null elements are prohibited. This class
is likely to be faster than Stack when used as a stack, and *faster than
LinkedList when used as a queue.*
{quote}
was:
Use ArrayDeque instead of LinkedList for queue implementation where thread
safety is not needed.
>From https://docs.oracle.com/javase/7/docs/api/java/util/ArrayDeque.html
{quote}
Resizable-array implementation of the Deque interface. Array deques have no
capacity restrictions; they grow as necessary to support usage. They are not
thread-safe; in the absence of external synchronization, they do not support
concurrent access by multiple threads. Null elements are prohibited. This class
is likely to be faster than Stack when used as a stack, and *faster than
LinkedList when used as a queue.*
{quote}
> Use ArrayDeque instead of LinkedList for queue implementation
> -
>
> Key: KYLIN-3095
> URL: https://issues.apache.org/jira/browse/KYLIN-3095
> Project: Kylin
> Issue Type: Improvement
>Reporter: Ted Yu
>Assignee: Kaige Liu
>Priority: Minor
> Labels: parallel
> Fix For: v2.5.0
>
>
> Use ArrayDeque instead of LinkedList for queue implementation where thread
> safety is not needed.
> From https://docs.oracle.com/javase/7/docs/api/java/util/ArrayDeque.html
> {quote}
> Resizable-array implementation of the Deque interface. Array deques have no
> capacity restrictions; they grow as necessary to support usage. They are not
> thread-safe; in the absence of external synchronization, they do not support
> concurrent access by multiple threads. Null elements are prohibited. This
> class is likely to be faster than Stack when used as a stack, and *faster
> than LinkedList when used as a queue.*
> {quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3046) Consider introducing log4j-extras
[ https://issues.apache.org/jira/browse/KYLIN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated KYLIN-3046: -- Description: log4j-extras allows log rotation as well as compression. https://logging.apache.org/log4j/extras/download.html We should consider using log4j-extras. was: log4j-extras allows log rotation as well as compression. https://logging.apache.org/log4j/extras/download.html We should consider using log4j-extras. > Consider introducing log4j-extras > -- > > Key: KYLIN-3046 > URL: https://issues.apache.org/jira/browse/KYLIN-3046 > Project: Kylin > Issue Type: Improvement >Reporter: Ted Yu >Priority: Major > Labels: log > Fix For: v2.5.0 > > > log4j-extras allows log rotation as well as compression. > https://logging.apache.org/log4j/extras/download.html > We should consider using log4j-extras. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3442) Fact distinct columns in Spark
[ https://issues.apache.org/jira/browse/KYLIN-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578116#comment-16578116 ] Chao Long commented on KYLIN-3442: -- Hi, [~Shaofengshi]. I'd like to fix this issue.:) > Fact distinct columns in Spark > -- > > Key: KYLIN-3442 > URL: https://issues.apache.org/jira/browse/KYLIN-3442 > Project: Kylin > Issue Type: Improvement > Components: Spark Engine >Reporter: Shaofeng SHI >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3495) Wrong datatype when using on max function on a empty double column
[
https://issues.apache.org/jira/browse/KYLIN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liu Shaohui updated KYLIN-3495:
---
Summary: Wrong datatype when using on max function on a empty double column
(was: Wrong datatypy when using on max function on a empty double column)
> Wrong datatype when using on max function on a empty double column
> --
>
> Key: KYLIN-3495
> URL: https://issues.apache.org/jira/browse/KYLIN-3495
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> SQL:
> {code:java}
> select
> count(*),sum(PER_BYTES_TIME_COST)/count(PER_BYTES_TIME_COST),max(PER_BYTES_TIME_COST),min(PER_BYTES_TIME_COST)
> from KYLIN_ONEBOX.HIVE_METRICS_JOB_DEV where KDAY_DATE >= '2018-07-01' and
> KDAY_DATE <= '2018-07-31' and PROJECT ='LEARN_KYLIN'{code}
>
> Exception:
> {code:java}
> NoSuchMethodException: SqlFunctions.greater(java.math.BigDecimal, double)
> while resolving method 'greater[class java.math.BigDecimal, double]' in class
> class org.apache.calcite.runtime.SqlFunctions
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
> at
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:940)
> at
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:670)
> at
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:188)
> at
> org.apache.kylin.rest.service.QueryService.queryAndUpdateCache(QueryService.java:505)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:464)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:390)
> at
> org.apache.kylin.rest.controller.QueryController.query(QueryController.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
> at
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
> at
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
> at
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
> at
> org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> at
> org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3495) Wrong datatypy when using on max function on a empty double column
[
https://issues.apache.org/jira/browse/KYLIN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liu Shaohui updated KYLIN-3495:
---
Summary: Wrong datatypy when using on max function on a empty double column
(was: Wrong datatypo when using on max function on a empty column)
> Wrong datatypy when using on max function on a empty double column
> --
>
> Key: KYLIN-3495
> URL: https://issues.apache.org/jira/browse/KYLIN-3495
> Project: Kylin
> Issue Type: Bug
>Reporter: Liu Shaohui
>Priority: Major
>
> SQL:
> {code:java}
> select
> count(*),sum(PER_BYTES_TIME_COST)/count(PER_BYTES_TIME_COST),max(PER_BYTES_TIME_COST),min(PER_BYTES_TIME_COST)
> from KYLIN_ONEBOX.HIVE_METRICS_JOB_DEV where KDAY_DATE >= '2018-07-01' and
> KDAY_DATE <= '2018-07-31' and PROJECT ='LEARN_KYLIN'{code}
>
> Exception:
> {code:java}
> NoSuchMethodException: SqlFunctions.greater(java.math.BigDecimal, double)
> while resolving method 'greater[class java.math.BigDecimal, double]' in class
> class org.apache.calcite.runtime.SqlFunctions
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
> at
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:940)
> at
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:670)
> at
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:188)
> at
> org.apache.kylin.rest.service.QueryService.queryAndUpdateCache(QueryService.java:505)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:464)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:390)
> at
> org.apache.kylin.rest.controller.QueryController.query(QueryController.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
> at
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
> at
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
> at
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
> at
> org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> at
> org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3495) Wrong datatypo when using on max function on a empty column
Liu Shaohui created KYLIN-3495:
--
Summary: Wrong datatypo when using on max function on a empty
column
Key: KYLIN-3495
URL: https://issues.apache.org/jira/browse/KYLIN-3495
Project: Kylin
Issue Type: Bug
Reporter: Liu Shaohui
SQL:
{code:java}
select
count(*),sum(PER_BYTES_TIME_COST)/count(PER_BYTES_TIME_COST),max(PER_BYTES_TIME_COST),min(PER_BYTES_TIME_COST)
from KYLIN_ONEBOX.HIVE_METRICS_JOB_DEV where KDAY_DATE >= '2018-07-01' and
KDAY_DATE <= '2018-07-31' and PROJECT ='LEARN_KYLIN'{code}
Exception:
{code:java}
NoSuchMethodException: SqlFunctions.greater(java.math.BigDecimal, double)
while resolving method 'greater[class java.math.BigDecimal, double]' in class
class org.apache.calcite.runtime.SqlFunctions
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:940)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:670)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:188)
at
org.apache.kylin.rest.service.QueryService.queryAndUpdateCache(QueryService.java:505)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:464)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:390)
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3494) build cube with spark ArrayIndexOutOfBoundsException
jilai liu created KYLIN-3494:
Summary: build cube with spark ArrayIndexOutOfBoundsException
Key: KYLIN-3494
URL: https://issues.apache.org/jira/browse/KYLIN-3494
Project: Kylin
Issue Type: Bug
Components: Job Engine
Affects Versions: v2.4.0
Reporter: jilai liu
Fix For: v1.6.0
Logged in as: dr.who
Application
About
Jobs
Tools
Log Type: stderr
Log Upload Time: Mon Aug 13 15:50:10 +0800 2018
Log Length: 74544
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data3/test/data/hadoop/hdfs/data/usercache/hadoop/filecache/17809/__spark_libs__6649521663189541594.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/data1/test/soft/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
18/08/13 15:49:38 INFO util.SignalUtils: Registered signal handler for TERM
18/08/13 15:49:38 INFO util.SignalUtils: Registered signal handler for HUP
18/08/13 15:49:38 INFO util.SignalUtils: Registered signal handler for INT
18/08/13 15:49:38 INFO yarn.ApplicationMaster: Preparing Local resources
18/08/13 15:49:39 INFO yarn.ApplicationMaster: ApplicationAttemptId:
appattempt_1533616206085_5657_01
18/08/13 15:49:39 INFO spark.SecurityManager: Changing view acls to: hadoop
18/08/13 15:49:39 INFO spark.SecurityManager: Changing modify acls to: hadoop
18/08/13 15:49:39 INFO spark.SecurityManager: Changing view acls groups to:
18/08/13 15:49:39 INFO spark.SecurityManager: Changing modify acls groups to:
18/08/13 15:49:39 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(hadoop); groups
with view permissions: Set(); users with modify permissions: Set(hadoop);
groups with modify permissions: Set()
18/08/13 15:49:39 INFO yarn.ApplicationMaster: Starting the user application in
a separate Thread
18/08/13 15:49:39 INFO yarn.ApplicationMaster: Waiting for spark context
initialization...
18/08/13 15:49:39 INFO spark.SparkContext: Running Spark version 2.1.2
18/08/13 15:49:39 INFO spark.SecurityManager: Changing view acls to: hadoop
18/08/13 15:49:39 INFO spark.SecurityManager: Changing modify acls to: hadoop
18/08/13 15:49:39 INFO spark.SecurityManager: Changing view acls groups to:
18/08/13 15:49:39 INFO spark.SecurityManager: Changing modify acls groups to:
18/08/13 15:49:39 INFO spark.SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(hadoop); groups
with view permissions: Set(); users with modify permissions: Set(hadoop);
groups with modify permissions: Set()
18/08/13 15:49:40 INFO util.Utils: Successfully started service 'sparkDriver'
on port 40358.
18/08/13 15:49:40 INFO spark.SparkEnv: Registering MapOutputTracker
18/08/13 15:49:40 INFO spark.SparkEnv: Registering BlockManagerMaster
18/08/13 15:49:40 INFO storage.BlockManagerMasterEndpoint: Using
org.apache.spark.storage.DefaultTopologyMapper for getting topology information
18/08/13 15:49:40 INFO storage.BlockManagerMasterEndpoint:
BlockManagerMasterEndpoint up
18/08/13 15:49:40 INFO storage.DiskBlockManager: Created local directory at
/data1/test/data/hadoop/hdfs/data/usercache/hadoop/appcache/application_1533616206085_5657/blockmgr-4cd0fed9-78ae-4e2c-826d-b42a8d6364d2
18/08/13 15:49:40 INFO storage.DiskBlockManager: Created local directory at
/data2/test/data/hadoop/hdfs/data/usercache/hadoop/appcache/application_1533616206085_5657/blockmgr-8cca22e9-ece0-469b-b7fa-3cd9567504d9
18/08/13 15:49:40 INFO storage.DiskBlockManager: Created local directory at
/data3/test/data/hadoop/hdfs/data/usercache/hadoop/appcache/application_1533616206085_5657/blockmgr-15f5073d-5ea2-4766-ab22-b8c68834fb80
18/08/13 15:49:40 INFO memory.MemoryStore: MemoryStore started with capacity
305.3 MB
18/08/13 15:49:40 INFO spark.SparkEnv: Registering OutputCommitCoordinator
18/08/13 15:49:40 INFO util.log: Logging initialized @2958ms
18/08/13 15:49:40 INFO ui.JettyUtils: Adding filter:
org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
18/08/13 15:49:40 INFO server.Server: jetty-9.2.z-SNAPSHOT
18/08/13 15:49:40 INFO handler.ContextHandler: Started
o.s.j.s.ServletContextHandler@2506206a\{/jobs,null,AVAILABLE,@Spark}
18/08/13 15:49:40 INFO handler.ContextHandler: Started
o.s.j.s.ServletContextHandler@7f1b8616\{/jobs/json,null,AVAILABLE,@Spark}
18/08/13 15:49:40 INFO handler.ContextHandler: Started
o.s.j.s.ServletContextHandler@5001120\{/jobs/job,null,AVAILABLE,@Spark}
18/08/13 15:49:40 INFO handler.ContextHandler: Started
o.s.j.s.ServletContextHandler@4a662152\{/jobs/job/json,null,AVAILABLE,@Spark}
18/08/13 15:49:40 INFO
[jira] [Commented] (KYLIN-3317) Replace UUID.randomUUID with deterministic PRNG
[ https://issues.apache.org/jira/browse/KYLIN-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577913#comment-16577913 ] ASF GitHub Bot commented on KYLIN-3317: --- codecov-io commented on issue #197: KYLIN-3317, replace UUID.randomUUID with new UUID(ThreadLocalRandom.current().nextLong(), ThreadLocalRandom.current().nextLong()) URL: https://github.com/apache/kylin/pull/197#issuecomment-412431045 # [Codecov](https://codecov.io/gh/apache/kylin/pull/197?src=pr=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@ddfed27`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `29.62%`. [](https://codecov.io/gh/apache/kylin/pull/197?src=pr=tree) ```diff @@Coverage Diff@@ ## master #197 +/- ## = Coverage ? 21.06% Complexity? 4292 = Files ? 1070 Lines ?67825 Branches ? 9837 = Hits ?14285 Misses?52169 Partials ? 1371 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/197?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...che/kylin/rest/controller/StreamingController.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvY29udHJvbGxlci9TdHJlYW1pbmdDb250cm9sbGVyLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...e/kylin/source/kafka/util/KafkaSampleProducer.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c291cmNlLWthZmthL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9zb3VyY2Uva2Fma2EvdXRpbC9LYWZrYVNhbXBsZVByb2R1Y2VyLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...apache/kylin/storage/hbase/HBaseResourceStore.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9IQmFzZVJlc291cmNlU3RvcmUuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | | [.../apache/kylin/rest/controller/ModelController.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvY29udHJvbGxlci9Nb2RlbENvbnRyb2xsZXIuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...kylin/storage/hbase/lookup/HBaseLookupMRSteps.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9sb29rdXAvSEJhc2VMb29rdXBNUlN0ZXBzLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...g/apache/kylin/rest/controller/CubeController.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvY29udHJvbGxlci9DdWJlQ29udHJvbGxlci5qYXZh) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...kylin/common/persistence/RootPersistentEntity.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9wZXJzaXN0ZW5jZS9Sb290UGVyc2lzdGVudEVudGl0eS5qYXZh) | `20.45% <0%> (ø)` | `4 <0> (?)` | | | [...ylin/rest/controller/ExternalFilterController.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3QvY29udHJvbGxlci9FeHRlcm5hbEZpbHRlckNvbnRyb2xsZXIuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...va/org/apache/kylin/rest/service/TableService.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-c2VydmVyLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3Jlc3Qvc2VydmljZS9UYWJsZVNlcnZpY2UuamF2YQ==) | `13.13% <0%> (ø)` | `9 <0> (?)` | | | [...apache/kylin/common/persistence/ResourceStore.java](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9wZXJzaXN0ZW5jZS9SZXNvdXJjZVN0b3JlLmphdmE=) | `59% <0%> (ø)` | `25 <0> (?)` | | | ... and [10 more](https://codecov.io/gh/apache/kylin/pull/197/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/197?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/197?src=pr=footer). Last update
[jira] [Commented] (KYLIN-3317) Replace UUID.randomUUID with deterministic PRNG
[
https://issues.apache.org/jira/browse/KYLIN-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577897#comment-16577897
]
ASF GitHub Bot commented on KYLIN-3317:
---
asfgit commented on issue #197: KYLIN-3317, replace UUID.randomUUID with new
UUID(ThreadLocalRandom.current().nextLong(),
ThreadLocalRandom.current().nextLong())
URL: https://github.com/apache/kylin/pull/197#issuecomment-412426659
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Replace UUID.randomUUID with deterministic PRNG
> ---
>
> Key: KYLIN-3317
> URL: https://issues.apache.org/jira/browse/KYLIN-3317
> Project: Kylin
> Issue Type: Task
> Components: Security
>Reporter: Ted Yu
>Assignee: jiatao.tao
>Priority: Major
> Fix For: v2.5.0
>
>
> Currently UUID.randomUUID is called in various places in the code base.
> * It is non-deterministic.
> * It uses a single secure random for UUID generation. This uses a single JVM
> wide lock, and this can lead to lock contention and other performance
> problems.
> We should move to something that is deterministic by using seeded PRNGs
> {code}
> new UUID(ThreadLocalRandom.current().nextLong(),
> ThreadLocalRandom.current().nextLong())
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3317) Replace UUID.randomUUID with deterministic PRNG
[
https://issues.apache.org/jira/browse/KYLIN-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577896#comment-16577896
]
ASF GitHub Bot commented on KYLIN-3317:
---
tttMelody opened a new pull request #197: KYLIN-3317, replace UUID.randomUUID
with new UUID(ThreadLocalRandom.current().nextLong(),
ThreadLocalRandom.current().nextLong())
URL: https://github.com/apache/kylin/pull/197
…urrent().nextLong(), ThreadLocalRandom.current().nextLong()).
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Replace UUID.randomUUID with deterministic PRNG
> ---
>
> Key: KYLIN-3317
> URL: https://issues.apache.org/jira/browse/KYLIN-3317
> Project: Kylin
> Issue Type: Task
> Components: Security
>Reporter: Ted Yu
>Assignee: jiatao.tao
>Priority: Major
> Fix For: v2.5.0
>
>
> Currently UUID.randomUUID is called in various places in the code base.
> * It is non-deterministic.
> * It uses a single secure random for UUID generation. This uses a single JVM
> wide lock, and this can lead to lock contention and other performance
> problems.
> We should move to something that is deterministic by using seeded PRNGs
> {code}
> new UUID(ThreadLocalRandom.current().nextLong(),
> ThreadLocalRandom.current().nextLong())
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3493) error: group dimensions on tableau with kylin
lilu created KYLIN-3493: --- Summary: error: group dimensions on tableau with kylin Key: KYLIN-3493 URL: https://issues.apache.org/jira/browse/KYLIN-3493 Project: Kylin Issue Type: Bug Reporter: lilu when I try to Group dimensions on tableau +kylin,the error occurs ,if there someone can help ?how to resovle this problem ? [Kylin][ODBC 1.0(w) Driver]The REST query request failed, the error message is: Encountered "\'" at line 1, column 182. Was expecting one of: "WITH" ... "+" ... "-" ... "NOT" ... "EXISTS" ... ... ... ... ... ... ... ... "TRUE" ... "FALSE" ... "UNKNOWN" ... "NULL" ...
