Hi,
For further informations about my error :
Here is verification using arthas watch cmd :
[arthas@20266]$ watch org.apache.kylin.source.hive.BeelineHiveClient init -x 2
Press Q or Ctrl+C to abort.
Affect(class count: 1 , method count: 1) cost in 162 ms, listenerId: 1
method=org.apache.kylin.source.hive.BeelineHiveClient.init
location=AtExceptionExit
ts=2021-09-17 15:31:36; [cost=15.4957ms] result=@ArrayList[
@Object[][
@String[jdbc:hive2://XXXXXXXXXXXXX:8443/XXXXX;ssl=true;sslTrustStore=/etc/security/gateway-client-trust.jks;trustStorePassword=change
it?hive.server2.transport.mode=http;hive.server2.thrift.http.path=gateway/cdp-proxy-api/hive],
@Properties[isEmpty=false;size=9],
],
@BeelineHiveClient[
HIVE_AUTH_USER=@String[user],
HIVE_AUTH_PASSWD=@String[password],
cnct=null,
stmt=null,
metaData=null,
],
null,
]
Thx,
Jamal Mameri
De : MAMERI Jamal - externe
Envoyé : jeudi 16 septembre 2021 14:43
À : '[email protected]' <[email protected]>; [email protected]
Objet : RE: Use Beeline for Hive on Apache Kylin 4.0.0 ?
Hello,
My env : Hadoop 3.1.1, and Hive 2.3.0.
2021-09-16 14:28:02,719 ERROR [http-bio-7070-exec-4]
controller.TableController:200 : INSTANCE
java.lang.NoSuchFieldError: INSTANCE
at
org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.<init>(DefaultHttpClientConnectionOperator.java:84)
at
org.apache.http.impl.conn.BasicHttpClientConnectionManager.<init>(BasicHttpClientConnectionManager.java:113)
at
org.apache.http.impl.conn.BasicHttpClientConnectionManager.<init>(BasicHttpClientConnectionManager.java:142)
at
org.apache.hive.jdbc.HiveConnection.getHttpClient(HiveConnection.java:400)
at
org.apache.hive.jdbc.HiveConnection.createHttpTransport(HiveConnection.java:257)
at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:201)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at
org.apache.kylin.source.hive.BeelineHiveClient.init(BeelineHiveClient.java:94)
at
org.apache.kylin.source.hive.BeelineHiveClient.<init>(BeelineHiveClient.java:88)
at
org.apache.kylin.source.hive.HiveClientFactory.getHiveClient(HiveClientFactory.java:29)
at
org.apache.kylin.source.hive.HiveMetadataExplorer.<init>(HiveMetadataExplorer.java:47)
at
org.apache.kylin.source.hive.HiveSource.getSourceMetadataExplorer(HiveSource.java:39)
at
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:273)
at
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:198)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:854)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:765)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:215)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:20
0)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java
:56)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:165)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:452)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1195)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:654)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:317)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
2021-09-16 14:28:02,720 ERROR [http-bio-7070-exec-4]
controller.BasicController:65 :
org.apache.kylin.rest.exception.InternalErrorException: INSTANCE
at
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:201)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:854)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:765)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:215)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:20
0)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java
:56)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:165)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:452)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1195)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:654)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:317)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoSuchFieldError: INSTANCE
at
org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.<init>(DefaultHttpClientConnectionOperator.java:84)
at
org.apache.http.impl.conn.BasicHttpClientConnectionManager.<init>(BasicHttpClientConnectionManager.java:113)
at
org.apache.http.impl.conn.BasicHttpClientConnectionManager.<init>(BasicHttpClientConnectionManager.java:142)
at
org.apache.hive.jdbc.HiveConnection.getHttpClient(HiveConnection.java:400)
at
org.apache.hive.jdbc.HiveConnection.createHttpTransport(HiveConnection.java:257)
at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:201)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at
org.apache.kylin.source.hive.BeelineHiveClient.init(BeelineHiveClient.java:94)
at
org.apache.kylin.source.hive.BeelineHiveClient.<init>(BeelineHiveClient.java:88)
at
org.apache.kylin.source.hive.HiveClientFactory.getHiveClient(HiveClientFactory.java:29)
at
org.apache.kylin.source.hive.HiveMetadataExplorer.<init>(HiveMetadataExplorer.java:47)
at
org.apache.kylin.source.hive.HiveSource.getSourceMetadataExplorer(HiveSource.java:39)
at
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:273)
at
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:198)
... 76 more
Regards,
Jamal Mameri
De : [email protected]<mailto:[email protected]>
<[email protected]<mailto:[email protected]>> De la part de
[email protected]<mailto:[email protected]>
Envoyé : jeudi 16 septembre 2021 13:31
À : [email protected]<mailto:[email protected]>; MAMERI Jamal - externe
<[email protected]<mailto:[email protected]>>
Objet : Re: Use Beeline for Hive on Apache Kylin 4.0.0 ?
Hello,
1. I don't know what error did you met, "I have an error message : <
INSTANCE > when loading new data sources." is not enough for me to analyse the
problem. Could you please show with me the exception(stacktrace)?
2. I have tested Kylin 4.0 to load Hive metadata using beeline and succeed.
3. My env : Hadoop 2.6, and Hive 1.1.0.
Here is my kylin conf in kylin.properties:
kylin.source.hive.client=beeline
kylin.source.hive.beeline-params=-u jdbc:hive2://cdh-master:10000 -n root
Here is connection with beeline:
[root@cdh-master apache-kylin-4.0.0-SNAPSHOT-bin]# beeline -u
jdbc:hive2://cdh-master:10000 -n root
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M;
support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated
and will likely be removed in a future release
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M;
support was removed in 8.0
scan complete in 9ms
Connecting to jdbc:hive2://cdh-master:10000
Connected to: Apache Hive (version 1.1.0-cdh5.7.6)
Driver: Hive JDBC (version 1.1.0-cdh5.7.6)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.1.0-cdh5.7.6 by Apache Hive
0: jdbc:hive2://cdh-master:10000> show databases;
INFO : Compiling
command(queryId=hive_20210916192525_0729cad4-0143-407a-9b4a-af1026912612): show
databases
INFO : Semantic Analysis Completed
INFO : Returning Hive schema:
Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from
deserializer)], properties:null)
INFO : Completed compiling
command(queryId=hive_20210916192525_0729cad4-0143-407a-9b4a-af1026912612); Time
taken: 0.002 seconds
INFO : Executing
command(queryId=hive_20210916192525_0729cad4-0143-407a-9b4a-af1026912612): show
databases
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing
command(queryId=hive_20210916192525_0729cad4-0143-407a-9b4a-af1026912612); Time
taken: 0.123 seconds
INFO : OK
+-----------------------+--+
| database_name |
+-----------------------+--+
| apache |
| citibike |
| cube_planner_demo |
Here is verification using arthas watch
cmd(https://arthas.aliyun.com/doc/en/watch.html):
[arthas@15680]$ watch org.apache.kylin.source.hive.BeelineHiveClient init -x 2
Press Q or Ctrl+C to abort.
Affect(class count: 1 , method count: 1) cost in 126 ms, listenerId: 2
method=org.apache.kylin.source.hive.BeelineHiveClient.init location=AtExit
ts=2021-09-16 19:20:49; [cost=43.493591ms] result=@ArrayList[
@Object[][
@String[jdbc:hive2://cdh-master:10000],
@Properties[isEmpty=false;size=11],
],
@BeelineHiveClient[
HIVE_AUTH_USER=@String[user],
HIVE_AUTH_PASSWD=@String[password],
cnct=@HiveConnection[org.apache.hive.jdbc.HiveConnection@5d596e96<mailto:cnct=@HiveConnection[org.apache.hive.jdbc.HiveConnection@5d596e96>],
stmt=@HiveStatement[org.apache.hive.jdbc.HiveStatement@4d2a9dec<mailto:stmt=@HiveStatement[org.apache.hive.jdbc.HiveStatement@4d2a9dec>],
metaData=@HiveDatabaseMetaData[org.apache.hive.jdbc.HiveDatabaseMetaData@413d7dcd<mailto:metaData=@HiveDatabaseMetaData[org.apache.hive.jdbc.HiveDatabaseMetaData@413d7dcd>],
],
null,
--
Best wishes to you !
From ：Xiaoxiang Yu
At 2021-09-16 17:41:37, "MAMERI Jamal - externe"
<[email protected]<mailto:[email protected]>> wrote:
>Hi Yaqian Zhang,
>
>
>
>By default Kylin uses Hive CLI to synchronize Hive tables.
>
>My need is using Beeline, instead of Hive CLI, to add data source tables in a
>project.
>
>When I param : kylin.source.hive.client=beeline, I have an error message : <
>INSTANCE > when loading new data sources.
>
>
>
>Regards,
>
>
>
>Jamal Mameri
>
>
>
>On 2021/09/16 09:02:14, Yaqian Zhang
><[email protected]<mailto:[email protected]<mailto:[email protected]%3cmailto:[email protected]>>>
>wrote:
>
>> Hi:>
>
>>
>
>> Kylin4 use spark engine to build cube, and spark application are submitted
>> through spark-submit, which has nothing to do with hive cli or beeline.. >
>
>>
>
>> Therefore, this configuration of “kylin.source.hive.client" has no effect
>> in kylin 4.>
>
>>
>
>> > 在 2021年9月16日，下午4:19，MAMERI Jamal - externe
>> > <[email protected]<mailto:[email protected]<mailto:[email protected]%3cmailto:[email protected]>>>
>> > 写道：>
>
>> > >
>
>> > Hello,>
>
>> > >
>
>> > I hope my email finds you well.>
>
>> > >
>
>> > I have installed the Apache Kylin 4.0.0 version.>
>
>> > >
>
>> > I want to use Beeline as Hive client but the following properties aren't
>> > existing in the file : KYLIN_HOME/conf/kylin.properties :>
>
>> > >
>
>> > >
>
>> > ## Hive client, valid value [cli, beeline]>
>
>> > kylin.source.hive.client=beeline>
>
>> > #>
>
>> > ## Absolute path to beeline shell, can be set to spark beeline instead of
>> > the default hive beeline on PATH>
>
>> > kylin.source.hive.beeline-shell=/apache/hive/bin/beeline>
>
>> > #>
>
>> > ## Parameters for beeline client, only necessary if hive client is beeline>
>
>> > kylin.source.hive.beeline-params=>
>
>> > >
>
>> > >
>
>> > Is it just an oversight?>
>
>> > Can we use the Beeline client for Hive with the new version 4.0.0 ?>
>
>> > Or only Hive client (cli) is available for this version ?>
>
>> > >
>
>> > Thanks,>
>
>> > >
>
>> > Best Regards,>
>
>> > >
>
>> > Jamal Mameri>
>
>>
>
>>
