Hi hubert:
Thanks to @youcheng.zhang (JIRA) who has fixed this bug. You can
cherry-pick this
commit(https://github.com/apache/kylin/commit/b4dace4db8304a53082265e614384132316801bb)
now or wait for
the next release.
Best Regards
Rongchuan.Jin
在 2019/1/16 下午6:15，“Rongchuan Jin”<[email protected]> 写入:
Hi hubert:
I don’t think root cause is conflict between pushdown property.
Best Regards
Rongchuan.Jin
在 2019/1/16 下午5:50，“hubert stefani”<[email protected]> 写入:
Ok. I will create the JIRA in a few minutes. Any chance there is a
conflict in the configuration with the kylin.query.pushdown.jdbc. properties ?
Le mercredi 16 janvier 2019 à 10:46:59 UTC+1, Rongchuan Jin
<[email protected]> a écrit :
Hi hubert:
Your configuration seems okay. I reproduced it in my environment, it
seems like a bug within ClassLoader. Welcome to create a JIRA ticket.
Best Regards
Rongchuan.Jin
在 2019/1/16 下午5:36，“hubert stefani”<[email protected]> 写入:
Please find hereunder the kylin properties lines related to mysql
jdbc connection: (it works properly through spark shell script)
# NOVAGEN -- CUSTOM CONFIGURATION FOR MYSQL AS SOURCE
kylin.source.jdbc.connection-url=jdbc:mysql://ip-172-31-36-94.eu-west-1.compute.internal:3306/decat
kylin.source.jdbc.driver=com.mysql.jdbc.Driver
kylin.source.jdbc.dialect=mysql
kylin.source.jdbc.user=root
kylin.source.jdbc.pass=
kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl
kylin.source.default=16
kylin.source.jdbc.sqoop-home=/usr/bin
kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.MysqlAdaptor
Le mercredi 16 janvier 2019 à 05:54:51 UTC+1, Rongchuan Jin
<[email protected]> a écrit :
Hi Hubert,
Could you please provide your kylin.properties with prefix
“kylin.source.jdbc ” or just show your project configurations. I think it’s
easier to find the root cause.
Best Regards
Rongchuan.Jin
在 2019/1/14 下午9:24，“hubert
stefani”<[email protected]> 写入:
Hi,
we are currently trying to test the KYLIN-3552 feature to
rely directly on Mysql for data source instead of Hive.
(we tried as much as possible to add correct info in
kylin.properties, add mysql jdbc drivers, create mysql.xml in
./conf/datasources ... as mentioned in
https://github.com/apache/kylin/pull/327/files )
the error we entountered is ( excerpt from kylin.log ) :
2019-01-14 09:48:16,223 WARN [http-bio-7070-exec-2]
extensible.JdbcSource:50 : DataSource cannot be connected. This may not be
required in a MapReduce job.
java.lang.LinkageError: loader constraint violation: loader
(instance of sun/misc/Launcher$AppClassLoader) previously initiated loading for
a different type with name "org/apache/kylin/common/KylinConfig"
at java.lang.ClassLoader.defineClass1(Native Method)
at
java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at
java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at
java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at
java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at
java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native
Method)
at
java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:27)
with further trace :
2019-01-14 09:48:16,229 ERROR [http-bio-7070-exec-2]
controller.TableController:197 :
java.lang.NullPointerException
at
org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
at
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:280)
at
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:195)
do you have any idea ?
Is there a User guide ?
