Re: Kylin to PostgreSQL Error in Cube build Step 1

[Xiaoxiang Yu]

Yes, actually there is NPE throw by JdbcExplorer, but it is not the first 
exception which related to JdbcExplorer, and that previous exception  should be 
the root cause. You may search "jdbc.extensible" or "JdbcSource" in kylin.log 
and you will find more information. I guess maybe your jdbc information like 
user/password/url is not configured in correct way.



Could you please find it and share with us? And it is OK if you send my the 
whole log file and I will check it.


Best wishes,
Xiaoxiang Yu


发件人: Andrey Molotov 
日期: 2019年11月21日 星期四 18:47
收件人: Xiaoxiang Yu 
抄送: "dev@kylin.apache.org" 
主题: Re: Kylin to PostgreSQL Error in Cube build Step 1

Dear Sir,
Thank you for your reply.

1.   Here is kylin.log at the moment, when “Oops… Failed to take action.” 
was thrown:

2019-11-21 13:04:32,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:05:02,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:05:08,277 INFO  [BadQueryDetector] service.BadQueryDetector:147 : 
Detect bad query.
2019-11-21 13:05:32,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:06:02,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:06:08,278 INFO  [BadQueryDetector] service.BadQueryDetector:147 : 
Detect bad query.
2019-11-21 13:06:32,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:07:02,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:07:08,278 INFO  [BadQueryDetector] service.BadQueryDetector:147 : 
Detect bad query.
2019-11-21 13:07:32,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:07:54,609 DEBUG [http-nio-7070-exec-3] 
security.KylinAuthenticationProvider:114 : User ADMIN authorities : 
[ROLE_ADMIN, ROLE_ANALYST, ROLE_MODELER]
2019-11-21 13:07:54,609 DEBUG [http-nio-7070-exec-3] 
security.KylinAuthenticationProvider:57 : User cache [-108, 112, -63, -32, 41, 
-87, -81, 81, -32, 61, -35, -111, 7, 56, -29, -59] is removed due to EXPIRED
2019-11-21 13:07:54,609 DEBUG [http-nio-7070-exec-3] 
security.KylinAuthenticationProvider:128 : Authenticated user 
org.springframework.security.authentication.UsernamePasswordAuthenticationToken@3704d9a0:
 Principal: org.springframework.security.core.userdetails.User@3b40b2f: 
Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; 
credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: 
ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER; Credentials: [PROTECTED]; Authenticated: 
true; Details: 
org.springframework.security.web.authentication.WebAuthenticationDetails@e21a:
 RemoteIpAddress: 172.0.0.66; SessionId: null; Granted Authorities: ROLE_ADMIN, 
ROLE_ANALYST, ROLE_MODELER
2019-11-21 13:07:54,610 DEBUG [http-nio-7070-exec-3] 
controller.UserController:52 : User login: 
org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; 
Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; 
credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: 
ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER
2019-11-21 13:08:02,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:08:08,279 INFO  [BadQueryDetector] service.BadQueryDetector:147 : 
Detect bad query.
2019-11-21 13:08:32,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:09:02,365 INFO  [FetcherRunner 308979117-47] 
threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
2019-11-21 13:09:08,279 INFO  [BadQueryDetector] service.BadQueryDetector:147 : 
Detect bad query.
2019-11-21 13:09:32,365 INF

Re: Kylin to PostgreSQL Error in Cube build Step 1

[codingfor...@126.com]

Hi, Molotov, your config is not current, below is the configuration I 
successfully run for your reference:

kylin.source.default=16
kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.PostgresqlAdaptor
kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl
kylin.source.jdbc.connection-url={yourUrl}
kylin.source.jdbc.dialect=postgresql
kylin.source.jdbc.driver=org.postgresql.Driver
kylin.source.jdbc.pass={yourPasswd}
kylin.source.jdbc.sqoop-home={yourSqoopHome}
kylin.source.jdbc.user=postgres



> 在 2019年11月21日，18:47，Andrey Molotov  写道：
> 
> kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor

Re: Kylin to PostgreSQL Error in Cube build Step 1

[Andrey Molotov]

catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
> at 
> org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:650)
> at 
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
> at 
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)
> at 
> org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:800)
> at 
> org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
> at 
> org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:806)
> at 
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1498)
>     at 
> org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at 
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
> at java.lang.Thread.run(Thread.java:748)
> 2019-11-21 13:15:08,285 INFO  [BadQueryDetector] service.BadQueryDetector:147 
> : Detect bad query.
> 2019-11-21 13:15:32,365 INFO  [FetcherRunner 308979117-47] 
> threadpool.DefaultFetcherRunner:94 : Job Fetcher: 0 should running, 0 actual 
> running, 0 stopped, 0 ready, 0 already succeed, 6 error, 2 discarded, 0 others
 
2.   My config is default with following keys added:
 JDBC Data Source
kylin.source.default=16
kylin.source.jdbc.connection-url=jdbc:postgresql://172.0.0.66:54321/test_db
kylin.source.jdbc.driver=org.postgresql.Driver
kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor
kylin.source.jdbc.dialect=postgresql
kylin.source.jdbc.user=user
kylin.source.jdbc.pass=pass
kylin.source.jdbc.sqoop-home=/home/hadoop/sqoop
kylin.source.jdbc.filed-delimiter=|
kylin.source.jdbc.sqoop-mapper-num=4
 

--
Best regards,
Andrey Molotov

> 21 нояб. 2019 г., в 12:12, Xiaoxiang Yu  
> написал(а):
> 
> 
> Hi Andrey,
> Firstly, thank you for your testing on our build, I have some question to ask:
> When you set kylin.source.default=16, you said you found “Oops… Failed to 
> take action.”, did you see what the exception kylin throw? Could you please 
> show us error message in kylin.log? Our patch work when 
> kylin.source.default=16, so the error message throw by kylin when you set it 
> to 8 is not what we care in this issue/PR. So the important things is what 
> occurred when you see “Oops… Failed to take action.”
> If you could provided more detail about you related config, maybe I can find 
> something useful.
> 
> Best wishes,
> Xiaoxiang Yu
>  
>  
> 发件人: Andrey Molotov 
> 日期: 2019年11月21日 星期四 16:19
> 收件人: Xiaoxiang Yu 
> 抄送: "dev@kylin.apache.org" 
> 主题: Re: Kylin to PostgreSQL Error in Cube build Step 1
>  
> Hello, Sir.
> I’ve installed the Kylin binary you’ve provided. Also I’ve prepared data 
> tables that you used to test you build 
> https://github.com/apache/kylin/pull/902 .
> If I set a property kylin.source.default=16 and click on Load Table Metadata 
> From Tree, I got an error: “Oops… Failed to take action.”
> So, I was forced to use kylin.source.default=8. I prepared model and cube 
> just like you, but still got the error on the first step
> My env:
> · PostgreSQL 9.5.20
> · cdh 5.16.2
> · Kylin build from master branch
> Here is log:
> java.io.IOException: OS command error exit with return code: 1, error 
> message: Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog 
> jobs will fail.
> 
> Please set $HCAT_HOME to the root of your HCatalog installation.
> 
> Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will 
> fail.
> 
> Please set $ACCUMULO_HOME to the root of your Accumulo installation.
> 
> Warning: /home/hadoop/sqoop/../zookeeper does not exist! Accumulo imports 
> will fail.
> 
> Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
> 
> WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of 
> HADOOP_PREFIX.
> 
> SLF4J: Class path contains multiple SLF4J bindings.
> 
> SLF4J: Found binding in 
> [jar:file:/home/hadoop/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 
> SLF4J: Found binding in 
> [jar:file:/home/hadoop/hbase/lib/slf4j-log

Re: Kylin to PostgreSQL Error in Cube build Step 1

[Xiaoxiang Yu]

Hi Andrey,
Firstly, thank you for your testing on our build, I have some question to ask:

  1.  When you set kylin.source.default=16, you said you found “Oops… Failed to 
take action.”, did you see what the exception kylin throw? Could you please 
show us error message in kylin.log? Our patch work when 
kylin.source.default=16, so the error message throw by kylin when you set it to 
8 is not what we care in this issue/PR. So the important things is what 
occurred when you see “Oops… Failed to take action.”
  2.  If you could provided more detail about you related config, maybe I can 
find something useful.

Best wishes,
Xiaoxiang Yu


发件人: Andrey Molotov 
日期: 2019年11月21日 星期四 16:19
收件人: Xiaoxiang Yu 
抄送: "dev@kylin.apache.org" 
主题: Re: Kylin to PostgreSQL Error in Cube build Step 1

Hello, Sir.
I’ve installed the Kylin binary you’ve provided. Also I’ve prepared data tables 
that you used to test you build https://github.com/apache/kylin/pull/902 .
If I set a property kylin.source.default=16 and click on Load Table Metadata 
From Tree, I got an error: “Oops… Failed to take action.”
So, I was forced to use kylin.source.default=8. I prepared model and cube just 
like you, but still got the error on the first step
My env:

• PostgreSQL 9.5.20

• cdh 5.16.2

• Kylin build from master branch
Here is log:
java.io.IOException: OS command error exit with return code: 1, error message: 
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will 
fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /home/hadoop/sqoop/../zookeeper does not exist! Accumulo imports will 
fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of 
HADOOP_PREFIX.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in 
[jar:file:/home/hadoop/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in 
[jar:file:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-11-21 10:51:09,835 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
2019-11-21 10:51:09,872 WARN tool.BaseSqoopTool: Setting your password on the 
command-line is insecure. Consider using -P instead.
2019-11-21 10:51:09,982 WARN sqoop.ConnFactory: Parameter --driver is set to an 
explicit driver however appropriate connection manager is not being set (via 
--connection-manager). Sqoop is going to fall back to 
org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
connection manager should be used next time.
2019-11-21 10:51:09,997 INFO manager.SqlManager: Using default fetchSize of 1000
2019-11-21 10:51:09,997 INFO tool.CodeGenTool: Beginning code generation
2019-11-21 10:51:10,443 INFO manager.SqlManager: Executing SQL statement: 
SELECT `FILM_PLAY`.`AUDIENCE_ID` as `FILM_PLAY_AUDIENCE_ID` 
,`FILM_PLAY`.`FILM_ID` as `FILM_PLAY_FILM_ID` ,`FILM_PLAY`.`WATCH_TIME` 
,`FILM_PLAY`.`PAYMENT` as `FILM_PLAY_PAYMENT`  FROM `SC1`.`FILM_PLAY` as 
`FILM_PLAY` INNER JOIN `PUBLIC`.`FILM` as `FILM` ON `FILM_PLAY`.`FILM_ID` = 
`FILM`.`FILM_ID` INNER JOIN `SC2`.`AUDIENCE` as `AUDIENCE` ON 
`FILM_PLAY`.`AUDIENCE_ID` = `AUDIENCE`.`AUDIENCE_ID` WHERE 1=1 AND 
(`FILM_PLAY`.`WATCH_TIME` >= '2017-01-01 00:00:00' AND `FILM_PLAY`.`WATCH_TIME` 
< '2017-12-01 00:00:00')  AND  (1 = 0)
2019-11-21 10:51:10,454 ERROR manager.SqlManager: Error executing statement: 
org.postgresql.util.PSQLException: ERROR: syntax error at or near "."
  Position: 19
org.postgresql.util.PSQLException: ERROR: syntax error at or near "."
  Position: 19
 at 
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2284)
 at 
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2003)
 at 
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:200)
 at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:424)
 at 
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:161)
 at 
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)
 at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:777)
 at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:786)
 at 
org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:289)
 at 
org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:260)
 at 
org.apache.sqoop.manag

Re: Kylin to PostgreSQL Error in Cube build Step 1

[Andrey Molotov]

Hello, Sir.
I’ve installed the Kylin binary you’ve provided. Also I’ve prepared data tables 
that you used to test you build https://github.com/apache/kylin/pull/902 .
If I set a property kylin.source.default=16 and click on Load Table Metadata 
From Tree, I got an error: “Oops… Failed to take action.”
So, I was forced to use kylin.source.default=8. I prepared model and cube just 
like you, but still got the error on the first step
My env:
· PostgreSQL 9.5.20
· cdh 5.16.2
· Kylin build from master branch
Here is log:
java.io.IOException: OS command error exit with return code: 1, error message: 
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.

Please set $HCAT_HOME to the root of your HCatalog installation.

Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will 
fail.

Please set $ACCUMULO_HOME to the root of your Accumulo installation.

Warning: /home/hadoop/sqoop/../zookeeper does not exist! Accumulo imports will 
fail.

Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.

WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of 
HADOOP_PREFIX.

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in 
[jar:file:/home/hadoop/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in 
[jar:file:/home/hadoop/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

2019-11-21 10:51:09,835 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7

2019-11-21 10:51:09,872 WARN tool.BaseSqoopTool: Setting your password on the 
command-line is insecure. Consider using -P instead.

2019-11-21 10:51:09,982 WARN sqoop.ConnFactory: Parameter --driver is set to an 
explicit driver however appropriate connection manager is not being set (via 
--connection-manager). Sqoop is going to fall back to 
org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
connection manager should be used next time.

2019-11-21 10:51:09,997 INFO manager.SqlManager: Using default fetchSize of 1000

2019-11-21 10:51:09,997 INFO tool.CodeGenTool: Beginning code generation

2019-11-21 10:51:10,443 INFO manager.SqlManager: Executing SQL statement: 
SELECT `FILM_PLAY`.`AUDIENCE_ID` as `FILM_PLAY_AUDIENCE_ID` 
,`FILM_PLAY`.`FILM_ID` as `FILM_PLAY_FILM_ID` ,`FILM_PLAY`.`WATCH_TIME` 
,`FILM_PLAY`.`PAYMENT` as `FILM_PLAY_PAYMENT`  FROM `SC1`.`FILM_PLAY` as 
`FILM_PLAY` INNER JOIN `PUBLIC`.`FILM` as `FILM` ON `FILM_PLAY`.`FILM_ID` = 
`FILM`.`FILM_ID` INNER JOIN `SC2`.`AUDIENCE` as `AUDIENCE` ON 
`FILM_PLAY`.`AUDIENCE_ID` = `AUDIENCE`.`AUDIENCE_ID` WHERE 1=1 AND 
(`FILM_PLAY`.`WATCH_TIME` >= '2017-01-01 00:00:00' AND `FILM_PLAY`.`WATCH_TIME` 
< '2017-12-01 00:00:00')  AND  (1 = 0)

2019-11-21 10:51:10,454 ERROR manager.SqlManager: Error executing statement: 
org.postgresql.util.PSQLException: ERROR: syntax error at or near "."

  Position: 19

org.postgresql.util.PSQLException: ERROR: syntax error at or near "."

  Position: 19

 at 
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2284)

 at 
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2003)

 at 
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:200)

 at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:424)

 at 
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:161)

 at 
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)

 at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:777)

 at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:786)

 at 
org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:289)

 at 
org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:260)

 at 
org.apache.sqoop.manager.SqlManager.getColumnTypesForQuery(SqlManager.java:253)

 at 
org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:336)

 at 
org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1872)

 at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1671)

 at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:106)

 at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:501)

 at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)

 at org.apache.sqoop.Sqoop.run(Sqoop.java:147)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

 at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)

 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)

 at 

Re: Kylin to PostgreSQL Error in Cube build Step 1

[Andrey Molotov]

Hello! Thank you for your reply. Yes, could you send me compiled jdbc-driver 
for PostgreSQL so I could also test it? Thank you.

—
Best Regards,
Molotov Andrey

30 окт. 2019 г., в 06:35, Xiaoxiang Yu  написал(а):
> 
> Hi Molotov,
>   The PR is under review and test, and In my side it is OK, you can check the 
> test with screenshot at page (https://github.com/apache/kylin/pull/902) to 
> see if it is tested well. If you want to test it at your env, please let me 
> know, and I will send the binary to you.  
> 
> 
> Best wishes,
> Xiaoxiang Yu 
> 
> 
> 在 2019/10/28 15:08，“Andrey Molotov” 写入:
> 
>Hello, thank you for your answer.
>I pulled the commit you provided and compiled jar file (two jar files, 
> actually: kylin-source-jdbc-3.0.0-SNAPSHOT.jar and 
> kylin-jdbc-3.0.0-SNAPSHOT.jar). Then for each of these files I did following: 
> renamed it and put it instead of existing kylin-jdbc-2.6.4.jar file in 
> kylin/lib directory. 
>But unfortunately this did help me resolve my problem with the backtick in 
> SQL query.
>Is there any other way to get a proper query line for PostgreSQL or maybe 
> I did something wrong? Thanks in advance.
> 
>> 16 окт. 2019 г., в 02:51, "codingfor...@126.com"  
>> написал(а):
>> 
>> Hi, Molotov, because postgresql's syntax and metadata have certain 
>> specialities, need to do some development work. PR 
>> https://github.com/apache/kylin/pull/747 
>>  id doing this kind of thing, it 
>> is in review now.
>> 
> 在 2019年10月15日，20:54，Andrey Molotov  写道：
>>> Hello, everyone.
>>> I’ve set up Kylin to access a PostgreSQL Database using JDBC as described 
>>> in http://kylin.apache.org/docs/tutorial/setup_jdbc_datasource.html .
>>> I’ve also set kylin.source.default=16 and 
>>> kylin.source.hive.enable.quote=false in kylin.properties.
>>> But when I try to build a cube a get an error on #1 Step Name: Sqoop To 
>>> Flat Hive Table.
>>> My Kylin Version is 2.6.4.
>>> Here is log:
>>> java.io.IOException: OS command error exit with return code: 1, 
>>> error message: Error: Could not find or load main class 
>>> org.apache.hadoop.hbase.util.GetJavaProperty
>>> SLF4J: Class path contains multiple SLF4J bindings.
>>> SLF4J: Found binding in 
>>> [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in 
>>> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in 
>>> [jar:file:/opt/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
>>> explanation.
>>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>> 2019-10-15 08:40:23,908 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
>>> 2019-10-15 08:40:23,936 WARN tool.BaseSqoopTool: Setting your password on 
>>> the command-line is insecure. Consider using -P instead.
>>> 2019-10-15 08:40:24,004 WARN sqoop.ConnFactory: Parameter --driver is set 
>>> to an explicit driver however appropriate connection manager is not being 
>>> set (via --connection-manager). Sqoop is going to fall back to 
>>> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly 
>>> which connection manager should be used next time.
>>> 2019-10-15 08:40:24,017 INFO manager.SqlManager: Using default fetchSize of 
>>> 1000
>>> 2019-10-15 08:40:24,017 INFO tool.CodeGenTool: Beginning code generation
>>> 2019-10-15 08:40:24,164 INFO manager.SqlManager: Executing SQL statement: 
>>> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
>>> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
>>> "installations"."install_datetime"
>>> FROM "data"."installations" AS "installations"
>>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
>>> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>>> 2019-10-15 08:40:24,176 INFO manager.SqlManager: Executing SQL statement: 
>>> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
>>> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
>>> "installations"."install_datetime"
>>> FROM "data"."installations" AS "installations"
>>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
>>> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>>> 2019-10-15 08:40:24,200 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is 
>>> /opt/hadoop
>>> Note: 
>>> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.java 
>>> uses or overrides a deprecated API.
>>> Note: Recompile with -Xlint:deprecation for details.
>>> 2019-10-15 08:40:25,545 INFO orm.CompilationManager: Writing jar file: 
>>> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.jar
>>> 2019-10-15 08:40:25,564 INFO mapreduce.ImportJobBase: Beginning query 
>>> import.
>>> 

Re: Kylin to PostgreSQL Error in Cube build Step 1

[Xiaoxiang Yu]

Hi Molotov,
   The PR is under review and test, and In my side it is OK, you can check the 
test with screenshot at page (https://github.com/apache/kylin/pull/902) to see 
if it is tested well. If you want to test it at your env, please let me know, 
and I will send the binary to you.  


Best wishes,
Xiaoxiang Yu 
 

在 2019/10/28 15:08，“Andrey Molotov” 写入:

Hello, thank you for your answer.
I pulled the commit you provided and compiled jar file (two jar files, 
actually: kylin-source-jdbc-3.0.0-SNAPSHOT.jar and 
kylin-jdbc-3.0.0-SNAPSHOT.jar). Then for each of these files I did following: 
renamed it and put it instead of existing kylin-jdbc-2.6.4.jar file in 
kylin/lib directory. 
But unfortunately this did help me resolve my problem with the backtick in 
SQL query.
Is there any other way to get a proper query line for PostgreSQL or maybe I 
did something wrong? Thanks in advance.

> 16 окт. 2019 г., в 02:51, "codingfor...@126.com"  
написал(а):
> 
> Hi, Molotov, because postgresql's syntax and metadata have certain 
specialities, need to do some development work. PR 
https://github.com/apache/kylin/pull/747 
 id doing this kind of thing, it is 
in review now.
> 
>>> 在 2019年10月15日，20:54，Andrey Molotov  写道：
>> Hello, everyone.
>> I’ve set up Kylin to access a PostgreSQL Database using JDBC as 
described in http://kylin.apache.org/docs/tutorial/setup_jdbc_datasource.html .
>> I’ve also set kylin.source.default=16 and 
kylin.source.hive.enable.quote=false in kylin.properties.
>> But when I try to build a cube a get an error on #1 Step Name: Sqoop To 
Flat Hive Table.
>> My Kylin Version is 2.6.4.
>> Here is log:
>>  java.io.IOException: OS command error exit with return 
code: 1, error message: Error: Could not find or load main class 
org.apache.hadoop.hbase.util.GetJavaProperty
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in 
[jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in 
[jar:file:/opt/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in 
[jar:file:/opt/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
explanation.
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>> 2019-10-15 08:40:23,908 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
>> 2019-10-15 08:40:23,936 WARN tool.BaseSqoopTool: Setting your password 
on the command-line is insecure. Consider using -P instead.
>> 2019-10-15 08:40:24,004 WARN sqoop.ConnFactory: Parameter --driver is 
set to an explicit driver however appropriate connection manager is not being 
set (via --connection-manager). Sqoop is going to fall back to 
org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
connection manager should be used next time.
>> 2019-10-15 08:40:24,017 INFO manager.SqlManager: Using default fetchSize 
of 1000
>> 2019-10-15 08:40:24,017 INFO tool.CodeGenTool: Beginning code generation
>> 2019-10-15 08:40:24,164 INFO manager.SqlManager: Executing SQL 
statement: SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
"installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
"installations"."install_datetime"
>> FROM "data"."installations" AS "installations"
>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
"installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>> 2019-10-15 08:40:24,176 INFO manager.SqlManager: Executing SQL 
statement: SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
"installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
"installations"."install_datetime"
>> FROM "data"."installations" AS "installations"
>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
"installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>> 2019-10-15 08:40:24,200 INFO orm.CompilationManager: HADOOP_MAPRED_HOME 
is /opt/hadoop
>> Note: 
/tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.java 
uses or overrides a deprecated API.
>> Note: Recompile with -Xlint:deprecation for details.
>> 2019-10-15 08:40:25,545 INFO orm.CompilationManager: Writing jar file: 
/tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.jar
>> 2019-10-15 08:40:25,564 INFO mapreduce.ImportJobBase: Beginning query 
import.
>> 2019-10-15 08:40:25,565 INFO Configuration.deprecation: 
mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
>> 2019-10-15 08:40:25,650 INFO Configuration.deprecation: mapred.jar is 
deprecated. Instead, use mapreduce.job.jar
>> 2019-10-15 

Re: Kylin to PostgreSQL Error in Cube build Step 1

[codingfor...@126.com]

Hi, this pr is still under review, it is recommended to try after merge to 
master, we will complete the review and merge in these days.


> 在 2019年10月28日，15:08，Andrey Molotov  写道：
> 
> Hello, thank you for your answer.
> I pulled the commit you provided and compiled jar file (two jar files, 
> actually: kylin-source-jdbc-3.0.0-SNAPSHOT.jar and 
> kylin-jdbc-3.0.0-SNAPSHOT.jar). Then for each of these files I did following: 
> renamed it and put it instead of existing kylin-jdbc-2.6.4.jar file in 
> kylin/lib directory. 
> But unfortunately this did help me resolve my problem with the backtick in 
> SQL query.
> Is there any other way to get a proper query line for PostgreSQL or maybe I 
> did something wrong? Thanks in advance.
> 
>> 16 окт. 2019 г., в 02:51, "codingfor...@126.com"  
>> написал(а):
>> 
>> Hi, Molotov, because postgresql's syntax and metadata have certain 
>> specialities, need to do some development work. PR 
>> https://github.com/apache/kylin/pull/747 
>>  id doing this kind of thing, it 
>> is in review now.
>> 
 在 2019年10月15日，20:54，Andrey Molotov  写道：
>>> Hello, everyone.
>>> I’ve set up Kylin to access a PostgreSQL Database using JDBC as described 
>>> in http://kylin.apache.org/docs/tutorial/setup_jdbc_datasource.html .
>>> I’ve also set kylin.source.default=16 and 
>>> kylin.source.hive.enable.quote=false in kylin.properties.
>>> But when I try to build a cube a get an error on #1 Step Name: Sqoop To 
>>> Flat Hive Table.
>>> My Kylin Version is 2.6.4.
>>> Here is log:
>>> java.io.IOException: OS command error exit with return code: 1, 
>>> error message: Error: Could not find or load main class 
>>> org.apache.hadoop.hbase.util.GetJavaProperty
>>> SLF4J: Class path contains multiple SLF4J bindings.
>>> SLF4J: Found binding in 
>>> [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in 
>>> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in 
>>> [jar:file:/opt/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
>>> explanation.
>>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>> 2019-10-15 08:40:23,908 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
>>> 2019-10-15 08:40:23,936 WARN tool.BaseSqoopTool: Setting your password on 
>>> the command-line is insecure. Consider using -P instead.
>>> 2019-10-15 08:40:24,004 WARN sqoop.ConnFactory: Parameter --driver is set 
>>> to an explicit driver however appropriate connection manager is not being 
>>> set (via --connection-manager). Sqoop is going to fall back to 
>>> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly 
>>> which connection manager should be used next time.
>>> 2019-10-15 08:40:24,017 INFO manager.SqlManager: Using default fetchSize of 
>>> 1000
>>> 2019-10-15 08:40:24,017 INFO tool.CodeGenTool: Beginning code generation
>>> 2019-10-15 08:40:24,164 INFO manager.SqlManager: Executing SQL statement: 
>>> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
>>> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
>>> "installations"."install_datetime"
>>> FROM "data"."installations" AS "installations"
>>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
>>> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>>> 2019-10-15 08:40:24,176 INFO manager.SqlManager: Executing SQL statement: 
>>> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
>>> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
>>> "installations"."install_datetime"
>>> FROM "data"."installations" AS "installations"
>>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
>>> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>>> 2019-10-15 08:40:24,200 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is 
>>> /opt/hadoop
>>> Note: 
>>> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.java 
>>> uses or overrides a deprecated API.
>>> Note: Recompile with -Xlint:deprecation for details.
>>> 2019-10-15 08:40:25,545 INFO orm.CompilationManager: Writing jar file: 
>>> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.jar
>>> 2019-10-15 08:40:25,564 INFO mapreduce.ImportJobBase: Beginning query 
>>> import.
>>> 2019-10-15 08:40:25,565 INFO Configuration.deprecation: mapred.job.tracker 
>>> is deprecated. Instead, use mapreduce.jobtracker.address
>>> 2019-10-15 08:40:25,650 INFO Configuration.deprecation: mapred.jar is 
>>> deprecated. Instead, use mapreduce.job.jar
>>> 2019-10-15 08:40:26,327 INFO Configuration.deprecation: mapred.map.tasks is 
>>> deprecated. Instead, use mapreduce.job.maps
>>> 2019-10-15 08:40:26,392 INFO client.RMProxy: Connecting 

Re: Kylin to PostgreSQL Error in Cube build Step 1

[Andrey Molotov]

Hello, thank you for your answer.
I pulled the commit you provided and compiled jar file (two jar files, 
actually: kylin-source-jdbc-3.0.0-SNAPSHOT.jar and 
kylin-jdbc-3.0.0-SNAPSHOT.jar). Then for each of these files I did following: 
renamed it and put it instead of existing kylin-jdbc-2.6.4.jar file in 
kylin/lib directory. 
But unfortunately this did help me resolve my problem with the backtick in SQL 
query.
Is there any other way to get a proper query line for PostgreSQL or maybe I did 
something wrong? Thanks in advance.

> 16 окт. 2019 г., в 02:51, "codingfor...@126.com"  
> написал(а):
> 
> Hi, Molotov, because postgresql's syntax and metadata have certain 
> specialities, need to do some development work. PR 
> https://github.com/apache/kylin/pull/747 
>  id doing this kind of thing, it is 
> in review now.
> 
>>> 在 2019年10月15日，20:54，Andrey Molotov  写道：
>> Hello, everyone.
>> I’ve set up Kylin to access a PostgreSQL Database using JDBC as described in 
>> http://kylin.apache.org/docs/tutorial/setup_jdbc_datasource.html .
>> I’ve also set kylin.source.default=16 and 
>> kylin.source.hive.enable.quote=false in kylin.properties.
>> But when I try to build a cube a get an error on #1 Step Name: Sqoop To Flat 
>> Hive Table.
>> My Kylin Version is 2.6.4.
>> Here is log:
>>  java.io.IOException: OS command error exit with return code: 1, 
>> error message: Error: Could not find or load main class 
>> org.apache.hadoop.hbase.util.GetJavaProperty
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in 
>> [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in 
>> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in 
>> [jar:file:/opt/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
>> explanation.
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>> 2019-10-15 08:40:23,908 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
>> 2019-10-15 08:40:23,936 WARN tool.BaseSqoopTool: Setting your password on 
>> the command-line is insecure. Consider using -P instead.
>> 2019-10-15 08:40:24,004 WARN sqoop.ConnFactory: Parameter --driver is set to 
>> an explicit driver however appropriate connection manager is not being set 
>> (via --connection-manager). Sqoop is going to fall back to 
>> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
>> connection manager should be used next time.
>> 2019-10-15 08:40:24,017 INFO manager.SqlManager: Using default fetchSize of 
>> 1000
>> 2019-10-15 08:40:24,017 INFO tool.CodeGenTool: Beginning code generation
>> 2019-10-15 08:40:24,164 INFO manager.SqlManager: Executing SQL statement: 
>> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
>> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
>> "installations"."install_datetime"
>> FROM "data"."installations" AS "installations"
>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
>> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>> 2019-10-15 08:40:24,176 INFO manager.SqlManager: Executing SQL statement: 
>> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
>> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
>> "installations"."install_datetime"
>> FROM "data"."installations" AS "installations"
>> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
>> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
>> 2019-10-15 08:40:24,200 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is 
>> /opt/hadoop
>> Note: 
>> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.java 
>> uses or overrides a deprecated API.
>> Note: Recompile with -Xlint:deprecation for details.
>> 2019-10-15 08:40:25,545 INFO orm.CompilationManager: Writing jar file: 
>> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.jar
>> 2019-10-15 08:40:25,564 INFO mapreduce.ImportJobBase: Beginning query import.
>> 2019-10-15 08:40:25,565 INFO Configuration.deprecation: mapred.job.tracker 
>> is deprecated. Instead, use mapreduce.jobtracker.address
>> 2019-10-15 08:40:25,650 INFO Configuration.deprecation: mapred.jar is 
>> deprecated. Instead, use mapreduce.job.jar
>> 2019-10-15 08:40:26,327 INFO Configuration.deprecation: mapred.map.tasks is 
>> deprecated. Instead, use mapreduce.job.maps
>> 2019-10-15 08:40:26,392 INFO client.RMProxy: Connecting to ResourceManager 
>> at /0.0.0.0:8032
>> 2019-10-15 08:40:26,640 INFO mapreduce.JobResourceUploader: Disabling 
>> Erasure Coding for path: 
>> /tmp/hadoop-yarn/staging/hadoop/.staging/job_1571114338286_0004
>> 2019-10-15 08:40:33,776 INFO db.DBInputFormat: Using read commited 
>> 

Re: Kylin to PostgreSQL Error in Cube build Step 1

[codingfor...@126.com]

Hi, Molotov, because postgresql's syntax and metadata have certain 
specialities, need to do some development work. PR 
https://github.com/apache/kylin/pull/747 
 id doing this kind of thing, it is 
in review now.

> 在 2019年10月15日，20:54，Andrey Molotov  写道：
> 
> Hello, everyone.
> I’ve set up Kylin to access a PostgreSQL Database using JDBC as described in 
> http://kylin.apache.org/docs/tutorial/setup_jdbc_datasource.html .
> 
> I’ve also set kylin.source.default=16 and 
> kylin.source.hive.enable.quote=false in kylin.properties.
> 
> But when I try to build a cube a get an error on #1 Step Name: Sqoop To Flat 
> Hive Table.
> 
> My Kylin Version is 2.6.4.
> 
> Here is log:
> 
>java.io.IOException: OS command error exit with return code: 
> 1, error message: Error: Could not find or load main class 
> org.apache.hadoop.hbase.util.GetJavaProperty
> 
> SLF4J: Class path contains multiple SLF4J bindings.
> 
> SLF4J: Found binding in 
> [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 
> SLF4J: Found binding in 
> [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 
> SLF4J: Found binding in 
> [jar:file:/opt/hbase/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> 
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
> explanation.
> 
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 
> 2019-10-15 08:40:23,908 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
> 
> 2019-10-15 08:40:23,936 WARN tool.BaseSqoopTool: Setting your password on the 
> command-line is insecure. Consider using -P instead.
> 
> 2019-10-15 08:40:24,004 WARN sqoop.ConnFactory: Parameter --driver is set to 
> an explicit driver however appropriate connection manager is not being set 
> (via --connection-manager). Sqoop is going to fall back to 
> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which 
> connection manager should be used next time.
> 
> 2019-10-15 08:40:24,017 INFO manager.SqlManager: Using default fetchSize of 
> 1000
> 
> 2019-10-15 08:40:24,017 INFO tool.CodeGenTool: Beginning code generation
> 
> 2019-10-15 08:40:24,164 INFO manager.SqlManager: Executing SQL statement: 
> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
> "installations"."install_datetime"
> 
> FROM "data"."installations" AS "installations"
> 
> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
> 
> 2019-10-15 08:40:24,176 INFO manager.SqlManager: Executing SQL statement: 
> SELECT "installations"."city" AS "INSTALLATIONS_CITY", 
> "installations"."device_type" AS "INSTALLATIONS_DEVICE_TYPE", 
> "installations"."install_datetime"
> 
> FROM "data"."installations" AS "installations"
> 
> WHERE 1 = 1 AND ("installations"."install_datetime" >= '2019-01-01' AND 
> "installations"."install_datetime" < '2019-01-03') AND  (1 = 0)
> 
> 2019-10-15 08:40:24,200 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is 
> /opt/hadoop
> 
> Note: 
> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.java 
> uses or overrides a deprecated API.
> 
> Note: Recompile with -Xlint:deprecation for details.
> 
> 2019-10-15 08:40:25,545 INFO orm.CompilationManager: Writing jar file: 
> /tmp/sqoop-hadoop/compile/33bbb7f633bb5f8338ed0a8e1e7ce3cc/QueryResult.jar
> 
> 2019-10-15 08:40:25,564 INFO mapreduce.ImportJobBase: Beginning query import.
> 
> 2019-10-15 08:40:25,565 INFO Configuration.deprecation: mapred.job.tracker is 
> deprecated. Instead, use mapreduce.jobtracker.address
> 
> 2019-10-15 08:40:25,650 INFO Configuration.deprecation: mapred.jar is 
> deprecated. Instead, use mapreduce.job.jar
> 
> 2019-10-15 08:40:26,327 INFO Configuration.deprecation: mapred.map.tasks is 
> deprecated. Instead, use mapreduce.job.maps
> 
> 2019-10-15 08:40:26,392 INFO client.RMProxy: Connecting to ResourceManager at 
> /0.0.0.0:8032
> 
> 2019-10-15 08:40:26,640 INFO mapreduce.JobResourceUploader: Disabling Erasure 
> Coding for path: 
> /tmp/hadoop-yarn/staging/hadoop/.staging/job_1571114338286_0004
> 
> 2019-10-15 08:40:33,776 INFO db.DBInputFormat: Using read commited 
> transaction isolation
> 
> 2019-10-15 08:40:33,777 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: 
> SELECT MIN("installations"."install_datetime"), 
> MAX("installations"."install_datetime")
> 
> FROM "data"."installations" AS "installations" WHERE 
> `INSTALLATIONS`.`INSTALL_DATETIME` >= '2019-01-01' AND 
> `INSTALLATIONS`.`INSTALL_DATETIME` < '2019-01-03'
> 
> 2019-10-15 08:40:33,785 INFO mapreduce.JobSubmitter: Cleaning up the staging 
> area /tmp/hadoop-yarn/staging/hadoop/.staging/job_1571114338286_0004
> 
> 2019-10-15 08:40:33,789 ERROR tool.ImportTool: Import failed: