Re: mvn install, could not find "calcite-core:1.13.0-kylin-r4"

2018-03-01 Thread Xixin
Hi Shaofeng,
forgot to say, when install/package, I also met these two errors and solved
as below:

[ERROR]
/Users/xixin/git/kylin/query/src/main/java/org/apache/kylin/query/adhoc/JdbcPushDownConnectionManager.java:[24,30]
错误: 程序包org.apache.commons.dbcp不存在

solved by add dependency in query pom.xml

commons-dbcp
commons-dbcp
1.2.1


[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.5.1:compile
(default-compile) on project atopcalcite: Compilation failure: Compilation
failure:
this is because missing "calcite-linq4j-1.13.0-kylin-r3"

solved the same like missing "calcite-core:1.13.0-kylin-r4" actually this
version configured in kylin pom.xml 
  
1.13.0-kylin-r3
branch v2.2.0-release use "r3", master branch use "r4"


so Mr.Shaofeng could this be optimized, and a freshman could access Kylin
quickly

--
Sent from: http://apache-kylin.74782.x6.nabble.com/


Re: [VOTE] Release apache-kylin-2.3.0 (RC3)

2018-03-01 Thread Dong Li
+1 binding

mvn test passed
md5, gpg, sha checked

My environment:
Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; 
2017-10-18T15:58:13+08:00)
Maven home: /usr/local/Cellar/maven/3.5.2/libexec
Java version: 1.8.0_101, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_101.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.13.3", arch: "x86_64", family: "mac"

Thanks,
Dong Li

On 02/03/2018, 09:57, "ShaoFeng Shi"  wrote:

+1 (binding)

Verified signature, md5, sha1; Compile and unit test success on Java 1.8
with MacOS.


2018-03-01 21:33 GMT+08:00 Ge Silas :

> +1
>
> On 1 Mar 2018, at 2:35 PM, Jianhua Peng  wrote:
>
> +1
>
> On 2018/03/01 03:35:31, Billy Liu  wrote:
> > Hi all,
> >
> > Now the known issue has been fixed, and all unit tests and integration
> > tests passed. I have created a new build for Apache Kylin 2.3.0,
> > release candidate 3.
> >
> > Changes highlights:
> >   [KYLIN-2727] - Introduce cube planner able to select cost-effective
> > cuboids to be built by cost-based algorithms
> >   [KYLIN-2726] - Introduce a dashboard for showing kylin service
> > related metrics, like query count, query latency, job count, etc
> >   [KYLIN-3125] - Support SparkSql in Cube building step â?oCreate
> > Intermediate Flat Hive Tableâ?
> >   [KYLIN-3044] - Support SQL Server as data source
> >   [KYLIN-2960] - Support user/group and role authentication for LDAP
> >
> > And more than 240 issues fixed.
> >
> > Thanks to everyone who has contributed to this release.
> > Here's release notes:
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> version=12341685=12316121
> >
> > The commit to be voted upon:
> > https://github.com/apache/kylin/commit/1179ee72d0a2a2c629a649751ef43a
> e9e82dc87a
> >
> > Its hash is 1179ee72d0a2a2c629a649751ef43ae9e82dc87a
> >
> > The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc3/
> >
> > The hashes of the artifacts are as follows:
> > apache-kylin-2.3.0-src.tar.gz.md5 138a96260dc2c8b8f9947b0bcbb11152
> > apache-kylin-2.3.0-src.tar.gz.sha1 b305bb91144d2d1470bd1a8578a111
> 732d04c6f8
> >
> > A staged Maven repository is available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1048/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/billyliu.asc
> >
> > Please vote on releasing this package as Apache Kylin 2.3.0
> >
> > The vote is open for the next 72 hours and passes if a majority of at
> > least three +1 PPMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Kylin 2.3.0
> > [ ]  0  I don't feel strongly about it, but I'm okay with the release
> > [ ] -1  Do not release this package because...
> >
> > Here is my vote:
> >
> > +1 (binding)
> >
> > With Warm regards
> >
> > Billy Liu
> >
>
>


-- 
Best regards,

Shaofeng Shi 史少锋





Re: mvn install, could not find "calcite-core:1.13.0-kylin-r4"

2018-03-01 Thread Xixin
Hi Shaofeng,
Thank you for your reply,=20
I have solved this by download the jar from kyligence repository and
manually installed in my local repository.

BR
Xixin Zhao

--
Sent from: http://apache-kylin.74782.x6.nabble.com/


Re: [VOTE] Release apache-kylin-2.3.0 (RC3)

2018-03-01 Thread ShaoFeng Shi
+1 (binding)

Verified signature, md5, sha1; Compile and unit test success on Java 1.8
with MacOS.


2018-03-01 21:33 GMT+08:00 Ge Silas :

> +1
>
> On 1 Mar 2018, at 2:35 PM, Jianhua Peng  wrote:
>
> +1
>
> On 2018/03/01 03:35:31, Billy Liu  wrote:
> > Hi all,
> >
> > Now the known issue has been fixed, and all unit tests and integration
> > tests passed. I have created a new build for Apache Kylin 2.3.0,
> > release candidate 3.
> >
> > Changes highlights:
> >   [KYLIN-2727] - Introduce cube planner able to select cost-effective
> > cuboids to be built by cost-based algorithms
> >   [KYLIN-2726] - Introduce a dashboard for showing kylin service
> > related metrics, like query count, query latency, job count, etc
> >   [KYLIN-3125] - Support SparkSql in Cube building step â?oCreate
> > Intermediate Flat Hive Tableâ?
> >   [KYLIN-3044] - Support SQL Server as data source
> >   [KYLIN-2960] - Support user/group and role authentication for LDAP
> >
> > And more than 240 issues fixed.
> >
> > Thanks to everyone who has contributed to this release.
> > Here's release notes:
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> version=12341685=12316121
> >
> > The commit to be voted upon:
> > https://github.com/apache/kylin/commit/1179ee72d0a2a2c629a649751ef43a
> e9e82dc87a
> >
> > Its hash is 1179ee72d0a2a2c629a649751ef43ae9e82dc87a
> >
> > The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc3/
> >
> > The hashes of the artifacts are as follows:
> > apache-kylin-2.3.0-src.tar.gz.md5 138a96260dc2c8b8f9947b0bcbb11152
> > apache-kylin-2.3.0-src.tar.gz.sha1 b305bb91144d2d1470bd1a8578a111
> 732d04c6f8
> >
> > A staged Maven repository is available for review at:
> > https://repository.apache.org/content/repositories/orgapachekylin-1048/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/billyliu.asc
> >
> > Please vote on releasing this package as Apache Kylin 2.3.0
> >
> > The vote is open for the next 72 hours and passes if a majority of at
> > least three +1 PPMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Kylin 2.3.0
> > [ ]  0  I don't feel strongly about it, but I'm okay with the release
> > [ ] -1  Do not release this package because...
> >
> > Here is my vote:
> >
> > +1 (binding)
> >
> > With Warm regards
> >
> > Billy Liu
> >
>
>


-- 
Best regards,

Shaofeng Shi 史少锋


Re: mvn install, could not find "calcite-core:1.13.0-kylin-r4"

2018-03-01 Thread ShaoFeng Shi
Hi Xixin,

As I know, there is no need to add extra repository to maven; Could you try
again, with "mvn clean package -DskipTests"?

2018-02-27 21:01 GMT+08:00 xixin :

> Hi all,
> I forked Kylin project from GitHub, and then clone to local.
> Installed maven
> When I Run: mvn -e clean install -DskipTests, I met the error as below:
> org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find
> artifact org.apache.calcite:calcite-core:jar:1.13.0-kylin-r4 in central (
> http://repo.snowballfinance.com/artifactory/repo <
> http://repo.snowballfinance.com/artifactory/repo>)
> I check the mvnrepository.com  and did not
> find this artifact:calcite:calcite-core 1.13.0-kylin-r4
> Then I checked Kylin pom.xml, find one repository assigned to “
> http://repository.kyligence.io:8081 
> ”,and
> I find the artifact.Problem is I can’t download this. I try to set my Maven
> repository to “http://repository.kyligence.io:8081 <
> http://repository.kyligence.io:8081/>”,but did not work.
> Do you have some ideas about this?
> Thanks in advance




-- 
Best regards,

Shaofeng Shi 史少锋


Re: [VOTE] Release apache-kylin-2.3.0 (RC3)

2018-03-01 Thread Ge Silas
+1

On 1 Mar 2018, at 2:35 PM, Jianhua Peng  wrote:

+1

On 2018/03/01 03:35:31, Billy Liu  wrote: 
> Hi all,
> 
> Now the known issue has been fixed, and all unit tests and integration
> tests passed. I have created a new build for Apache Kylin 2.3.0,
> release candidate 3.
> 
> Changes highlights:
>   [KYLIN-2727] - Introduce cube planner able to select cost-effective
> cuboids to be built by cost-based algorithms
>   [KYLIN-2726] - Introduce a dashboard for showing kylin service
> related metrics, like query count, query latency, job count, etc
>   [KYLIN-3125] - Support SparkSql in Cube building step â?oCreate
> Intermediate Flat Hive Table�
>   [KYLIN-3044] - Support SQL Server as data source
>   [KYLIN-2960] - Support user/group and role authentication for LDAP
> 
> And more than 240 issues fixed.
> 
> Thanks to everyone who has contributed to this release.
> Here's release notes:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12341685=12316121
> 
> The commit to be voted upon:
> https://github.com/apache/kylin/commit/1179ee72d0a2a2c629a649751ef43ae9e82dc87a
> 
> Its hash is 1179ee72d0a2a2c629a649751ef43ae9e82dc87a
> 
> The artifacts to be voted on are located here:
> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc3/
> 
> The hashes of the artifacts are as follows:
> apache-kylin-2.3.0-src.tar.gz.md5 138a96260dc2c8b8f9947b0bcbb11152
> apache-kylin-2.3.0-src.tar.gz.sha1 b305bb91144d2d1470bd1a8578a111732d04c6f8
> 
> A staged Maven repository is available for review at:
> https://repository.apache.org/content/repositories/orgapachekylin-1048/
> 
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/billyliu.asc
> 
> Please vote on releasing this package as Apache Kylin 2.3.0
> 
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 PPMC votes are cast.
> 
> [ ] +1 Release this package as Apache Kylin 2.3.0
> [ ]  0  I don't feel strongly about it, but I'm okay with the release
> [ ] -1  Do not release this package because...
> 
> Here is my vote:
> 
> +1 (binding)
> 
> With Warm regards
> 
> Billy Liu
> 



Re: Extract Fact Table Distinct Columns error

2018-03-01 Thread Ge Silas
Hello,

Can you check if you HBase was running fine during that time? I met a similar 
issue when HBase was not stable so the job status was not able to be 
synchronized.

Thanks,
Silas

On 22 Feb 2018, at 10:09 AM, xuzhe  wrote:

Hi, I built cube met something error. I couldn't solve it.
   Hadoop version : 2.7.3
   Hadoop NameNode HA
   ResouceManager HA

  log below:
  2018-02-22 09:05:04,510 INFO  [pool-8-thread-1]
threadpool.DefaultScheduler:123 : Job Fetcher: 1 should running, 1 actual
running, 0 stopped, 0 ready, 8 already succeed, 25 error, 61 discarded, 0
others
2018-02-22 09:05:34,499 INFO  [pool-8-thread-1]
threadpool.DefaultScheduler:123 : Job Fetcher: 1 should running, 1 actual
running, 0 stopped, 0 ready, 8 already succeed, 25 error, 61 discarded, 0
others
2018-02-22 09:06:04,499 INFO  [pool-8-thread-1]
threadpool.DefaultScheduler:123 : Job Fetcher: 1 should running, 1 actual
running, 0 stopped, 0 ready, 8 already succeed, 25 error, 61 discarded, 0
others
2018-02-22 09:06:34,499 INFO  [pool-8-thread-1]
threadpool.DefaultScheduler:123 : Job Fetcher: 1 should running, 1 actual
running, 0 stopped, 0 ready, 8 already succeed, 25 error, 61 discarded, 0
others
2018-02-22 09:06:59,485 INFO  [Job
9948d6ae-715a-4543-9d3b-8f9da133cb17-6583] mapred.ClientServiceDelegate:278
: Application state is completed. FinalApplicationStatus=SUCCEEDED.
Redirecting to job history server
2018-02-22 09:06:59,498 ERROR [Job
9948d6ae-715a-4543-9d3b-8f9da133cb17-6583] common.HadoopJobStatusChecker:58
: error check status
java.io.IOException: Job status not available 
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:331)
at org.apache.hadoop.mapreduce.Job.getStatus(Job.java:338)
at
org.apache.kylin.engine.mr.common.HadoopJobStatusChecker.checkStatus(HadoopJobStatusChecker.java:38)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:152)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:65)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:141)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-02-22 09:06:59,500 ERROR [Job
9948d6ae-715a-4543-9d3b-8f9da133cb17-6583] common.MapReduceExecutable:196 :
error execute
MapReduceExecutable{id=9948d6ae-715a-4543-9d3b-8f9da133cb17-02, name=Extract
Fact Table Distinct Columns, state=RUNNING}
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.Job.getTrackingURL(Job.java:363)
at
org.apache.kylin.engine.mr.common.HadoopCmdOutput.getInfo(HadoopCmdOutput.java:62)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:161)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:65)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:141)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2018-02-22 09:06:59,516 INFO  [Job
9948d6ae-715a-4543-9d3b-8f9da133cb17-6583] execution.ExecutableManager:425 :
job id:9948d6ae-715a-4543-9d3b-8f9da133cb17-02 from RUNNING to ERROR
2018-02-22 09:06:59,534 INFO  [Job
9948d6ae-715a-4543-9d3b-8f9da133cb17-6583] execution.ExecutableManager:425 :
job id:9948d6ae-715a-4543-9d3b-8f9da133cb17 from RUNNING to ERROR
2018-02-22 09:06:59,535 DEBUG [Job
9948d6ae-715a-4543-9d3b-8f9da133cb17-6583] execution.AbstractExecutable:259
: no need to send email, user list is empty




--
Sent from: http://apache-kylin.74782.x6.nabble.com/



[jira] [Created] (KYLIN-3270) Add integration test for Optimize Job

2018-03-01 Thread Zhong Yanghong (JIRA)
Zhong Yanghong created KYLIN-3270:
-

 Summary: Add integration test for Optimize Job
 Key: KYLIN-3270
 URL: https://issues.apache.org/jira/browse/KYLIN-3270
 Project: Kylin
  Issue Type: Sub-task
  Components: Tools, Build and Test
Reporter: Zhong Yanghong
Assignee: Zhong Yanghong






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)