date:20160523

[jira] [Created] (KYLIN-1729) Error at #3 Step Name: Build Dimension Dictionary Duration

2016-05-23 Thread Chaozhong Yang (JIRA)

Chaozhong Yang created KYLIN-1729:
-

 Summary: Error at  #3 Step Name: Build Dimension Dictionary 
Duration
 Key: KYLIN-1729
 URL: https://issues.apache.org/jira/browse/KYLIN-1729
 Project: Kylin
  Issue Type: Bug
  Components: Job Engine
Affects Versions: v1.5.0, 1.x-HBase1.1.3
Reporter: Chaozhong Yang
Assignee: Dong Li


stack trace as follows:

java.lang.NegativeArraySizeException
at 
org.apache.kylin.dict.TrieDictionaryBuilder.buildTrieBytes(TrieDictionaryBuilder.java:472)
at 
org.apache.kylin.dict.TrieDictionaryBuilder.build(TrieDictionaryBuilder.java:439)
at 
org.apache.kylin.dict.DictionaryGenerator.buildStringDict(DictionaryGenerator.java:163)
at 
org.apache.kylin.dict.DictionaryGenerator.buildDictionaryFromValueEnumerator(DictionaryGenerator.java:75)
at 
org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:108)
at 
org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:300)
at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:165)
at 
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:51)
at 
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
at 
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at 
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

result code:2



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: A error at cube build. @ #3 Step Name: Build Dimension Dictionary Duration: 0.03 mins

2016-05-23 Thread 陈佛林

Yeah, the problem reproduces

2016-05-22 9:55 GMT+08:00 Li Yang :

> Source code at the line is
>
> byte[] value = new byte[getSizeOfValue()];
>
> Have you tried rebuild the build from beginning? If the problem reproduces,
> I think it's a bug and deserves a JIRA.
>
> On Thu, May 19, 2016 at 3:20 PM, 陈佛林  wrote:
>
> > 1.3
> >
> > 2016-05-15 20:43 GMT+08:00 Li Yang :
> >
> > > What's the kylin version?
> > >
> > > On Fri, May 13, 2016 at 4:30 PM, 陈佛林  wrote:
> > >
> > > > java.lang.NegativeArraySizeException
> > > > at
> > > >
> > >
> >
> org.apache.kylin.dict.TrieDictionary.getValueFromIdImpl(TrieDictionary.java:266)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.common.util.Dictionary.getValueFromId(Dictionary.java:111)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.dict.lookup.SnapshotTable$1.getRow(SnapshotTable.java:126)
> > > > at
> > > > org.apache.kylin.dict.lookup.LookupTable.init(LookupTable.java:65)
> > > > at
> > > > org.apache.kylin.dict.lookup.LookupTable.(LookupTable.java:53)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.dict.lookup.LookupStringTable.(LookupStringTable.java:32)
> > > > at
> > > >
> org.apache.kylin.cube.CubeManager.getLookupTable(CubeManager.java:487)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:62)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJob.java:52)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:62)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> > > > at
> > > >
> > >
> >
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
> > > > at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > > at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > >
> > >
> >
>

Re: If modelers design cubes,the steps of designing cube is less thanadmin's and don't contain advanced setting

2016-05-23 Thread ????????~~

Please do not forward the message to me, thank you. 

  
  --
  --
 ??-
 ??150 1410 4760
 ??372861...@qq.com
 ??tian.wei...@zte.com.cn
 QQ:   372861232
 --


  
  

 

 -- Original --
  From:  "??";;
 Date:  Mon, May 23, 2016 06:38 PM
 To:  "dev"; 
 
 Subject:  If modelers design cubes,the steps of designing cube is less 
thanadmin's and don't contain advanced setting

 

Hello all,
 If I login in kylin web server as an admin,I will see all steps about
designing a cube. But when logining in kylin web server as a modeler ,I find
that there is not advanced setting. only an admin can operates the step ? We
hope modeler also can operated advanced setting.


admin:
 
modeler:
 

thanks

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/If-modelers-design-cubes-the-steps-of-designing-cube-is-less-than-admin-s-and-don-t-contain-advancedg-tp4682.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: If modelers design cubes,the steps of designing cube is less than admin's and don't contain advanced setting

2016-05-23 Thread Luke Han

The "advanced settings" is only open to admin by design now.

But I think it's valuable feature if it could be a configurable value
somewhere (keep it simple, to have it in properties is good idea)

Would you mind to open one JIRA to track this?

Thanks.
Luke


Best Regards!
-

Luke Han

On Mon, May 23, 2016 at 3:38 AM, 杨海乐  wrote:

> Hello all,
>  If I login in kylin web server as an admin,I will see all steps about
> designing a cube. But when logining in kylin web server as a modeler ,I
> find
> that there is not advanced setting. only an admin can operates the step ?
> We
> hope modeler also can operated advanced setting.
>
>
> admin:
> 
> modeler:
> 
>
> thanks
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/If-modelers-design-cubes-the-steps-of-designing-cube-is-less-than-admin-s-and-don-t-contain-advancedg-tp4682.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>

If modelers design cubes,the steps of designing cube is less than admin's and don't contain advanced setting

2016-05-23 Thread 杨海乐

Hello all,
 If I login in kylin web server as an admin,I will see all steps about
designing a cube. But when logining in kylin web server as a modeler ,I find
that there is not advanced setting. only an admin can operates the step ? We
hope modeler also can operated advanced setting.


admin:
 
modeler:
 

thanks

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/If-modelers-design-cubes-the-steps-of-designing-cube-is-less-than-admin-s-and-don-t-contain-advancedg-tp4682.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

If modelers design cubes,the steps of designing cube is less than admin's and don't contain advanced setting

2016-05-23 Thread 杨海乐

Hello all,
 If I login in kylin web server as an admin,I will see all steps about
designing a cube. But when logining in kylin web server as a modeler ,I find
that there is not advanced setting. only an admin can operates the step ?

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/If-modelers-design-cubes-the-steps-of-designing-cube-is-less-than-admin-s-and-don-t-contain-advancedg-tp4681.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: 回复：About kylin restful：

2016-05-23 Thread zhangrongkun

I have used：
curl -c /tmp/cookiefile.txt -X POST -H "Authorization:
Basic(base64(ADMIN:KYLIN))" -H 'Content-Type: application/json'
http://localhost:7070/kylin/api/user/authentication

although can't meet exception,My /tmp/cookiefile.txt only has this content:

# Netscape HTTP Cookie File
# http://curl.haxx.se/rfc/cookie_spec.html
# This file was generated by libcurl! Edit at your own risk.

#HttpOnly_localhost FALSE   /kylin/ FALSE   0   JSESSIONID
56362B68538369D23FC1A43C833CA68F


--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/About-kylin-restful-tp4678p4680.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

??????About kylin restful??

2016-05-23 Thread bitbean

Authorization: Basic ADMIN is not correct


Authorization: Basic (base64(ADMIN:KYLIN)) is right




--  --
??: "zhangrongkun";<563364...@qq.com>;
: 2016??5??23??(??) 5:56
??: "dev"; 

: About kylin restful??



when I use??

curl -c /tmp/cookiefile.txt -X POST -H "Authorization: Basic ADMIN" -H
'Content-Type: application/json'
http://localhost:7070/kylin/api/user/authentication

the command returns exception??

Apache Tomcat/7.0.59 - Error report 
HTTP Status 500 - Cannot create a session after the response has been
committed
*type* Exception report*message*
Cannot create a session after the response has been
committed*description* The server encountered an internal
error that prevented it from fulfilling this request.*exception*
java.lang.IllegalStateException: Cannot create a session after the
response has been committed
org.apache.catalina.connector.Request.doGetSession(Request.java:3002)
org.apache.catalina.connector.Request.getSession(Request.java:2378)

org.apache.catalina.connector.RequestFacade.getSession(RequestFacade.java:897)

javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:229)

org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:80)

org.apache.kylin.rest.filter.KylinApiFilter.doFilterInternal(KylinApiFilter.java:69)

org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205)
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
*note* The full stack trace of the root cause is available
in the Apache Tomcat/7.0.59 logs.
Apache Tomcat/7.0.59


--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/About-kylin-restful-tp4678.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

About kylin restful：

2016-05-23 Thread zhangrongkun

when I use：

curl -c /tmp/cookiefile.txt -X POST -H "Authorization: Basic ADMIN" -H
'Content-Type: application/json'
http://localhost:7070/kylin/api/user/authentication

the command returns exception：

Apache Tomcat/7.0.59 - Error report 
HTTP Status 500 - Cannot create a session after the response has been
committed
*type* Exception report*message*
Cannot create a session after the response has been
committed*description* The server encountered an internal
error that prevented it from fulfilling this request.*exception*
java.lang.IllegalStateException: Cannot create a session after the
response has been committed
org.apache.catalina.connector.Request.doGetSession(Request.java:3002)
org.apache.catalina.connector.Request.getSession(Request.java:2378)

org.apache.catalina.connector.RequestFacade.getSession(RequestFacade.java:897)

javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:229)

org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:80)

org.apache.kylin.rest.filter.KylinApiFilter.doFilterInternal(KylinApiFilter.java:69)

org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205)
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
*note* The full stack trace of the root cause is available
in the Apache Tomcat/7.0.59 logs.
Apache Tomcat/7.0.59


--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/About-kylin-restful-tp4678.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: Is day type a special date type ?

2016-05-23 Thread zhangrongkun

Yes.You are right,thank you very much.

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/Is-day-type-a-special-date-type-tp4674p4677.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

[jira] [Created] (KYLIN-1728) Introduce dictionary metadata

2016-05-23 Thread liyang (JIRA)

liyang created KYLIN-1728:
-

 Summary: Introduce dictionary metadata
 Key: KYLIN-1728
 URL: https://issues.apache.org/jira/browse/KYLIN-1728
 Project: Kylin
  Issue Type: Improvement
Reporter: liyang


To allow

- Special dictionary builder for specified column
- Two or more columns to share dictionary



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Is day type a special date type ?

2016-05-23 Thread Yerui Sun

day is the reserve keyword in kylin, try this:

select “DAY",sum(sendmsgs) from sendlog_daily group by “DAY"


> 在 2016年5月23日，17:41，zhangrongkun <563364...@qq.com> 写道：
> 
> At query time,my sql is:select day ,sum(sendmsgs) from sendlog_daily group by
> day; but result exception :
> 
> 
>  
> 
> 
> ,But my sql is :select sex ,sum(sendmsgs) from sendlog_daily group by sex;
> It return right
> 
> --
> View this message in context: 
> http://apache-kylin.74782.x6.nabble.com/Is-day-type-a-special-date-type-tp4674.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.

Is day type a special date type ?

2016-05-23 Thread zhangrongkun

At query time,my sql is:select day ,sum(sendmsgs) from sendlog_daily group by
day; but result exception :


 


,But my sql is :select sex ,sum(sendmsgs) from sendlog_daily group by sex;
It return right

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/Is-day-type-a-special-date-type-tp4674.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Improve streaming cubing

2016-05-23 Thread Li Yang

Hi,

I created a new JIRA to improve the current streaming cubing, to make it
more scalable and resilient. Ideas and thoughts are very welcome.

KYLIN-1726 Scalable streaming cubing


Cheers
Yang

[VOTE] Release apache-kylin-1.5.2 (release candidate 3)

2016-05-23 Thread Dong Li

Hi all,

I have created a build for Apache Kylin 1.5.2, release candidate 3.

Changes highlights:

   - [KYLIN-1077] - Support Hive View as Lookup Table
   - [KYLIN-1515] - Make Kylin run on MapR
   - [KYLIN-1600] - Download diagnosis zip from GUI
   - [KYLIN-1672] - support kylin on cdh 5.7


Thanks to everyone who has contributed to this release.
Here’s release notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528

The commit to be voted upon:
*https://github.com/apache/kylin/commit/af2646b72fbb6dc81699ad6661303fd612a2eebf
*

Its hash is af2646b72fbb6dc81699ad6661303fd612a2eebf.

The artifacts to be voted on are located here:
*https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc3/
*

The hashes of the artifacts are as follows:
apache-kylin-1.5.2-src.tar.gz.md511542b6fd4cfc9ed844e8f626d5960b7
apache-kylin-1.5.2-src.tar.gz.sha1
 57c6e33dfcad34ddcfc805965b00ea6f1d04422f

A staged Maven repository is available for review at:
*https://repository.apache.org/content/repositories/orgapachekylin-1028/
*

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/lidong.asc

Please vote on releasing this package as Apache Kylin 1.5.2.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 1.5.2
[ ] 0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Here is my vote:
+1 (binding)

Thanks,
Dong Li

[jira] [Created] (KYLIN-1727) Calcite throws "ava.lang.ClassCastException: java.math.BigDecimal cannot be cast to java.lang.Byte"

2016-05-23 Thread Chaozhong Yang (JIRA)

Chaozhong Yang created KYLIN-1727:
-

 Summary: Calcite throws "ava.lang.ClassCastException: 
java.math.BigDecimal cannot be cast to java.lang.Byte"
 Key: KYLIN-1727
 URL: https://issues.apache.org/jira/browse/KYLIN-1727
 Project: Kylin
  Issue Type: Bug
  Components: Query Engine
Affects Versions: v1.5.0, 1.x-HBase1.1.3
Reporter: Chaozhong Yang
Assignee: liyang


I got error from Kylin when try a simple sql like: select colum_a, 
sum(column_b) from table group by column_a

The stack trace is:
```
Caused by: java.lang.ClassCastException: java.math.BigDecimal cannot be cast to 
java.lang.Byte
at Baz$4.apply(Unknown Source)
at Baz$4.apply(Unknown Source)
at Baz$4.apply(Unknown Source)
at 
org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:825)
at 
org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:754)
at 
org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:302)
at Baz.bind(Unknown Source)
at 
org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:326)
at 
org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:281)
at 
org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:545)
at 
org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:536)
at 
org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:187)
at 
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:65)
at 
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:44)
at 
org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:566)
at 
org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:578)
at 
org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571)
at 
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135)
... 79 more
```

In addition, the column "column_b" was declared as "tinyint" in hive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1726) Scalable streaming cubing

2016-05-23 Thread liyang (JIRA)

liyang created KYLIN-1726:
-

 Summary: Scalable streaming cubing
 Key: KYLIN-1726
 URL: https://issues.apache.org/jira/browse/KYLIN-1726
 Project: Kylin
  Issue Type: New Feature
Reporter: liyang
Assignee: liyang


We try to achieve:

1. Scale streaming cubing workload on a computation cluster, e.g. YARN
2. Support Kafka as a formal data source
3. Guarantee no data loss reading from Kafka, even records are no strictly 
ordered by time



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1729) Error at #3 Step Name: Build Dimension Dictionary Duration

Re: A error at cube build. @ #3 Step Name: Build Dimension Dictionary Duration: 0.03 mins

Re: If modelers design cubes,the steps of designing cube is less thanadmin's and don't contain advanced setting

Re: If modelers design cubes,the steps of designing cube is less than admin's and don't contain advanced setting

If modelers design cubes,the steps of designing cube is less than admin's and don't contain advanced setting

If modelers design cubes,the steps of designing cube is less than admin's and don't contain advanced setting

Re: 回复：About kylin restful：

??????About kylin restful??

About kylin restful：

Re: Is day type a special date type ?

[jira] [Created] (KYLIN-1728) Introduce dictionary metadata

Re: Is day type a special date type ?

Is day type a special date type ?

Improve streaming cubing

[VOTE] Release apache-kylin-1.5.2 (release candidate 3)

[jira] [Created] (KYLIN-1727) Calcite throws "ava.lang.ClassCastException: java.math.BigDecimal cannot be cast to java.lang.Byte"

[jira] [Created] (KYLIN-1726) Scalable streaming cubing

17 matches

Site Navigation

Mail list logo

Footer information