[jira] [Created] (KYLIN-4021) Async Broadcast of project schema may cause creating cube failed

[Liu Shaohui (JIRA)]

Liu Shaohui created KYLIN-4021:
--

 Summary: Async Broadcast of project schema may cause creating cube 
failed
 Key: KYLIN-4021
 URL: https://issues.apache.org/jira/browse/KYLIN-4021
 Project: Kylin
  Issue Type: Bug
  Components: Metadata
Reporter: Liu Shaohui


In our prod cluster, we found some creating cube requests failed for the model 
not found.

The problem is that users will create the cube right after creating the model 
success. But the the two requests may be routed to two different servers.

When the other server receive creating cube request, the project schema may be 
not updated for the async Broadcast and the server can not found the model 
related to the cube.

the log at query server 1
{code:java}
kylin.log.11:2019-05-27 10:26:44,143 INFO  [http-bio-7070-exec-962] 
model.DataModelManager:248 : Saving Model model_k1_bb_83_uyyy3636 to 
Project BigBI_Hive with bigbi_kylin as owner
kylin.log.11:2019-05-27 10:26:44,144 INFO  [http-bio-7070-exec-962] 
model.DataModelManager:185 : Model model_k1_bb_83_uyyy3636 is missing or 
unloaded yet
kylin.log.11:2019-05-27 10:26:44,145 INFO  [http-bio-7070-exec-962] 
persistence.ResourceStore:309 : Update resource: 
/model_desc/model_k1_bb_83_uyyy3636.json with content:{code}
and the log at query server 2
{code:java}
2019-05-27 10:26:44,296 WARN  [http-bio-7070-exec-132] cube.CubeDescManager:195 
: Broken cube desc CubeDesc [name=cube_b_bb_83_uyyy3636]
java.lang.NullPointerException: DateModelDesc(model_k1_bb_83_uyyy3636) not 
found
at 
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:235)
at org.apache.kylin.cube.model.CubeDesc.init(CubeDesc.java:664)
at 
org.apache.kylin.cube.CubeDescManager.createCubeDesc(CubeDescManager.java:193)
at 
org.apache.kylin.rest.service.CubeService.createCubeAndDesc(CubeService.java:216)
at 
org.apache.kylin.rest.service.CubeService$$FastClassBySpringCGLIB$$17a07c0e.invoke()
at 
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at 
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at 
org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:69)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at 
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
at 
org.apache.kylin.rest.service.CubeService$$EnhancerBySpringCGLIB$$20946622.createCubeAndDesc()
at 
org.apache.kylin.rest.controller.CubeController.saveCubeDesc(CubeController.java:735)
at sun.reflect.GeneratedMethodAccessor341.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498){code}
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Maven repository URL could not be accessed (http://repository.kyligence.io:8081/repository/maven-public/)

[ShaoFeng Shi]

Hello Sam,

Our engineer will change the service port to a default port. But this may
not happen quickly because they are busy before the end of June. Thank you
for the feedback!

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org




Sam Lau - ITD  于2019年5月22日周三 上午9:19写道：

> Dear,
>
>
>
> Maven raise the below exception after he dependency 
> *org.apache.kylin:kylin-core-metadata
> *imported.
>
> My company network only allow PC to allow 80 and 443 port of URL
> outsite.
>
> Port 8081 is not allowed in my company network
>
>
>
> Could you help update the repository URL (using http:// Or
> https://... with default port) ?
>
> Caused by: org.eclipse.aether.transfer.ArtifactTransferException: Failure
> to transfer org.apache.calcite:calcite-core:pom:1.16.0-kylin-r2 from 
> *http://repository.kyligence.io
> :8081/repository/maven-public/* was
> cached in the local repository, resolution will not be reattempted until
> the update interval of kyligence has elapsed or updates are forced.
> Original error: Could not transfer artifact
> org.apache.calcite:calcite-core:pom:1.16.0-kylin-r2 from/to kyligence (
> http://repository.kyligence.io:8081/repository/maven-public/): connect
> timed out
>
> at
> org.eclipse.aether.internal.impl.DefaultUpdateCheckManager.newException(DefaultUpdateCheckManager.java:240)
>
> at
> org.eclipse.aether.internal.impl.DefaultUpdateCheckManager.checkArtifact(DefaultUpdateCheckManager.java:208)
>
> at
> org.eclipse.aether.internal.impl.DefaultArtifactResolver.gatherDownloads(DefaultArtifactResolver.java:563)
>
> at
> org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:481)
>
> at
> org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:399)
>
>
>
> https://github.com/apache/kylin/blob/master/pom.xml#L1098
>
>
>
> http://repository.kyligence.io:8081/repository/maven-public/
>
>
>
>
>
> Best regards,
>
> Sam
>
> *EGL Tours Company Limited **東瀛遊旅行社有限公司 **(**香港聯合交易所主板上市 股份代號 6882)*
> *電話查詢及服務中心**: 3692-0888 **Website: www.egltours.com
>  Facebook: www.facebook.com/egltours
> *
>
>
> 本郵件(及任何附件)可能 載有機密、專有、具有特權或受法律保護的資料，並僅供收件人(或負責將資料遞交給收件人的人士)使用。如閣下不是本郵件
> 的預定收件人，便無權閱讀、列印、保留、複製或傳佈本郵件或其任何部分。如閣下錯誤地收到本郵件，請立即將之銷毀或從閣 下的系統中刪除，並通知寄件人。
>
> __
> http://www.egltours.com/promotion
>
> This message (and any attachments) may contain information that is
> confidential,proprietary,privileged or otherwise protected by law.The
> message is intended solely for the named addressee (or a person responsible
> for delivering it to the addressee).If you are not the intended recipient
> of this message, you are not authorized to read, print, retain , copy or
> disseminate this message or any part of it.If you have received this
> message in error, please destroy the message or delete it from your system
> immediately and notify the sender.
>

Re: spark.yarn.executor.memoryOverhead' has been deprecated problem

[ShaoFeng Shi]

Hello Nithya,

You can remove  "
kylin.engine.spark-conf.spark.yarn.executor.memoryOverhead" from
conf/kylin.properties and kylin-defaults.properties. The
"kylin-defaults.properties" is packaged in the
kylin-core-common-.jar, which is
in tomcat/webapps/kylin/WEB-INF/lib/ folder, you need to unzip and then
re-package it.

Could you please report this as a JIRA so that the developers will handle
it? A patch is also welcomed.

BTW, please subscribe dev@kylin.apache.org (drop an email to
dev-subscr...@kylin.apache.org) before sending an email, otherwise your
email will be pending until someone manually accept it.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org




nithya.mb4...@gmail.com  于2019年5月29日周三 上午9:24写道：

> Can someone please respond what is the solution for this?
>
> --
> Sent from: http://apache-kylin.74782.x6.nabble.com/
>

[jira] [Created] (KYLIN-4020) fix_length rowkey encode without sepecified length can be saved but cause CreateHTable step failed

[Yuzhang QIU (JIRA)]

Yuzhang QIU created KYLIN-4020:
--

 Summary: fix_length rowkey encode without sepecified length can be 
saved but cause CreateHTable step failed
 Key: KYLIN-4020
 URL: https://issues.apache.org/jira/browse/KYLIN-4020
 Project: Kylin
  Issue Type: Improvement
  Components: Metadata
Affects Versions: v2.5.2
Reporter: Yuzhang QIU


Hi dear team:

Just as title said.  
Maybe there should have more strict check for advanced settings, I think.

How do you think about this?

If there already have same JIRA，please inform me and close this one.


   Best regards

   yuzhang



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: spark.yarn.executor.memoryOverhead' has been deprecated problem

[nithya.mb4...@gmail.com]

Can someone please respond what is the solution for this?

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

Problem starting Apache Kylin

[Aitor Martin Redondo]

Hi,

I have an issue starting Apache Kylin. I'm using Apache Kylin version 2.6.2
in a Hortonworks version 3.0.1. I'm using this version of kylin -> Binary
for Hadoop 3 download:

   - for Hadoop 3.1 + HBase 2.0 (includes Hortonworks HDP 3.0)


I have documented the issue in stack overflow:
https://stackoverflow.com/questions/56254032/unable-to-start-apache-kylin-in-hdp-3-0-1

Thanks,
-- 
Aitor Martín Redondo
Estudiante de Ingeniería de Telecomunicaciones
Especialidad en telemática

[jira] [Created] (KYLIN-4019) I had a problem when I tried to make a connection from kylin to powerbi with KylinODBCDriver,the connection was sucessful but the data seemed wrong,I was wondering whethe

[jamie_lee (JIRA)]

jamie_lee created KYLIN-4019:


 Summary: I had a problem when I tried to make a connection from 
kylin to powerbi with KylinODBCDriver,the connection was sucessful but the data 
seemed wrong,I was wondering whether I used the correct driver?or the 
KylinODBCDriver didn't support directquery mode? r
 Key: KYLIN-4019
 URL: https://issues.apache.org/jira/browse/KYLIN-4019
 Project: Kylin
  Issue Type: Bug
Reporter: jamie_lee






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (KYLIN-4018) apache kylin 连接powerbi出错

[jamie_lee (JIRA)]

jamie_lee created KYLIN-4018:


 Summary: apache kylin 连接powerbi出错
 Key: KYLIN-4018
 URL: https://issues.apache.org/jira/browse/KYLIN-4018
 Project: Kylin
  Issue Type: Bug
  Components: Driver - ODBC
Reporter: jamie_lee






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: 使用left join查询时报错

[ShaoFeng Shi]

Define another cube with inner join. Kylin will automatically match the
join type in query with the cube/model definition.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org




Gods_Dusk <197795...@qq.com> 于2019年5月28日周二 下午3:16写道：

> inner join, and I modify to left join, it works well, thx a lot. besides,
> if
> I want to use both inner and left, how can I do?
>
>
> --
> Sent from: http://apache-kylin.74782.x6.nabble.com/
>

Re: 使用left join查询时报错

[Gods_Dusk]

inner join, and I modify to left join, it works well, thx a lot. besides, if
I want to use both inner and left, how can I do?


--
Sent from: http://apache-kylin.74782.x6.nabble.com/