Hi, you can use command 'ulimit -a' to see the limitation of opening files, and
google how to modify this limitation.
Best regards,
Zhichao Zhang
------------------ ???????? ------------------
??????:
"user"
<[email protected]>;
????????: 2020??7??9??(??????) ????5:43
??????: "user"<[email protected]>;
????: "crowgns"<[email protected]>;
????: ??????Re: ????cube????4?????????????????????????????? ????????????
??????????????kylin??????????????????????????????????????????????????????????????????????????????????????
------------------ ???????? ------------------
??????: "????"<[email protected]>;
????????: 2020??7??9??(??????) ????3:53
??????: "user"<[email protected]>;
????: Re:Re: ????cube????4?????????????????????????????? ????????????
??????????????????????????
At 2020-07-09 10:39:53, "Yaqian Zhang" <[email protected]> wrote:
Hi:
If it's useful to restart kylin or rebuild the job?
?? 2020??7??8????11:16???????? <[email protected]> ??????
------------------ ???????? ------------------
??????: "??????"<[email protected]>;
????????: 2020??7??3??(??????) ????4:55
??????: "user"<[email protected]>;
????: When build cube in kylin, it failed at the 4th step "Build Dimension
Dictionary"
Hello everyone:
Recently, we have encountered a new problem.
That is, when build cube in kylin, it failed at the 4th step "Build Dimension
Dictionary".
<[email protected]>
and the error message is like below. Before tha?? we have never met such
quetion, and our model and cube have functioned properly for at least one
month. After reading some articles and blogs, someone think the errors could be
related to the cube which has been set some measures like, "TOP-N" and
"COUNT_DISTINCT". Indeed??I have set the measures like "TOP-N" and
"COUNT_DISTINCT" when create cube. What should we do to solve the proble?
Please tell me if you know the reason. Thank you very much.
our kylin is 2.6.3.
org.apache.kylin.engine.mr.exception.HadoopShellException:
java.lang.RuntimeException: java.io.FileNotFoundException:
/etc/hadoop/3.1.0.0-78/0/core-site.xml (??????????????) at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3000) at
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2926) at
org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2806) at
org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) at
org.apache.kylin.common.util.HadoopUtil.healSickConfig(HadoopUtil.java:69) at
org.apache.kylin.common.util.HadoopUtil.getCurrentConfiguration(HadoopUtil.java:59)
at org.apache.kylin.common.util.HadoopUtil.getFileSystem(HadoopUtil.java:103)
at org.apache.kylin.common.util.HadoopUtil.getFileSystem(HadoopUtil.java:95)
at
org.apache.kylin.common.util.HadoopUtil.getWorkingFileSystem(HadoopUtil.java:82)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob$2.getDictionary(CreateDictionaryJob.java:92)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:95)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:69)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93) at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) Caused by:
java.io.FileNotFoundException: /etc/hadoop/3.1.0.0-78/0/core-site.xml
(??????????????) at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195) at
java.io.FileInputStream.<init>(FileInputStream.java:138) at
java.io.FileInputStream.<init>(FileInputStream.java:93) at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2901)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2953)
... 21 more result code:2 at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
java.lang.Thread.run(Thread.java:748)<[email protected]>
<[email protected]><[email protected]><kylin(1).log>
