Duma created KYLIN-5849:
---------------------------
Summary: File does not exist:
/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml
Key: KYLIN-5849
URL: https://issues.apache.org/jira/browse/KYLIN-5849
Project: Kylin
Issue Type: Bug
Reporter: Duma
When I attempt to start kylin is failing to start due to this error below. I am
using Spark 3.2.4 that was already installed. I am not using spark within the
kylin installation directory. Please help
[Thread-24661] INFO org.sparkproject.jetty.server.AbstractConnector - Stopped
Spark@3edb1cb3\{HTTP/1.1, (http/1.1)}{0.0.0.0:4041}
[Thread-24661] INFO org.apache.spark.ui.SparkUI - Stopped Spark web UI at
http://bg-data-master:4041
[dispatcher-event-loop-7] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[Thread-24661] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore
cleared
[Thread-24661] INFO org.apache.spark.storage.BlockManager - BlockManager stopped
[Thread-24661] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[Thread-24661] WARN org.apache.spark.metrics.MetricsSystem - Stopping a
MetricsSystem that is not running
[dispatcher-event-loop-12] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[Thread-24661] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
{color:#FF0000}*[Thread-24661] ERROR org.apache.spark.sql.SparderContext -
Error for initializing spark*{color}
{color:#FF0000}*org.apache.spark.SparkException: External scheduler cannot be
instantiated*{color}
{color:#FF0000} *at*{color}
org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2989)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:569)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2700)
at
org.apache.spark.sql.KylinSession$KylinBuilder.$anonfun$getOrCreateKylinSession$2(KylinSession.scala:102)
at scala.Option.getOrElse(Option.scala:189)
at
org.apache.spark.sql.KylinSession$KylinBuilder.getOrCreateKylinSession(KylinSession.scala:96)
at
org.apache.spark.sql.SparderContext$$anon$1.run(SparderContext.scala:145)
at java.lang.Thread.run(Thread.java:750)
{color:#FF0000}*Caused by: java.io.FileNotFoundException: File does not exist:
/data1/kylin/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml*{color}
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
Caused by:
org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File does
not exist: /data1/kylin/apache-kylin-4.0.4-bin-spark3/conf/fairscheduler.xml
at org.ap at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
at
org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
at
org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getBlockLocations(FSDirStatAndListingOp.java:156)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2002)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:773)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:442)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
