dev
Logged in as: dr.who
Logs for container_e389_1523346903747_182411_01_000007
ResourceManager
RM Home
NodeManager
Tools
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/data08/nm-local-dirs/filecache/2608/spark2.1.1_jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The enable unsafe sort value "null" is invalid. Using the default value "true
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The custom block distribution value "null" is invalid. Using the default
value "false
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The enable vector reader value "null" is invalid. Using the default value
"true
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The value "LOCALLOCK" configured for key carbon.lock.type is invalid for
current file system. Use the default value HDFSLOCK instead.
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The carbon task distribution value "null" is invalid. Using the default
value "block
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The enable auto handoff value "null" is invalid. Using the default value
"true
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task
28 The specified value for property sort.inmemory.size.inmbis Invalid. Taking
the default value.1024
18/04/28 18:25:35 WARN Client: Exception encountered while connecting to the
server :
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException):
Operation category READ is not supported in state standby
18/04/28 18:25:35 WARN CarbonProperties: [Executor task launch worker for task
28][partitionID:cab;queryID:56345813895185751] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:36 WARN CarbonProperties: [Executor task launch worker for task
33][partitionID:cab;queryID:56345815252722993] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:38 WARN CarbonProperties: [Executor task launch worker for task
55][partitionID:cab;queryID:56345817033017122] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:39 WARN CarbonProperties: [Executor task launch worker for task
71][partitionID:cab;queryID:56345818201032258] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:42 AUDIT CarbonFactDataHandlerColumnar:
[hdd371][ip_crm][Thread-209]Problem while writing the carbon data file:
{{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
18/04/28 18:25:42 AUDIT CarbonFactDataHandlerColumnar:
[hdd371][ip_crm][Thread-134]{{java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.execute(RowResultMergerProcessor.java:168)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:228)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:60)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
18/04/28 18:25:42 ERROR CarbonMergerRDD: [Executor task launch worker for task
84][partitionID:cab;queryID:56345819695951602] Compaction Failed
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
{{java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.execute(RowResultMergerProcessor.java:168)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:228)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:60)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:333)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.execute(RowResultMergerProcessor.java:168)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:228)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:60)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
... 13 more
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
18/04/28 18:25:42 AUDIT CarbonFactDataHandlerColumnar:
[hdd371][ip_crm][Thread-134]{{java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
18/04/28 18:25:42 ERROR TaskContextImpl: Error in TaskCompletionListener
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
{{java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:333)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
... 16 more
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
18/04/28 18:25:42 ERROR Executor: Exception in task 108.0 in stage 0.0 (TID 84)
org.apache.spark.util.TaskCompletionListenerException:
{{java.util.concurrent.ExecutionException:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at
org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at
org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at
org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException:
Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at
org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:105)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
18/04/28 18:25:42 WARN CarbonProperties: [Executor task launch worker for task
120][partitionID:cab;queryID:56345821364343098] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:25:43 WARN CarbonProperties: [Executor task launch worker for task
133][partitionID:cab;queryID:56345822409462742] Configured value for property
carbon.number.of.cores.while.loading is wrong. Falling back to the default
value 2
18/04/28 18:26:15 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
yixu2001
From: manishgupta88
Date: 2018-04-27 13:39
To: dev
Subject: Re: COMPACT error
Hi,
From the exception it seems there is some problem during processing the data
in writer step.
Can you please share the complete executor and driver logs to get some idea
on the exact issue.
Regards
Manish Gupta
--
Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
