[jira] [Commented] (CARBONDATA-1180) loading data failed for dictionary file id is locked for updation
[ https://issues.apache.org/jira/browse/CARBONDATA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053724#comment-16053724 ] Liu Shaohui commented on CARBONDATA-1180: - [~chenerlu] After checking the executor log, I found the root cause is no write permission for table data path. Thanks for your attention~ > loading data failed for dictionary file id is locked for updation > --- > > Key: CARBONDATA-1180 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1180 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.2.0 >Reporter: Liu Shaohui > > use Spark 2.1 in yarn-client mode and query from beeline to spark sql > thriftserver > {code} > CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city > string, age Int) STORED BY 'carbondata'; > LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE > carbondata_test; > {code} > Data load is failed for following exception. > {code} > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time +details > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time > at scala.sys.package$.error(package.scala:27) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.(CarbonGlobalDictionaryRDD.scala:407) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:287) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > {code} > The 1.2.0 contains the fix in CARBONDATA-614. > Any suggestion about this problem? Thanks~ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (CARBONDATA-1180) loading data failed for dictionary file id is locked for updation
[ https://issues.apache.org/jira/browse/CARBONDATA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053622#comment-16053622 ] Liu Shaohui commented on CARBONDATA-1180: - [~chenerlu] Yes. I recreated tables and load the data for 3 times. I will encounter this issue every time. {code} CREATE TABLE IF NOT EXISTS carbondata_test3(id string, name string, city string, age Int) STORED BY 'carbondata'; LOAD DATA INPATH 'hdfs:///user/sql/sample-data/sample.csv' INTO TABLE carbondata_test3; {code} > loading data failed for dictionary file id is locked for updation > --- > > Key: CARBONDATA-1180 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1180 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.2.0 >Reporter: Liu Shaohui > > use Spark 2.1 in yarn-client mode and query from beeline to spark sql > thriftserver > {code} > CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city > string, age Int) STORED BY 'carbondata'; > LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE > carbondata_test; > {code} > Data load is failed for following exception. > {code} > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time +details > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time > at scala.sys.package$.error(package.scala:27) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.(CarbonGlobalDictionaryRDD.scala:407) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:287) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > {code} > The 1.2.0 contains the fix in CARBONDATA-614. > Any suggestion about this problem? Thanks~ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (CARBONDATA-1180) loading data failed for dictionary file id is locked for updation
[ https://issues.apache.org/jira/browse/CARBONDATA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053607#comment-16053607 ] chenerlu commented on CARBONDATA-1180: -- Is this always happen ? Could you please remove carbondata_test related metafiles and retry ? > loading data failed for dictionary file id is locked for updation > --- > > Key: CARBONDATA-1180 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1180 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.2.0 >Reporter: Liu Shaohui > > use Spark 2.1 in yarn-client mode and query from beeline to spark sql > thriftserver > {code} > CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city > string, age Int) STORED BY 'carbondata'; > LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE > carbondata_test; > {code} > Data load is failed for following exception. > {code} > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time +details > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time > at scala.sys.package$.error(package.scala:27) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.(CarbonGlobalDictionaryRDD.scala:407) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:287) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > {code} > The 1.2.0 contains the fix in CARBONDATA-614. > Any suggestion about this problem? Thanks~ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (CARBONDATA-1180) loading data failed for dictionary file id is locked for updation
[ https://issues.apache.org/jira/browse/CARBONDATA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052610#comment-16052610 ] Liu Shaohui commented on CARBONDATA-1180: - [~QiangCai] Could you give some suggestions? Thanks~ > loading data failed for dictionary file id is locked for updation > --- > > Key: CARBONDATA-1180 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1180 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.2.0 >Reporter: Liu Shaohui > > use Spark 2.1 in yarn-client mode and query from beeline to spark sql > thriftserver > {code} > CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city > string, age Int) STORED BY 'carbondata'; > LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE > carbondata_test; > {code} > Data load is failed for following exception. > {code} > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time +details > java.lang.RuntimeException: Dictionary file id is locked for updation. Please > try after some time > at scala.sys.package$.error(package.scala:27) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.(CarbonGlobalDictionaryRDD.scala:407) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:287) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > {code} > The 1.2.0 contains the fix in CARBONDATA-614. > Any suggestion about this problem? Thanks~ -- This message was sent by Atlassian JIRA (v6.4.14#64029)