Ajeet Rai created CARBONDATA-1754:
-------------------------------------
Summary: Carbon1.3.0 Concurrent Load-Compaction: Compaction job
fails at run time if insert overwrite job is running concurrently
Key: CARBONDATA-1754
URL: https://issues.apache.org/jira/browse/CARBONDATA-1754
Project: CarbonData
Issue Type: Bug
Components: data-load
Affects Versions: 1.3.0
Environment: 3 Node ant cluster
Reporter: Ajeet Rai
Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if
insert overwrite job is running concurrently.
Steps:
1: Create a table
2: Start three load one by one
3: After load is completed, start insert overwrite and minor compaction
concurrently from two different session
4: observe that both jobs are are running
5: Observe that Insert overwrite job is success but after that compaction fails
with below exception:
| ERROR | [pool-23-thread-49] | Error running hive query: |
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException:
Compaction failed. Please check logs for more info. Exception in compaction
java.lang.Exception: Compaction failed to update metadata for table
ajeet.flow_carbon_new999
7: Ideally compaction job should give error with message that insert overwrite
in progress.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
