[
https://issues.apache.org/jira/browse/CARBONDATA-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajeet Rai updated CARBONDATA-1754:
----------------------------------
Description:
Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if
insert overwrite job is running concurrently.
Steps:
1: Create a table
2: Start three load one by one
3: After load is completed, start insert overwrite and minor compaction
concurrently from two different session
4: observe that both jobs are are running
5: Observe that Insert overwrite job is success but after that compaction fails
with below exception:
| ERROR | [pool-23-thread-49] | Error running hive query: |
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException:
Compaction failed. Please check logs for more info. Exception in compaction
java.lang.Exception: Compaction failed to update metadata for table
ajeet.flow_carbon_new999
7: Ideally compaction job should give error in start with message that insert
overwrite in progress.
was:
Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if
insert overwrite job is running concurrently.
Steps:
1: Create a table
2: Start three load one by one
3: After load is completed, start insert overwrite and minor compaction
concurrently from two different session
4: observe that both jobs are are running
5: Observe that Insert overwrite job is success but after that compaction fails
with below exception:
| ERROR | [pool-23-thread-49] | Error running hive query: |
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException:
Compaction failed. Please check logs for more info. Exception in compaction
java.lang.Exception: Compaction failed to update metadata for table
ajeet.flow_carbon_new999
7: Ideally compaction job should give error with message that insert overwrite
in progress.
> Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if
> insert overwrite job is running concurrently
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-1754
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1754
> Project: CarbonData
> Issue Type: Bug
> Components: data-load
> Affects Versions: 1.3.0
> Environment: 3 Node ant cluster
> Reporter: Ajeet Rai
> Labels: dfx
>
> Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if
> insert overwrite job is running concurrently.
> Steps:
> 1: Create a table
> 2: Start three load one by one
> 3: After load is completed, start insert overwrite and minor compaction
> concurrently from two different session
> 4: observe that both jobs are are running
> 5: Observe that Insert overwrite job is success but after that compaction
> fails with below exception:
> | ERROR | [pool-23-thread-49] | Error running hive query: |
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
> org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException:
> Compaction failed. Please check logs for more info. Exception in compaction
> java.lang.Exception: Compaction failed to update metadata for table
> ajeet.flow_carbon_new999
> 7: Ideally compaction job should give error in start with message that insert
> overwrite in progress.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
