Chetan Bhat created CARBONDATA-4048:
---------------------------------------
Summary: Update fails after continous update operations with error
Key: CARBONDATA-4048
URL: https://issues.apache.org/jira/browse/CARBONDATA-4048
Project: CarbonData
Issue Type: Bug
Components: data-query
Affects Versions: 2.1.0
Environment: Spark 2.3.2
Reporter: Chetan Bhat
Create table , load data and perform continous update operation on the table.
0: jdbc:hive2://10.20.255.171:23040> CREATE TABLE uniqdata (CUST_ID
int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp,
BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10),
DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2
double,INTEGER_COLUMN1 int) stored as carbondata TBLPROPERTIES
("TABLE_BLOCKSIZE"= "256 MB",'flat_folder'='true');
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (0.177 seconds)
0: jdbc:hive2://10.20.255.171:23040> LOAD DATA inpath
'hdfs://hacluster/chetan/2000_UniqData.csv' INTO table uniqdata
options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION,
DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2,
Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1','TIMESTAMPFORMAT'='yyyy-MM-dd
HH:mm:ss','BAD_RECORDS_ACTION'='FORCE');
+---------+--+
| Result |
+---------+--+
+---------+--+
No rows selected (1.484 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1<123372036856;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 2 |
+--------------------+--+
1 row selected (3.294 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1>123372038852;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 1 |
+--------------------+--+
1 row selected (3.467 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1<=123372036859;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 9 |
+--------------------+--+
1 row selected (3.349 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1>=123372038846;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 8 |
+--------------------+--+
1 row selected (3.259 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1 == 123372038845;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 1 |
+--------------------+--+
1 row selected (4.164 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1 like '123%';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 2000 |
+--------------------+--+
1 row selected (3.695 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1 between 123372038849 AND 123372038855;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 5 |
+--------------------+--+
1 row selected (3.228 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1 = 123372038845 OR false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 1 |
+--------------------+--+
1 row selected (3.548 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1 = 123372038849 AND true;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 1 |
+--------------------+--+
1 row selected (3.321 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (bigint_column1)=(100)
where bigint_column1 not between (123372038849) AND (12337203885);
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 4025 |
+--------------------+--+
1 row selected (3.718 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name<'CUST_NAME_01990';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 5978 |
+--------------------+--+
1 row selected (4.109 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name>'CUST_NAME_01990';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 6022 |
+--------------------+--+
1 row selected (3.643 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name<='CUST_NAME_01990';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 5981 |
+--------------------+--+
1 row selected (3.713 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name >='CUST_NAME_01990';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 12050 |
+--------------------+--+
1 row selected (4.019 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name=='CUST_NAME_01990';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 3 |
+--------------------+--+
1 row selected (3.327 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name like 'CUST_NAME_0199%';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 47 |
+--------------------+--+
1 row selected (3.47 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name between 'CUST_NAME_01990' AND 'CUST_NAME_01995';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 26 |
+--------------------+--+
1 row selected (3.512 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name = 'CUST_NAME_01990' OR false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 3 |
+--------------------+--+
1 row selected (3.589 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name='cust_00033' AND false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 0 |
+--------------------+--+
1 row selected (0.462 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('deepti')
where cust_name not between 'CUST_NAME_01990' AND 'CUST_NAME_1999';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 18107 |
+--------------------+--+
1 row selected (4.353 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100.00) where decimal_column1<12345678917.1234000000;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 224 |
+--------------------+--+
1 row selected (3.494 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100.00) where decimal_column1>12345.6808982656;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 23964 |
+--------------------+--+
1 row selected (4.677 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100.00) where decimal_column1<=12345678917.1234000000;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 24247 |
+--------------------+--+
1 row selected (4.717 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100.00) where decimal_column1>=12345.6807932656;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 6025 |
+--------------------+--+
1 row selected (3.754 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100.00) where decimal_column1=12345.6807332656;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 0 |
+--------------------+--+
1 row selected (2.198 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100) where decimal_column1 like '123%';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 6025 |
+--------------------+--+
1 row selected (4.173 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100) where decimal_column1 between 12345.6808882656 AND
12345.6809002656;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 0 |
+--------------------+--+
1 row selected (2.113 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100) where (decimal_column1) = (12345678920.1234000000) OR
false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 3 |
+--------------------+--+
1 row selected (3.798 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100) where decimal_column1 = 12345.6808782656 OR false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 0 |
+--------------------+--+
1 row selected (2.126 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(100.0) where decimal_column1 not between 12345.6808882656
AND 12345.6809002656;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 42325 |
+--------------------+--+
1 row selected (5.33 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(10000)
where cust_id<10987;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 47870 |
+--------------------+--+
1 row selected (5.907 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(1000) where
cust_id>10987;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 456 |
+--------------------+--+
1 row selected (3.596 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id<=10987;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 96220 |
+--------------------+--+
1 row selected (7.291 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id>=10987;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 480 |
+--------------------+--+
1 row selected (3.597 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id==10987;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 24 |
+--------------------+--+
1 row selected (3.534 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id like '109%';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 2568 |
+--------------------+--+
1 row selected (3.909 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id between 10987 AND 10999;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 480 |
+--------------------+--+
1 row selected (3.717 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id = 10987 OR false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 24 |
+--------------------+--+
1 row selected (3.535 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id = 10987 AND false;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 0 |
+--------------------+--+
1 row selected (0.467 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_id)=(100) where
cust_id not between 10987 AND 10999;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 147666 |
+--------------------+--+
1 row selected (9.295 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(ASCII(cust_name)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 24 |
+--------------------+--+
1 row selected (3.562 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(CONCAT(cust_name,ACTIVE_EMUI_VERSION)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 48 |
+--------------------+--+
1 row selected (3.785 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(CONCAT('Mr.', cust_name)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 72 |
+--------------------+--+
1 row selected (3.509 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(concat_ws('/',cust_name)) where cust_id=10902;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 24 |
+--------------------+--+
1 row selected (3.525 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(concat_ws('/',cust_name,active_emui_version)) where cust_id=10902;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 48 |
+--------------------+--+
1 row selected (3.537 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(LENGTH(cust_name)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 96 |
+--------------------+--+
1 row selected (3.627 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(bigint_column1)=(LENGTH(bigint_column1)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 120 |
+--------------------+--+
1 row selected (3.61 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(LTRIM(cust_name)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 144 |
+--------------------+--+
1 row selected (3.705 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(FORMAT_NUMBER(bigint_column1, 2)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 168 |
+--------------------+--+
1 row selected (3.63 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(REVERSE(cust_name)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 192 |
+--------------------+--+
1 row selected (3.655 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_name)=(REPEAT(cust_name,2)) where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 216 |
+--------------------+--+
1 row selected (3.677 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=('A J
Styles') where cust_id=10902;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 72 |
+--------------------+--+
1 row selected (3.674 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (cust_name)=(cust_id)
where cust_id=10902;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 96 |
+--------------------+--+
1 row selected (3.643 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(bigint_column1)=('deepti') where cust_id=10903;
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 240 |
+--------------------+--+
1 row selected (3.756 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_id)=(21474836479999999) where cust_name='CUST_NAME_01999';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 150 |
+--------------------+--+
1 row selected (3.727 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(cust_id)=(-214748364867) where cust_name='CUST_NAME_01998';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 125 |
+--------------------+--+
1 row selected (3.741 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(bigint_column1)=(-9223372036854770000) where cust_name='CUST_NAME_01998';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 250 |
+--------------------+--+
1 row selected (3.696 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(bigint_column2)=(922337203685479999999999) where cust_name='CUST_NAME_01998';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 375 |
+--------------------+--+
1 row selected (3.688 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(double_column1)=(4.9E-32) where cust_name='CUST_NAME_01998';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 500 |
+--------------------+--+
1 row selected (3.889 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set
(decimal_column1)=(1234567890123456789012.123456789012345) where
cust_name='CUST_NAME_01998';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 625 |
+--------------------+--+
1 row selected (11.982 seconds)
0: jdbc:hive2://10.20.255.171:23040> update uniqdata set (dob)=('2016-13-31
12:00:00') where cust_name='CUST_NAME_01998';
+--------------------+--+
| Updated Row Count |
+--------------------+--+
| 750 |
+--------------------+--+
1 row selected (5.614 seconds)
After some time the update fails.
0: jdbc:hive2://10.20.255.171:23040> Update uniqdata set (CUST_ID) = ((select
ASCII(CUST_NAME) from uniqdata where cust_name='CUST_NAME_00060'));
Error: java.lang.RuntimeException: Update operation failed. more than one row
returned by a subquery used as an expression:
Subquery subquery980
+- *(1) Project [ascii(CUST_NAME#45) AS ascii(CUST_NAME)#982]
+- *(1) Filter (isnotnull(cust_name#45) && (cust_name#45 = CUST_NAME_00060))
+- *(1) FileScan carbondata chetan.uniqdata[cust_name#45] PushedFilters:
[IsNotNull(cust_name), EqualTo(cust_name,CUST_NAME_00060)], ReadSchema:
struct<CUST_NAME:string> (state=,code=0)
Log-
2020-11-07 00:30:09,167 | ERROR | [HiveServer2-Background-Pool: Thread-363] |
Exception in update operation |
org.apache.spark.sql.execution.command.mutation.CarbonProjectForUpdateCommand.processData(CarbonProjectForUpdateCommand.scala:228)2020-11-07
00:30:09,167 | ERROR | [HiveServer2-Background-Pool: Thread-363] | Exception
in update operation |
org.apache.spark.sql.execution.command.mutation.CarbonProjectForUpdateCommand.processData(CarbonProjectForUpdateCommand.scala:228)java.lang.RuntimeException:
more than one row returned by a subquery used as an expression:Subquery
subquery980+- *(1) Project [ascii(CUST_NAME#45) AS ascii(CUST_NAME)#982] +-
*(1) Filter (isnotnull(cust_name#45) && (cust_name#45 = CUST_NAME_00060))
+- *(1) FileScan carbondata chetan.uniqdata[cust_name#45] PushedFilters:
[IsNotNull(cust_name), EqualTo(cust_name,CUST_NAME_00060)], ReadSchema:
struct<CUST_NAME:string>
at scala.sys.package$.error(package.scala:27) at
org.apache.spark.sql.execution.ScalarSubquery.updateResult(subquery.scala:69)
at
org.apache.spark.sql.execution.SparkPlan$$anonfun$waitForSubqueries$1.apply(SparkPlan.scala:185)
at
org.apache.spark.sql.execution.SparkPlan$$anonfun$waitForSubqueries$1.apply(SparkPlan.scala:184)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at
org.apache.spark.sql.execution.SparkPlan.waitForSubqueries(SparkPlan.scala:184)
at
org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:154)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at
org.apache.spark.sql.execution.CodegenSupport$class.produce(WholeStageCodegenExec.scala:83)
at
org.apache.spark.sql.execution.ProjectExec.produce(basicPhysicalOperators.scala:35)
at
org.apache.spark.sql.execution.WholeStageCodegenExec.doCodeGen(WholeStageCodegenExec.scala:524)
at
org.apache.spark.sql.execution.WholeStageCodegenExec.doExecute(WholeStageCodegenExec.scala:576)
at
org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at
org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at
org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127) at
org.apache.spark.sql.execution.columnar.InMemoryRelation.buildBuffers(InMemoryRelation.scala:107)
at
org.apache.spark.sql.execution.columnar.InMemoryRelation.<init>(InMemoryRelation.scala:102)
at
org.apache.spark.sql.execution.columnar.InMemoryRelation$.apply(InMemoryRelation.scala:43)
at
org.apache.spark.sql.execution.CacheManager$$anonfun$cacheQuery$1.apply(CacheManager.scala:97)
at
org.apache.spark.sql.execution.CacheManager.writeLock(CacheManager.scala:67) at
org.apache.spark.sql.execution.CacheManager.cacheQuery(CacheManager.scala:91)
at org.apache.spark.sql.Dataset.persist(Dataset.scala:2929) at
org.apache.spark.sql.execution.command.mutation.CarbonProjectForUpdateCommand.processData(CarbonProjectForUpdateCommand.scala:140)
at
org.apache.spark.sql.execution.command.DataCommand$$anonfun$run$2.apply(package.scala:132)
at
org.apache.spark.sql.execution.command.DataCommand$$anonfun$run$2.apply(package.scala:132)
at
org.apache.spark.sql.execution.command.Auditable$class.runWithAudit(package.scala:104)
at
org.apache.spark.sql.execution.command.DataCommand.runWithAudit(package.scala:130)
at org.apache.spark.sql.execution.command.DataCommand.run(package.scala:132)
at
org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at
org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at
org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:79)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190) at
org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190) at
org.apache.spark.sql.Dataset$$anonfun$52.apply(Dataset.scala:3259) at
org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:77)
at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3258) at
org.apache.spark.sql.Dataset.<init>(Dataset.scala:190) at
org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:75) at
org.apache.spark.sql.SparkSession.sql(SparkSession.scala:642) at
org.apache.spark.sql.SQLContext.sql(SQLContext.scala:694) at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:232)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:175)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:171)
at java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1.run(SparkExecuteStatementOperation.scala:185)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at
java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)2020-11-07 00:30:09,173 | INFO |
[HiveServer2-Background-Pool: Thread-363] | updateLock unlocked successfully
after update uniqdata |
org.apache.spark.sql.execution.command.mutation.CarbonProjectForUpdateCommand.processData(CarbonProjectForUpdateCommand.scala:248)2020-11-07
00:30:09,178 | INFO | [HiveServer2-Background-Pool: Thread-363] |
compactionLock unlocked successfully after update uniqdata |
org.apache.spark.sql.execution.command.mutation.CarbonProjectForUpdateCommand.processData(CarbonProjectForUpdateCommand.scala:254)2020-11-07
00:30:09,182 | INFO | [HiveServer2-Background-Pool: Thread-363] | Metadata
lock has been successfully released |
org.apache.carbondata.core.locks.CarbonLockUtil.fileUnlock(CarbonLockUtil.java:49)2020-11-07
00:30:09,189 | AUDIT | [HiveServer2-Background-Pool: Thread-363] |
\{"time":"November 7, 2020 12:30:09 AM
CST","username":"anonymous","opName":"UPDATE
DATA","opId":"2805904551130888","opStatus":"FAILED","opTime":"1313
ms","table":"chetan.uniqdata","extraInfo":{"Exception":"java.lang.RuntimeException","Message":"Update
operation failed. more than one row returned by a subquery used as an
expression:\nSubquery subquery980\n+- *(1) Project [ascii(CUST_NAME#45) AS
ascii(CUST_NAME)#982]\n +- *(1) Filter (isnotnull(cust_name#45) &&
(cust_name#45 = CUST_NAME_00060))\n +- *(1) FileScan carbondata
chetan.uniqdata[cust_name#45] PushedFilters: [IsNotNull(cust_name),
EqualTo(cust_name,CUST_NAME_00060)], ReadSchema: struct<CUST_NAME:string>\n"}}
|
org.apache.carbondata.processing.util.Auditor.logOperationEnd(Auditor.java:97)2020-11-07
00:30:09,191 | ERROR | [HiveServer2-Background-Pool: Thread-363] | Error
executing query, currentState RUNNING, |
org.apache.spark.internal.Logging$class.logError(Logging.scala:91)java.lang.RuntimeException:
Update operation failed. more than one row returned by a subquery used as an
expression:Subquery subquery980+- *(1) Project [ascii(CUST_NAME#45) AS
ascii(CUST_NAME)#982] +- *(1) Filter (isnotnull(cust_name#45) &&
(cust_name#45 = CUST_NAME_00060)) +- *(1) FileScan carbondata
chetan.uniqdata[cust_name#45] PushedFilters: [IsNotNull(cust_name),
EqualTo(cust_name,CUST_NAME_00060)], ReadSchema: struct<CUST_NAME:string>
at scala.sys.package$.error(package.scala:27) at
org.apache.spark.sql.execution.command.mutation.CarbonProjectForUpdateCommand.processData(CarbonProjectForUpdateCommand.scala:232)
at
org.apache.spark.sql.execution.command.DataCommand$$anonfun$run$2.apply(package.scala:132)
at
org.apache.spark.sql.execution.command.DataCommand$$anonfun$run$2.apply(package.scala:132)
at
org.apache.spark.sql.execution.command.Auditable$class.runWithAudit(package.scala:104)
at
org.apache.spark.sql.execution.command.DataCommand.runWithAudit(package.scala:130)
at org.apache.spark.sql.execution.command.DataCommand.run(package.scala:132)
at
org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at
org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at
org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:79)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190) at
org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190) at
org.apache.spark.sql.Dataset$$anonfun$52.apply(Dataset.scala:3259) at
org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:77)
at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3258) at
org.apache.spark.sql.Dataset.<init>(Dataset.scala:190) at
org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:75) at
org.apache.spark.sql.SparkSession.sql(SparkSession.scala:642) at
org.apache.spark.sql.SQLContext.sql(SQLContext.scala:694) at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:232)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:175)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:171)
at java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1.run(SparkExecuteStatementOperation.scala:185)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at
java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)2020-11-07 00:30:09,192 | ERROR |
[HiveServer2-Background-Pool: Thread-363] | Error running hive query: |
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:179)org.apache.hive.service.cli.HiveSQLException:
java.lang.RuntimeException: Update operation failed. more than one row
returned by a subquery used as an expression:Subquery subquery980+- *(1)
Project [ascii(CUST_NAME#45) AS ascii(CUST_NAME)#982] +- *(1) Filter
(isnotnull(cust_name#45) && (cust_name#45 = CUST_NAME_00060)) +- *(1)
FileScan carbondata chetan.uniqdata[cust_name#45] PushedFilters:
[IsNotNull(cust_name), EqualTo(cust_name,CUST_NAME_00060)], ReadSchema:
struct<CUST_NAME:string>
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:269)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:175)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:171)
at java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1.run(SparkExecuteStatementOperation.scala:185)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at
java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)2020-11-07 00:30:09,195 | INFO |
[HiveServer2-Handler-Pool: Thread-83] | Asked to cancel job group
60a4f869-1300-4a8a-a575-196f32184ed1 |
org.apache.spark.internal.Logging$class.logInfo(Logging.scala:54)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
