study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-883819350
hi, when the spark beeline ,it also happen error ``` [hdfs@hadoop-node-1 spark-2.3.4-bin-hadoop2.7]$ bin/beeline Beeline version 1.2.1.spark2 by Apache Hive beeline> !connecot jdbc:hive2://hadoop-node-1:10000 Unknown command: connecot jdbc:hive2://hadoop-node-1:10000 beeline> !connect jdbc:hive2://hadoop-node-1:10000 Connecting to jdbc:hive2://hadoop-node-1:10000 Enter username for jdbc:hive2://hadoop-node-1:10000: hd123 Enter password for jdbc:hive2://hadoop-node-1:10000: ********** Connected to: Spark SQL (version 2.3.4) Driver: Hive JDBC (version 1.2.1.spark2) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://hadoop-node-1:10000> show segments for table test_table; +-------+--------------------+--------------------------+------------------+------------+------------+-------------+--------------+--+ | ID | Status | Load Start Time | Load Time Taken | Partition | Data Size | Index Size | File Format | +-------+--------------------+--------------------------+------------------+------------+------------+-------------+--------------+--+ | 21 | Compacted | 2021-07-09 09:22:41.538 | 7.399S | NA | 619.53KB | 54.21KB | columnar_v3 | | 20 | Compacted | 2021-07-08 18:15:33.536 | 1.454S | NA | 411.54KB | 54.02KB | columnar_v3 | | 19 | Compacted | 2021-07-08 18:14:44.265 | 8.104S | NA | 259.04KB | 53.96KB | columnar_v3 | | 18 | Compacted | 2021-07-08 18:09:25.752 | 7.792S | NA | 178.86KB | 53.90KB | columnar_v3 | | 17 | Compacted | 2021-07-08 18:09:02.815 | 5.136S | NA | 88.90KB | 26.86KB | columnar_v3 | | 16.1 | Compacted | 2021-07-12 13:51:47.44 | 2.452S | NA | 390.78KB | 54.30KB | columnar_v3 | | 16 | Compacted | 2021-07-08 18:03:54.558 | 7.348S | NA | 44.62KB | 13.42KB | columnar_v3 | | 15 | Compacted | 2021-07-08 15:03:17.527 | 1.354S | NA | 12.61KB | 1.29KB | columnar_v3 | | 14 | Compacted | 2021-07-08 14:32:53.337 | 0.485S | NA | 7.48KB | 1.29KB | columnar_v3 | | 13 | Compacted | 2021-07-08 14:32:36.673 | 0.44S | NA | 4.83KB | 1.28KB | columnar_v3 | | 12.1 | Compacted | 2021-07-12 13:51:47.44 | 1.122S | NA | 22.06KB | 1.30KB | columnar_v3 | | 12 | Compacted | 2021-07-08 14:30:41.506 | 0.43S | NA | 3.59KB | 1.28KB | columnar_v3 | | 11 | Compacted | 2021-07-08 14:29:57.866 | 0.436S | NA | 2.95KB | 1.27KB | columnar_v3 | | 10 | Compacted | 2021-07-08 14:29:45.201 | 0.445S | NA | 2.57KB | 1.27KB | columnar_v3 | | 9 | Compacted | 2021-07-08 14:28:36.513 | 0.438S | NA | 2.38KB | 1.27KB | columnar_v3 | | 8.1 | Compacted | 2021-07-12 13:51:47.44 | 0.837S | NA | 3.52KB | 1.28KB | columnar_v3 | | 8 | Compacted | 2021-07-08 14:27:50.502 | 0.541S | NA | 2.28KB | 1.26KB | columnar_v3 | | 7 | Compacted | 2021-07-08 14:27:08.431 | 0.49S | NA | 2.20KB | 1.26KB | columnar_v3 | | 6 | Marked for Delete | 2021-07-08 10:48:47.684 | 0.386S | NA | 1.08KB | 656.0B | columnar_v3 | | 5 | Compacted | 2021-07-08 10:44:38.283 | 14.552S | NA | 1.06KB | 646.0B | columnar_v3 | | 4 | Compacted | 2021-07-08 10:43:51.58 | 14.259S | NA | 1.05KB | 644.0B | columnar_v3 | | 3 | Marked for Delete | 2021-07-08 10:43:19.104 | 16.868S | NA | 1.05KB | 644.0B | columnar_v3 | | 2.3 | Success | 2021-07-12 13:52:15.043 | 1.342S | NA | 1.14MB | 54.60KB | columnar_v3 | | 2.2 | Compacted | 2021-07-12 13:51:47.44 | 1.389S | NA | 23.36KB | 1.30KB | columnar_v3 | | 2.1 | Compacted | 2021-07-12 13:51:47.44 | 0.56S | NA | 2.28KB | 1.27KB | columnar_v3 | | 2 | Compacted | 2021-07-08 10:27:01.657 | 0.487S | NA | 1.14KB | 659.0B | columnar_v3 | | 1 | Marked for Delete | 2021-07-08 10:21:01.823 | 0.45S | NA | 1.06KB | 646.0B | columnar_v3 | | 0 | Marked for Delete | 2021-07-08 10:20:36.083 | 0.738S | NA | 1.05KB | 644.0B | columnar_v3 | +-------+--------------------+--------------------------+------------------+------------+------------+-------------+--------------+--+ 28 rows selected (0.063 seconds) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM test_table WHERE SEGMENT.ID IN (0,1); Error: org.apache.spark.sql.AnalysisException: cannot resolve '`SEGMENT.ID`' given input columns: [test_table.age, tupleId, test_table.name, test_table.city, test_table.id]; line 1 pos 38; 'Project ['tupleId] +- 'Filter 'SEGMENT.ID IN (0,1) +- Project [id#2898, name#2899, city#2900, age#2901, UDF:getTupleId() AS tupleId#3151] +- SubqueryAlias test_table +- Relation[id#2898,name#2899,city#2900,age#2901] CarbonDatasourceHadoopRelation (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM table test_table WHERE SEGMENT.ID IN (0,1); Error: java.lang.RuntimeException: Delete segment by Id is failed. Invalid ID is: 0 (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM table test_table WHERE SEGMENT.ID IN ('0','1'); Error: org.apache.spark.sql.catalyst.analysis.NoSuchTableException: Table or view 'table' not found in database 'default'; (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM table test_table WHERE SEGMENT.ID IN (0); Error: java.lang.RuntimeException: Delete segment by Id is failed. Invalid ID is: 0 (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM test_table WHERE SEGMENT.ID IN (0); Error: org.apache.spark.sql.AnalysisException: cannot resolve '`SEGMENT.ID`' given input columns: [test_table.age, test_table.name, test_table.city, tupleId, test_table.id]; line 1 pos 38; 'Project ['tupleId] +- 'Filter 'SEGMENT.ID IN (0) +- Project [id#2898, name#2899, city#2900, age#2901, UDF:getTupleId() AS tupleId#3178] +- SubqueryAlias test_table +- Relation[id#2898,name#2899,city#2900,age#2901] CarbonDatasourceHadoopRelation (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM table test_table WHERE SEGMENT.ID IN (0); Error: java.lang.RuntimeException: Delete segment by Id is failed. Invalid ID is: 0 (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> DELETE FROM table test_table WHERE SEGMENT.ID IN (6); Error: java.lang.RuntimeException: Delete segment by Id is failed. Invalid ID is: 6 (state=,code=0) 0: jdbc:hive2://hadoop-node-1:10000> show segments for table test_table; +-------+--------------------+--------------------------+------------------+------------+------------+-------------+--------------+--+ | ID | Status | Load Start Time | Load Time Taken | Partition | Data Size | Index Size | File Format | +-------+--------------------+--------------------------+------------------+------------+------------+-------------+--------------+--+ | 21 | Compacted | 2021-07-09 09:22:41.538 | 7.399S | NA | 619.53KB | 54.21KB | columnar_v3 | | 20 | Compacted | 2021-07-08 18:15:33.536 | 1.454S | NA | 411.54KB | 54.02KB | columnar_v3 | | 19 | Compacted | 2021-07-08 18:14:44.265 | 8.104S | NA | 259.04KB | 53.96KB | columnar_v3 | | 18 | Compacted | 2021-07-08 18:09:25.752 | 7.792S | NA | 178.86KB | 53.90KB | columnar_v3 | | 17 | Compacted | 2021-07-08 18:09:02.815 | 5.136S | NA | 88.90KB | 26.86KB | columnar_v3 | | 16.1 | Compacted | 2021-07-12 13:51:47.44 | 2.452S | NA | 390.78KB | 54.30KB | columnar_v3 | | 16 | Compacted | 2021-07-08 18:03:54.558 | 7.348S | NA | 44.62KB | 13.42KB | columnar_v3 | | 15 | Compacted | 2021-07-08 15:03:17.527 | 1.354S | NA | 12.61KB | 1.29KB | columnar_v3 | | 14 | Compacted | 2021-07-08 14:32:53.337 | 0.485S | NA | 7.48KB | 1.29KB | columnar_v3 | | 13 | Compacted | 2021-07-08 14:32:36.673 | 0.44S | NA | 4.83KB | 1.28KB | columnar_v3 | | 12.1 | Compacted | 2021-07-12 13:51:47.44 | 1.122S | NA | 22.06KB | 1.30KB | columnar_v3 | | 12 | Compacted | 2021-07-08 14:30:41.506 | 0.43S | NA | 3.59KB | 1.28KB | columnar_v3 | | 11 | Compacted | 2021-07-08 14:29:57.866 | 0.436S | NA | 2.95KB | 1.27KB | columnar_v3 | | 10 | Compacted | 2021-07-08 14:29:45.201 | 0.445S | NA | 2.57KB | 1.27KB | columnar_v3 | | 9 | Compacted | 2021-07-08 14:28:36.513 | 0.438S | NA | 2.38KB | 1.27KB | columnar_v3 | | 8.1 | Compacted | 2021-07-12 13:51:47.44 | 0.837S | NA | 3.52KB | 1.28KB | columnar_v3 | | 8 | Compacted | 2021-07-08 14:27:50.502 | 0.541S | NA | 2.28KB | 1.26KB | columnar_v3 | | 7 | Compacted | 2021-07-08 14:27:08.431 | 0.49S | NA | 2.20KB | 1.26KB | columnar_v3 | | 6 | Marked for Delete | 2021-07-08 10:48:47.684 | 0.386S | NA | 1.08KB | 656.0B | columnar_v3 | | 5 | Compacted | 2021-07-08 10:44:38.283 | 14.552S | NA | 1.06KB | 646.0B | columnar_v3 | | 4 | Compacted | 2021-07-08 10:43:51.58 | 14.259S | NA | 1.05KB | 644.0B | columnar_v3 | | 3 | Marked for Delete | 2021-07-08 10:43:19.104 | 16.868S | NA | 1.05KB | 644.0B | columnar_v3 | | 2.3 | Success | 2021-07-12 13:52:15.043 | 1.342S | NA | 1.14MB | 54.60KB | columnar_v3 | | 2.2 | Compacted | 2021-07-12 13:51:47.44 | 1.389S | NA | 23.36KB | 1.30KB | columnar_v3 | | 2.1 | Compacted | 2021-07-12 13:51:47.44 | 0.56S | NA | 2.28KB | 1.27KB | columnar_v3 | | 2 | Compacted | 2021-07-08 10:27:01.657 | 0.487S | NA | 1.14KB | 659.0B | columnar_v3 | | 1 | Marked for Delete | 2021-07-08 10:21:01.823 | 0.45S | NA | 1.06KB | 646.0B | columnar_v3 | | 0 | Marked for Delete | 2021-07-08 10:20:36.083 | 0.738S | NA | 1.05KB | 644.0B | columnar_v3 | +-------+--------------------+--------------------------+------------------+------------+------------+-------------+--------------+--+ 28 rows selected (0.064 seconds) 0: jdbc:hive2://hadoop-node-1:10000> ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org