[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-886418870 thanks thanks thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-885533091 thanks . what does it mean about 'Compacted' 'Success', the Status has how many types ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-885531971 thanks . what does it mean about 'Compacted' 'Success', the Status has how many types ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-885358237 Thank you very much for your help, let me know more about carbondata！ I have a questions . in the https://github.com/apache/carbondata/blob/master/docs/clean-files.md ``` Carbondata supports a Trash Folder which is used as a redundant folder where all stale(segments whose entry is not in tablestatus file) carbondata segments are moved to during clean files operation. This trash folder is mantained inside the table path and is a hidden folder(.Trash). The segments that are moved to the trash folder are mantained under a timestamp subfolder(each clean files operation is represented by a timestamp). This helps the user to list down segments in the trash folder by timestamp. By default all the timestamp sub-directory have an expiration time of 7 days(since the timestamp it was created) and it can be configured by the user using the following carbon property. The supported values are between 0 and 365(both included.) ``` but, Not automatically deleted after the default time.This is why？ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-883819350 hi, when the spark beeline ,it also happen error ``` [hdfs@hadoop-node-1 spark-2.3.4-bin-hadoop2.7]$ bin/beeline Beeline version 1.2.1.spark2 by Apache Hive beeline> !connecot jdbc:hive2://hadoop-node-1:1 Unknown command: connecot jdbc:hive2://hadoop-node-1:1 beeline> !connect jdbc:hive2://hadoop-node-1:1 Connecting to jdbc:hive2://hadoop-node-1:1 Enter username for jdbc:hive2://hadoop-node-1:1: hd123 Enter password for jdbc:hive2://hadoop-node-1:1: ** Connected to: Spark SQL (version 2.3.4) Driver: Hive JDBC (version 1.2.1.spark2) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://hadoop-node-1:1> show segments for table test_table; +---++--+--+++-+--+--+ | ID | Status | Load Start Time | Load Time Taken | Partition | Data Size | Index Size | File Format | +---++--+--+++-+--+--+ | 21| Compacted | 2021-07-09 09:22:41.538 | 7.399S | NA | 619.53KB | 54.21KB | columnar_v3 | | 20| Compacted | 2021-07-08 18:15:33.536 | 1.454S | NA | 411.54KB | 54.02KB | columnar_v3 | | 19| Compacted | 2021-07-08 18:14:44.265 | 8.104S | NA | 259.04KB | 53.96KB | columnar_v3 | | 18| Compacted | 2021-07-08 18:09:25.752 | 7.792S | NA | 178.86KB | 53.90KB | columnar_v3 | | 17| Compacted | 2021-07-08 18:09:02.815 | 5.136S | NA | 88.90KB| 26.86KB | columnar_v3 | | 16.1 | Compacted | 2021-07-12 13:51:47.44 | 2.452S | NA | 390.78KB | 54.30KB | columnar_v3 | | 16| Compacted | 2021-07-08 18:03:54.558 | 7.348S | NA | 44.62KB| 13.42KB | columnar_v3 | | 15| Compacted | 2021-07-08 15:03:17.527 | 1.354S | NA | 12.61KB| 1.29KB | columnar_v3 | | 14| Compacted | 2021-07-08 14:32:53.337 | 0.485S | NA | 7.48KB | 1.29KB | columnar_v3 | | 13| Compacted | 2021-07-08 14:32:36.673 | 0.44S| NA | 4.83KB | 1.28KB | columnar_v3 | | 12.1 | Compacted | 2021-07-12 13:51:47.44 | 1.122S | NA | 22.06KB| 1.30KB | columnar_v3 | | 12| Compacted | 2021-07-08 14:30:41.506 | 0.43S| NA | 3.59KB | 1.28KB | columnar_v3 | | 11| Compacted | 2021-07-08 14:29:57.866 | 0.436S | NA | 2.95KB | 1.27KB | columnar_v3 | | 10| Compacted | 2021-07-08 14:29:45.201 | 0.445S | NA | 2.57KB | 1.27KB | columnar_v3 | | 9 | Compacted | 2021-07-08 14:28:36.513 | 0.438S | NA | 2.38KB | 1.27KB | columnar_v3 | | 8.1 | Compacted | 2021-07-12 13:51:47.44 | 0.837S | NA | 3.52KB | 1.28KB | columnar_v3 | | 8 | Compacted | 2021-07-08 14:27:50.502 | 0.541S | NA | 2.28KB | 1.26KB | columnar_v3 | | 7 | Compacted | 2021-07-08 14:27:08.431 | 0.49S| NA | 2.20KB | 1.26KB | columnar_v3 | | 6 | Marked for Delete | 2021-07-08 10:48:47.684 | 0.386S | NA | 1.08KB | 656.0B | columnar_v3 | | 5 | Compacted | 2021-07-08 10:44:38.283 | 14.552S | NA | 1.06KB | 646.0B | columnar_v3 | | 4 | Compacted | 2021-07-08 10:43:51.58 | 14.259S | NA | 1.05KB | 644.0B | columnar_v3 | | 3 | Marked for Delete | 2021-07-08 10:43:19.104 | 16.868S | NA | 1.05KB | 644.0B | columnar_v3 | | 2.3 | Success| 2021-07-12 13:52:15.043 | 1.342S | NA | 1.14MB | 54.60KB | columnar_v3 | | 2.2 | Compacted | 2021-07-12 13:51:47.44 | 1.389S | NA | 23.36KB| 1.30KB | columnar_v3 | | 2.1 | Compacted | 2021-07-12 13:51:47.44 | 0.56S| NA | 2.28KB | 1.27KB | columnar_v3 | | 2 | Compacted | 2021-07-08 10:27:01.657 | 0.487S | NA | 1.14KB | 659.0B | columnar_v3 | | 1 | Marked for Delete | 2021-07-08 10:21:01.823 | 0.45S| NA | 1.06KB | 646.0B | columnar_v3 | | 0 | Marked for Delete | 2021-07-08 10:20:36.083
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-883815940 1. it is hive beeline ``` 0: jdbc:hive2://hadoop-node-1:1> show create table test_table; ++--+ | createtab_stmt | ++--+ | CREATE TABLE `test_table` (`id` STRING, `name` STRING, `city` STRING, `age` INT) USING carbondata OPTIONS ( `indexInfo` '[]' ) | ++--+ 1 row selected (0.493 seconds) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-882976676 Hi, DELETE FROM default.test_table WHERE SEGMENT.ID IN (0,1); also reported an error. error info : Error: org.apache.spark.sql.AnalysisException: cannot resolve '`SEGMENT.ID`' given input columns: .line 1 pos 45; 'Project ['tupleId] +- 'Filter 'SEGMENT.ID IN (0) ... 39 more fields] +- SubqueryAlias 38 more fields] CarbonDatasourceHadoopRelation (state=,code=0) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-882976676 Hi, DELETE FROM default.test_table WHERE SEGMENT.ID IN (0,1); also reported an error. error info : Error: org.apache.spark.sql.AnalysisException: cannot resolve '`SEGMENT.ID`' given input columns: .line 1 pos 45; 'Project ['tupleId] +- 'Filter 'SEGMENT.ID IN (0) ... 39 more fields] +- SubqueryAlias 38 more fields] CarbonDatasourceHadoopRelation (state=,code=0) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-882976676 Hi, DELETE FROM default.test_table WHERE SEGMENT.ID IN (0,1); also reported an error. error info : Error: org.apache.spark.sql.AnalysisException: cannot resolve '`SEGMENT.ID`' given input columns: .line 1 pos 45; 'Project ['tupleId] +- 'Filter 'SEGMENT.ID IN (0) ... 39 more fields] +- SubqueryAlias 38 more fields] CarbonDatasourceHadoopRelation (state=,code=0) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
