[GitHub] [carbondata] CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179#issuecomment-484849948 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11171/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484807300 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2908/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484807436 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11169/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179#issuecomment-484829766 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2910/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484845192 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11170/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484848449 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2911/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484808296 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3139/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484815975 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2909/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] asfgit closed pull request #3174: [CARBONDATA-3344] Fix Drop column not present in table
asfgit closed pull request #3174: [CARBONDATA-3344] Fix Drop column not present in table URL: https://github.com/apache/carbondata/pull/3174 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] Indhumathi27 opened a new pull request #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
Indhumathi27 opened a new pull request #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179 1. Support Incremental DataLoad for MV Datamap[with single parent table] 2. New DDL for supporting compaction on mv datamap table. Please refer [https://issues.apache.org/jira/browse/CARBONDATA-3296 ](https://issues.apache.org/jira/browse/CARBONDATA-3296) for more details - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Resolved] (CARBONDATA-3344) Fix Drop column not present in table
[ https://issues.apache.org/jira/browse/CARBONDATA-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-3344. - Resolution: Fixed Fix Version/s: 1.5.4 > Fix Drop column not present in table > > > Key: CARBONDATA-3344 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3344 > Project: CarbonData > Issue Type: Bug >Reporter: Indhumathi Muthumurugesh >Priority: Minor > Fix For: 1.5.4 > > Attachments: drop.png > > Time Spent: 3.5h > Remaining Estimate: 0h > > Steps to Reproduce: > # create table test1(col1 int) stored by 'carbondata' > # Try to Drop column not present in table => alter table test1 drop > columns(name) > # Find the null pointer exception > !drop.png! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [carbondata] CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179#issuecomment-484848200 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3141/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179#issuecomment-484878700 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2912/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-484898806 Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11174/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] QiangCai opened a new pull request #3180: [WIP] delete issue test case
QiangCai opened a new pull request #3180: [WIP] delete issue test case URL: https://github.com/apache/carbondata/pull/3180 ``` +-++---+--+---++---+--+---++-+ |smallintfield|intfield|bigintfield|floatfield|doublefield|decimalfield|timestampfield |datefield |stringfield|varcharfield|charfield| +-++---+--+---++---+--+---++-+ |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |2|2 |2 |2.1 |2.1|2.1234 |2017-06-12 23:59:02|2017-06-12|abc2 |abcd2 |abcde2 | |2|2 |2 |2.1 |2.1|2.1234 |2017-06-12 23:59:02|2017-06-12|abc2 |abcd2 |abcde2 | |2|2 |2 |2.1 |2.1|2.1234 |2017-06-12 23:59:02|2017-06-12|abc2 |abcd2 |abcde2 | |2|2 |2 |2.1 |2.1|2.1234 |2017-06-12 23:59:02|2017-06-12|abc2 |abcd2 |abcde2 | |2|2 |2 |2.1 |2.1|2.1234 |2017-06-12 23:59:02|2017-06-12|abc2 |abcd2 |abcde2 | |2|2 |2 |2.1 |2.1|2.1234 |2017-06-12 23:59:02|2017-06-12|abc2 |abcd2 |abcde2 | |3|3 |3 |3.1 |3.1|3.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3 |3.1 |3.1|3.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3 |3.1 |3.1|3.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3 |3.1 |3.1|3.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3 |3.1 |3.1|3.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3 |3.1 |3.1|3.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | +-++---+--+---++---+--+---++-+ ``` after delete from $tableName where smallIntField = 2 the decimalfield is incorrect ``` +-++---+--+---++---+--+---++-+ |smallintfield|intfield|bigintfield|floatfield|doublefield|decimalfield|timestampfield |datefield |stringfield|varcharfield|charfield| +-++---+--+---++---+--+---++-+ |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |-1 |-1 |-1 |-1.1 |-1.1 |-1.1234 |2017-06-11 00:00:01|2017-06-11|abc1 |abcd1 |abcde1 | |3|3 |3 |3.1 |3.1|2.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3 |3.1 |3.1|2.1234 |2017-06-13 23:59:03|2017-06-13|abc3 |abcd3 |abcde3 | |3|3 |3
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484948271 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11177/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179#issuecomment-484900081 Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11173/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] kunal642 commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
kunal642 commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-484909160 Please add a check for Binary Type in all constructors of Field.java This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3180: [WIP] delete issue test case
CarbonDataQA commented on issue #3180: [WIP] delete issue test case URL: https://github.com/apache/carbondata/pull/3180#issuecomment-484917603 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2915/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3180: [WIP] delete issue test case
CarbonDataQA commented on issue #3180: [WIP] delete issue test case URL: https://github.com/apache/carbondata/pull/3180#issuecomment-484938209 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11176/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484878260 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11172/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property
CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property URL: https://github.com/apache/carbondata/pull/3178#issuecomment-484913456 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3145/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-484880890 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2913/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-484897767 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3144/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484946623 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3147/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property
CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property URL: https://github.com/apache/carbondata/pull/3178#issuecomment-484912068 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2914/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484869337 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3142/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table]
CarbonDataQA commented on issue #3179: [WIP] Support Incremental DataLoad for MV Datamap[with single parent table] URL: https://github.com/apache/carbondata/pull/3179#issuecomment-484903091 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3143/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property
CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property URL: https://github.com/apache/carbondata/pull/3178#issuecomment-484912468 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11175/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3177: [WIP] Distributed index server
CarbonDataQA commented on issue #3177: [WIP] Distributed index server URL: https://github.com/apache/carbondata/pull/3177#issuecomment-484923827 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2916/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3180: [WIP] delete issue test case
CarbonDataQA commented on issue #3180: [WIP] delete issue test case URL: https://github.com/apache/carbondata/pull/3180#issuecomment-484945268 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3146/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-485048849 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2917/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] xubo245 commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
xubo245 commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-485048118 @kunal642 ok, done This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property
CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property URL: https://github.com/apache/carbondata/pull/3178#issuecomment-485056873 Build Failed with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11179/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (CARBONDATA-3356) There are some exception when carbonData DataSource read SDK files with varchar
xubo245 created CARBONDATA-3356:
---
Summary: There are some exception when carbonData DataSource read
SDK files with varchar
Key: CARBONDATA-3356
URL: https://issues.apache.org/jira/browse/CARBONDATA-3356
Project: CarbonData
Issue Type: Bug
Reporter: xubo245
There are some exception when carbonData DataSource read SDK files with
varchar
## write data:
{code:java}
public void testReadSchemaFromDataFileArrayString() {
String path = "./testWriteFiles";
try {
FileUtils.deleteDirectory(new File(path));
Field[] fields = new Field[11];
fields[0] = new Field("stringField", DataTypes.STRING);
fields[1] = new Field("shortField", DataTypes.SHORT);
fields[2] = new Field("intField", DataTypes.INT);
fields[3] = new Field("longField", DataTypes.LONG);
fields[4] = new Field("doubleField", DataTypes.DOUBLE);
fields[5] = new Field("boolField", DataTypes.BOOLEAN);
fields[6] = new Field("dateField", DataTypes.DATE);
fields[7] = new Field("timeField", DataTypes.TIMESTAMP);
fields[8] = new Field("decimalField", DataTypes.createDecimalType(8, 2));
fields[9] = new Field("varcharField", DataTypes.VARCHAR);
fields[10] = new Field("arrayField",
DataTypes.createArrayType(DataTypes.STRING));
Map map = new HashMap<>();
map.put("complex_delimiter_level_1", "#");
CarbonWriter writer = CarbonWriter.builder()
.outputPath(path)
.withLoadOptions(map)
.withCsvInput(new Schema(fields))
.writtenBy("CarbonReaderTest")
.build();
for (int i = 0; i < 10; i++) {
String[] row2 = new String[]{
"robot" + (i % 10),
String.valueOf(i % 1),
String.valueOf(i),
String.valueOf(Long.MAX_VALUE - i),
String.valueOf((double) i / 2),
String.valueOf(true),
"2019-03-02",
"2019-02-12 03:03:34",
"12.345",
"varchar",
"Hello#World#From#Carbon"
};
writer.write(row2);
}
writer.close();
File[] dataFiles = new File(path).listFiles(new FilenameFilter() {
@Override
public boolean accept(File dir, String name) {
if (name == null) {
return false;
}
return name.endsWith("carbondata");
}
});
if (dataFiles == null || dataFiles.length < 1) {
throw new RuntimeException("Carbon data file not exists.");
}
Schema schema = CarbonSchemaReader
.readSchema(dataFiles[0].getAbsolutePath())
.asOriginOrder();
// Transform the schema
String[] strings = new String[schema.getFields().length];
for (int i = 0; i < schema.getFields().length; i++) {
strings[i] = (schema.getFields())[i].getFieldName();
}
// Read data
CarbonReader reader = CarbonReader
.builder(path, "_temp")
.projection(strings)
.build();
int i = 0;
while (reader.hasNext()) {
Object[] row = (Object[]) reader.readNextRow();
assert (row[0].equals("robot" + i));
assert (row[2].equals(i));
assert (row[6].equals(17957));
Object[] arr = (Object[]) row[10];
assert (arr[0].equals("Hello"));
assert (arr[3].equals("Carbon"));
i++;
}
reader.close();
// FileUtils.deleteDirectory(new File(path));
} catch (Throwable e) {
e.printStackTrace();
Assert.fail(e.getMessage());
}
}
{code}
## read data
{code:java}
test("Test read image carbon with spark carbon file format, generate by
sdk, CTAS") {
sql("DROP TABLE IF EXISTS binaryCarbon")
sql("DROP TABLE IF EXISTS binaryCarbon3")
if (SparkUtil.isSparkVersionEqualTo("2.1")) {
sql(s"CREATE TABLE binaryCarbon USING CARBON OPTIONS(PATH
'$writerPath')")
sql(s"CREATE TABLE binaryCarbon3 USING CARBON OPTIONS(PATH
'$outputPath')" + " AS SELECT * FROM binaryCarbon")
} else {
//sql(s"CREATE TABLE binaryCarbon USING CARBON LOCATION
'$writerPath'")
sql(s"CREATE TABLE binaryCarbon USING CARBON LOCATION
'/Users/xubo/Desktop/xubo/git/carbondata3/store/sdk/testWriteFiles'")
sql("SELECT COUNT(*) FROM binaryCarbon").show()
}
}
{code}
## exception:
{code:java}
java.io.IOException: All common columns present in the files doesn't have same
datatype. Unsupported operation on nonTransactional table. Check logs.
at
org.apache.carbondata.core.scan.executor.impl.AbstractQueryExecutor.updateColumns(AbstractQueryExecutor.java:290)
at
org.apache.carbondata.core.scan.executor.impl.AbstractQueryExecutor.getDataBlocks(AbstractQueryExecutor.java:234)
at
[GitHub] [carbondata] CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-485052622 Build Success with Spark 2.3.2, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/11178/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type
CarbonDataQA commented on issue #3173: [CARBONDATA-3351] Support Binary Data Type URL: https://github.com/apache/carbondata/pull/3173#issuecomment-485053928 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3148/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property
CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property URL: https://github.com/apache/carbondata/pull/3178#issuecomment-485056824 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/2918/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property
CarbonDataQA commented on issue #3178: [WIP] Support alter SORT_COLUMNS property URL: https://github.com/apache/carbondata/pull/3178#issuecomment-485056796 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/3149/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
