[GitHub] carbondata issue #2921: [CARBONDATA-3104] Removed unnecessary configuration ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2921 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9706/ ---
[GitHub] carbondata issue #2921: [CARBONDATA-3104] Removed unnecessary configuration ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2921 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1658/ ---
[GitHub] carbondata issue #2921: [CARBONDATA-3104] Removed unnecessary configuration ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2921 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1448/ ---
[GitHub] carbondata issue #2921: [CARBONDATA-3104] Removed unnecessary configuration ...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/2921 add to whitelist ---
[GitHub] carbondata pull request #2633: [WIP] Handle clearing memory only in case of ...
Github user dhatchayani closed the pull request at: https://github.com/apache/carbondata/pull/2633 ---
[GitHub] carbondata pull request #2923: [CARBONDATA-3101] Fixed dataload failure when...
Github user manishgupta88 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2923#discussion_r234499385
--- Diff:
integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/standardpartition/StandardPartitionTableQueryTestCase.scala
---
@@ -437,6 +437,20 @@ test("Creation of partition table should fail if the
colname in table schema and
sql("drop datamap if exists preaggTable on table partitionTable")
}
+ test("validate data in partition table after dropping and adding a
column") {
+sql("drop table if exists par")
+sql("create table par(name string) partitioned by (age double) stored
by " +
+ "'carbondata'")
+sql(s"load data local inpath '$resourcesPath/uniqwithoutheader.csv'
into table par options" +
+s"('header'='false')")
+sql("alter table par drop columns(name)")
+sql("alter table par add columns(name string)")
+sql(s"load data local inpath '$resourcesPath/uniqwithoutheader.csv'
into table par options" +
+s"('header'='false')")
--- End diff --
keeping partition column at the end is carbondata behavior which may or may
not be known to user. For a normal table whenever a column is dropped and
added, the added column data should either be added as the last column in csv
file or it should be mapped through fileheader which is the correct behavior.
As you are using the same csv file in your test case without changing the
order of data and providing header the above explained behavior might not hold
true. Please revisit the changes and take opinion from other PMC's/Committers
on this behavioral change
---
[GitHub] carbondata issue #2921: [CARBONDATA-3104] Removed unnecessary configuration ...
Github user kunal642 commented on the issue: https://github.com/apache/carbondata/pull/2921 retest this please ---
[GitHub] carbondata issue #2917: [WIP]Show load/insert/update/delete row number
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/2917 This is a good feature, will it show the number of rows got deleted or updated? hope it can get into next version. ---
