[
https://issues.apache.org/jira/browse/CARBONDATA-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158972#comment-17158972
]
Kunal Kapoor commented on CARBONDATA-3904:
--
What is the warehouse location?
bishunli created CARBONDATA-3906:
Summary: Optimize sort performance in writting file
Key: CARBONDATA-3906
URL: https://issues.apache.org/jira/browse/CARBONDATA-3906
Project: CarbonData
Issu
shunlean opened a new pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847
### Why is this PR needed?
Only after sorting temp, the write(sortTemp file) operation can run.
For better performance, we want to do the writeDataToFile and SortDataRows
operations in
CarbonDataQA1 commented on pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#issuecomment-659300018
Can one of the admins verify this patch?
This is an automated message from the Apache Git Service.
To r
QiangCai commented on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659304203
finalName is ${artifactId}-${version} by default, this change will not
impact artifactId and version.
Other modules will can not find the dependency: carbondata-spark_2.3
ajantha-bhat commented on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659305724
@QiangCai : Developer should not manually modify pom to make it work for
spark2.4.
so I fixed like above.
But some testcase failed to find CSV file after t
ajantha-bhat edited a comment on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659305724
@QiangCai : Developer should not manually modify pom to make it work for
spark2.4.
After this PR both 2.4 and 2.5 works without any manual change and jar names
ajantha-bhat commented on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659307068
retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
ajantha-bhat commented on pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#issuecomment-659307713
Add to whitelist
This is an automated message from the Apache Git Service.
To respond to the message, pl
ajantha-bhat commented on pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#issuecomment-659307892
retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
CarbonDataQA1 commented on pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#issuecomment-659309836
Build Failed with Spark 2.3.4, Please check CI
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3402/
-
IceMimosa opened a new pull request #3848:
URL: https://github.com/apache/carbondata/pull/3848
### Why is this PR needed?
Loading Data to the partitioned table will update all segments
updateDeltaEndTimestamp,that will cause the driver to clear all segments cache
when doing the query.
CarbonDataQA1 commented on pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#issuecomment-659311646
Build Failed with Spark 2.4.5, Please check CI
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1661/
QiangCai commented on pull request #3787:
URL: https://github.com/apache/carbondata/pull/3787#issuecomment-659312148
during SI loading, it should use this sort_scope.
This is an automated message from the Apache Git Service.
IceMimosa commented on pull request #3848:
URL: https://github.com/apache/carbondata/pull/3848#issuecomment-659312101
reset please
This is an automated message from the Apache Git Service.
To respond to the message, please lo
ajantha-bhat commented on pull request #3787:
URL: https://github.com/apache/carbondata/pull/3787#issuecomment-659312911
@QiangCai : yes, it is in WIP. SI global sort I will support from this PR
This is an automated message f
ShreelekhyaG opened a new pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849
### Why is this PR needed?
To support timestamp format table level.
### What changes were proposed in this PR?
Made the priority of timestamp format as:
1) Load command opti
CarbonDataQA1 commented on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659338632
Build Failed with Spark 2.4.5, Please check CI
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1660/
CarbonDataQA1 commented on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659339600
Build Failed with Spark 2.3.4, Please check CI
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3403/
-
Venugopal Reddy K created CARBONDATA-3907:
-
Summary: Reuse firePreLoadEvents and firePostLoadEvents methods
from CommonLoadUtils to trigger LoadTablePreExecutionEvent and
LoadTablePostExecutionEvent respectively in alter table add segment
VenuReddy2103 opened a new pull request #3850:
URL: https://github.com/apache/carbondata/pull/3850
### Why is this PR needed?
Currently we have 2 different ways of firing LoadTablePreExecutionEvent and
LoadTablePostExecutionEvent. We can reuse firePreLoadEvents and
firePostLoadEvents m
[
https://issues.apache.org/jira/browse/CARBONDATA-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venugopal Reddy K updated CARBONDATA-3907:
--
Description:
*[Issue]*
Currently we have 2 different ways of firing LoadT
CarbonDataQA1 commented on pull request #3848:
URL: https://github.com/apache/carbondata/pull/3848#issuecomment-659376770
Build Success with Spark 2.4.5, Please check CI
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1662/
CarbonDataQA1 commented on pull request #3848:
URL: https://github.com/apache/carbondata/pull/3848#issuecomment-659380516
Build Failed with Spark 2.3.4, Please check CI
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3404/
-
Prasanna Ravichandran created CARBONDATA-3908:
-
Summary: When a carbon segment is added through the alter add
segments query, then it is not accounting the added carbon segment values.
Key: CARBONDATA-3908
CarbonDataQA1 commented on pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849#issuecomment-659392712
Build Failed with Spark 2.3.4, Please check CI
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3407/
-
CarbonDataQA1 commented on pull request #3850:
URL: https://github.com/apache/carbondata/pull/3850#issuecomment-659422935
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Gi
CarbonDataQA1 commented on pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849#issuecomment-659447560
Build Success with Spark 2.4.5, Please check CI
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1665/
ShreelekhyaG commented on pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849#issuecomment-659467768
retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
Indhumathi27 opened a new pull request #3851:
URL: https://github.com/apache/carbondata/pull/3851
### Why is this PR needed?
### What changes were proposed in this PR?
### Does this PR introduce any user interface change?
- No
- Yes. (please explain the
Chetan Bhat created CARBONDATA-3909:
---
Summary: Insert into select fails after insert decimal value as
null and set sort scope to global sort
Key: CARBONDATA-3909
URL: https://issues.apache.org/jira/browse/CARBON
CarbonDataQA1 commented on pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849#issuecomment-659550711
Build Success with Spark 2.3.4, Please check CI
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3408/
-
CarbonDataQA1 commented on pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849#issuecomment-659554650
Build Success with Spark 2.4.5, Please check CI
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1666/
akashrn5 commented on a change in pull request #3850:
URL: https://github.com/apache/carbondata/pull/3850#discussion_r455974523
##
File path:
integration/spark/src/main/scala/org/apache/spark/sql/execution/command/management/CarbonAddLoadCommand.scala
##
@@ -228,24 +228,17 @@
akashrn5 commented on a change in pull request #3851:
URL: https://github.com/apache/carbondata/pull/3851#discussion_r455977271
##
File path:
integration/spark/src/test/scala/org/apache/carbondata/integration/spark/testsuite/dataload/TestLoadDataGeneral.scala
##
@@ -234,9 +234
CarbonDataQA1 commented on pull request #3851:
URL: https://github.com/apache/carbondata/pull/3851#issuecomment-659591221
Build Success with Spark 2.4.5, Please check CI
http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1667/
CarbonDataQA1 commented on pull request #3851:
URL: https://github.com/apache/carbondata/pull/3851#issuecomment-659592635
Build Success with Spark 2.3.4, Please check CI
http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3409/
-
QiangCai commented on a change in pull request #3771:
URL: https://github.com/apache/carbondata/pull/3771#discussion_r456167613
##
File path:
integration/spark/src/test/scala/org/apache/carbondata/integration/spark/testsuite/complexType/TestArrayContainsPushDown.scala
##
@@ -0
Zhangshunyu commented on pull request #3849:
URL: https://github.com/apache/carbondata/pull/3849#issuecomment-659774957
Greate! This is a useful feature.
This is an automated message from the Apache Git Service.
To respond to
QiangCai commented on a change in pull request #3771:
URL: https://github.com/apache/carbondata/pull/3771#discussion_r456175101
##
File path:
integration/spark/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala
##
@@ -865,7 +870,33 @@ private
QiangCai commented on a change in pull request #3771:
URL: https://github.com/apache/carbondata/pull/3771#discussion_r456176045
##
File path:
core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelFilterExecuterImpl.java
##
@@ -222,49 +228,103 @@ public Bit
QiangCai commented on a change in pull request #3785:
URL: https://github.com/apache/carbondata/pull/3785#discussion_r456179554
##
File path:
integration/spark/src/main/scala/org/apache/spark/sql/events/MergeIndexEventListener.scala
##
@@ -104,73 +104,80 @@ class MergeIndexEve
tianlileer closed pull request #710:
URL: https://github.com/apache/carbondata/pull/710
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
Zhangshunyu commented on pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#issuecomment-659810429
please check the build failure info
This is an automated message from the Apache Git Service.
To respond
Zhangshunyu commented on a change in pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#discussion_r456193818
##
File path:
processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/UnsafeSortDataRows.java
##
@@ -200,25 +203,44 @@ publi
Zhangshunyu commented on a change in pull request #3847:
URL: https://github.com/apache/carbondata/pull/3847#discussion_r456193999
##
File path:
processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/SortParameters.java
##
@@ -37,6 +40,13 @@
import org.apache
QiangCai commented on a change in pull request #3810:
URL: https://github.com/apache/carbondata/pull/3810#discussion_r456203328
##
File path:
integration/spark/src/main/scala/org/apache/spark/sql/secondaryindex/util/SecondaryIndexUtil.scala
##
@@ -440,14 +448,22 @@ object Seco
QiangCai commented on pull request #3807:
URL: https://github.com/apache/carbondata/pull/3807#issuecomment-659829122
@ajantha-bhat
1. remove CarbonData jars from your local maven repo at first.
2. build it with -o, you will find dependency error( can not find the
dependency: carbond
QiangCai commented on pull request #3778:
URL: https://github.com/apache/carbondata/pull/3778#issuecomment-659830702
please describe the PR and fix the failure.
This is an automated message from the Apache Git Service.
To res
QiangCai commented on a change in pull request #3842:
URL: https://github.com/apache/carbondata/pull/3842#discussion_r456206506
##
File path:
integration/spark/src/main/scala/org/apache/spark/rdd/CarbonMergeFilesRDD.scala
##
@@ -157,21 +157,21 @@ object CarbonMergeFilesRDD {
QiangCai commented on a change in pull request #3842:
URL: https://github.com/apache/carbondata/pull/3842#discussion_r456206506
##
File path:
integration/spark/src/main/scala/org/apache/spark/rdd/CarbonMergeFilesRDD.scala
##
@@ -157,21 +157,21 @@ object CarbonMergeFilesRDD {
Akash R Nilugal created CARBONDATA-3910:
---
Summary: load fails when csv file present in local and loading to
cluster
Key: CARBONDATA-3910
URL: https://issues.apache.org/jira/browse/CARBONDATA-3910
akashrn5 commented on pull request #3838:
URL: https://github.com/apache/carbondata/pull/3838#issuecomment-659863917
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, plea
Akash R Nilugal created CARBONDATA-3911:
---
Summary: NullPointerException is thrown when clean files is
executed after two updates
Key: CARBONDATA-3911
URL: https://issues.apache.org/jira/browse/CARBONDATA-391
QiangCai commented on a change in pull request #3825:
URL: https://github.com/apache/carbondata/pull/3825#discussion_r456247931
##
File path:
common/src/main/java/org/apache/carbondata/common/logging/impl/ExtendedRollingFileAppender.java
##
@@ -203,19 +194,16 @@ public void ro
QiangCai commented on a change in pull request #3826:
URL: https://github.com/apache/carbondata/pull/3826#discussion_r456252916
##
File path:
streaming/src/main/java/org/apache/carbondata/streaming/segment/StreamSegment.java
##
@@ -400,12 +386,7 @@ public static void recoverFi
QiangCai commented on a change in pull request #3826:
URL: https://github.com/apache/carbondata/pull/3826#discussion_r456252916
##
File path:
streaming/src/main/java/org/apache/carbondata/streaming/segment/StreamSegment.java
##
@@ -400,12 +386,7 @@ public static void recoverFi
57 matches
Mail list logo