[jira] [Updated] (CARBONDATA-3927) TupleID/Position reference is long , make it short

2020-07-27 Thread Akash R Nilugal (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akash R Nilugal updated CARBONDATA-3927: Issue Type: Improvement (was: Bug) > TupleID/Position reference is long ,

[jira] [Created] (CARBONDATA-3929) Improve the CDC merge feature time

2020-07-27 Thread Akash R Nilugal (Jira)
Akash R Nilugal created CARBONDATA-3929: --- Summary: Improve the CDC merge feature time Key: CARBONDATA-3929 URL: https://issues.apache.org/jira/browse/CARBONDATA-3929 Project: CarbonData

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3860: [CARBONDATA-3889] Cleanup duplicated code in carbondata-core module

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3860: URL: https://github.com/apache/carbondata/pull/3860#issuecomment-664293945 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1761/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3863: [CARBONDATA-3924] Add default dynamic parameters only one time in a JVM process

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3863: URL: https://github.com/apache/carbondata/pull/3863#issuecomment-664244778 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1758/

[GitHub] [carbondata] marchpure commented on pull request #3864: [HOTFIX] Show Segment with stage returns empty

2020-07-27 Thread GitBox
marchpure commented on pull request #3864: URL: https://github.com/apache/carbondata/pull/3864#issuecomment-664245504 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [carbondata] ajantha-bhat commented on pull request #3863: [CARBONDATA-3924] Add default dynamic parameters only one time in a JVM process

2020-07-27 Thread GitBox
ajantha-bhat commented on pull request #3863: URL: https://github.com/apache/carbondata/pull/3863#issuecomment-664257717 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3837: [CARBONDATA-3927]Remove compressor name from tupleID to make it short to improve store size and performance.

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3837: URL: https://github.com/apache/carbondata/pull/3837#issuecomment-664283269 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1759/

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
ajantha-bhat commented on a change in pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#discussion_r46076 ## File path: processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithColumnRangeImpl.java

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3778: [CARBONDATA-3916] Support array with SI

2020-07-27 Thread GitBox
ajantha-bhat commented on a change in pull request #3778: URL: https://github.com/apache/carbondata/pull/3778#discussion_r460795333 ## File path: index/secondary-index/src/test/scala/org/apache/carbondata/spark/testsuite/secondaryindex/TestSIWithComplexArrayType.scala ## @@

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3863: [CARBONDATA-3924] Add default dynamic parameters only one time in a JVM process

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3863: URL: https://github.com/apache/carbondata/pull/3863#issuecomment-664251374 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3500/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3860: [CARBONDATA-3889] Cleanup duplicated code in carbondata-core module

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3860: URL: https://github.com/apache/carbondata/pull/3860#issuecomment-664286181 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3503/

[jira] [Created] (CARBONDATA-3924) Should add default dynamic parameters only one time in one JVM process

2020-07-27 Thread David Cai (Jira)
David Cai created CARBONDATA-3924: - Summary: Should add default dynamic parameters only one time in one JVM process Key: CARBONDATA-3924 URL: https://issues.apache.org/jira/browse/CARBONDATA-3924

[jira] [Created] (CARBONDATA-3926) flink-integration i find it can't move file to stage_data directory

2020-07-27 Thread yutao (Jira)
yutao created CARBONDATA-3926: - Summary: flink-integration i find it can't move file to stage_data directory Key: CARBONDATA-3926 URL: https://issues.apache.org/jira/browse/CARBONDATA-3926 Project:

[GitHub] [carbondata] shunlean commented on a change in pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
shunlean commented on a change in pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#discussion_r460741367 ## File path: processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/UnsafeSortDataRows.java ## @@ -200,25 +203,44 @@ public

[jira] [Created] (CARBONDATA-3928) Handle the Strings which length is greater than 32000 as a bad record.

2020-07-27 Thread Nihal kumar ojha (Jira)
Nihal kumar ojha created CARBONDATA-3928: Summary: Handle the Strings which length is greater than 32000 as a bad record. Key: CARBONDATA-3928 URL: https://issues.apache.org/jira/browse/CARBONDATA-3928

[GitHub] [carbondata] MarvinLitt commented on a change in pull request #3855: [CARBONDATA-3863], after using index service clean the temp data

2020-07-27 Thread GitBox
MarvinLitt commented on a change in pull request #3855: URL: https://github.com/apache/carbondata/pull/3855#discussion_r460667653 ## File path: integration/spark/src/main/scala/org/apache/carbondata/indexserver/IndexServer.scala ## @@ -316,4 +324,17 @@ object IndexServer

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
ajantha-bhat commented on a change in pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#discussion_r460667652 ## File path: processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithColumnRangeImpl.java

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
ajantha-bhat commented on a change in pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#discussion_r460667652 ## File path: processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithColumnRangeImpl.java

[jira] [Updated] (CARBONDATA-3925) flink-integration CarbonWriter.java LOG print use CarbonS3Writer's classname

2020-07-27 Thread yutao (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yutao updated CARBONDATA-3925: -- Description: in CarbonWriter.java code ,you can find this; public abstract class

[jira] [Commented] (CARBONDATA-3925) flink-integration CarbonWriter.java LOG print use CarbonS3Writer's classname

2020-07-27 Thread yutao (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165483#comment-17165483 ] yutao commented on CARBONDATA-3925: --- i want resolve this bug > flink-integration

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3864: [HOTFIX] Show Segment with stage returns empty

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3864: URL: https://github.com/apache/carbondata/pull/3864#issuecomment-664186370 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1760/

[jira] [Created] (CARBONDATA-3927) TupleID/Position reference is long , make it short

2020-07-27 Thread Akash R Nilugal (Jira)
Akash R Nilugal created CARBONDATA-3927: --- Summary: TupleID/Position reference is long , make it short Key: CARBONDATA-3927 URL: https://issues.apache.org/jira/browse/CARBONDATA-3927 Project:

[GitHub] [carbondata] akashrn5 commented on a change in pull request #3857: [CARBONDATA-3914] Fixed issue on reading data from carbon table through hive beeline when no data is present in table.

2020-07-27 Thread GitBox
akashrn5 commented on a change in pull request #3857: URL: https://github.com/apache/carbondata/pull/3857#discussion_r460677188 ## File path: core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java ## @@ -2137,7 +2138,7 @@ public static String

[GitHub] [carbondata] akashrn5 commented on a change in pull request #3857: [CARBONDATA-3914] Fixed issue on reading data from carbon table through hive beeline when no data is present in table.

2020-07-27 Thread GitBox
akashrn5 commented on a change in pull request #3857: URL: https://github.com/apache/carbondata/pull/3857#discussion_r460677188 ## File path: core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java ## @@ -2137,7 +2138,7 @@ public static String

[GitHub] [carbondata] marchpure opened a new pull request #3864: [HOTFIX] Show Segment with stage returns empty

2020-07-27 Thread GitBox
marchpure opened a new pull request #3864: URL: https://github.com/apache/carbondata/pull/3864 ### Why is this PR needed? ListStageFiles function has a bug, leading to the failure of listing stage files ### What changes were proposed in this PR? The code related to list

[GitHub] [carbondata] ajantha-bhat commented on pull request #3863: [CARBONDATA-3924] Add default dynamic parameters only one time in a JVM process

2020-07-27 Thread GitBox
ajantha-bhat commented on pull request #3863: URL: https://github.com/apache/carbondata/pull/3863#issuecomment-664184155 LGTM. can merge once build passes This is an automated message from the Apache Git Service. To

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3837: [wip]remove compressor name from tupleID

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3837: URL: https://github.com/apache/carbondata/pull/3837#issuecomment-664184402 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3501/

[jira] [Commented] (CARBONDATA-3926) flink-integration i find it can't move file to stage_data directory

2020-07-27 Thread yutao (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165566#comment-17165566 ] yutao commented on CARBONDATA-3926: --- but i think  it can  be a hdfs directory  >

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3855: [CARBONDATA-3863], after using index service clean the temp data

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3855: URL: https://github.com/apache/carbondata/pull/3855#issuecomment-664239278 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3499/

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
ajantha-bhat commented on a change in pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#discussion_r46076 ## File path: processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithColumnRangeImpl.java

[GitHub] [carbondata] ajantha-bhat commented on pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
ajantha-bhat commented on pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#issuecomment-664141006 @shunlean : please handle the comments given by @Zhangshunyu This is an automated message from the

[GitHub] [carbondata] MarvinLitt commented on a change in pull request #3855: [CARBONDATA-3863], after using index service clean the temp data

2020-07-27 Thread GitBox
MarvinLitt commented on a change in pull request #3855: URL: https://github.com/apache/carbondata/pull/3855#discussion_r460666952 ## File path: integration/spark/src/main/scala/org/apache/carbondata/indexserver/IndexServer.scala ## @@ -316,4 +324,17 @@ object IndexServer

[GitHub] [carbondata] akkio-97 closed pull request #3859: [CARBONDATA-3921] SI load fails with 'unable to get filestatus error' in concurrent scenario

2020-07-27 Thread GitBox
akkio-97 closed pull request #3859: URL: https://github.com/apache/carbondata/pull/3859 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Created] (CARBONDATA-3925) flink-integration CarbonWriter.java LOG print use CarbonS3Writer's classname

2020-07-27 Thread yutao (Jira)
yutao created CARBONDATA-3925: - Summary: flink-integration CarbonWriter.java LOG print use CarbonS3Writer's classname Key: CARBONDATA-3925 URL: https://issues.apache.org/jira/browse/CARBONDATA-3925

[GitHub] [carbondata] QiangCai opened a new pull request #3863: [CARBONDATA-3924] Add default dynamic parameters only one time in a JVM process

2020-07-27 Thread GitBox
QiangCai opened a new pull request #3863: URL: https://github.com/apache/carbondata/pull/3863 ### Why is this PR needed? PR#3805 introduces a problem that the system will add default dynamic parameters many times in a JVM process at concurrent query case. If

[jira] [Closed] (CARBONDATA-3926) flink-integration i find it can't move file to stage_data directory

2020-07-27 Thread yutao (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yutao closed CARBONDATA-3926. - Resolution: Not A Bug the temp directory is a local directory,not allow hdfs directory >

[GitHub] [carbondata] MarvinLitt commented on a change in pull request #3855: [CARBONDATA-3863], after using index service clean the temp data

2020-07-27 Thread GitBox
MarvinLitt commented on a change in pull request #3855: URL: https://github.com/apache/carbondata/pull/3855#discussion_r460675486 ## File path: integration/spark/src/main/scala/org/apache/carbondata/indexserver/IndexServer.scala ## @@ -316,4 +324,17 @@ object IndexServer

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3774: [CARBONDATA-3833] Make geoID visible

2020-07-27 Thread GitBox
ajantha-bhat commented on a change in pull request #3774: URL: https://github.com/apache/carbondata/pull/3774#discussion_r460688922 ## File path: integration/spark/src/test/scala/org/apache/carbondata/geo/GeoTest.scala ## @@ -112,6 +238,23 @@ class GeoTest extends QueryTest

[GitHub] [carbondata] QiangCai commented on a change in pull request #3860: [CARBONDATA-3889] Cleanup duplicated code in carbondata-core module

2020-07-27 Thread GitBox
QiangCai commented on a change in pull request #3860: URL: https://github.com/apache/carbondata/pull/3860#discussion_r460716343 ## File path: core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/FixedLengthDimensionColumnPage.java ## @@ -136,15 +131,29 @@ public

[GitHub] [carbondata] QiangCai commented on a change in pull request #3860: [CARBONDATA-3889] Cleanup duplicated code in carbondata-core module

2020-07-27 Thread GitBox
QiangCai commented on a change in pull request #3860: URL: https://github.com/apache/carbondata/pull/3860#discussion_r460716433 ## File path: core/src/main/java/org/apache/carbondata/core/index/dev/expr/AndIndexExprWrapper.java ## @@ -47,25 +47,20 @@ public

[jira] [Updated] (CARBONDATA-3926) flink-integration i find it can't move file to stage_data directory

2020-07-27 Thread yutao (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yutao updated CARBONDATA-3926: -- Description: [https://github.com/apache/carbondata/blob/master/docs/flink-integration-guide.md]

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3864: [HOTFIX] Show Segment with stage returns empty

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3864: URL: https://github.com/apache/carbondata/pull/3864#issuecomment-664187028 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3502/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3855: [CARBONDATA-3863], after using index service clean the temp data

2020-07-27 Thread GitBox
CarbonDataQA1 commented on pull request #3855: URL: https://github.com/apache/carbondata/pull/3855#issuecomment-664237649 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1757/

[GitHub] [carbondata] akashrn5 commented on pull request #3837: [wip]remove compressor name from tupleID

2020-07-27 Thread GitBox
akashrn5 commented on pull request #3837: URL: https://github.com/apache/carbondata/pull/3837#issuecomment-664178336 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [carbondata] kevinjmh commented on a change in pull request #3847: [CARBONDATA-3906] Optimize sort performance in writting file

2020-07-27 Thread GitBox
kevinjmh commented on a change in pull request #3847: URL: https://github.com/apache/carbondata/pull/3847#discussion_r460750438 ## File path: processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithColumnRangeImpl.java ##

[jira] [Resolved] (CARBONDATA-3924) Should add default dynamic parameters only one time in one JVM process

2020-07-27 Thread Ajantha Bhat (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajantha Bhat resolved CARBONDATA-3924. -- Fix Version/s: 2.1.0 Resolution: Fixed > Should add default dynamic