[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#issuecomment-645595925 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3168/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#issuecomment-645594860 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1443/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645591158 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3167/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645556175 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1442/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure opened a new pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command
marchpure opened a new pull request #3792: URL: https://github.com/apache/carbondata/pull/3792 ### Why is this PR needed? When the number segments is large, "SHOW SEGMENTS" time overhead is too high. The LIMIT operator shall be supported in the SHOW SEGMENTS command. ### What changes were proposed in this PR? Add LIMIT operator in the grammar parsing and read segments function. ### Does this PR introduce any user interface change? Yes ### Is any new testcase added? Yes This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure closed pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
marchpure closed pull request #3791: URL: https://github.com/apache/carbondata/pull/3791 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
marchpure commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645514004 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] test
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-645502123 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1440/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] test
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-645498719 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3164/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645488559 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1441/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645485273 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3165/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] xiaohui0318 commented on pull request #3788: [CARBONDATA-3844]Fix scan the relevant database instead of scanning all
xiaohui0318 commented on pull request #3788: URL: https://github.com/apache/carbondata/pull/3788#issuecomment-645348038 > May be create an mv in database A as select from a table in database B, when query the table, we should check all mv on this table, not only in database B. We have a cluster with more than 1,500 databases, and it takes more than 20 seconds to scan each select statement, no matter how simple the SQL. I wonder it should be placed in a specified database? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645332346 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3162/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
CarbonDataQA1 commented on pull request #3791: URL: https://github.com/apache/carbondata/pull/3791#issuecomment-645332657 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1438/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] niuge01 commented on pull request #3788: [CARBONDATA-3844]Fix scan the relevant database instead of scanning all
niuge01 commented on pull request #3788: URL: https://github.com/apache/carbondata/pull/3788#issuecomment-645329423 May be create an mv in database A as select from a table in database B, when query the table, we should check all mv on this table, not only in database B. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader
CarbonDataQA1 commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-645308981 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1437/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader
CarbonDataQA1 commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-645308529 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3161/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] marchpure opened a new pull request #3791: [CARBONDATA-3856] Support the LIMIT operator for show segments command
marchpure opened a new pull request #3791: URL: https://github.com/apache/carbondata/pull/3791 ### Why is this PR needed? When the number segments is large, "SHOW SEGMENTS" time overhead is too high. The LIMIT operator shall be supported in the SHOW SEGMENTS command. ### What changes were proposed in this PR? Add LIMIT operator in the grammar parsing and read segments function. ### Does this PR introduce any user interface change? - Yes. Added description of LIMIT operator in the SHOW SEGMENT doc. ### Is any new testcase added? - Yes This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (CARBONDATA-3856) Support the LIMIT operator for show segments command
Xingjun Hao created CARBONDATA-3856: --- Summary: Support the LIMIT operator for show segments command Key: CARBONDATA-3856 URL: https://issues.apache.org/jira/browse/CARBONDATA-3856 Project: CarbonData Issue Type: New Feature Components: spark-integration Affects Versions: 2.0.0 Reporter: Xingjun Hao Fix For: 2.0.2 Now, in the 2.0.0 release, CarbonData doesn't support LIMIT operator in the SHOW SEGMENTS command. The time cost is expensive when there are too many segments. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (CARBONDATA-3854) Quote char support to unprintable character like \u0009 \u0010
[ https://issues.apache.org/jira/browse/CARBONDATA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajantha Bhat resolved CARBONDATA-3854. -- Fix Version/s: 2.1.0 Resolution: Fixed > Quote char support to unprintable character like \u0009 \u0010 > -- > > Key: CARBONDATA-3854 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3854 > Project: CarbonData > Issue Type: New Feature >Reporter: Mahesh Raju Somalaraju >Priority: Minor > Fix For: 2.1.0 > > Time Spent: 50m > Remaining Estimate: 0h > > Quote char support to unprintable character like \u0009 \u0010 > Currently carbondata will not support setting quotechar to printable char > like \u0009. > current behaviour is quotechar will through exception if we give more than > one character. > > Need to support more than one character same as like delimiter. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] asfgit closed pull request #3790: [CARBONDATA-3854] Quotechar support to more than one character
asfgit closed pull request #3790: URL: https://github.com/apache/carbondata/pull/3790 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] ajantha-bhat commented on pull request #3790: [CARBONDATA-3854] Quotechar support to more than one character
ajantha-bhat commented on pull request #3790: URL: https://github.com/apache/carbondata/pull/3790#issuecomment-645245948 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] ajantha-bhat commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader
ajantha-bhat commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-645244871 please merge @akashrn5 , @xubo245 @jackylk This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] ajantha-bhat commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader
ajantha-bhat commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-645244714 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (CARBONDATA-3820) Fix CDC failure when sort columns present in source dataframe
[ https://issues.apache.org/jira/browse/CARBONDATA-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajantha Bhat resolved CARBONDATA-3820. -- Fix Version/s: 2.1.0 Resolution: Fixed > Fix CDC failure when sort columns present in source dataframe > - > > Key: CARBONDATA-3820 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3820 > Project: CarbonData > Issue Type: New Feature >Reporter: Xingjun Hao >Priority: Major > Fix For: 2.1.0 > > Time Spent: 1h 50m > Remaining Estimate: 0h > > If there is GloabalSort table in the CDC Flow. The following exception will > be throwed: > Exception in thread "main" java.lang.RuntimeException: column: id specified > in sort columns does not exist in schema > at > org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildTableSchema(CarbonWriterBuilder.java:828) > at > org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildCarbonTable(CarbonWriterBuilder.java:794) > at > org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildLoadModel(CarbonWriterBuilder.java:720) > at > org.apache.spark.sql.carbondata.execution.datasources.CarbonSparkDataSourceUtil$.prepareLoadModel(CarbonSparkDataSourceUtil.scala:281) > at > org.apache.spark.sql.carbondata.execution.datasources.SparkCarbonFileFormat.prepareWrite(SparkCarbonFileFormat.scala:141) > at > org.apache.spark.sql.execution.command.mutation.merge.CarbonMergeDataSetCommand.processIUD(CarbonMergeDataSetCommand.scala:269) > at > org.apache.spark.sql.execution.command.mutation.merge.CarbonMergeDataSetCommand.processData(CarbonMergeDataSetCommand.scala:152) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] asfgit closed pull request #3764: [CARBONDATA-3820] Fix CDC failure when sort columns present in source dataframe
asfgit closed pull request #3764: URL: https://github.com/apache/carbondata/pull/3764 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] test
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-645242470 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1436/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] test
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-645242241 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3160/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] ajantha-bhat commented on pull request #3764: [CARBONDATA-3820] Fix CDC failure when sort columns present in source dataframe
ajantha-bhat commented on pull request #3764: URL: https://github.com/apache/carbondata/pull/3764#issuecomment-645241433 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
