[GitHub] [carbondata] CarbonDataQA commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene
CarbonDataQA commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene URL: https://github.com/apache/carbondata/pull/3418#issuecomment-548220105 Build Success with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/727/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene
CarbonDataQA commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene URL: https://github.com/apache/carbondata/pull/3418#issuecomment-548218938 Build Success with Spark 2.2.1, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.2/726/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene
CarbonDataQA commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene URL: https://github.com/apache/carbondata/pull/3418#issuecomment-548206684 Build Success with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/719/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] lamber-ken commented on issue #3401: [CARBONDATA-3528] refactor java checkstyle rules
lamber-ken commented on issue #3401: [CARBONDATA-3528] refactor java checkstyle rules URL: https://github.com/apache/carbondata/pull/3401#issuecomment-548202957 @jackylk, please cc, thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] jackylk commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene
jackylk commented on issue #3418: Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene URL: https://github.com/apache/carbondata/pull/3418#issuecomment-548202254 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment
CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment URL: https://github.com/apache/carbondata/pull/3427#issuecomment-547964253 Build Failed with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/726/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment
CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment URL: https://github.com/apache/carbondata/pull/3427#issuecomment-547958707 Build Failed with Spark 2.2.1, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.2/725/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment
CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment URL: https://github.com/apache/carbondata/pull/3427#issuecomment-547921452 Build Success with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/718/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3400: Fix query on bloom in case of multiple data files in one segment
CarbonDataQA commented on issue #3400: Fix query on bloom in case of multiple data files in one segment URL: https://github.com/apache/carbondata/pull/3400#issuecomment-547900355 Build Success with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/723/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3387: [TEST] Added testcases for multiple scenario
CarbonDataQA commented on issue #3387: [TEST] Added testcases for multiple scenario URL: https://github.com/apache/carbondata/pull/3387#issuecomment-547899644 Build Success with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/724/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3387: [TEST] Added testcases for multiple scenario
CarbonDataQA commented on issue #3387: [TEST] Added testcases for multiple scenario URL: https://github.com/apache/carbondata/pull/3387#issuecomment-547898782 Build Success with Spark 2.2.1, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.2/723/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3400: Fix query on bloom in case of multiple data files in one segment
CarbonDataQA commented on issue #3400: Fix query on bloom in case of multiple data files in one segment URL: https://github.com/apache/carbondata/pull/3400#issuecomment-547897662 Build Success with Spark 2.2.1, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.2/722/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment
CarbonDataQA commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment URL: https://github.com/apache/carbondata/pull/3427#issuecomment-547893027 Build Success with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/717/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] manishnalla1994 commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
manishnalla1994 commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-547890811 @ravipesala Please review. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] manishnalla1994 commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment
manishnalla1994 commented on issue #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment URL: https://github.com/apache/carbondata/pull/3427#issuecomment-547890638 @ravipesala Please review. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] kunal642 commented on issue #3419: [CARBONDATA-3555] Make move filter related methods under DataMapFilter and pass
kunal642 commented on issue #3419: [CARBONDATA-3555] Make move filter related methods under DataMapFilter and pass URL: https://github.com/apache/carbondata/pull/3419#issuecomment-547887691 @ravipesala @kumarvishal09 Please review This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] manishnalla1994 opened a new pull request #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment
manishnalla1994 opened a new pull request #3427: [CARBONDATA-3562] Fix for SDK filter queries not working when schema is given explicitly while Add Segment URL: https://github.com/apache/carbondata/pull/3427 Problem : Queries will not return correct result from added segment when the schema is given explicitly in case of SDK. Solution : Handled it by validating based on both column name and column id if it matches for the SDK column. Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily: - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (CARBONDATA-3562) Fix for SDK filter queries not working when schema is given explicitly while Add Segment
MANISH NALLA created CARBONDATA-3562: Summary: Fix for SDK filter queries not working when schema is given explicitly while Add Segment Key: CARBONDATA-3562 URL: https://issues.apache.org/jira/browse/CARBONDATA-3562 Project: CarbonData Issue Type: Bug Reporter: MANISH NALLA Queries will not return correct result from added segment when the schema is given explicitly in case of SDK. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [carbondata] CarbonDataQA commented on issue #3400: Fix query on bloom in case of multiple data files in one segment
CarbonDataQA commented on issue #3400: Fix query on bloom in case of multiple data files in one segment URL: https://github.com/apache/carbondata/pull/3400#issuecomment-547880855 Build Success with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/715/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] shivamasn commented on issue #3400: Fix query on bloom in case of multiple data files in one segment
shivamasn commented on issue #3400: Fix query on bloom in case of multiple data files in one segment URL: https://github.com/apache/carbondata/pull/3400#issuecomment-547863064 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] shivamasn commented on issue #3387: [TEST] Added testcases for multiple scenario
shivamasn commented on issue #3387: [TEST] Added testcases for multiple scenario URL: https://github.com/apache/carbondata/pull/3387#issuecomment-547862894 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-547841533 Build Success with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/722/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-547837749 Build Success with Spark 2.2.1, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.2/721/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-547811461 Build Success with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/714/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Updated] (CARBONDATA-3557) Support write Flink streaming data to Carbon
[
https://issues.apache.org/jira/browse/CARBONDATA-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhi Liu updated CARBONDATA-3557:
Attachment: Support write flink streaming data to carbon.docx
> Support write Flink streaming data to Carbon
>
>
> Key: CARBONDATA-3557
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3557
> Project: CarbonData
> Issue Type: New Feature
> Components: spark-integration
>Reporter: Zhi Liu
>Priority: Major
> Fix For: 2.0.0
>
> Attachments: Support write flink streaming data to carbon.docx
>
> Time Spent: 5h 20m
> Remaining Estimate: 0h
>
> Sometimes, user need to write flink streaming data to carbon, required high
> concurrency and high throughput.
> The write process is:
> # Write flink streaming data to local file system of flink task node use
> flink StreamingFileSink and carbon SDK;
> # Copy local carbon data file to carbon data store system, such as HDFS, S3;
> # Generate and write segment file to ${tablePath}/load_details;
> Run "alter table ${tableName} collect segments" command on server, to compact
> segment files in ${tablePath}/load_details, and then move the compacted
> segment file to ${tablePath}/Metadata/Segments/，update table status file
> finally.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [carbondata] CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-54017 Build Failed with Spark 2.2.1, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.2/720/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-547775552 Build Failed with Spark 2.3.2, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/721/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (CARBONDATA-3561) After deletor updat the data, the query results become incorrect
Xigua created CARBONDATA-3561:
-
Summary: After deletor updat the data, the query results become
incorrect
Key: CARBONDATA-3561
URL: https://issues.apache.org/jira/browse/CARBONDATA-3561
Project: CarbonData
Issue Type: Bug
Components: data-query
Affects Versions: 1.5.4, 1.6.0
Environment: SUSE12 CDH5
Reporter: Xigua
Attachments: image-2019-10-30-14-42-49-871.png,
image-2019-10-30-14-43-21-972.png
When I delet or updat table data use spark SQL 2.2.3, it affects other row
data,the query results become incorrect.
{quote}CREATE TABLE `workqueue_zyy02` (`queuecode` STRING, `channelflag`
STRING, `dt` STRING)
USING org.apache.spark.sql.CarbonSource
PARTITIONED BY (dt);
delete from workqueue_zyy02 m where m.queuecode ='1';{quote}
*before*
* !image-2019-10-30-14-42-49-871.png!
*
* *after*
* !image-2019-10-30-14-43-21-972.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [carbondata] CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment
CarbonDataQA commented on issue #3426: [CARBONDATA-3560] Fixed issues for Add Segment URL: https://github.com/apache/carbondata/pull/3426#issuecomment-547755448 Build Success with Spark 2.1.0, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.1/713/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
