Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1435
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1191/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1736:
--
Description:
1. Create a table
create table if not exists lineitem1(L_SHIPDATE
Jacky Li created CARBONDATA-1739:
Summary: Clean up store path interface
Key: CARBONDATA-1739
URL: https://issues.apache.org/jira/browse/CARBONDATA-1739
Project: CarbonData
Issue Type:
Github user gvramana commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1508#discussion_r151408491
--- Diff:
integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/preaaggregate/PreAggregateListeners.scala
---
@@ -51,11 +51,39 @@
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1507
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1180/
---
GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/1511
[CARBONDATA-1741] Remove AKSK in log when saving to S3
In order to provide better security, AKSK credential information should be
removed in log
- [X] Any interfaces changed?
GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/1513
[CARBONDATA-1745] Use default metastore path from Hive
When creating CarbonSession, if user does not specify metastore path, use
default metastore path from Hive
- [X] Any interfaces
Github user jackylk commented on the issue:
https://github.com/apache/carbondata/pull/1504
retest this please
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1513
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1193/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255622#comment-16255622
]
kumar vishal commented on CARBONDATA-1740:
--
This is failing because of order by in query. In
Github user asfgit closed the pull request at:
https://github.com/apache/carbondata/pull/1432
---
Github user asfgit closed the pull request at:
https://github.com/apache/carbondata/pull/1505
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1513
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1189/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1748:
Description:
Steps :
In spark Beeline user executes the following queries.
drop
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1512
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1190/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1514
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1192/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1507
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1194/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1504
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1195/
---
Github user kumarvishal09 commented on the issue:
https://github.com/apache/carbondata/pull/1505
LGTM
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1748:
Description:
Steps :
drop database if exists test_db1 cascade;
create database
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1494
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1188/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1749:
Description:
Steps :
In carbon.properties the mdt file directory path is configured as
Github user kumarvishal09 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1435#discussion_r151446750
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java ---
@@ -2119,5 +2127,146 @@ public static String
Github user kumarvishal09 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1435#discussion_r151446545
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java ---
@@ -2119,5 +2127,146 @@ public static String
Github user kumarvishal09 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1435#discussion_r151458293
--- Diff:
integration/spark2/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
---
@@ -292,6 +290,35 @@ object
Chetan Bhat created CARBONDATA-1748:
---
Summary: (Carbon1.3.0- DB creation external path) - Permission of
created table and database folder in carbon store not correct
Key: CARBONDATA-1748
URL:
[
https://issues.apache.org/jira/browse/CARBONDATA-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1747:
Description:
Steps :
In spark Beeline user executes the following queries
drop
Chetan Bhat created CARBONDATA-1749:
---
Summary: (Carbon1.3.0- DB creation external path) - mdt file is
not created in directory as per configuration in carbon.properties
Key: CARBONDATA-1749
URL:
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1435
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1196/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1167
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1179/
---
Github user gvramana commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1508#discussion_r151410067
--- Diff:
integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/preaaggregate/PreAggregateListeners.scala
---
@@ -51,11 +51,39 @@
GitHub user ravipesala opened a pull request:
https://github.com/apache/carbondata/pull/1510
[WIP] Supported DataMap chooser and expression for supporting multiple
datamaps in single query
This PR supports 3 features.
1. Load datamaps from the DataMapSchema which are created
xubo245 created CARBONDATA-1742:
---
Summary: Fix NullPointerException in SegmentStatusManager
Key: CARBONDATA-1742
URL: https://issues.apache.org/jira/browse/CARBONDATA-1742
Project: CarbonData
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1505
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1181/
---
GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/1514
[CARBONDATA-1746] Count star optimization
Since carbon records number of row in metadata, count star query can
leverage it to improve performance.
- [X] Any interfaces changed?
[
https://issues.apache.org/jira/browse/CARBONDATA-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1735:
Labels: DFX (was: functional)
> Carbon1.3.0 Load: Segment created during load is not
GitHub user kunal642 opened a pull request:
https://github.com/apache/carbondata/pull/1508
[CARBONDATA-1738] Block direct insert/load on pre-aggregate table
Block load/insert on pre-aggregate table
- [X] Any interfaces changed?
No
- [X] Any backward compatibility
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1505
SDV Build Success , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/1753/
---
Github user gvramana commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1508#discussion_r151407441
--- Diff:
integration/spark2/src/main/scala/org/apache/spark/sql/CarbonSession.scala ---
@@ -212,6 +212,18 @@ object CarbonSession {
[
https://issues.apache.org/jira/browse/CARBONDATA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1740:
--
Summary: Carbon1.3.0-Pre-AggregateTable - Query plan exception for
aggregate query
Github user dhatchayani commented on the issue:
https://github.com/apache/carbondata/pull/1505
retest this please
---
GitHub user xubo245 opened a pull request:
https://github.com/apache/carbondata/pull/1512
[CARBONDATA-1742] Fix NullPointerException in SegmentStatusManager
when loadFolderDetailsArray is null ,there is NullPointerException. We
should fix it.
You can merge this pull request into a
Ajeet Rai created CARBONDATA-1744:
-
Summary: Carbon1.3.0 Concurrent Load-Delete:Delete query is not
working correctly if load is already in process.
Key: CARBONDATA-1744
URL:
[
https://issues.apache.org/jira/browse/CARBONDATA-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kunal Kapoor reassigned CARBONDATA-1743:
Assignee: Kunal Kapoor
> Carbon1.3.0-Pre-AggregateTable - Query returns no
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1506
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/1754/
---
Jacky Li created CARBONDATA-1746:
Summary: Count Star optimization
Key: CARBONDATA-1746
URL: https://issues.apache.org/jira/browse/CARBONDATA-1746
Project: CarbonData
Issue Type: New Feature
Chetan Bhat created CARBONDATA-1747:
---
Summary: (Carbon1.3.0- DB creation external path) - Owner name of
compacted segment and segment after update is not correct
Key: CARBONDATA-1747
URL:
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1432
SDV Build Success , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/1752/
---
Jacky Li created CARBONDATA-1741:
Summary: Remove AKSK in Log
Key: CARBONDATA-1741
URL: https://issues.apache.org/jira/browse/CARBONDATA-1741
Project: CarbonData
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/CARBONDATA-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1743:
--
Description:
Steps:
1. Create table and load with large data
create table if not
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1509
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1183/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1506
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1178/
---
Kunal Kapoor created CARBONDATA-1738:
Summary: Block direct load on pre-aggregate table
Key: CARBONDATA-1738
URL: https://issues.apache.org/jira/browse/CARBONDATA-1738
Project: CarbonData
[
https://issues.apache.org/jira/browse/CARBONDATA-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1737:
--
Description:
1. Create a table
create table if not exists lineitem2(L_SHIPDATE
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1505
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1186/
---
Github user dhatchayani commented on the issue:
https://github.com/apache/carbondata/pull/1505
retest this please
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/1504
LGTM
---
GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/1509
[CARBONDATA-1739] Clean up store path interface
There are many getStorePath API, this PR unified it in one place:
`CarbonProperties.getStorePath`
It can be used in driver side
-
[
https://issues.apache.org/jira/browse/CARBONDATA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1740:
--
Description:
0: jdbc:hive2://10.18.98.48:23040> select
Ramakrishna S created CARBONDATA-1740:
-
Summary: Carbon1.3.0-Pre-AggregateTable - Aggregate query with
order by fails when main table is having pre-aggregate table
Key: CARBONDATA-1740
URL:
[
https://issues.apache.org/jira/browse/CARBONDATA-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xubo245 updated CARBONDATA-1742:
Description: when loadFolderDetailsArray is null ,there is
NullPointerException. We should
Jacky Li created CARBONDATA-1745:
Summary: Remove local metastore path
Key: CARBONDATA-1745
URL: https://issues.apache.org/jira/browse/CARBONDATA-1745
Project: CarbonData
Issue Type:
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1511
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1184/
---
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1494#discussion_r151395683
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/CommonUtil.scala
---
@@ -851,13 +851,20 @@ object CommonUtil {
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1494#discussion_r151395517
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/Compactor.scala
---
@@ -113,7 +113,8 @@ object Compactor {
Ramakrishna S created CARBONDATA-1736:
-
Summary: Carbon1.3.0-Pre-AggregateTable -Query from segment set
is not effective when pre-aggregate table is present
Key: CARBONDATA-1736
URL:
[
https://issues.apache.org/jira/browse/CARBONDATA-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1737:
--
Description:
1. Create a table
create table if not exists lineitem2(L_SHIPDATE
Ramakrishna S created CARBONDATA-1743:
-
Summary: Carbon1.3.0-Pre-AggregateTable - Query returns no value
if run at the time of pre-aggregate table creation
Key: CARBONDATA-1743
URL:
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1510
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1185/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1504
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1187/
---
Ramakrishna S created CARBONDATA-1737:
-
Summary: Carbon1.3.0-Pre-AggregateTable - Pre-aggregate table
loads partially when segment filter is set on the main table
Key: CARBONDATA-1737
URL:
[
https://issues.apache.org/jira/browse/CARBONDATA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna S updated CARBONDATA-1740:
--
Description:
lineitem3: has a pre-aggregate table
select
Github user akashrn5 commented on the issue:
https://github.com/apache/carbondata/pull/1512
@xubo245 this change is already being handled in #1507
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1508
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1182/
---
Github user akashrn5 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1435#discussion_r151421484
--- Diff:
core/src/main/java/org/apache/carbondata/core/datastore/impl/FileFactory.java
---
@@ -606,4 +609,53 @@ public static FileSystem
Github user xubo245 commented on the issue:
https://github.com/apache/carbondata/pull/1515
Please review it @jackylk @QiangCai
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1726:
Description:
Steps :
// prepare csv file for batch loading
cd
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1471#discussion_r151615805
--- Diff:
core/src/main/java/org/apache/carbondata/core/datamap/dev/AbstractDataMapWriter.java
---
@@ -0,0 +1,110 @@
+/*
+ * Licensed to the
[
https://issues.apache.org/jira/browse/CARBONDATA-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhatchayani reassigned CARBONDATA-1734:
---
Assignee: dhatchayani (was: Akash R Nilugal)
> Ignore empty line while reading
[
https://issues.apache.org/jira/browse/CARBONDATA-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1726:
Description:
Steps :
// prepare csv file for batch loading
cd
[
https://issues.apache.org/jira/browse/CARBONDATA-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1726:
Description:
Steps :
// prepare csv file for batch loading
cd
Github user zzcclp commented on the issue:
https://github.com/apache/carbondata/pull/1516
I have complied successfully with below commands:
1. mvn -Pspark-2.1 -Pbuild-with-format -Dspark.version=2.1.2 clean package;
2. mvn -Pspark-2.1 -Phadoop-2.2.0 -Pbuild-with-format
GitHub user dhatchayani opened a pull request:
https://github.com/apache/carbondata/pull/1520
[CARBONDATA-1734] Ignore empty line while reading CSV
Ignore / Skip empty lines while loading
Load level and System level properties are added to control it.
- [ ] Any
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1519
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1214/
---
GitHub user kunal642 opened a pull request:
https://github.com/apache/carbondata/pull/1521
[WIP] [CARBONDATA-1743] fix conurrent pre-agg creation and query
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ]
GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/1522
[HOTFIX] change to use store path in property in testcase
Change to use store path in property in testcase
- [X] Any interfaces changed?
No
- [X] Any backward compatibility
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/1522
LGTM
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1508
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1215/
---
Github user asfgit closed the pull request at:
https://github.com/apache/carbondata/pull/1522
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacky Li resolved CARBONDATA-1750.
--
Resolution: Fixed
Assignee: QiangCai
Fix Version/s: 1.3.0
>
Github user chenliang613 commented on the issue:
https://github.com/apache/carbondata/pull/1519
@zzcclp can you change the title format , like :
[CARBONDATA-1753][Streaming] Fix missing 'org.scalatest.tools.Runner' issue
when run test with streaming module
---
Github user chenliang613 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1516#discussion_r151621845
--- Diff: pom.xml ---
@@ -453,9 +453,9 @@
- hadoop-2.7.2
+ hadoop-2.2.0
--- End diff --
[
https://issues.apache.org/jira/browse/CARBONDATA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kumar vishal reassigned CARBONDATA-1740:
Assignee: kumar vishal
> Carbon1.3.0-Pre-AggregateTable - Query plan
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1517
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1204/
---
Github user chenliang613 commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1471#discussion_r151598459
--- Diff:
core/src/main/java/org/apache/carbondata/core/datamap/dev/AbstractDataMapWriter.java
---
@@ -0,0 +1,110 @@
+/*
--- End diff --
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1516
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1206/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1726:
Priority: Blocker (was: Major)
> Carbon1.3.0-Streaming - Select query from
Github user anubhav100 commented on the issue:
https://github.com/apache/carbondata/pull/1491
retest this please
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1509
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1208/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chetan Bhat updated CARBONDATA-1726:
Description:
Steps :
// prepare csv file for batch loading
cd
1 - 100 of 182 matches
Mail list logo