[jira] [Created] (CARBONDATA-366) Incorrect load data behaviour in mentioned scenario
Ashok Kumar created CARBONDATA-366: -- Summary: Incorrect load data behaviour in mentioned scenario Key: CARBONDATA-366 URL: https://issues.apache.org/jira/browse/CARBONDATA-366 Project: CarbonData Issue Type: Bug Reporter: Ashok Kumar Priority: Minor In some scenario, when user loads data system shows load is success full but when we query, there is no data. When we see at store location, 0 byte file is created for index file. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-365) Compaction fails when table is created with configured block size
Ashok Kumar created CARBONDATA-365:
--
Summary: Compaction fails when table is created with configured
block size
Key: CARBONDATA-365
URL: https://issues.apache.org/jira/browse/CARBONDATA-365
Project: CarbonData
Issue Type: Bug
Reporter: Ashok Kumar
Priority: Minor
When user creates table with configured block size as given below.
Compaction fails after multiple load.
create table T_Carbn06(Active_status String,Item_type_cd INT,Qty_day_avg
INT,Qty_total INT,Sell_price BIGINT,Sell_pricep DOUBLE,Discount_price
DOUBLE,Profit DECIMAL(3,2),Item_code String,Item_name String,Outlet_name
String,Update_time TIMESTAMP,Create_date String)STORED BY
'org.apache.carbondata.format' TBLPROPERTIES('table_blocksize'='2047');
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CARBONDATA-364) Drop table is behaving inconsistently
Ashok Kumar created CARBONDATA-364: -- Summary: Drop table is behaving inconsistently Key: CARBONDATA-364 URL: https://issues.apache.org/jira/browse/CARBONDATA-364 Project: CarbonData Issue Type: Bug Reporter: Ashok Kumar Priority: Minor Scenario Run load command on table and then run drop table command for same table. Drop table will give message as table is locked for updation but actually its deleting all files table related files from store. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Int accepting range of BigInt
Hi, I would like to know when we execute the query : create table employee(id int, name String) stored by 'carbondata'; the table created is : [image: Inline image 1] the Int is converted into BigInt and Int supports range beyond (-2147483648 to 2147483647) -- Regards | Pallavi Singh
[GitHub] incubator-carbondata pull request #286: [CARBONDATA-350] mv processing/sorta...
GitHub user allwefantasy opened a pull request: https://github.com/apache/incubator-carbondata/pull/286 [CARBONDATA-350] mv processing/sortandgroupby/sortdatastep/SortKeyStep to ⦠- No new unit test cases have been added - Just passed existing unit test cases - actions Moving .../processing/sortandgroupby/sortdatastep/SortKeyStep.java to .../processing/sortandgroupby/sortdatastep/ package since they are duplicated. You can merge this pull request into a Git repository by running: $ git pull https://github.com/allwefantasy/incubator-carbondata master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/286.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #286 commit 97135e48c5052488875a4bd483ad103a35ac1aa9 Author: WilliamZhu Date: 2016-11-03T04:20:13Z [Issue-350] mv processing/sortandgroupby/sortdatastep/SortKeyStep to processing/sortandgroupby/sortdatastep --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Discussion:Add support alluxio(tachyon) file system(ecosystem)
Hi all For supporting alluxio users to use higher performance file format(CarbonData), and build Apache CarbonData ecosystem, i propose to support alluxio file system.
[GitHub] incubator-carbondata pull request #281: [CARBONDATA-362]Optimize the Paramet...
Github user lion-x closed the pull request at: https://github.com/apache/incubator-carbondata/pull/281 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #281: [CARBONDATA-362]Optimize the Paramet...
Github user Hexiaoqiao commented on a diff in the pull request:
https://github.com/apache/incubator-carbondata/pull/281#discussion_r86279989
--- Diff:
integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
---
@@ -65,7 +65,7 @@ object CarbonDataRDDFactory extends Logging {
sqlContext: SQLContext,
carbonLoadModel: CarbonLoadModel,
storeLocation: String,
- hdfsStoreLocation: String,
+ StoreLocation: String,
--- End diff --
pls follow the code style and use lowercase character of variable.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-carbondata pull request #285: [WIP]Insert into carbon table featur...
GitHub user ashokblend opened a pull request: https://github.com/apache/incubator-carbondata/pull/285 [WIP]Insert into carbon table feature Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/ashokblend/incubator-carbondata insertintocarbon Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/285.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #285 commit b8358b026a56579585b9b35843807721edfe647b Author: Ashok Date: 2016-11-03T02:15:17Z Insert into carbon table feature --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #284: [WIP]In case while copying store to ...
GitHub user ashokblend opened a pull request: https://github.com/apache/incubator-carbondata/pull/284 [WIP]In case while copying store to hdfs, if stream didn't closed properly⦠Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- â¦, file doesn't get copied to HDFS So we need to propogate exception to executor so that task can be launched again. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ashokblend/incubator-carbondata loadIssue Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/284.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #284 commit af98f2a9eea8e9e5dff1e4565c4b10cf75098bb3 Author: Ashok Date: 2016-11-03T02:11:07Z In case while copying store to hdfs, if stream didn't closed properly, file doesn't get copied to HDFS So we need to propogate exception to executor so that task can be launched again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #283: [WIP]Pass block size to model during...
GitHub user ashokblend opened a pull request: https://github.com/apache/incubator-carbondata/pull/283 [WIP]Pass block size to model during compaction. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/ashokblend/incubator-carbondata compaction Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/283.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #283 commit a37f8be5300f13f2c02f77f7d3a9e5ca8dcb7483 Author: Ashok Date: 2016-11-03T02:05:37Z Pass block size to model during compaction. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #282: [WIP]When data load and drop is exec...
GitHub user ashokblend opened a pull request: https://github.com/apache/incubator-carbondata/pull/282 [WIP]When data load and drop is executed concurrently, then even though dr⦠Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- â¦op didn't get lock, its table files. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ashokblend/incubator-carbondata droptable Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/282.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #282 commit 886e42aaf75a4ba72e4f3d4dbd9fc82ec5a5417c Author: Ashok Date: 2016-11-03T02:07:59Z When data load and drop is executed concurrently, then even though drop didn't get lock, its table files. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #281: [CARBONDATA-362]Optimize the Paramet...
GitHub user lion-x opened a pull request: https://github.com/apache/incubator-carbondata/pull/281 [CARBONDATA-362]Optimize the Parameters Name in CarbonDataRDDFactory.scala # Why raise this PR? changes the name of "hdfsStoreLocation" to "storePath", because not only support hdfs path. # How to test? Pass all test cases. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lion-x/incubator-carbondata optimizeParametersName Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/281.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #281 commit ef50982ee53929d67b3e58d57d7a05a46a8a2ba8 Author: lion-x Date: 2016-11-03T01:02:31Z optimizeParametersName --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r86214621 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -953,66 +959,6 @@ public static void checkAndCreateCarbonDataLocation(String carbonStorePath, Stri } /** - * method to distribute the blocklets of a block in multiple blocks --- End diff -- May be we should take a call for removing blocklet distribution. For filter queries with small number of blocks to scan it is very helpful to process faster. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r86211496 --- Diff: core/src/main/java/org/apache/carbondata/scan/filter/FilterExpressionProcessor.java --- @@ -352,4 +354,18 @@ private FilterResolverIntf getFilterResolverBasedOnExpressionType( return new RowLevelFilterResolverImpl(expression, false, false, tableIdentifier); } + public static FilterResolverIntf getResolvedFilter(AbsoluteTableIdentifier identifier, --- End diff -- Why it was added? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-363) Block loading issue in case of blocklet distribution
kumar vishal created CARBONDATA-363: --- Summary: Block loading issue in case of blocklet distribution Key: CARBONDATA-363 URL: https://issues.apache.org/jira/browse/CARBONDATA-363 Project: CarbonData Issue Type: Bug Reporter: kumar vishal Assignee: kumar vishal Problem: In case of blocklet distribution same block is getting loaded multiple times this is because when blocklet distribution is enabled same block will divided inside a task so there is not synchronisation as block loading is done in different thread because of this same block is getting read from carbon data file footer multiple times and it is hitting the first time query performance. Solution: Need to add locking for above issue, if one thread is loading particulate block other thread need and once block loaded other thread need to use same reference of the block -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #280: [CARBONDATA-363]fixed block loading ...
GitHub user kumarvishal09 opened a pull request: https://github.com/apache/incubator-carbondata/pull/280 [CARBONDATA-363]fixed block loading issue in case of blocklet distribution **Problem**: In case of blocklet distribution same block is getting loaded multiple times this is because when blocklet distribution is enabled same block will divided inside a task so there is not synchronisation as block loading is done in different thread because of this same block is getting read from carbon data file footer multiple times and it is hitting the first time query performance. **Solution**: Need to add locking for above issue, if one thread is loading particulate block other thread need and once block loaded other thread need to use same reference of the block You can merge this pull request into a Git repository by running: $ git pull https://github.com/kumarvishal09/incubator-carbondata blockloadingissue Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/280.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #280 commit a6d8a18a73e3ed8e39de444b2ddfded45813493f Author: kumarvishal Date: 2016-11-02T17:02:42Z fixed block loading issue in case of blocklet distribution --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-362) Optimize the parameters' name in CarbonDataRDDFactory.scala
Liang Chen created CARBONDATA-362: - Summary: Optimize the parameters' name in CarbonDataRDDFactory.scala Key: CARBONDATA-362 URL: https://issues.apache.org/jira/browse/CARBONDATA-362 Project: CarbonData Issue Type: Bug Reporter: Liang Chen Priority: Trivial Optimize the parameters' name in CarbonDataRDDFactory.scala: changes the name of "hdfsStoreLocation" to "storePath", because not only support hdfs path. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #274: [CARBONDATA-355] Remove unnecessary ...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/274 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-361) SMALL INT data showing unsupported datatype
Prabhat Kashyap created CARBONDATA-361: -- Summary: SMALL INT data showing unsupported datatype Key: CARBONDATA-361 URL: https://issues.apache.org/jira/browse/CARBONDATA-361 Project: CarbonData Issue Type: Bug Reporter: Prabhat Kashyap When I tried executing the following query with SMALLINT datatype create table testTable2(id SMALLINT, name String) stored by 'carbondata' ; It is giving me following exception. Error: org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Unsupported data type : FieldSchema(name:id, type:smallint, comment:null).getType (state=,code=0) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #275: [CARBONDATA-349][WIP] Support load l...
GitHub user Jay357089 reopened a pull request: https://github.com/apache/incubator-carbondata/pull/275 [CARBONDATA-349][WIP] Support load local file into carbon table https://issues.apache.org/jira/browse/CARBONDATA-349 You can merge this pull request into a Git repository by running: $ git pull https://github.com/Jay357089/incubator-carbondata supportLocal Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/275.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #275 commit e0e9ce8a58bafefb30809ca61def402beb07dfdb Author: Jay357089 Date: 2016-11-02T06:59:52Z support load local file --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #275: [CARBONDATA-349][WIP] Support load l...
Github user Jay357089 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/275 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #276: [CARBONDATA-356]Remove Two Useless F...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/276 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #279: [CARBONDATA-328] [Spark] Improve Cod...
GitHub user PKOfficial opened a pull request: https://github.com/apache/incubator-carbondata/pull/279 [CARBONDATA-328] [Spark] Improve Code and Fix Warnings [Squashed] Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. **Please provide details on** - **Whether new unit test cases have been added or why no new tests are required?** Not required because no change in functionality. - **What manual testing you have done?** Run basic Commands in Beeline. - **Any additional information to help reviewers in testing this change.** No --- Improved spark module code. * Removed some compliation warnings. * Replace pattern matching for boolean to IF-ELSE. * Improved code according to scala standards. * Removed unnecessary new lines. * Added string interpolation instead of string concatenation. * Removed unnecessary semi-colons. * Fixed indentation. * add useKettle option for loading * Fixed indentation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/PKOfficial/incubator-carbondata improved-code Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/279.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #279 commit 044260fc7265251be097d6544dade1bc4db1e3a0 Author: X-Lion Date: 2016-09-29T14:33:18Z Lionx0929 mend commit 2fd3cd566eec870d7e2601b3bdc66496fa509377 Author: ravipesala Date: 2016-10-20T02:41:46Z Added Writer processor step for dataloading. Rebased Fixed comments. Added factory for fact data handler Fixed review comments. Fixed compilation issue after rebase commit a982583720c83bbf558f6fc1404078b5bbffaa15 Author: hexiaoqiao Date: 2016-10-28T14:44:57Z CARBONDATA-343 delete some duplicated definition code CARBONDATA-343 delete some duplicated definition code commit 1be29a884a5ab00b970fea7c3901f8acf0a13465 Author: Prabhat Kashyap Date: 2016-10-19T16:54:47Z Improved spark module code. * Removed some compliation warnings. * Replace pattern matching for boolean to IF-ELSE. * Improved code according to scala standards. * Removed unnecessary new lines. * Added string interpolation instead of string concatenation. * Removed unnecessary semi-colons. * Fixed indentation. * add useKettle option for loading * Fixed indentation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #276: [CARBONDATA-356]Remove Two Useless F...
Github user lion-x commented on a diff in the pull request:
https://github.com/apache/incubator-carbondata/pull/276#discussion_r86104485
--- Diff:
core/src/main/java/org/apache/carbondata/scan/expression/ExpressionResult.java
---
@@ -33,8 +33,7 @@
import
org.apache.carbondata.scan.expression.exception.FilterIllegalMemberException;
public class ExpressionResult implements Comparable {
-
- private static final long serialVersionUID = 1L;
+
--- End diff --
I checked in my env. mvn clean passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-carbondata pull request #272: [CARBONDATA-353]Update doc for datef...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/272 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #278: [CARBONDATA-85][WIP] support insert ...
GitHub user QiangCai opened a pull request: https://github.com/apache/incubator-carbondata/pull/278 [CARBONDATA-85][WIP] support insert into carbon table select from table **1.Support insert into carbon table select from table** **2.Imporve performance of dataframe loading** You can merge this pull request into a Git repository by running: $ git pull https://github.com/QiangCai/incubator-carbondata loaddataframe Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/278.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #278 commit 217947dc6f167f8ae490d28254eed4785eea73d3 Author: QiangCai Date: 2016-10-24T02:54:20Z DataLoadCoalescedRDD DataLoadPartitionCoalescer concurrently read dataframe commit 39d517179184c8412a488e44b5b914412ec24451 Author: QiangCai Date: 2016-11-01T09:39:57Z add test case --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-360) On Dictionary excluded column, condition is not working if value is not in ''
Krishna Reddy created CARBONDATA-360: Summary: On Dictionary excluded column, condition is not working if value is not in '' Key: CARBONDATA-360 URL: https://issues.apache.org/jira/browse/CARBONDATA-360 Project: CarbonData Issue Type: Bug Components: data-query Affects Versions: 0.2.0-incubating Reporter: Krishna Reddy Priority: Minor Fix For: 0.2.0-incubating On Dictionary excluded column, condition is not working if value is not in '' for numeric -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-359) is null & null functions are not working when data fetching from sub query
Krishna Reddy created CARBONDATA-359: Summary: is null & null functions are not working when data fetching from sub query Key: CARBONDATA-359 URL: https://issues.apache.org/jira/browse/CARBONDATA-359 Project: CarbonData Issue Type: Bug Components: data-query Affects Versions: 0.2.0-incubating Reporter: Krishna Reddy Fix For: 0.2.0-incubating Is null & Not null functions are not working when data fetching from sub query. select * from (select if( Latest_areaId=3,1,Latest_areaId) test from Carbon_automation) qq where test is null; select * from (select if( Latest_areaId=3,1,Latest_areaId) test from Carbon_automation) qq where test is not null; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-358) Compaction is not working in latest release
Krishna Reddy created CARBONDATA-358: Summary: Compaction is not working in latest release Key: CARBONDATA-358 URL: https://issues.apache.org/jira/browse/CARBONDATA-358 Project: CarbonData Issue Type: Bug Components: data-query Affects Versions: 0.2.0-incubating Environment: stand alone environment Reporter: Krishna Reddy Fix For: 0.2.0-incubating Compaction feature is not working in open source 0.2 release (Major, Minor and Auto) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #277: [CARBONDATA-357] Added ValueCompress...
GitHub user kunal642 opened a pull request: https://github.com/apache/incubator-carbondata/pull/277 [CARBONDATA-357] Added ValueCompressionUtilTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[CARBONDATA-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - What manual testing you have done? - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/kunal642/incubator-carbondata CARBONDATA-357 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/277.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #277 commit e20a094e4f2d2436f31864d0b653a305b6a8ddc1 Author: kunal642 Date: 2016-11-02T08:49:24Z Added ValueCompressionUtilTest --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-357) Write unit test for ValueCompressionUtil
Prabhat Kashyap created CARBONDATA-357: -- Summary: Write unit test for ValueCompressionUtil Key: CARBONDATA-357 URL: https://issues.apache.org/jira/browse/CARBONDATA-357 Project: CarbonData Issue Type: Sub-task Reporter: Prabhat Kashyap -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-356) Remove Two Useless Files ConvertedType.java and QuerySchemaInfo.java
Lionx created CARBONDATA-356: Summary: Remove Two Useless Files ConvertedType.java and QuerySchemaInfo.java Key: CARBONDATA-356 URL: https://issues.apache.org/jira/browse/CARBONDATA-356 Project: CarbonData Issue Type: Improvement Reporter: Lionx Assignee: Lionx Priority: Minor ConvertedType.java and QuerySchemaInfo.java are uselesss. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #276: [WIP] Remove Two Useless Files Conve...
GitHub user lion-x opened a pull request: https://github.com/apache/incubator-carbondata/pull/276 [WIP] Remove Two Useless Files ConvertedType.java and QuerySchemaInfo.java # Why raise this PR? ## Remove Two Useless Files. core/src/main/java/org/apache/carbondata/core/carbon/metadata/datatype/ConvertedType.java core/src/main/java/org/apache/carbondata/scan/model/QuerySchemaInfo.java ## Correct Some Spelling Mistakes # How to test? Pass all test cases. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lion-x/incubator-carbondata SpellingMistakes161102 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/276.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #276 commit b7c4dbb8daaf8b0d322328807b5646157fac162d Author: lion-x Date: 2016-11-02T03:20:56Z SpellingMistakes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #268: Add one FAQ in README
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #275: [CARBONDATA-349][WIP] Support load l...
GitHub user Jay357089 opened a pull request: https://github.com/apache/incubator-carbondata/pull/275 [CARBONDATA-349][WIP] Support load local file into carbon table https://issues.apache.org/jira/browse/CARBONDATA-349 You can merge this pull request into a Git repository by running: $ git pull https://github.com/Jay357089/incubator-carbondata supportLocal Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/275.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #275 commit ec034ae38e14094193b6ee07f1da6bb27a393537 Author: Jay357089 Date: 2016-11-02T06:59:52Z support load local file --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: List the supported datatypes in carbondata
As per the previous conversation reply : Following are the supported datatypes in carbon. string,int, integer,tinyint,short,long,bigint,numeric,double,decimal, timestamp,array,struct. Could you please clarify if both int and Integer should be supported ? Using Integer datatype is giving me following error 0: jdbc:hive2://localhost:1> create table emp(id Integer, name String) stored by 'carbondata'; Error: org.apache.spark.sql.AnalysisException: cannot recognize input near 'Integer' ',' 'name' in column type; line 1 pos 20 (state=,code=0) On Sat, Oct 29, 2016 at 7:11 AM, Ravindra Pesala wrote: > Hi, > > Following are the supported datatypes in carbon. > string,int, > integer,tinyint,short,long,bigint,numeric,double,decimal, > timestamp,array,struct. > > Regards, > Ravi > > On 28 October 2016 at 11:49, Swati wrote: > > > Hi, > > > > I would like to know about the datatypes which are supported by > carbondata > > as I am getting this error *"MalformedCarbonCommandException: > Unsupported > > data type"* while running the queries against these datatypes :*" tiny > Int, > > smallInt, float, date, varchar, char, boolean, binary, Map, Union "*. > Also > > there is no information available in the documentation about supported > > datatypes. > > > > > > > > -- > > View this message in context: http://apache-carbondata- > > mailing-list-archive.1130556.n5.nabble.com/List-the- > > supported-datatypes-in-carbondata-tp2419.html > > Sent from the Apache CarbonData Mailing List archive mailing list archive > > at Nabble.com. > > > > > > -- > Thanks & Regards, > Ravi > -- Regards | Pallavi Singh Software Consultant Knoldus Software LLP pallavi.si...@knoldus.in +91-9911235949
