[jira] [Created] (CARBONDATA-1422) Major and Minor Compaction Failing

2017-08-28 Thread Pallavi Singh (JIRA)
Pallavi Singh created CARBONDATA-1422:
-

 Summary: Major and Minor Compaction Failing
 Key: CARBONDATA-1422
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1422
 Project: CarbonData
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Pallavi Singh
 Fix For: 1.2.0


The major and minor compaction is failing. 
Please find the error logs below :

0: jdbc:hive2://localhost:1> show segments for table uniqdata;
++--+--+--+--+
| SegmentSequenceId  |  Status  | Load Start Time  |  Load End Time 
  |
++--+--+--+--+
| 9  | Success  | 2017-08-29 11:17:29.927  | 2017-08-29 
11:17:30.555  |
| 8  | Success  | 2017-08-29 11:17:27.572  | 2017-08-29 
11:17:28.363  |
| 7  | Success  | 2017-08-29 11:17:23.583  | 2017-08-29 
11:17:25.112  |
| 6  | Success  | 2017-08-29 11:17:07.966  | 2017-08-29 
11:17:09.322  |
| 5  | Success  | 2017-08-29 10:38:15.727  | 2017-08-29 
10:38:16.548  |
| 4  | Success  | 2017-08-29 10:37:13.053  | 2017-08-29 
10:37:13.888  |
| 3  | Success  | 2017-08-29 10:36:57.851  | 2017-08-29 
10:36:59.08   |
| 2  | Success  | 2017-08-29 10:36:49.439  | 2017-08-29 
10:36:50.373  |
| 1  | Success  | 2017-08-29 10:36:37.365  | 2017-08-29 
10:36:38.768  |
| 0  | Success  | 2017-08-29 10:36:21.011  | 2017-08-29 
10:36:26.1|
++--+--+--+--+
10 rows selected (0.081 seconds)
0: jdbc:hive2://localhost:1> ALTER TABLE uniqdata COMPACT 'MINOR';
Error: java.lang.RuntimeException: Compaction failed. Please check logs for 
more info. Exception in compaction java.lang.Exception: Compaction Failure in 
Merger Rdd. (state=,code=0)
0: jdbc:hive2://localhost:1> ALTER TABLE uniqdata COMPACT 'MAJOR';
Error: java.lang.RuntimeException: Compaction failed. Please check logs for 
more info. Exception in compaction java.lang.Exception: Compaction Failure in 
Merger Rdd. (state=,code=0)
0: jdbc:hive2://localhost:1> 




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (CARBONDATA-1421) Auto Compaction Failing in CarbonData Loading

2017-08-28 Thread Pallavi Singh (JIRA)
Pallavi Singh created CARBONDATA-1421:
-

 Summary: Auto Compaction Failing in CarbonData Loading
 Key: CARBONDATA-1421
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1421
 Project: CarbonData
  Issue Type: Bug
  Components: data-load
Affects Versions: 1.2.0
Reporter: Pallavi Singh
 Fix For: 1.2.0


I ran the create query followed by multiple load queries and the 
auto-compaction is failing.

0: jdbc:hive2://localhost:1> LOAD DATA inpath 
'hdfs://localhost:54310/data/4000_UniqData.csv' INTO table uniqdata 
options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, 
DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, 
Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (1.183 seconds)
0: jdbc:hive2://localhost:1> LOAD DATA inpath 
'hdfs://localhost:54310/data/5000_UniqData.csv' INTO table uniqdata 
options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, 
DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, 
Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. 
Please check logs. (state=,code=0)
0: jdbc:hive2://localhost:1> LOAD DATA inpath 
'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata 
options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, 
DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, 
Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. 
Please check logs. (state=,code=0)
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> 
0: jdbc:hive2://localhost:1> show segments for table uniqdata;
++--+--+--+--+
| SegmentSequenceId  |  Status  | Load Start Time  |  Load End Time 
  |
++--+--+--+--+
| 4  | Success  | 2017-08-29 10:37:13.053  | 2017-08-29 
10:37:13.888  |
| 3  | Success  | 2017-08-29 10:36:57.851  | 2017-08-29 
10:36:59.08   |
| 2  | Success  | 2017-08-29 10:36:49.439  | 2017-08-29 
10:36:50.373  |
| 1  | Success  | 2017-08-29 10:36:37.365  | 2017-08-29 
10:36:38.768  |
| 0  | Success  | 2017-08-29 10:36:21.011  | 2017-08-29 
10:36:26.1|
++--+--+--+--+
5 rows selected (0.099 seconds)
0: jdbc:hive2://localhost:1> LOAD DATA inpath 
'hdfs://localhost:54310/data/7000_UniqData.csv' INTO table uniqdata 
options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, 
DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, 
Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1');
Error: java.lang.Exception: Dataload is success. Auto-Compaction has failed. 
Please check logs. (state=,code=0)
0: jdbc:hive2://localhost:1> show segments for table uniqdata;
++--+--+--+--+
| SegmentSequenceId  |  Status  | Load Start Time  |  Load End Time 
  |
++--+--+--+--+
| 5  | Success  | 2017-08-29 10:38:15.727  | 2017-08-29 
10:38:16.548  |
| 4  | Success  | 2017-08-29 10:37:13.053  | 2017-08-29 
10:37:13.888  |
| 3  | Success  | 2017-08-29 10:36:57.851  | 2017-08-29 
10:36:59.08   |
| 2  | Success  | 2017-08-29 10:36:49.439  | 2017-08-29 
10:36:50.373  |
| 1  | Success  | 2017-08-29 10:36:37.365  | 2017-08-29 
10:36:38.768  |
| 0  | Success  | 2017-08-29 10:36:21.011  | 2017-08-29 
10:36:26.1|
++--+--+--+--+




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (CARBONDATA-1420) Partition Feature doesn't support a Partition Column of Date Type.

2017-08-28 Thread Neha Bhardwaj (JIRA)
Neha Bhardwaj created CARBONDATA-1420:
-

 Summary: Partition Feature doesn't support a Partition Column of 
Date Type.
 Key: CARBONDATA-1420
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1420
 Project: CarbonData
  Issue Type: Bug
 Environment: spark 2.1
Reporter: Neha Bhardwaj


*Create Table :
DROP TABLE IF EXISTS list_partition_table_date;

CREATE TABLE list_partition_table_date(shortField SHORT, intField INT, 
bigintField LONG, doubleField DOUBLE, stringField STRING, timestampField 
TIMESTAMP, decimalField DECIMAL(18,2), charField CHAR(5), floatField FLOAT, 
complexData ARRAY ) PARTITIONED BY (dateField DATE) STORED BY 
'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='2010/7/23 , 
2011/7/23, 2012/7/23');

*Output : 
Error: java.lang.RuntimeException: 
BaseSqlParser null
CarbonSqlParser [1.1] failure: identifier matching regex (?i)ALTER expected

CREATE TABLE list_partition_table_date(shortField SHORT, intField INT, 
bigintField LONG, doubleField DOUBLE, stringField STRING, timestampField 
TIMESTAMP, decimalField DECIMAL(18,2), charField CHAR(5), floatField FLOAT, 
complexData ARRAY ) PARTITIONED BY (dateField DATE) STORED BY 
'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='2010/7/23 , 
2011/7/23, 2012/7/23')
^ (state=,code=0)




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata issue #1286: [CARBONDATA-1404] Added Unit test cases for Hive Int...

2017-08-28 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1286
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (CARBONDATA-1419) Add adaptive encoding for Double data type

2017-08-28 Thread Jacky Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacky Li updated CARBONDATA-1419:
-
Description: 
Add two new encoding for Double data type:
1. AdaptiveFloatingCodec, it will multiple the column value by Math.pow(10, 
decimalCount) and do type cast from double to target data type like byte, 
short, int
2. AdaptiveDeltaFloatingCodec, it will first calculate the delta of column 
value and maximum value and multiple by Math.pow(10, decimalCount) and do type 
cast from double to target data type like byte, short, int

> Add adaptive encoding for Double data type
> --
>
> Key: CARBONDATA-1419
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1419
> Project: CarbonData
>  Issue Type: New Feature
>Reporter: Jacky Li
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Add two new encoding for Double data type:
> 1. AdaptiveFloatingCodec, it will multiple the column value by Math.pow(10, 
> decimalCount) and do type cast from double to target data type like byte, 
> short, int
> 2. AdaptiveDeltaFloatingCodec, it will first calculate the delta of column 
> value and maximum value and multiple by Math.pow(10, decimalCount) and do 
> type cast from double to target data type like byte, short, int



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata pull request #1295: [CARBONDATA-1419] Support adaptive encoding f...

2017-08-28 Thread jackylk
GitHub user jackylk opened a pull request:

https://github.com/apache/carbondata/pull/1295

[CARBONDATA-1419] Support adaptive encoding for Double data type

Add two new encoding for Double data type:
1. AdaptiveFloatingCodec, it will multiple the column value by Math.pow(10, 
decimalCount) and do type cast from double to target data type like byte, 
short, int
2. AdaptiveDeltaFloatingCodec, it will first calculate the delta of column 
value and maximum value and multiple by Math.pow(10, decimalCount) and do type 
cast from double to target data type like byte, short, int

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jackylk/incubator-carbondata upscale

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1295.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1295


commit 56548813f015b919f0304d45c117c6f93b1fadc0
Author: Jacky Li 
Date:   2017-08-29T04:09:47Z

support adaptive encoding for double




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1230: [WIP]corrected sdv test cases

2017-08-28 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1230
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/3428/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1284: [CARBONDATA-1330] Not able to drop temporary table b...

2017-08-28 Thread PannerselvamVelmyl
Github user PannerselvamVelmyl commented on the issue:

https://github.com/apache/carbondata/pull/1284
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1294: [CARBONDATA-1418] Use CarbonTableInputFormat ...

2017-08-28 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1294


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1294: [CARBONDATA-1418] Use CarbonTableInputFormat for cre...

2017-08-28 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1294
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1294: [CARBONDATA-1418] Use CarbonTableInputFormat for cre...

2017-08-28 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1294
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1292: [CARBONDATA-649] fix for update with rand

2017-08-28 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1292#discussion_r135672191
  
--- Diff: 
integration/spark-common-test/src/test/resources/IUD/2000_UniqData_2.csv ---
@@ -0,0 +1,5 @@
+CUST_ID,CUST_NAME,DECIMAL_COLUMN1
--- End diff --

can you simulate the data for test, don't suggest adding many csv files to 
repo.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1292: [CARBONDATA-649] fix for update with rand

2017-08-28 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1292#discussion_r135672102
  
--- Diff: examples/spark2/src/main/resources/2000_UniqData_2.csv ---
@@ -0,0 +1,4 @@
+9000,CUST_NAME_1,12345678901.1234
+9001,1CUST_NAME_0,12345678901.1234
--- End diff --

Why added test file to example module ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1294: [CARBONDATA-1418] Use CarbonTableInputFormat for cre...

2017-08-28 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1294
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1266: [CARBONDATA-1393] Avoid to throw NPE when execute 'f...

2017-08-28 Thread zzcclp
Github user zzcclp commented on the issue:

https://github.com/apache/carbondata/pull/1266
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1266: [CARBONDATA-1393] Avoid to throw NPE when execute 'f...

2017-08-28 Thread zzcclp
Github user zzcclp commented on the issue:

https://github.com/apache/carbondata/pull/1266
  
retest it please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1294: [CARBONDATA-1418] Use CarbonTableInputFormat ...

2017-08-28 Thread bhavya411
GitHub user bhavya411 opened a pull request:

https://github.com/apache/carbondata/pull/1294

[CARBONDATA-1418] Use CarbonTableInputFormat for creating the Splits and 
QueryModel

Refactored Code to use CarbonTableInputFormat for creating splits

Build Successful
All Test Cases executing successfully
Manually verified the changes



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bhavya411/incubator-carbondata 
prestoImprovement

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1294.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1294


commit 86c7d2240555b2579726a9f6378f51af93ab2677
Author: Bhavya 
Date:   2017-08-28T17:51:58Z

Used CarbonTableInputFormat for creating the Splits and QueryModel




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...

2017-08-28 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1293
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/3427/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-1418) Use CarbonTableInputFormat in Presto Integration

2017-08-28 Thread Bhavya Aggarwal (JIRA)
Bhavya Aggarwal created CARBONDATA-1418:
---

 Summary: Use CarbonTableInputFormat in Presto Integration
 Key: CARBONDATA-1418
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1418
 Project: CarbonData
  Issue Type: Improvement
  Components: presto-integration
Affects Versions: 1.2.0
 Environment: All 
Reporter: Bhavya Aggarwal
Assignee: Bhavya Aggarwal
 Fix For: 1.2.0


Use CarbonTableInputFormat in Presto Integration



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...

2017-08-28 Thread sraghunandan
Github user sraghunandan commented on the issue:

https://github.com/apache/carbondata/pull/1293
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1293: [CARBONDATA-1417]Added cluster tests for IUD, batch ...

2017-08-28 Thread sraghunandan
Github user sraghunandan commented on the issue:

https://github.com/apache/carbondata/pull/1293
  
ok to test


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1293: [CARBONDATA-1417]Added cluster tests for IUD,...

2017-08-28 Thread sraghunandan
GitHub user sraghunandan opened a pull request:

https://github.com/apache/carbondata/pull/1293

[CARBONDATA-1417]Added cluster tests for IUD, batch sort and global sort 
features

1.IUD
2.batch sort
3.global sort


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sraghunandan/carbondata-1 missing_sdv_tests

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1293.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1293


commit e67de0bd6c99d7199104ddaeb21e52e028bf58a1
Author: Raghunandan S 
Date:   2017-08-28T16:27:20Z

Added cluster tests for
1.IUD
2.batch sort
3.global sort




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-1417) Add Cluster tests for IUD, batch sort and Global sort features

2017-08-28 Thread Raghunandan (JIRA)
Raghunandan created CARBONDATA-1417:
---

 Summary: Add Cluster tests for IUD, batch sort and Global sort 
features
 Key: CARBONDATA-1417
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1417
 Project: CarbonData
  Issue Type: Bug
Reporter: Raghunandan






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata issue #1292: [CARBONDATA-649] fix for update with rand

2017-08-28 Thread ashwini-krishnakumar
Github user ashwini-krishnakumar commented on the issue:

https://github.com/apache/carbondata/pull/1292
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (CARBONDATA-1416) Show Segments raises exception for a Partition Table after Updation.

2017-08-28 Thread Neha Bhardwaj (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Neha Bhardwaj updated CARBONDATA-1416:
--
Attachment: list_partition_table.csv

> Show Segments raises exception for a Partition Table after Updation.
> 
>
> Key: CARBONDATA-1416
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1416
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
> Environment: spark 2.1
>Reporter: Neha Bhardwaj
> Attachments: list_partition_table.csv
>
>
> 1. Create Partition Table :
> DROP TABLE IF EXISTS list_partition_table_string;
>  CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, 
> bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField 
> DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, 
> complexData ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 
> 'carbondata' TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, 
> America, Europe', 'DICTIONARY_EXCLUDE'='stringfield');
> 2. Load Data :
> load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into 
> table list_partition_table_string 
> options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata',
>  'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 
> 'SINGLE_PASS'='TRUE');
> 3. Update Data :
> update list_partition_table_string set (stringfield)=('China') where 
> stringfield = 'Japan' ;
>  update list_partition_table_string set (stringfield)=('Japan') where 
> stringfield > 'Europe' ;
>  update list_partition_table_string set (stringfield)=('Asia') where 
> stringfield < 'Europe' ;
> 4. Compaction :
> ALTER TABLE list_partition_table_string COMPACT 'Minor';
>  Show segments for table list_partition_table_string;
> Expected Output: Segments Must be Displayed.
> Actual Output : Error: java.lang.NullPointerException (state=,code=0)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata issue #1291: [CARBONDATA-1343] Hive can't query data when the car...

2017-08-28 Thread chenliang613
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1291
  
@cenyuhai  i think, CarbonInputFormat should extend CarbonTableInputFormat 
now.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1291: [CARBONDATA-1343] Hive can't query data when ...

2017-08-28 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1291#discussion_r135560774
  
--- Diff: 
hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java ---
@@ -133,7 +133,7 @@ public static void setTableInfo(Configuration 
configuration, TableInfo tableInfo
   /**
* Get TableInfo object from `configuration`
*/
-  private TableInfo getTableInfo(Configuration configuration) throws 
IOException {
+  public TableInfo getTableInfo(Configuration configuration) throws 
IOException {
--- End diff --

In the future,  carbondata will use CarbonTableInputFormat to replace 
CarbonInputFormat, so please use CarbonTableInputFormat.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-1416) Show Segments raises exception for a Partition Table after Updation.

2017-08-28 Thread Neha Bhardwaj (JIRA)
Neha Bhardwaj created CARBONDATA-1416:
-

 Summary: Show Segments raises exception for a Partition Table 
after Updation.
 Key: CARBONDATA-1416
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1416
 Project: CarbonData
  Issue Type: Bug
  Components: data-query
 Environment: spark 2.1
Reporter: Neha Bhardwaj


1. Create Partition Table :
DROP TABLE IF EXISTS list_partition_table_string;

 CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, 
bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField 
DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, complexData 
ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 'carbondata' 
TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, America, Europe', 
'DICTIONARY_EXCLUDE'='stringfield');

2. Load Data :
load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into 
table list_partition_table_string 
options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata',
 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 
'SINGLE_PASS'='TRUE');

3. Update Data :
update list_partition_table_string set (stringfield)=('China') where 
stringfield = 'Japan' ;

 update list_partition_table_string set (stringfield)=('Japan') where 
stringfield > 'Europe' ;

 update list_partition_table_string set (stringfield)=('Asia') where 
stringfield < 'Europe' ;

4. Compaction :
ALTER TABLE list_partition_table_string COMPACT 'Minor';

 Show segments for table list_partition_table_string;

Expected Output: Segments Must be Displayed.
Actual Output : Error: java.lang.NullPointerException (state=,code=0)





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (CARBONDATA-1415) Show Segments raises exception for a Partition Table after Updation.

2017-08-28 Thread Neha Bhardwaj (JIRA)
Neha Bhardwaj created CARBONDATA-1415:
-

 Summary: Show Segments raises exception for a Partition Table 
after Updation.
 Key: CARBONDATA-1415
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1415
 Project: CarbonData
  Issue Type: Bug
  Components: data-query
 Environment: spark 2.1
Reporter: Neha Bhardwaj


1. Create Partition Table :
DROP TABLE IF EXISTS list_partition_table_string;

 CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, 
bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField 
DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, complexData 
ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 'carbondata' 
TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, America, Europe', 
'DICTIONARY_EXCLUDE'='stringfield');

2. Load Data :
load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into 
table list_partition_table_string 
options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata',
 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 
'SINGLE_PASS'='TRUE');

3. Update Data :
update list_partition_table_string set (stringfield)=('China') where 
stringfield = 'Japan' ;

 update list_partition_table_string set (stringfield)=('Japan') where 
stringfield > 'Europe' ;

 update list_partition_table_string set (stringfield)=('Asia') where 
stringfield < 'Europe' ;

4. Compaction :
ALTER TABLE list_partition_table_string COMPACT 'Minor';

 Show segments for table list_partition_table_string;

Expected Output: Segments Must be Displayed.
Actual Output : Error: java.lang.NullPointerException (state=,code=0)





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (CARBONDATA-1414) Show Segments raises exception for a Partition Table after Updation.

2017-08-28 Thread Neha Bhardwaj (JIRA)
Neha Bhardwaj created CARBONDATA-1414:
-

 Summary: Show Segments raises exception for a Partition Table 
after Updation.
 Key: CARBONDATA-1414
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1414
 Project: CarbonData
  Issue Type: Bug
  Components: data-query
 Environment: spark 2.1
Reporter: Neha Bhardwaj
 Attachments: list_partition_table.csv

1. Create Partition Table :
DROP TABLE IF EXISTS list_partition_table_string;

 CREATE TABLE list_partition_table_string(shortField SHORT, intField INT, 
bigintField LONG, doubleField DOUBLE, timestampField TIMESTAMP, decimalField 
DECIMAL(18,2), dateField DATE, charField CHAR(5), floatField FLOAT, complexData 
ARRAY ) PARTITIONED BY (stringField STRING) STORED BY 'carbondata' 
TBLPROPERTIES('PARTITION_TYPE'='LIST', 'LIST_INFO'='Asia, America, Europe', 
'DICTIONARY_EXCLUDE'='stringfield');

2. Load Data :
load data inpath 'hdfs://localhost:54310/CSV/list_partition_table.csv' into 
table list_partition_table_string 
options('FILEHEADER'='shortfield,intfield,bigintfield,doublefield,stringfield,timestampfield,decimalfield,datefield,charfield,floatfield,complexdata',
 'COMPLEX_DELIMITER_LEVEL_1'='$','COMPLEX_DELIMITER_LEVEL_2'='#', 
'SINGLE_PASS'='TRUE');

3. Update Data :
update list_partition_table_string set (stringfield)=('China') where 
stringfield = 'Japan' ;

 update list_partition_table_string set (stringfield)=('Japan') where 
stringfield > 'Europe' ;

 update list_partition_table_string set (stringfield)=('Asia') where 
stringfield < 'Europe' ;

4. Compaction :
ALTER TABLE list_partition_table_string COMPACT 'Minor';

 Show segments for table list_partition_table_string;

Expected Output: Segments Must be Displayed.
Actual Output : Error: java.lang.NullPointerException (state=,code=0)





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata issue #1265: [CARBONDATA-1128] Add direct string encoding for sho...

2017-08-28 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1265
  
@jackylk it seems lot of tests are failing, can you check


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1292: [CARBONDATA-649] fix for update with rand

2017-08-28 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1292
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1292: [CARBONDATA-649] fix for update with rand

2017-08-28 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1292
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1292: [CARBONDATA-649] fix for update with rand

2017-08-28 Thread ashwini-krishnakumar
GitHub user ashwini-krishnakumar opened a pull request:

https://github.com/apache/carbondata/pull/1292

[CARBONDATA-649] fix for update with rand

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[CARBONDATA-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).
 - [ ] Testing done
 
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- What manual testing you have done?
- Any additional information to help reviewers in testing this 
change.
 
 - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
 
---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ashwini-krishnakumar/carbondata master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1292.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1292


commit 40e897008fdb4922f5db84a239d9af482fec03d8
Author: ashwini-krishnakumar 
Date:   2017-08-28T13:31:00Z

Changes for CARBONDATA-649

commit 691e0d9397b7913bffd1fdba14cee3d762544573
Author: ashwini-krishnakumar 
Date:   2017-08-28T13:55:50Z

Changes to the [CARBONDATA-649] update with rand




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-1413) Incorrect result displays after creating a partition table with incorrect range_info

2017-08-28 Thread Vandana Yadav (JIRA)
Vandana Yadav created CARBONDATA-1413:
-

 Summary: Incorrect result displays after creating a partition 
table with incorrect range_info
 Key: CARBONDATA-1413
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1413
 Project: CarbonData
  Issue Type: Bug
  Components: data-query, sql
Affects Versions: 1.2.0
 Environment: spark 2.1
Reporter: Vandana Yadav
Priority: Minor
 Attachments: 2000_UniqData.csv, partition4.png

Incorrect result displays after creating a partition table with incorrect 
range_info

Description: While creating a partitioned table with string data type column if 
we provide wrong credentials it should not create partition but in this 
scenario when I am providing range info as any integer data type instead of 
string data type, it is creating a partitioned table which is not a correct 
result, it should display an error saying invalid credentials.

Steps to Reproduce

1)Create a Partitioned table with incorrect credentials
CREATE TABLE uniqdata_part2_incorrect1 (CUST_ID int,CUST_NAME String,DOB 
Timestamp,DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
int) PARTITIONED BY (ACTIVE_EMUI_VERSION string) STORED BY 
'org.apache.carbondata.format' TBLPROPERTIES 
('PARTITION_TYPE'='RANGE','RANGE_INFO'='1',"TABLE_BLOCKSIZE"= "256 MB");

2) Load data into the partitioned table
LOAD DATA INPATH 'hdfs://localhost:54310/uniqdata/2000_UniqData.csv' into table 
uniqdata_part2_incorrect1 OPTIONS('DELIMITER'=',' , 
'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');

3) Execute Query:
show partitions uniqdata_part2_incorrect1;

4)Result On beeline:
+---+--+
| partition |
+---+--+
| 0, active_emui_version = DEFAULT  |
| 1, active_emui_version < 1|
+---+--+

5)Expected Result:
The partitioned table should not be created as there were wrong credentials in 
the create table query(integer at the place of string)




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (CARBONDATA-1412) delete working incorrectly while using segment.starttime before ''

2017-08-28 Thread Sangeeta Gulia (JIRA)
Sangeeta Gulia created CARBONDATA-1412:
--

 Summary: delete working incorrectly while using segment.starttime 
before ''
 Key: CARBONDATA-1412
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1412
 Project: CarbonData
  Issue Type: Bug
  Components: data-query, test
 Environment: Spark-2.1
Reporter: Sangeeta Gulia
Priority: Minor
 Fix For: 1.2.0


Issue exists in the below query :

delete from table uniqdata_delete where segment.starttime before 
'starttime_of_last_segment_created';

It should mark all those segments for delete whose start-time is before the 
given time and should not delete the segment with the given time.

But it is marking the segment for delete which is having the exact start time 
also.

To replicate the issue: 

CREATE TABLE uniqdata_delete (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION 
string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double, INTEGER_COLUMN1 
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= 
"256 MB")

LOAD DATA INPATH 
'hdfs://localhost:54310/user/hduser/input-files/3000_UniqData.csv' into table 
uniqdata_delete 
OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1')


LOAD DATA INPATH 
'hdfs://localhost:54310/user/hduser/input-files/3000_UniqData.csv' into table 
uniqdata_delete 
OPTIONS('FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1')


delete from table uniqdata_delete where segment.starttime before 
'starttime_of_last_segment_created';




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] carbondata issue #1289: [CARBONDATA-1406] Fixed the issue with the Quotation...

2017-08-28 Thread sgururajshetty
Github user sgururajshetty commented on the issue:

https://github.com/apache/carbondata/pull/1289
  
LGTM
The " " is been removed from the heading as it is not the standard to have 
" " in headings.

@chenliang613 kindly review and merge



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1266: [CARBONDATA-1393] Avoid to throw NPE when execute 'f...

2017-08-28 Thread zzcclp
Github user zzcclp commented on the issue:

https://github.com/apache/carbondata/pull/1266
  
retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata issue #1213: [CARBONDATA-1342] Fixed bugs for spark conf property...

2017-08-28 Thread manishgupta88
Github user manishgupta88 commented on the issue:

https://github.com/apache/carbondata/pull/1213
  
Already merged


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] carbondata pull request #1213: [CARBONDATA-1342] Fixed bugs for spark conf p...

2017-08-28 Thread manishgupta88
Github user manishgupta88 closed the pull request at:

https://github.com/apache/carbondata/pull/1213


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (CARBONDATA-1406) Fix inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK “ in installation.md file

2017-08-28 Thread Pallavi Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallavi Singh updated CARBONDATA-1406:
--
Affects Version/s: 1.2.0

> Fix inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK  “ 
> in installation.md file
> 
>
> Key: CARBONDATA-1406
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1406
> Project: CarbonData
>  Issue Type: Bug
>  Components: docs
>Affects Versions: 1.2.0
>Reporter: Pallavi Singh
>Assignee: Pallavi Singh
>Priority: Minor
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The inconsistent usage of QUOTATION MARK " and LEFT DOUBLE QUOTATION MARK  “ 
> in installation.md file are creating conversion issue while generating the 
> documentation for the website from the docs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (CARBONDATA-1411) Show Segment command gives Null Pointer Exception after the table is updated

2017-08-28 Thread Pallavi Singh (JIRA)
Pallavi Singh created CARBONDATA-1411:
-

 Summary: Show Segment command gives Null Pointer Exception after 
the table is updated
 Key: CARBONDATA-1411
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1411
 Project: CarbonData
  Issue Type: Bug
Affects Versions: 1.2.0
 Environment: Linux, Hadoop 2.2.0 and spark 2.1.0
Reporter: Pallavi Singh
 Fix For: 1.2.0


I created a table :
CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, 
DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= 
"256 MB")

and loaded the table : 
LOAD DATA inpath 'hdfs://localhost:54310/data/2000_UniqData.csv' INTO table 
uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, 
ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, 
DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1')

I loaded the table 7 times using multiple cvs.

Then executed the following command :

show segments for table uniqdata;

and output was :

0: jdbc:hive2://localhost:1> show segments for table uniqdata;
+++--+--+--+
| SegmentSequenceId  |   Status   | Load Start Time  |  Load End 
Time   |
+++--+--+--+
| 5  | Success| 2017-08-28 13:19:01.779  | 2017-08-28 
13:19:02.527  |
| 4  | Success| 2017-08-28 13:18:58.597  | 2017-08-28 
13:18:59.339  |
| 3  | Compacted  | 2017-08-28 13:18:48.341  | 2017-08-28 
13:18:49.527  |
| 2  | Compacted  | 2017-08-28 13:18:44.96   | 2017-08-28 
13:18:46.222  |
| 1  | Compacted  | 2017-08-28 13:17:56.818  | 2017-08-28 
13:17:57.988  |
| 0.1| Success| 2017-08-28 13:18:49.698  | 2017-08-28 
13:18:50.659  |
| 0  | Compacted  | 2017-08-28 13:17:41.944  | 2017-08-28 
13:17:43.564  |
+++--+--+--+

now after that I executed the following query :

update uniqdata set (dob)=('2016-12-31 12:00:00') where 
cust_name='CUST_NAME_01998';

and then again ran : show segments for table uniqdata;

And now I am getting : Error: java.lang.NullPointerException (state=,code=0)





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)