[GitHub] incubator-carbondata issue #747: [CARBONDATA - 878] Fixed Formatting Issues ...

[ksimar]

Github user ksimar commented on the issue:

https://github.com/apache/incubator-carbondata/pull/747
  
@chenliang613 Updated the title. Please review the PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[Sephiroth-Lin]

Github user Sephiroth-Lin commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
@ravipesala Yes, inside the code gen, then it will clear for executor side, 
but for driver side after code gen we also need to clear the access count. From 
my test, if we don't clear it, then we can't remove it from memory if we don't 
have enough memory to load another cache.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #747: [CARBONDATA - 878] - Formatted Document

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/747
  
Please update the title, how about : 
[CARBONDATA - 878]  Fixed Formatting Issues in document quick-start-guide.md


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-729) CarbonOutputFormat

[cen yuhai (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

cen yuhai updated CARBONDATA-729:
-
Summary: CarbonOutputFormat  (was: Stable CarbonOutputFormat)

> CarbonOutputFormat
> --
>
> Key: CARBONDATA-729
> URL: https://issues.apache.org/jira/browse/CARBONDATA-729
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: hadoop-integration
>Affects Versions: NONE, 1.1.0-incubating
>Reporter: cen yuhai
>
> Now we already has a carbon inputformat, but we don't have a carbon 
> outputformat.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (CARBONDATA-882) Add SORT_COLUMNS option support in dataframe writer

[Jacky Li (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacky Li updated CARBONDATA-882:

Description: User can should be able to specify SORT_COLUMNS option when 
using dataframe.write  (was: User can specify Not to sort during loading, by 
adding an option in dataframe.write)

> Add SORT_COLUMNS option support in dataframe writer
> ---
>
> Key: CARBONDATA-882
> URL: https://issues.apache.org/jira/browse/CARBONDATA-882
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Jacky Li
> Fix For: 1.2.0-incubating
>
>
> User can should be able to specify SORT_COLUMNS option when using 
> dataframe.write



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (CARBONDATA-882) Add SORT_COLUMNS option support in dataframe writer

[Jacky Li (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacky Li updated CARBONDATA-882:

Summary: Add SORT_COLUMNS option support in dataframe writer  (was: Add no 
sort support in dataframe writer)

> Add SORT_COLUMNS option support in dataframe writer
> ---
>
> Key: CARBONDATA-882
> URL: https://issues.apache.org/jira/browse/CARBONDATA-882
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Jacky Li
> Fix For: 1.2.0-incubating
>
>
> User can specify Not to sort during loading, by adding an option in 
> dataframe.write



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-882) Add no sort support in dataframe writer

[Jacky Li (JIRA)]

Jacky Li created CARBONDATA-882:
---

 Summary: Add no sort support in dataframe writer
 Key: CARBONDATA-882
 URL: https://issues.apache.org/jira/browse/CARBONDATA-882
 Project: CarbonData
  Issue Type: Improvement
Reporter: Jacky Li
 Fix For: 1.2.0-incubating


User can specify Not to sort during loading, by adding an option in 
dataframe.write



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #732: [CARBONDATA-754] improve performance when o...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/732
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1494/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-877) String datatype is throwing an error when included in DIctionary_Exclude in a alter query

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-877.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> String datatype is throwing an error when included in DIctionary_Exclude in a 
> alter query
> -
>
> Key: CARBONDATA-877
> URL: https://issues.apache.org/jira/browse/CARBONDATA-877
> Project: CarbonData
>  Issue Type: Bug
>Reporter: SWATI RAO
>Assignee: Kunal Kapoor
> Fix For: 1.1.0-incubating
>
> Attachments: 2000_UniqData.csv
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION 
> string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
> bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
> decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
> int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES 
> ("TABLE_BLOCKSIZE"= "256 MB");
> LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
> table uniqdata OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> ALTER TABLE uniqdata RENAME TO uniqdata1;
> alter table uniqdata1 drop columns(CUST_NAME);
> alter table uniqdata1 add columns(CUST_NAME string) 
> TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
> 'DEFAULT.VALUE.CUST_NAME'='testuser') ;
> Column added successfully. But when we execute:
> select distinct(CUST_NAME) from uniqdata1 ; 
> &
> select count(CUST_NAME) from uniqdata1 ;
> it throws an error :
> "Job aborted due to stage failure: Task 0 in stage 9.0 failed 1 times, most 
> recent failure: Lost task 0.0 in stage 9.0 (TID 206, localhost, executor 
> driver): java.lang.ArrayIndexOutOfBoundsException: 4186"



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #753: [CARBONDATA-877] Fixed ArrayIndexOut...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/753


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #753: [CARBONDATA-877] Fixed ArrayIndexOutOfBound...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/753
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
@Sephiroth-Lin Actually clearing the cache at the time of codegen 
generation does not help as it just returns the code string to spark , Spark 
compiles it and executes as part of WholeCodeGen. We need to find a way to 
clear inside the code gen.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #738: [CARBONDATA-872] Fix comment issues ...

[ffpeng90]

Github user ffpeng90 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/738


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[QiangCai]

Github user QiangCai commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1493/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #755: [CARBONDATA-881] Load status is successful ...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/755
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1492/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #755: [CARBONDATA-881] Load status is succ...

[mohammadshahidkhan]

GitHub user mohammadshahidkhan opened a pull request:

https://github.com/apache/incubator-carbondata/pull/755

[CARBONDATA-881] Load status is successful even though system is fail to 
write status into tablestatus file



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohammadshahidkhan/incubator-carbondata 
load_commit_point_fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/755.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #755


commit ca33c850d586c6f7a7f88a0edfead4e805591739
Author: mohammadshahidkhan 
Date:   2017-04-06T13:44:50Z

[CARBONDATA-881] Load status is successful even though system is fail to 
write status into tablestatus file




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-881) Load status is successful even though system is fail to write status into tablestatus file

[Mohammad Shahid Khan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mohammad Shahid Khan updated CARBONDATA-881:

Summary: Load status is successful even though system is fail to write 
status into tablestatus file  (was: Load status is successful even though 
system is fail to writte status into tablestatus file)

> Load status is successful even though system is fail to write status into 
> tablestatus file
> --
>
> Key: CARBONDATA-881
> URL: https://issues.apache.org/jira/browse/CARBONDATA-881
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Mohammad Shahid Khan
>Assignee: Mohammad Shahid Khan
>
> org.apache.carbondata.core.statusmanager.SegmentStatusManager.SegmentStatusManager
>  is eating the IOException 
> due to this even though when carbon is fail to write the load status in the 
> tablestatus file, the final load is successful.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-881) Load status is successful even though system is fail to writte status into tablestatus file

[Mohammad Shahid Khan (JIRA)]

Mohammad Shahid Khan created CARBONDATA-881:
---

 Summary: Load status is successful even though system is fail to 
writte status into tablestatus file
 Key: CARBONDATA-881
 URL: https://issues.apache.org/jira/browse/CARBONDATA-881
 Project: CarbonData
  Issue Type: Bug
Reporter: Mohammad Shahid Khan
Assignee: Mohammad Shahid Khan


org.apache.carbondata.core.statusmanager.SegmentStatusManager.SegmentStatusManager
 is eating the IOException 
due to this even though when carbon is fail to write the load status in the 
tablestatus file, the final load is successful.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #754: [CARBONDATA-880] Path should not get printe...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/754
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1491/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #754: [CARBONDATA-880] Path should not get...

[ravikiran23]

GitHub user ravikiran23 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/754

[CARBONDATA-880] Path should not get printed in the explain extended DDL

Path is getting printed in the explain extended DDL. this should not get 
printed. AS this can be security issue. and no need to expose the store path to 
the end user.

so overriding the toString method and printing only database name and table 
name.

after fix :
CarbonDatasourceHadoopRelation [ default, carbon_table ] 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ravikiran23/incubator-carbondata 
CarbonRelationPrinting

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/754.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #754


commit ec9eed9667eece094acad6b9614fe16fb01e3692
Author: ravikiran 
Date:   2017-04-06T13:00:39Z

CARBONDATA-880
Path is getting printed in the explain extended DDL. this should not get 
printed. so overriding the toString method.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #753: [CARBONDATA-877] Fixed ArrayIndexOut...

[kunal642]

GitHub user kunal642 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/753

[CARBONDATA-877] Fixed ArrayIndexOutOfBoundException for 
ColumnarVectorWrapper

Row id was being incremented with the column number and eventually the 
index on which we had to put the data would be greater than the array size.





You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kunal642/incubator-carbondata CARBONDATA-877

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/753.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #753


commit 7e2e0f3dea340a82611c07fc4acd2d79d7f2c8a7
Author: kunal642 
Date:   2017-04-06T13:05:57Z

fixed ArrayIndexOutOfBoundException for ColumnarVectorWrapper




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[Sephiroth-Lin]

Github user Sephiroth-Lin commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
@kumarvishal09 @QiangCai @watermen Please help review, tks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #752: [CARBONDATA-879] Clear driver side dict cac...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/752
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #752: [CARBONDATA-879] Clear driver side d...

[Sephiroth-Lin]

GitHub user Sephiroth-Lin opened a pull request:

https://github.com/apache/incubator-carbondata/pull/752

[CARBONDATA-879] Clear driver side dict cache for CarbonDictionaryDecoder



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Sephiroth-Lin/incubator-carbondata 
carbondata-879

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/752.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #752


commit 07c4c71bcea737d9db87ac426c1fe077801e3b24
Author: Sephiroth-Lin 
Date:   2017-04-06T13:01:13Z

Clear driver side dict cache for CarbonDictionaryDecoder




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-880) when explain extended is done on a query then store path is getting printed to the user.

[ravikiran (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ravikiran updated CARBONDATA-880:
-
Request participants:   (was: )
 Description: 
when explain extended is done on a query then store path is getting printed to 
the user in carbonhadooprelation. 

the path should not be shown to the user.

example :
CarbonDatasourceHadoopRelation(org.apache.spark.sql.CarbonSession@1ed6b3b9,[Ljava.lang.String;@21b14680,Map(path
 -> 
file:/D:/Carbon/incubator-carbondata/examples/spark2/target/warehouse/carbon_table,
 serialization.format -> 1, dbname -> default, tablepath -> 
D:Carbonincubator-carbondata/examples/spark2/target/storedefaultcarbon_table, 
tablename -> 
carbon_table),Some(StructType(StructField(shortField,ShortType,true), 
StructField(intField,IntegerType,true)

  was:
when explain extended is done on a query then store path is getting printed to 
the user in carbonhadooprelation. 

the path should not be shown to the user.


> when explain extended is done on a query then store path is getting printed 
> to the user.
> 
>
> Key: CARBONDATA-880
> URL: https://issues.apache.org/jira/browse/CARBONDATA-880
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: ravikiran
>Assignee: ravikiran
>
> when explain extended is done on a query then store path is getting printed 
> to the user in carbonhadooprelation. 
> the path should not be shown to the user.
> example :
> CarbonDatasourceHadoopRelation(org.apache.spark.sql.CarbonSession@1ed6b3b9,[Ljava.lang.String;@21b14680,Map(path
>  -> 
> file:/D:/Carbon/incubator-carbondata/examples/spark2/target/warehouse/carbon_table,
>  serialization.format -> 1, dbname -> default, tablepath -> 
> D:Carbonincubator-carbondata/examples/spark2/target/storedefaultcarbon_table, 
> tablename -> 
> carbon_table),Some(StructType(StructField(shortField,ShortType,true), 
> StructField(intField,IntegerType,true)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Issue Comment Deleted] (CARBONDATA-880) when explain extended is done on a query then store path is getting printed to the user.

[ravikiran (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ravikiran updated CARBONDATA-880:
-
Comment: was deleted

(was: below is the example : 
CarbonDatasourceHadoopRelation(org.apache.spark.sql.CarbonSession@1ed6b3b9,[Ljava.lang.String;@21b14680,Map(path
 -> 
file:/D:/Carbon/incubator-carbondata/examples/spark2/target/warehouse/carbon_table,
 serialization.format -> 1, dbname -> default, tablepath -> 
D:Carbonincubator-carbondata/examples/spark2/target/storedefaultcarbon_table, 
tablename -> 
carbon_table),Some(StructType(StructField(shortField,ShortType,true), 
StructField(intField,IntegerType,true))

> when explain extended is done on a query then store path is getting printed 
> to the user.
> 
>
> Key: CARBONDATA-880
> URL: https://issues.apache.org/jira/browse/CARBONDATA-880
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: ravikiran
>Assignee: ravikiran
>
> when explain extended is done on a query then store path is getting printed 
> to the user in carbonhadooprelation. 
> the path should not be shown to the user.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (CARBONDATA-880) when explain extended is done on a query then store path is getting printed to the user.

[ravikiran (JIRA)]

[ 
https://issues.apache.org/jira/browse/CARBONDATA-880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958877#comment-15958877
 ] 

ravikiran commented on CARBONDATA-880:
--

below is the example : 
CarbonDatasourceHadoopRelation(org.apache.spark.sql.CarbonSession@1ed6b3b9,[Ljava.lang.String;@21b14680,Map(path
 -> 
file:/D:/Carbon/incubator-carbondata/examples/spark2/target/warehouse/carbon_table,
 serialization.format -> 1, dbname -> default, tablepath -> 
D:Carbonincubator-carbondata/examples/spark2/target/storedefaultcarbon_table, 
tablename -> 
carbon_table),Some(StructType(StructField(shortField,ShortType,true), 
StructField(intField,IntegerType,true)

> when explain extended is done on a query then store path is getting printed 
> to the user.
> 
>
> Key: CARBONDATA-880
> URL: https://issues.apache.org/jira/browse/CARBONDATA-880
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Reporter: ravikiran
>Assignee: ravikiran
>
> when explain extended is done on a query then store path is getting printed 
> to the user in carbonhadooprelation. 
> the path should not be shown to the user.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-880) when explain extended is done on a query then store path is getting printed to the user.

[ravikiran (JIRA)]

ravikiran created CARBONDATA-880:


 Summary: when explain extended is done on a query then store path 
is getting printed to the user.
 Key: CARBONDATA-880
 URL: https://issues.apache.org/jira/browse/CARBONDATA-880
 Project: CarbonData
  Issue Type: Bug
  Components: data-query
Reporter: ravikiran
Assignee: ravikiran


when explain extended is done on a query then store path is getting printed to 
the user in carbonhadooprelation. 

the path should not be shown to the user.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (CARBONDATA-879) Clear driver side dictionary cache for CarbonDictionaryDecoder

[Weizhong (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Weizhong reassigned CARBONDATA-879:
---

Assignee: Weizhong

> Clear driver side dictionary cache for CarbonDictionaryDecoder
> --
>
> Key: CARBONDATA-879
> URL: https://issues.apache.org/jira/browse/CARBONDATA-879
> Project: CarbonData
>  Issue Type: Improvement
>  Components: spark-integration
> Environment: Spark 2.1 + CarbonData 1.1.0
>Reporter: Weizhong
>Assignee: Weizhong
>Priority: Minor
>
> Currently, when CarbonDictionaryDecoder use WholeStageCodegen will create 
> dictionary cache on driver side, but didn't clear access count, so clear it 
> as getFilterValues does when getSplits.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-879) Clear driver side dictionary cache for CarbonDictionaryDecoder

[Weizhong (JIRA)]

Weizhong created CARBONDATA-879:
---

 Summary: Clear driver side dictionary cache for 
CarbonDictionaryDecoder
 Key: CARBONDATA-879
 URL: https://issues.apache.org/jira/browse/CARBONDATA-879
 Project: CarbonData
  Issue Type: Improvement
  Components: spark-integration
 Environment: Spark 2.1 + CarbonData 1.1.0
Reporter: Weizhong
Priority: Minor


Currently, when CarbonDictionaryDecoder use WholeStageCodegen will create 
dictionary cache on driver side, but didn't clear access count, so clear it as 
getFilterValues does when getSplits.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (CARBONDATA-877) String datatype is throwing an error when included in DIctionary_Exclude in a alter query

[Kunal Kapoor (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Kapoor reassigned CARBONDATA-877:
---

Assignee: Kunal Kapoor

> String datatype is throwing an error when included in DIctionary_Exclude in a 
> alter query
> -
>
> Key: CARBONDATA-877
> URL: https://issues.apache.org/jira/browse/CARBONDATA-877
> Project: CarbonData
>  Issue Type: Bug
>Reporter: SWATI RAO
>Assignee: Kunal Kapoor
> Attachments: 2000_UniqData.csv
>
>
> CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION 
> string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
> bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
> decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
> int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES 
> ("TABLE_BLOCKSIZE"= "256 MB");
> LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
> table uniqdata OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> ALTER TABLE uniqdata RENAME TO uniqdata1;
> alter table uniqdata1 drop columns(CUST_NAME);
> alter table uniqdata1 add columns(CUST_NAME string) 
> TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
> 'DEFAULT.VALUE.CUST_NAME'='testuser') ;
> Column added successfully. But when we execute:
> select distinct(CUST_NAME) from uniqdata1 ; 
> &
> select count(CUST_NAME) from uniqdata1 ;
> it throws an error :
> "Job aborted due to stage failure: Task 0 in stage 9.0 failed 1 times, most 
> recent failure: Lost task 0.0 in stage 9.0 (TID 206, localhost, executor 
> driver): java.lang.ArrayIndexOutOfBoundsException: 4186"



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #747: [CARBONDATA] - Formatted Document

[ksimar]

Github user ksimar commented on the issue:

https://github.com/apache/incubator-carbondata/pull/747
  
@chenliang613 
1) PR title is corrected.
2) This PR Fixes the inconsistent styling issues in the 
quick-start-guide.md document.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #751: [CARBONDATA-816] Added Example for Hive Int...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/751
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1490/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-878) Inconsistent stylin in quick-start.md file

[Pallavi Singh (JIRA)]

Pallavi Singh created CARBONDATA-878:


 Summary: Inconsistent stylin in quick-start.md file
 Key: CARBONDATA-878
 URL: https://issues.apache.org/jira/browse/CARBONDATA-878
 Project: CarbonData
  Issue Type: Improvement
  Components: docs
Reporter: Pallavi Singh
Priority: Trivial






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #751: [CARBONDATA-816] Added Example for Hive Int...

[anubhav100]

Github user anubhav100 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/751
  
@chenliang613 can you please have a look?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #751: [CARBONDATA-816] Added Example for H...

[anubhav100]

GitHub user anubhav100 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/751

[CARBONDATA-816]  Added Example for Hive Integration

Added Example For HIve Carbon Integration



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/anubhav100/incubator-carbondata CARBONDATA-816

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/751.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #751


commit 22777620df18b1e9d98a9ec7e15674c0e50f6334
Author: anubhav100 
Date:   2017-04-06T12:17:35Z

added example for hive carbon integration




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-846) Add support to revert changes to alter table commands if there is a failure while executing the changes on hive.

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-846.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Add support to revert changes to alter table commands if there is a failure 
> while executing the changes on hive.
> 
>
> Key: CARBONDATA-846
> URL: https://issues.apache.org/jira/browse/CARBONDATA-846
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Kunal Kapoor
>Assignee: Kunal Kapoor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 3.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #727: [CARBONDATA-846] Added support to re...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/727


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-872) Fix comment issues of integration/presto for easier reading

[Liang Chen (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-872.
---
   Resolution: Fixed
Fix Version/s: 1.2.0-incubating

> Fix comment issues of integration/presto for easier reading
> ---
>
> Key: CARBONDATA-872
> URL: https://issues.apache.org/jira/browse/CARBONDATA-872
> Project: CarbonData
>  Issue Type: Bug
>  Components: presto-integration
>Reporter: Liang Chen
>Assignee: ffpeng
> Fix For: 1.2.0-incubating
>
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> Fix comment issues of integration/presto for easier reading



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #738: [CARBONDATA-872] Fix comment issues of inte...

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/738
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1489/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #744: [CARBONDATA -816] Added Example For ...

[anubhav100]

Github user anubhav100 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/744


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-862) USE_KETTLE option described in dml-operation-on-carbondata.md document doesn't work

[Liang Chen (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-862.
---
   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> USE_KETTLE option described in dml-operation-on-carbondata.md document 
> doesn't work
> ---
>
> Key: CARBONDATA-862
> URL: https://issues.apache.org/jira/browse/CARBONDATA-862
> Project: CarbonData
>  Issue Type: Bug
>  Components: docs
>Affects Versions: 1.0.0-incubating
>Reporter: Divya Gupta
>Assignee: Divya Gupta
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #738: [CARBONDATA-872] Fix comment issues of inte...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/738
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1488/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1487/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-877) String datatype is throwing an error when included in DIctionary_Exclude in a alter query

[SWATI RAO (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SWATI RAO updated CARBONDATA-877:
-
Description: 
CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, 
DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= 
"256 MB");

LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
table uniqdata OPTIONS('DELIMITER'=',' , 
'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');

ALTER TABLE uniqdata RENAME TO uniqdata1;

alter table uniqdata1 drop columns(CUST_NAME);

alter table uniqdata1 add columns(CUST_NAME string) 
TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
'DEFAULT.VALUE.CUST_NAME'='testuser') ;

Column added successfully. But when we execute:
select distinct(CUST_NAME) from uniqdata1 ; 
&
select count(CUST_NAME) from uniqdata1 ;

it throws an error :
"Job aborted due to stage failure: Task 0 in stage 9.0 failed 1 times, most 
recent failure: Lost task 0.0 in stage 9.0 (TID 206, localhost, executor 
driver): java.lang.ArrayIndexOutOfBoundsException: 4186"



  was:
CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, 
DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= 
"256 MB");

LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
table uniqdata OPTIONS('DELIMITER'=',' , 
'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');

ALTER TABLE uniqdata RENAME TO uniqdata1;

alter table uniqdata1 drop columns(CUST_NAME);

alter table uniqdata1 add columns(CUST_NAME string) 
TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
'DEFAULT.VALUE.CUST_NAME'='testuser') ;

Column added successfully. But when we execute:
select distinct(CUST_NAME) from uniqdata1 ; 
&
select count(CUST_NAME) from uniqdata1 ;

it throws an error :
"Job aborted due to stage failure: Task 0 in stage 9.0 failed 1 times, most 
recent failure: Lost task 0.0 in stage 9.0 (TID 206, localhost, executor 
driver): java.lang.ArrayIndexOutOfBoundsException: 4186"




alter table uniqdata1 add columns(CUST_NAME string) 
TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
'DEFAULT.VALUE.CUST_NAME'='testuser');



> String datatype is throwing an error when included in DIctionary_Exclude in a 
> alter query
> -
>
> Key: CARBONDATA-877
> URL: https://issues.apache.org/jira/browse/CARBONDATA-877
> Project: CarbonData
>  Issue Type: Bug
>Reporter: SWATI RAO
> Attachments: 2000_UniqData.csv
>
>
> CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION 
> string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
> bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
> decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
> int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES 
> ("TABLE_BLOCKSIZE"= "256 MB");
> LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
> table uniqdata OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> ALTER TABLE uniqdata RENAME TO uniqdata1;
> alter table uniqdata1 drop columns(CUST_NAME);
> alter table uniqdata1 add columns(CUST_NAME string) 
> TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
> 'DEFAULT.VALUE.CUST_NAME'='testuser') ;
> Column added successfully. But when we execute:
> select distinct(CUST_NAME) from uniqdata1 ; 
> &
> select count(CUST_NAME) from uniqdata1 ;
> it throws an error :
> "Job aborted due to stage failure: Task 0 in stage 9.0 failed 1 times, most 
> recent failure: Lost task 0.0 in stage 9.0 (TID 206, localhost, executor 
> driver): java.lang.ArrayIndexOutOfBoundsException: 4186"



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #731: [CARBONDATA-862] Removed Use Kettle ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/731


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-877) String datatype is throwing an error when included in DIctionary_Exclude in a alter query

[SWATI RAO (JIRA)]

SWATI RAO created CARBONDATA-877:


 Summary: String datatype is throwing an error when included in 
DIctionary_Exclude in a alter query
 Key: CARBONDATA-877
 URL: https://issues.apache.org/jira/browse/CARBONDATA-877
 Project: CarbonData
  Issue Type: Bug
Reporter: SWATI RAO
 Attachments: 2000_UniqData.csv

CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, 
DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= 
"256 MB");

LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
table uniqdata OPTIONS('DELIMITER'=',' , 
'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');

ALTER TABLE uniqdata RENAME TO uniqdata1;

alter table uniqdata1 drop columns(CUST_NAME);

alter table uniqdata1 add columns(CUST_NAME string) 
TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
'DEFAULT.VALUE.CUST_NAME'='testuser') ;

Column added successfully. But when we execute:
select distinct(CUST_NAME) from uniqdata1 ; 
&
select count(CUST_NAME) from uniqdata1 ;

it throws an error :
"Job aborted due to stage failure: Task 0 in stage 9.0 failed 1 times, most 
recent failure: Lost task 0.0 in stage 9.0 (TID 206, localhost, executor 
driver): java.lang.ArrayIndexOutOfBoundsException: 4186"




alter table uniqdata1 add columns(CUST_NAME string) 
TBLPROPERTIES('DICTIONARY_EXCLUDE'='CUST_NAME', 
'DEFAULT.VALUE.CUST_NAME'='testuser');




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (CARBONDATA-847) Select query not working properly after alter.

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-847.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Select query not working properly after alter.
> --
>
> Key: CARBONDATA-847
> URL: https://issues.apache.org/jira/browse/CARBONDATA-847
> Project: CarbonData
>  Issue Type: Bug
>Affects Versions: 1.1.0-incubating
> Environment: Spark2.1
>Reporter: SWATI RAO
>Assignee: Kunal Kapoor
> Fix For: 1.1.0-incubating
>
> Attachments: 2000_UniqData.csv
>
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> Execute these set of queries: 
> CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION 
> string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 
> bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 
> decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 
> int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES 
> ("TABLE_BLOCKSIZE"= "256 MB");
> LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into 
> table uniqdata OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> ALTER TABLE uniqdata RENAME TO uniqdata1;
> alter table uniqdata1 add columns(dict int) 
> TBLPROPERTIES('DICTIONARY_INCLUDE'='dict','DEFAULT.VALUE.dict'= '');
> select distinct(dict) from uniqdata2 ;
> it will display the result but when we perform :
> select * from uniqdata1 ;
> it will display an error message :
> Job aborted due to stage failure: Task 3 in stage 59.0 failed 1 times, most 
> recent failure: Lost task 3.0 in stage 59.0 (TID 714, localhost, executor 
> driver): java.lang.NullPointerException



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[manishgupta88]

Github user manishgupta88 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #724: [CARBONDATA-847] Fixed NullPointerEx...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/724


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #738: [CARBONDATA-872] Fix comment issues of inte...

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/738
  
@ffpeng90  can you remove this file 
(integration/presto/src/checkstyle/checks.xml) .


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[kunal642]

Github user kunal642 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
@manishgupta88 ok



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[manishgupta88]

Github user manishgupta88 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
@kunal642 change column name to column ID for every check in the revert 
methods


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #724: [CARBONDATA-847] Fixed NullPointerException...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/724
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #744: [CARBONDATA -816] Added Example For HIve In...

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/744
  
Please put all files under integration/hive for all hive related PR


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #744: [CARBONDATA -816] Added Example For ...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/744#discussion_r110134827
  
--- Diff: format/src/main/thrift/sort_index.thrift ---
@@ -1,28 +1,26 @@
-/**
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License.  You may obtain a copy of the License at
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
  *
- * http://www.apache.org/licenses/LICENSE-2.0
+ *http://www.apache.org/licenses/LICENSE-2.0
  *
- * Unless required by applicable law or agreed to in writing,
- * software distributed under the License is distributed on an
- * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- * KIND, either express or implied.  See the License for the
- * specific language governing permissions and limitations
- * under the License.
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 
 /**
- * File format description for carbon sort index file
+ * File format description for CarbonData sort index file
--- End diff --

Suggest creating a new PR based on apache/hive


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #748: changes in release-guide.md file

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/748


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1485/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #746: changes in troubleshooting.md file

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/746


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-874) select * from table order by limit query is failing

[kumar vishal (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

kumar vishal resolved CARBONDATA-874.
-
   Resolution: Fixed
 Assignee: Ravindra Pesala
Fix Version/s: 1.1.0-incubating

> select * from table order by limit query is failing
> ---
>
> Key: CARBONDATA-874
> URL: https://issues.apache.org/jira/browse/CARBONDATA-874
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Ravindra Pesala
>Assignee: Ravindra Pesala
> Fix For: 1.1.0-incubating
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Query like below are failing in carbon with spark 2.1
> select * from alldatatypestablesort order by empname limit 10



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #726: [CARBONDATA-874] Fixed order by limi...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/726


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #724: [CARBONDATA-847] Fixed NullPointerException...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/724
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1484/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #726: [CARBONDATA-874] Fixed order by limit with ...

[kumarvishal09]

Github user kumarvishal09 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/726
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-780) Alter table support for compaction through sort step

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-780.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Alter table support for compaction through sort step
> 
>
> Key: CARBONDATA-780
> URL: https://issues.apache.org/jira/browse/CARBONDATA-780
> Project: CarbonData
>  Issue Type: Sub-task
>Reporter: Manish Gupta
>Assignee: Manish Gupta
> Fix For: 1.1.0-incubating
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> Alter table need to support compaction process where complete data need to be 
> sorted again and then written to file.
> Currently in compaction process data is directly given to writer step where 
> it is splitted into columns and written. But as columns are sorted from left 
> to right, on dropping a column data will again become unorganized as dropped 
> column data will not be considered during compaction. In these scenarios 
> complete data need to be sorted again and then submitted to writer step.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #703: [CARBONDATA-780] Alter table support...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/703


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #746: changes in troubleshooting.md file

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/746
  
LGTM 
:)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/703
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/703
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1483/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #744: [CARBONDATA -816] Added Example For ...

[anubhav100]

Github user anubhav100 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/744#discussion_r110124001
  
--- Diff: format/src/main/thrift/sort_index.thrift ---
@@ -1,28 +1,26 @@
-/**
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License.  You may obtain a copy of the License at
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
  *
- * http://www.apache.org/licenses/LICENSE-2.0
+ *http://www.apache.org/licenses/LICENSE-2.0
  *
- * Unless required by applicable law or agreed to in writing,
- * software distributed under the License is distributed on an
- * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- * KIND, either express or implied.  See the License for the
- * specific language governing permissions and limitations
- * under the License.
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 
 /**
- * File format description for carbon sort index file
+ * File format description for CarbonData sort index file
--- End diff --

Changes come from master branch should I remove these extra commits?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-400) [Bad Records] Load data is fail and displaying the string value in beeline as exception

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-400.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> [Bad Records] Load data is fail and displaying the string value in beeline as 
> exception
> ---
>
> Key: CARBONDATA-400
> URL: https://issues.apache.org/jira/browse/CARBONDATA-400
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 0.1.0-incubating
> Environment: 3node cluster
>Reporter: MAKAMRAGHUVARDHAN
>Assignee: Akash R Nilugal
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 4h 40m
>  Remaining Estimate: 0h
>
> Steps
> 1. Create table
> CREATE TABLE String_test2 (string_col string) STORED BY 
> 'org.apache.carbondata.format';
> 2. Load the data with parameter 'BAD_RECORDS_ACTION'='FORCE' and csv contains 
> a string value that is out of boundary.
> LOAD DATA INPATH 'hdfs://hacluster/Carbon/Priyal/string5.csv' into table 
> String_test2 OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_LOGGER_ENABLE'='TRUE', 
> 'BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='string_col');
> Actual Result: Load data is failed and displaying the string value in beeline 
> as exception trace.
> Expected Result:Should display a correct error message and should  not print 
> the exception trace on the console.
> Exception thrown on console is as shown below.
> Error: com.univocity.parsers.common.TextParsingException: Error processing 
> input: Length of parsed input (11) exceeds the maximum number of 
> characters defined in your parser settings (10).
> Hint: Number of characters processed may have exceeded limit of 10 
> characters per column. Use settings.setMaxCharsPerColumn(int) to define the 
> maximum number of characters a column can have
> Ensure your configuration is correct, with delimiters, quotes and escape 
> sequences that match the input format you are trying to parse
> Parser Configuration: CsvParserSettings:
> Column reordering enabled=true
> Empty value=null
> Header extraction enabled=false
> Headers=null
> Ignore leading whitespaces=true
> Ignore trailing whitespaces=true
> Input buffer size=128
> Input reading on separate thread=false
> Line separator detection enabled=false
> Maximum number of characters per column=10
> Maximum number of columns=20480
> Null value=
> Number of records to read=all
> Parse unescaped quotes=true
> Row processor=none
> Selected fields=none
> Skip empty lines=trueFormat configuration:
> CsvFormat:
> Comment character=#
> Field delimiter=,
> Line separator (normalized)=\n
> Line separator sequence=\n
> Quote character="
> Quote escape character=quote escape
> Quote escape escape character=\0, line=0, char=12. 
> Content parsed: 
> [hellohowareyouwelcomehellohellohellohellohellohellohellohelloheellooabcdefghijklmnopqrstuvwxyzabcqwertuyioplkjhgfdsazxcvbnmpoiuytrewqasdfghjklmnbvcxzasdghskhdgkhdbkshkjchskdhfssudkdjdudusdjhdshdshsjddshjdkdhgdhdshdhdududushdudududududududududududududududududuudududududududuudududududududududududududududududududududududududududuhellohowareyouwelcomehellohellohellohellohellohellohellohelloheellooabcdefghijklmnopqrstuvwxyzabcqwertuyioplkjhgfdsazxcvbnmpoiuytrewqasdfghjklmnbvcxzasdghskhdgkhdbkshkjchskdhfssudkdjdudusdjhdshdshsjddshjdkdhgdhdshdhdududushdudududududududududududududududududuudududududududuududududududududuu



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #398: [CARBONDATA-400] Error message for dataload...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/398
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #738: [CARBONDATA-872] Fix comment issues of inte...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/738
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1482/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #744: [CARBONDATA -816] Added Example For ...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/744#discussion_r110121865
  
--- Diff: format/src/main/thrift/sort_index.thrift ---
@@ -1,28 +1,26 @@
-/**
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License.  You may obtain a copy of the License at
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
  *
- * http://www.apache.org/licenses/LICENSE-2.0
+ *http://www.apache.org/licenses/LICENSE-2.0
  *
- * Unless required by applicable law or agreed to in writing,
- * software distributed under the License is distributed on an
- * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- * KIND, either express or implied.  See the License for the
- * specific language governing permissions and limitations
- * under the License.
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 
 /**
- * File format description for carbon sort index file
+ * File format description for CarbonData sort index file
--- End diff --

why change thrift files?  


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1481/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-839) Table lock file is not getting deleted after table rename is successful

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-839.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Table lock file is not getting deleted after table rename is successful
> ---
>
> Key: CARBONDATA-839
> URL: https://issues.apache.org/jira/browse/CARBONDATA-839
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Kunal Kapoor
>Assignee: Kunal Kapoor
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Table lock file is not getting deleted after table rename is successful



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #717: [CARBONDATA-839] Fixed issue with me...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/717


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #750: revert pom.xml for hive branch

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/750


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/703
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1480/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #717: [CARBONDATA-839] Fixed issue with meta lock...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/717
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #750: revert pom.xml for hive branch

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/750
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #738: [CARBONDATA-872] Fix comment issues ...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/738#discussion_r110118287
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/CarbondataSplitManager.java
 ---
@@ -106,6 +110,12 @@ public ConnectorSplitSource 
getSplits(ConnectorTransactionHandle transactionHand
 return constraintBuilder.build();
   }
 
+  /**
+   * Convert presto-TupleDomain predication into Carbon scan express 
condition
+   * @param originalConstraint  presto-TupleDomain
+   * @param carbonTable
+   * @return
+ */
--- End diff --

please change the comment format.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #738: [CARBONDATA-872] Fix comment issues ...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/738#discussion_r110118360
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/CarbondataSplitManager.java
 ---
@@ -249,6 +250,11 @@ public Expression 
parseFilterExpression(TupleDomain originalConstr
 return finalFilters;
   }
 
+  /**
+   * Convert presto spi Type into Carbondata Type
+   * @param colType
+   * @return
+ */
--- End diff --

please change the comment format


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #738: [CARBONDATA-872] Fix comment issues ...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/738#discussion_r110116629
  
--- Diff: integration/presto/src/checkstyle/checks.xml ---
@@ -0,0 +1,7 @@
+
+http://www.puppycrawl.com/dtds/configuration_1_3.dtd;>
--- End diff --

Please remove this file.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #398: [CARBONDATA-400] Error message for d...

[ravipesala]

Github user ravipesala commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/398#discussion_r110117757
  
--- Diff: 
integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala
 ---
@@ -784,9 +784,28 @@ object GlobalDictionaryUtil {
   }
 } catch {
   case ex: Exception =>
-LOGGER.error(ex, "generate global dictionary failed")
-throw ex
+ex match {
+  case spx: SparkException =>
+LOGGER.error(spx, "generate global dictionary failed")
+throw new Exception("generate global dictionary failed, " +
+trimErrorMessage(spx.getMessage))
+  case _ =>
+LOGGER.error(ex, "generate global dictionary failed")
+throw ex
+}
+}
+  }
+
+  // Get proper error message of TextParsingException
+  def trimErrorMessage(input: String): String = {
+var errorMessage: String = null
+if (input != null) {
+  if (input.split("Hint").length > 0 &&
+  input.split("Hint")(0).split("TextParsingException: ").length > 
1) {
+errorMessage = input.split("Hint")(0).split("TextParsingException: 
")(1)
+  }
--- End diff --

Just simplify as follows.
```
val hintSplit = input.split("Hint")
if (hintSplit.length > 0) {
  val parseSplit = hintSplit(0).split("TextParsingException: ")
  if (parseSplit.length > 1) {
   errorMessage = parseSplit(1)
  }
}
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #694: [CARBONDATA-814] bad record log file...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/694


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1478/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1479/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #738: [CARBONDATA-872] Fix comment issues ...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/738#discussion_r110117100
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/CarbondataRecordCursor.java
 ---
@@ -78,6 +78,10 @@ public 
CarbondataRecordCursor(CarbonReadSupport readSupport,
 return columnHandles.get(field).getColumnType();
   }
 
+  /**
+   * get next Row/Page
+   * @return
+ */
--- End diff --

please change format the comment as below : 
/**
 * get next Row/Page
 * @return
 */


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-814) bad record log file writing is not correct

[Ravindra Pesala (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-814.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> bad record log file writing is not correct
> --
>
> Key: CARBONDATA-814
> URL: https://issues.apache.org/jira/browse/CARBONDATA-814
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Mohammad Shahid Khan
>Assignee: Mohammad Shahid Khan
> Fix For: 1.1.0-incubating
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #694: [CARBONDATA-814] bad record log file writin...

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/694
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/703
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1477/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #750: revert pom.xml for hive branch

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/750
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1476/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #703: [CARBONDATA-780] Alter table support for co...

[manishgupta88]

Github user manishgupta88 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/703
  
@ravipesala fixed review comments...kindly review and merge


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #749: [CARBONDATA-854] Datastax CFS file system s...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/749
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1475/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #727: [CARBONDATA-846] Added support to revert ch...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/727
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1474/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #727: [CARBONDATA-846] Added support to re...

[ravipesala]

Github user ravipesala commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/727#discussion_r110112392
  
--- Diff: 
integration/spark2/src/main/scala/org/apache/spark/util/AlterTableUtil.scala ---
@@ -96,4 +104,109 @@ object AlterTableUtil {
 }
 schemaParts.mkString(",")
   }
+
--- End diff --

Add comments on all methods


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---