date:20170323

[GitHub] incubator-carbondata pull request #672: [CARBONDATA-727][WIP] add hive integ...

2017-03-23 Thread chenliang613

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/672#discussion_r107839323
  
--- Diff: pom.xml ---
@@ -381,6 +389,15 @@
   
 
 
+  hive-1.2.1
--- End diff --

suggest changing to hive-1.2 for 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #687: [CARBONDATA-801] Examples syntax fix

2017-03-23 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/687
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1318/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #695: [CARBONDATA-696] Fixed Null Pointer Excepti...

2017-03-23 Thread kunal642

Github user kunal642 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/695
  
@kumarvishal09 review this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-706) Mulitiple OR operators does not work properly in carbondata

2017-03-23 Thread Liang Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-706.
---
   Resolution: Fixed
 Assignee: Ravindra Pesala
Fix Version/s: 1.1.0-incubating

> Mulitiple OR operators does not work properly in carbondata
> ---
>
> Key: CARBONDATA-706
> URL: https://issues.apache.org/jira/browse/CARBONDATA-706
> Project: CarbonData
>  Issue Type: Bug
>  Components: sql
>Affects Versions: 1.1.0-incubating
> Environment: Spark 2.1
>Reporter: SWATI RAO
>Assignee: Ravindra Pesala
>Priority: Minor
> Fix For: 1.1.0-incubating
>
> Attachments: 100_hive_test.csv
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Incorrect result displays with multiple OR operators. 
> Steps to Reproduces:
> 1:Create table using following Command
>  " create table Carbon_automation (imei string,deviceInformationId int,MAC 
> string,deviceColor string,device_backColor string,modelId string,marketName 
> string,AMSize string,ROMSize string,CUPAudit string,CPIClocked string,series 
> string,productionDate timestamp,bomCode string,internalModels string, 
> deliveryTime string, channelsId string, channelsName string , deliveryAreaId 
> string, deliveryCountry string, deliveryProvince string, deliveryCity 
> string,deliveryDistrict string, deliveryStreet string, oxSingleNumber string, 
> ActiveCheckTime string, ActiveAreaId string, ActiveCountry string, 
> ActiveProvince string, Activecity string, ActiveDistrict string, ActiveStreet 
> string, ActiveOperatorId string, Active_releaseId string, Active_EMUIVersion 
> string, Active_operaSysVersion string, Active_BacVerNumber string, 
> Active_BacFlashVer string, Active_webUIVersion string, 
> Active_webUITypeCarrVer string,Active_webTypeDataVerNumber string, 
> Active_operatorsVersion string, Active_phonePADPartitionedVersions string, 
> Latest_YEAR int, Latest_MONTH int, Latest_DAY int, Latest_HOUR string, 
> Latest_areaId string, Latest_country string, Latest_province string, 
> Latest_city string, Latest_district string, Latest_street string, 
> Latest_releaseId string, Latest_EMUIVersion string, Latest_operaSysVersion 
> string, Latest_BacVerNumber string, Latest_BacFlashVer string, 
> Latest_webUIVersion string, Latest_webUITypeCarrVer string, 
> Latest_webTypeDataVerNumber string, Latest_operatorsVersion string, 
> Latest_phonePADPartitionedVersions string, Latest_operatorId string, 
> gamePointDescription string,gamePointId double,contractNumber 
> double,imei_count int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES 
> ('DICTIONARY_INCLUDE'='deviceInformationId,Latest_YEAR,Latest_MONTH,Latest_DAY')"
> 2:Load Data with following command
>  " LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/HiveData' INTO TABLE 
> Carbon_automation 
> OPTIONS('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='imei,deviceInformationId,MAC,deviceColor,device_backColor,modelId,marketName,AMSize,ROMSize,CUPAudit,CPIClocked,series,productionDate,bomCode,internalModels,deliveryTime,channelsId,channelsName,deliveryAreaId,deliveryCountry,deliveryProvince,deliveryCity,deliveryDistrict,deliveryStreet,oxSingleNumber,contractNumber,ActiveCheckTime,ActiveAreaId,ActiveCountry,ActiveProvince,Activecity,ActiveDistrict,ActiveStreet,ActiveOperatorId,Active_releaseId,Active_EMUIVersion,Active_operaSysVersion,Active_BacVerNumber,Active_BacFlashVer,Active_webUIVersion,Active_webUITypeCarrVer,Active_webTypeDataVerNumber,Active_operatorsVersion,Active_phonePADPartitionedVersions,Latest_YEAR,Latest_MONTH,Latest_DAY,Latest_HOUR,Latest_areaId,Latest_country,Latest_province,Latest_city,Latest_district,Latest_street,Latest_releaseId,Latest_EMUIVersion,Latest_operaSysVersion,Latest_BacVerNumber,Latest_BacFlashVer,Latest_webUIVersion,Latest_webUITypeCarrVer,Latest_webTypeDataVerNumber,Latest_operatorsVersion,Latest_phonePADPartitionedVersions,Latest_operatorId,gamePointId,gamePointDescription,imei_count')"
> 3:Now run the Select Query:
> " select imei,gamePointId, channelsId,series  from Carbon_automation where 
> channelsId >=10 OR channelsId <=1 or series='7Series' "
> 4:Result Displays 
> " 0: jdbc:hive2://localhost:1> select imei,gamePointId, channelsId,series 
>  from Carbon_automation where channelsId >=10 OR channelsId <=1 or 
> series='7Series';
> +-+--+-+--+--+
> |imei | gamePointId  | channelsId  |  series  |
> +-+--+-+--+--+
> | 1AA1| 2738.562 | 4   | 7Series  |
> | 1AA10   | 1714.635 | 4   | 7Series  |
> | 1AA100  | 1271.0   | 6   | 5Series  |
> | 1AA1000 | 692.0| 3   | 5Series  |
> | 1AA1|

[jira] [Commented] (CARBONDATA-761) Dictionary server should not be shutdown after loading

2017-03-23 Thread Ravindra Pesala (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939841#comment-15939841
 ] 

Ravindra Pesala commented on CARBONDATA-761:


it is duplicated to CARBONDATA-773

> Dictionary server should not be shutdown after loading
> --
>
> Key: CARBONDATA-761
> URL: https://issues.apache.org/jira/browse/CARBONDATA-761
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Reporter: QiangCai
>Assignee: QiangCai
>Priority: Minor
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Code:
> CarbonTableSchema/LoadTable



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #695: Fixed Null Pointer Exception for double dat...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/695
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1317/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #661: [CARBONDATA-761] remove shutdown dictionary...

2017-03-23 Thread ravipesala

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/661
  
@lionelcao There is another PR 
https://github.com/apache/incubator-carbondata/pull/656 working on the same 
cause.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #687: [CARBONDATA-801] Examples syntax fix

2017-03-23 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/687
  
add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #695: Fixed Null Pointer Exception for dou...

2017-03-23 Thread kunal642

GitHub user kunal642 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/695

Fixed Null Pointer Exception for double data type without fraction

Fixed null pointer exception for double data type
Removed unused methods

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kunal642/incubator-carbondata CARBONDATA-696

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/695.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #695


commit aa2f82b841d41ff16e057361da170eae0da74ff3
Author: kunal642 
Date:   2017-03-24T05:14:32Z

Fixed NPE for double data type without fraction




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #692: [CARBONDATA-706] Fixing Spark 1.6 te...

2017-03-23 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/692


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Assigned] (CARBONDATA-696) NPE when select query run on measure having double data type without fraction.

2017-03-23 Thread Kunal Kapoor (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Kapoor reassigned CARBONDATA-696:
---

Assignee: Kunal Kapoor  (was: kumar vishal)

> NPE  when select query run on measure having double data type without 
> fraction.
> ---
>
> Key: CARBONDATA-696
> URL: https://issues.apache.org/jira/browse/CARBONDATA-696
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Affects Versions: 1.0.0-incubating
>Reporter: Babulal
>Assignee: Kunal Kapoor
> Attachments: logs, oscon_10.csv
>
>
> Create table as below
> cc.sql("create table oscon_carbon_old  (CUST_PRFRD_FLG String,PROD_BRAND_NAME 
> String,PROD_COLOR String,CUST_LAST_RVW_DATE String,CUST_COUNTRY 
> String,CUST_CITY String,PRODUCT_NAME String,CUST_JOB_TITLE String,CUST_STATE 
> String,CUST_BUY_POTENTIAL String,PRODUCT_MODEL String,ITM_ID String,ITM_NAME 
> String,PRMTION_ID String,PRMTION_NAME String,SHP_MODE_ID String,SHP_MODE 
> String,DELIVERY_COUNTRY String,DELIVERY_STATE String,DELIVERY_CITY 
> String,DELIVERY_DISTRICT String,ACTIVE_EMUI_VERSION String,WH_NAME 
> String,STR_ORDER_DATE String,OL_ORDER_NO String,OL_ORDER_DATE String,OL_SITE 
> String,CUST_FIRST_NAME String,CUST_LAST_NAME String,CUST_BIRTH_DY 
> String,CUST_BIRTH_MM String,CUST_BIRTH_YR String,CUST_BIRTH_COUNTRY 
> String,CUST_SEX String,CUST_ADDRESS_ID String,CUST_STREET_NO 
> String,CUST_STREET_NAME String,CUST_AGE String,CUST_SUITE_NO String,CUST_ZIP 
> String,CUST_COUNTY String,PRODUCT_ID String,PROD_SHELL_COLOR 
> String,DEVICE_NAME String,PROD_SHORT_DESC String,PROD_LONG_DESC 
> String,PROD_THUMB String,PROD_IMAGE String,PROD_UPDATE_DATE String,PROD_LIVE 
> String,PROD_LOC String,PROD_RAM String,PROD_ROM String,PROD_CPU_CLOCK 
> String,PROD_SERIES String,ITM_REC_START_DATE String,ITM_REC_END_DATE 
> String,ITM_BRAND_ID String,ITM_BRAND String,ITM_CLASS_ID String,ITM_CLASS 
> String,ITM_CATEGORY_ID String,ITM_CATEGORY String,ITM_MANUFACT_ID 
> String,ITM_MANUFACT String,ITM_FORMULATION String,ITM_COLOR 
> String,ITM_CONTAINER String,ITM_MANAGER_ID String,PRM_START_DATE 
> String,PRM_END_DATE String,PRM_CHANNEL_DMAIL String,PRM_CHANNEL_EMAIL 
> String,PRM_CHANNEL_CAT String,PRM_CHANNEL_TV String,PRM_CHANNEL_RADIO 
> String,PRM_CHANNEL_PRESS String,PRM_CHANNEL_EVENT String,PRM_CHANNEL_DEMO 
> String,PRM_CHANNEL_DETAILS String,PRM_PURPOSE String,PRM_DSCNT_ACTIVE 
> String,SHP_CODE String,SHP_CARRIER String,SHP_CONTRACT String,CHECK_DATE 
> String,CHECK_YR String,CHECK_MM String,CHECK_DY String,CHECK_HOUR String,BOM 
> String,INSIDE_NAME String,PACKING_DATE String,PACKING_YR String,PACKING_MM 
> String,PACKING_DY String,PACKING_HOUR String,DELIVERY_PROVINCE 
> String,PACKING_LIST_NO String,ACTIVE_CHECK_TIME String,ACTIVE_CHECK_YR 
> String,ACTIVE_CHECK_MM String,ACTIVE_CHECK_DY String,ACTIVE_CHECK_HOUR 
> String,ACTIVE_AREA_ID String,ACTIVE_COUNTRY String,ACTIVE_PROVINCE 
> String,ACTIVE_CITY String,ACTIVE_DISTRICT String,ACTIVE_NETWORK 
> String,ACTIVE_FIRMWARE_VER String,ACTIVE_OS_VERSION String,LATEST_CHECK_TIME 
> String,LATEST_CHECK_YR String,LATEST_CHECK_MM String,LATEST_CHECK_DY 
> String,LATEST_CHECK_HOUR String,LATEST_AREAID String,LATEST_COUNTRY 
> String,LATEST_PROVINCE String,LATEST_CITY String,LATEST_DISTRICT 
> String,LATEST_FIRMWARE_VER String,LATEST_EMUI_VERSION 
> String,LATEST_OS_VERSION String,LATEST_NETWORK String,WH_ID 
> String,WH_STREET_NO String,WH_STREET_NAME String,WH_STREET_TYPE 
> String,WH_SUITE_NO String,WH_CITY String,WH_COUNTY String,WH_STATE 
> String,WH_ZIP String,WH_COUNTRY String,OL_SITE_DESC String,OL_RET_ORDER_NO 
> String,OL_RET_DATE String,PROD_MODEL_ID String,CUST_ID String,PROD_UNQ_MDL_ID 
> String,CUST_NICK_NAME String,CUST_LOGIN String,CUST_EMAIL_ADDR 
> String,PROD_UNQ_DEVICE_ADDR String,PROD_UQ_UUID String,PROD_BAR_CODE 
> String,TRACKING_NO String,STR_ORDER_NO String,CUST_DEP_COUNT 
> double,CUST_VEHICLE_COUNT double,CUST_ADDRESS_CNT double,CUST_CRNT_CDEMO_CNT 
> double,CUST_CRNT_HDEMO_CNT double,CUST_CRNT_ADDR_DM 
> double,CUST_FIRST_SHIPTO_CNT double,CUST_FIRST_SALES_CNT 
> double,CUST_GMT_OFFSET double,CUST_DEMO_CNT double,CUST_INCOME 
> double,PROD_UNLIMITED double,PROD_OFF_PRICE double,PROD_UNITS 
> double,TOTAL_PRD_COST double,TOTAL_PRD_DISC double,PROD_WEIGHT 
> double,REG_UNIT_PRICE double,EXTENDED_AMT double,UNIT_PRICE_DSCNT_PCT 
> double,DSCNT_AMT double,PROD_STD_CST double,TOTAL_TX_AMT double,FREIGHT_CHRG 
> double,WAITING_PERIOD double,DELIVERY_PERIOD double,ITM_CRNT_PRICE 
> double,ITM_UNITS double,ITM_WSLE_CST double,ITM_SIZE double,PRM_CST 
> double,PRM_RESPONSE_TARGET double,PRM_ITM_DM double,SHP_MODE_CNT 
> double,WH_GMT_OFFSET double,WH_SQ_FT double,STR_ORD_QTY double,STR_WSLE_CST 
> double,STR_LIST_PRICE

[GitHub] incubator-carbondata issue #692: [CARBONDATA-706] Fixing Spark 1.6 testcases...

2017-03-23 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/692
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #694: [CARBONDATA-814] bad record log file...

2017-03-23 Thread mohammadshahidkhan

GitHub user mohammadshahidkhan opened a pull request:

https://github.com/apache/incubator-carbondata/pull/694

[CARBONDATA-814] bad record log file writing is not correct



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohammadshahidkhan/incubator-carbondata 
badrecord_log_file_creation_fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/694.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #694


commit a353b93a62221f3eb7c580a0efe606b6b2748fd6
Author: mohammadshahidkhan 
Date:   2017-03-24T05:03:02Z

[CARBONDATA-814] bad record log file writing is not correct




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-814) bad record log file writing is not correct

2017-03-23 Thread Mohammad Shahid Khan (JIRA)

Mohammad Shahid Khan created CARBONDATA-814:
---

 Summary: bad record log file writing is not correct
 Key: CARBONDATA-814
 URL: https://issues.apache.org/jira/browse/CARBONDATA-814
 Project: CarbonData
  Issue Type: Bug
Reporter: Mohammad Shahid Khan
Assignee: Mohammad Shahid Khan






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1315/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1314/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #693: [CARBONDATA-813] Fix all issues to build su...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/693
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1313/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #693: [CARBONDATA-813] Fix all issues to b...

2017-03-23 Thread chenliang613

GitHub user chenliang613 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/693

[CARBONDATA-813] Fix all issues to build success for integration/presto

Fix pom issues and add the correct dependency jar to build success for 
integration/presto

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/chenliang613/incubator-carbondata presto_run

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/693.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #693


commit c4c928e6d2baffab3531db9f929235e453cf1abb
Author: chenliang613 
Date:   2017-03-23T17:21:23Z

Fix pom issues and add the correct dependency jar to build success for 
integration/presto




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-813) Fix pom issues and add the correct dependency jar to build success for integration/presto

2017-03-23 Thread Liang Chen (JIRA)

Liang Chen created CARBONDATA-813:
-

 Summary: Fix pom issues and add the correct dependency jar to 
build success for integration/presto
 Key: CARBONDATA-813
 URL: https://issues.apache.org/jira/browse/CARBONDATA-813
 Project: CarbonData
  Issue Type: Sub-task
  Components: presto-integration
Reporter: Liang Chen
Assignee: Liang Chen
Priority: Minor


Fix all issues to build success for integration/presto



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #692: [CARBONDATA-803] Fixing Spark 1.6 testcases...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/692
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1312/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-811) Refactor dictionary based result collector class

2017-03-23 Thread Ravindra Pesala (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-811.

   Resolution: Fixed
Fix Version/s: 1.0.1-incubating

> Refactor dictionary based result collector class
> 
>
> Key: CARBONDATA-811
> URL: https://issues.apache.org/jira/browse/CARBONDATA-811
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Srinath Thota
>Priority: Minor
> Fix For: 1.0.1-incubating
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> Problem: For each batch result collector class is filling all the class level 
> variable this may hit the performance
> Solution: fill it in constructor, so only once it will be initialize.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #690: [CARBONDATA-811] Refactor dictionary...

2017-03-23 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/690


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #690: [CARBONDATA-811] Refactor dictionary based ...

2017-03-23 Thread ravipesala

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/690
  
LGTM. Testcases are failing not because of this PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #692: [CARBONDATA-803] Fixing Spark 1.6 te...

2017-03-23 Thread ravipesala

GitHub user ravipesala opened a pull request:

https://github.com/apache/incubator-carbondata/pull/692

[CARBONDATA-803] Fixing Spark 1.6 testcases. Or filters are not working in 
spark 1.6.

Currently few testcases are failing in spark-1.6 because of OR filters are 
partially pushed down in spark 1.6 so i returns wrong results.
Now this PR makes either completely push down the OR filters or completely 
handled by spark layer.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ravipesala/incubator-carbondata 
or-filter-issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/692.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #692


commit 8679eb33a56821de109a967c426ef04856e3e2ab
Author: ravipesala 
Date:   2017-03-23T16:47:48Z

Or filters are not working in spark 1.6.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #691: [CARBONDATA-783] Fixed message fails with o...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/691
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1311/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #691: [CARBONDATA-783] Fixed message fails with o...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/691
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1310/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #691: [CARBONDATA-783] Fixed message fails with o...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/691
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1309/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #691: [CARBONDATA-783] Fixed message fails...

2017-03-23 Thread ravipesala

GitHub user ravipesala opened a pull request:

https://github.com/apache/incubator-carbondata/pull/691

[CARBONDATA-783]Fixed message fails with outofbound exception in 
dictionary server

This error happens because we are using TCP protocol and it may not sends 
the whole data in single packet, so if the data is big it is sending in 
multiple packets but we are taking only first packet to process the data, that 
is why it is failing.

Now added the length decoder and added length of whole message at header, 
so length decoder receives all packets depending on the length provided at 
header of message.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ravipesala/incubator-carbondata 
single-pass-optim

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/691.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #691


commit 2fb0be27c2445f9de13ff77c70b80554b60d9492
Author: ravipesala 
Date:   2017-03-23T08:34:07Z

Add single pass perf test

commit 757313dcf41b0068a377e68a37928f9210e2fd3d
Author: ravipesala 
Date:   2017-03-23T13:57:23Z

Fixed message fails with outofbound exception in dictionary server




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-783) Loading data with Single Pass 'true' option is throwing an exception

2017-03-23 Thread Ravindra Pesala (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala updated CARBONDATA-783:
---
Priority: Major  (was: Trivial)

> Loading data with Single Pass 'true' option is throwing an exception
> 
>
> Key: CARBONDATA-783
> URL: https://issues.apache.org/jira/browse/CARBONDATA-783
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Affects Versions: 1.1.0-incubating
> Environment: spark 2.1
>Reporter: Geetika Gupta
>Assignee: Ravindra Pesala
> Attachments: 7000_UniqData.csv
>
>
> I tried to create table using the following query:
> CREATE TABLE uniq_include_dictionary (CUST_ID int,CUST_NAME 
> String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, 
> BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), 
> DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 
> double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' 
> TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2');
> Table creation was successfull but when I tried to load data into the table 
> It showed the following error:
> ERROR 16-03 13:41:32,354 - nioEventLoopGroup-8-2 
> java.lang.IndexOutOfBoundsException: readerIndex(64) + length(25) exceeds 
> writerIndex(80): UnpooledUnsafeDirectByteBuf(ridx: 64, widx: 80, cap: 80)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1161)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1155)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:694)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:702)
>   at 
> org.apache.carbondata.core.dictionary.generator.key.DictionaryMessage.readData(DictionaryMessage.java:70)
>   at 
> org.apache.carbondata.core.dictionary.server.DictionaryServerHandler.channelRead(DictionaryServerHandler.java:59)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:367)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:353)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:346)
>   at 
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:367)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:353)
>   at 
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911)
>   at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
>   at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:652)
>   at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:575)
>   at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:489)
>   at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:451)
>   at 
> io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140)
>   at 
> io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144)
>   at java.lang.Thread.run(Thread.java:745)
> ERROR 16-03 13:41:32,355 - nioEventLoopGroup-8-2 exceptionCaught
> java.lang.IndexOutOfBoundsException: readerIndex(64) + length(25) exceeds 
> writerIndex(80): UnpooledUnsafeDirectByteBuf(ridx: 64, widx: 80, cap: 80)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1161)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1155)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:694)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:702)
>   at 
> org.apache.carbondata.core.dictionary.generator.key.DictionaryMessage.readData(DictionaryMessage.java:70)
>   at 
> org.apache.carbondata.core.dictionary.server.DictionaryServerHandler.channelRead(DictionaryServerHandler.java:59)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:367)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:353)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:346)
>   at 
>

[jira] [Assigned] (CARBONDATA-783) Loading data with Single Pass 'true' option is throwing an exception

2017-03-23 Thread Ravindra Pesala (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala reassigned CARBONDATA-783:
--

Assignee: Ravindra Pesala

> Loading data with Single Pass 'true' option is throwing an exception
> 
>
> Key: CARBONDATA-783
> URL: https://issues.apache.org/jira/browse/CARBONDATA-783
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-query
>Affects Versions: 1.1.0-incubating
> Environment: spark 2.1
>Reporter: Geetika Gupta
>Assignee: Ravindra Pesala
>Priority: Trivial
> Attachments: 7000_UniqData.csv
>
>
> I tried to create table using the following query:
> CREATE TABLE uniq_include_dictionary (CUST_ID int,CUST_NAME 
> String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, 
> BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), 
> DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 
> double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' 
> TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,Double_COLUMN2,DECIMAL_COLUMN2');
> Table creation was successfull but when I tried to load data into the table 
> It showed the following error:
> ERROR 16-03 13:41:32,354 - nioEventLoopGroup-8-2 
> java.lang.IndexOutOfBoundsException: readerIndex(64) + length(25) exceeds 
> writerIndex(80): UnpooledUnsafeDirectByteBuf(ridx: 64, widx: 80, cap: 80)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1161)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1155)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:694)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:702)
>   at 
> org.apache.carbondata.core.dictionary.generator.key.DictionaryMessage.readData(DictionaryMessage.java:70)
>   at 
> org.apache.carbondata.core.dictionary.server.DictionaryServerHandler.channelRead(DictionaryServerHandler.java:59)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:367)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:353)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:346)
>   at 
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:367)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:353)
>   at 
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911)
>   at 
> io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
>   at 
> io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:652)
>   at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:575)
>   at 
> io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:489)
>   at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:451)
>   at 
> io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:140)
>   at 
> io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144)
>   at java.lang.Thread.run(Thread.java:745)
> ERROR 16-03 13:41:32,355 - nioEventLoopGroup-8-2 exceptionCaught
> java.lang.IndexOutOfBoundsException: readerIndex(64) + length(25) exceeds 
> writerIndex(80): UnpooledUnsafeDirectByteBuf(ridx: 64, widx: 80, cap: 80)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1161)
>   at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1155)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:694)
>   at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:702)
>   at 
> org.apache.carbondata.core.dictionary.generator.key.DictionaryMessage.readData(DictionaryMessage.java:70)
>   at 
> org.apache.carbondata.core.dictionary.server.DictionaryServerHandler.channelRead(DictionaryServerHandler.java:59)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:367)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:353)
>   at 
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:346)
>   at 
>

[GitHub] incubator-carbondata issue #690: [CARBONDATA-811] Refactor dictionary based ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/690
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1308/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #690: [CARBONDATA-811] Refactor dictionary...

2017-03-23 Thread thotasrinath

GitHub user thotasrinath opened a pull request:

https://github.com/apache/incubator-carbondata/pull/690

[CARBONDATA-811] Refactor dictionary based result collector class.

Initialization of variables is moved to constructor. So that initialization 
is done only once on object creation instead of running a business logic.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/thotasrinath/incubator-carbondata 
ResultCollectorClassOptimization

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/690.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #690


commit 542fcb921ac32eeb8b26e484dbd60b9b5fb16e8c
Author: thotasrinath 
Date:   2017-03-23T13:44:13Z

Refactor dictionary based result collector class.
Initialization of variables is moved to constructor. So that initialization 
is done only once on object creation instead of running a business logic.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #688: [CARBONDATA-811] Refactor result collector ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/688
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1307/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #688: [CARBONDATA-811] Refactor result col...

2017-03-23 Thread thotasrinath

Github user thotasrinath closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/688


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #689: [CARBONDATA-812] make vectorized reader as ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/689
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1306/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #688: [CARBONDATA-811] Refactor result collector ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/688
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1305/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-812) make vectorized reader as default reader

2017-03-23 Thread Jacky Li (JIRA)

Jacky Li created CARBONDATA-812:
---

 Summary: make vectorized reader as default reader
 Key: CARBONDATA-812
 URL: https://issues.apache.org/jira/browse/CARBONDATA-812
 Project: CarbonData
  Issue Type: Improvement
Reporter: Jacky Li
 Fix For: 1.1.0-incubating






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #689: [CARBONDATA-812] make vectorized rea...

2017-03-23 Thread jackylk

GitHub user jackylk opened a pull request:

https://github.com/apache/incubator-carbondata/pull/689

[CARBONDATA-812] make vectorized reader as default reader

change property for vectorized reader to true

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jackylk/incubator-carbondata makedefault

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/689.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #689


commit 3d1b3041089e26704637cad8918c3a7d4f939c6a
Author: jackylk 
Date:   2017-03-23T12:45:22Z

change vectorized reader default to true




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #688: [CARBONDATA-811] Refactor result collector ...

2017-03-23 Thread ravipesala

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/688
  
add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #688: [CARBONDATA-811] Refactor result collector ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/688
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #688: [CARBONDATA-811] Refactor result col...

2017-03-23 Thread thotasrinath

GitHub user thotasrinath opened a pull request:

https://github.com/apache/incubator-carbondata/pull/688

[CARBONDATA-811] Refactor result collector class

**Problem**: For each batch result collector class is filling all the class 
level variable this may hit the performance
**Solution**: fill it in constructor, so only once it will be initialize.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/thotasrinath/incubator-carbondata 
RefactorResultCollectorClass

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/688.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #688


commit 093609eb361172d882f994ab2b175aa44d98be31
Author: Srinath Thota 
Date:   2017-03-23T11:47:57Z

[CARBONDATA-801] Examples syntax fix

commit 979e0a0ffb9baec45bcc5b5f69caf9ef071ec328
Author: thotasrinath 
Date:   2017-03-23T12:27:47Z

Refactor Dictionary based Result Collector Class




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #616: [CARBONDATA-708] Fixed Between Filter Issue...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/616
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1304/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #616: [CARBONDATA-708] Fixed Between Filte...

2017-03-23 Thread bhavya411

Github user bhavya411 closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/616


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #687: [CARBONDATA-801] Examples syntax fix

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/687
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #687: [CARBONDATA-801] Examples syntax fix

2017-03-23 Thread thotasrinath

GitHub user thotasrinath opened a pull request:

https://github.com/apache/incubator-carbondata/pull/687

[CARBONDATA-801] Examples syntax fix

Updated the document as per the supported syntax.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/thotasrinath/incubator-carbondata master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/687.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #687


commit 093609eb361172d882f994ab2b175aa44d98be31
Author: Srinath Thota 
Date:   2017-03-23T11:47:57Z

[CARBONDATA-801] Examples syntax fix




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (CARBONDATA-801) [Documentation] Examples format to be fixed

2017-03-23 Thread Srinath Thota (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938110#comment-15938110
 ] 

Srinath Thota commented on CARBONDATA-801:
--

[~gururaj] can i try to fix this issue. Please assign to me.

> [Documentation] Examples format to be fixed
> ---
>
> Key: CARBONDATA-801
> URL: https://issues.apache.org/jira/browse/CARBONDATA-801
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
>Priority: Minor
>
> Some examples provided in DDL are enclosed in “” which might not work in some 
> scenarios. Need to replace the “” in the examples to ‘’.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (CARBONDATA-798) Update Bad Records folder name during table rename

2017-03-23 Thread Venkata Ramana G (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Venkata Ramana G updated CARBONDATA-798:

Issue Type: Bug  (was: Improvement)

> Update Bad Records folder name during table rename 
> ---
>
> Key: CARBONDATA-798
> URL: https://issues.apache.org/jira/browse/CARBONDATA-798
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Kunal Kapoor
>Assignee: Kunal Kapoor
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> Currently the bad records location is not being updated during table rename.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (CARBONDATA-798) Update Bad Records folder name during table rename

2017-03-23 Thread Venkata Ramana G (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Venkata Ramana G resolved CARBONDATA-798.
-
   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Update Bad Records folder name during table rename 
> ---
>
> Key: CARBONDATA-798
> URL: https://issues.apache.org/jira/browse/CARBONDATA-798
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Kunal Kapoor
>Assignee: Kunal Kapoor
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> Currently the bad records location is not being updated during table rename.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #678: [CARBONDATA-798] Added support to re...

2017-03-23 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/678


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #672: [CARBONDATA-727][WIP] add hive integration ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/672
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1303/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-792) Range Filter Optimization

2017-03-23 Thread Venkata Ramana G (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Venkata Ramana G resolved CARBONDATA-792.
-
   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Range Filter Optimization
> -
>
> Key: CARBONDATA-792
> URL: https://issues.apache.org/jira/browse/CARBONDATA-792
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: sounak chakraborty
>Assignee: sounak chakraborty
> Fix For: 1.1.0-incubating
>
>  Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> Combine separate less than and greater than filter expression into a single 
> expression in order to gain performance. As within a single expression both 
> Min and Max values will be there, evaluation of rows will be come much 
> easier. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #670: [CARBONDATA-792] Range Filter Optimi...

2017-03-23 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/670


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #680: [CARBONDATA-800] ArrayIndexOfBound E...

2017-03-23 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/680


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-800) ArrayIndexOfBound Exception thrown when block size is specified as 2048 MB

2017-03-23 Thread Venkata Ramana G (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Venkata Ramana G resolved CARBONDATA-800.
-
Resolution: Fixed

> ArrayIndexOfBound Exception thrown when block size is specified as 2048 MB
> --
>
> Key: CARBONDATA-800
> URL: https://issues.apache.org/jira/browse/CARBONDATA-800
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Manish Gupta
>Assignee: Manish Gupta
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> If table block size if specified for its max value 2048, then while 
> converting it into bytes it goes out of integer range and hence a negative 
> value is assigned for blocklet size. Because of this exception is thrown.
> java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
>   at java.util.ArrayList.rangeCheck(ArrayList.java:635)
>   at java.util.ArrayList.get(ArrayList.java:411)
>   at 
> org.apache.carbondata.processing.store.writer.v3.CarbonFactDataWriterImplV3.writeDataToFile(CarbonFactDataWriterImplV3.java:329)
>   at 
> org.apache.carbondata.processing.store.writer.v3.CarbonFactDataWriterImplV3.writeBlockletData(CarbonFactDataWriterImplV3.java:319)
>   at 
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:1602)
>   at 
> org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:1582)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>   at java.lang.Thread.run(Thread.java:745)
> ERROR 21-03 14:20:34,396 - [Executor task launch 
> worker-0][partitionID:default_carbon_table_fd22a530-1ae4-459f-aae4-b1d8cdef514f]
>  
> org.apache.carbondata.processing.store.writer.exception.CarbonDataWriterException:
>  Index: 0, Size: 0
> java.util.concurrent.ExecutionException: 
> org.apache.carbondata.processing.store.writer.exception.CarbonDataWriterException:
>  Index: 0, Size: 0
>   at java.util.concurrent.FutureTask.report(FutureTask.java:122)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #678: [CARBONDATA-798] Added support to rename ba...

2017-03-23 Thread gvramana

Github user gvramana commented on the issue:

https://github.com/apache/incubator-carbondata/pull/678
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-805) Fix groupid,package name,Class name issues

2017-03-23 Thread Ravindra Pesala (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-805.

   Resolution: Fixed
Fix Version/s: 1.1.0-incubating

> Fix groupid,package name,Class name issues
> --
>
> Key: CARBONDATA-805
> URL: https://issues.apache.org/jira/browse/CARBONDATA-805
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: presto-integration
>Reporter: Liang Chen
>Assignee: Liang Chen
>Priority: Minor
> Fix For: 1.1.0-incubating
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Fix groupid,package name,Class name issues



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #686: [CARBONDATA-805] Fix groupid,package...

2017-03-23 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/686


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #672: [CARBONDATA-727][WIP] add hive integration ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/672
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1301/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #686: [CARBONDATA-805] Fix groupid,package name,C...

2017-03-23 Thread ravipesala

Github user ravipesala commented on the issue:

https://github.com/apache/incubator-carbondata/pull/686
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #686: [CARBONDATA-805] Fix groupid,package name,C...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/686
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1300/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #672: [CARBONDATA-727][WIP] add hive integ...

2017-03-23 Thread cenyuhai

Github user cenyuhai commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/672#discussion_r107607409
  
--- Diff: dev/java-code-format-template.xml ---
@@ -34,8 +34,8 @@
   
 
   
-  
   
+  
--- End diff --

@chenliang613 @QiangCai Qiang Cai told me that it is wrong. So I change it  
by the way


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #686: Fix groupid,package name,Class name ...

2017-03-23 Thread chenliang613

GitHub user chenliang613 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/686

Fix groupid,package name,Class name issues of presto integration

Fix groupid,package name,Class name issues of presto integration

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/chenliang613/incubator-carbondata presto_name

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/686.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #686


commit 32bf2961a38d53c4674fc57b25ab48d99e0f4858
Author: chenliang613 
Date:   2017-03-23T08:02:30Z

Fix groupid,package name,Class name issues




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #672: [CARBONDATA-727][WIP] add hive integ...

2017-03-23 Thread chenliang613

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/672#discussion_r107606797
  
--- Diff: dev/java-code-format-template.xml ---
@@ -34,8 +34,8 @@
   
 
   
-  
   
+  
--- End diff --

Can you explain ,why change the order ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #672: [CARBONDATA-727][WIP] add hive integration ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/672
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1299/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #672: [CARBONDATA-727][WIP] add hive integration ...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/672
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1298/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #685: [CARBONDATA-809] Fixed union with alias err...

2017-03-23 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/685
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/1297/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #685: [CARBONDATA-809] Fixed union with al...

2017-03-23 Thread ravipesala

GitHub user ravipesala opened a pull request:

https://github.com/apache/incubator-carbondata/pull/685

[CARBONDATA-809] Fixed union with alias error

When using alias in union queries, it uses same instance of alias across 
the query, so one query alias is getting overridden with other table alias 
thats why it return wrong data.

Now this PR passes exclusive alias map for each union query. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ravipesala/incubator-carbondata alias-issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/685.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #685


commit 4c8aa969f814730aa5954764a30ef638879f9445
Author: ravipesala 
Date:   2017-03-23T06:27:11Z

Fixed union with alias error




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-810) Index builder exception display to user using select query.

2017-03-23 Thread Vinod Rohilla (JIRA)

Vinod Rohilla created CARBONDATA-810:


 Summary: Index builder exception display to user using select 
query.
 Key: CARBONDATA-810
 URL: https://issues.apache.org/jira/browse/CARBONDATA-810
 Project: CarbonData
  Issue Type: Bug
  Components: data-query
Affects Versions: 1.1.0-incubating
 Environment: Spark 2.1
Reporter: Vinod Rohilla
Priority: Minor
 Attachments: FACT_UNITED_DATA_INFO_sample_cube.csv

Error message display as Job aborted due to stage failure.

Steps to reproduce:

1: Create the table in Carbon:

create table IF NOT EXISTS traffic_2g_3g_4g (SOURCE_INFO String 
,APP_CATEGORY_ID String ,APP_CATEGORY_NAME String ,APP_SUB_CATEGORY_ID String 
,APP_SUB_CATEGORY_NAME String ,RAT_NAME String ,IMSI String ,OFFER_MSISDN 
String ,OFFER_ID String ,OFFER_OPTION_1 String ,OFFER_OPTION_2 String 
,OFFER_OPTION_3 String ,MSISDN String ,PACKAGE_TYPE String ,PACKAGE_PRICE 
String ,TAG_IMSI String ,TAG_MSISDN String ,PROVINCE String ,CITY String 
,AREA_CODE String ,TAC String ,IMEI String ,TERMINAL_TYPE String 
,TERMINAL_BRAND String ,TERMINAL_MODEL String ,PRICE_LEVEL String ,NETWORK 
String ,SHIPPED_OS String ,WIFI String ,WIFI_HOTSPOT String ,GSM String ,WCDMA 
String ,TD_SCDMA String ,LTE_FDD String ,LTE_TDD String ,CDMA String 
,SCREEN_SIZE String ,SCREEN_RESOLUTION String ,HOST_NAME String ,WEBSITE_NAME 
String ,OPERATOR String ,SRV_TYPE_NAME String ,TAG_HOST String ,CGI String 
,CELL_NAME String ,COVERITY_TYPE1 String ,COVERITY_TYPE2 String ,COVERITY_TYPE3 
String ,COVERITY_TYPE4 String ,COVERITY_TYPE5 String ,LATITUDE String 
,LONGITUDE String ,AZIMUTH String ,TAG_CGI String ,APN String ,USER_AGENT 
String ,DAY String ,HOUR String ,MIN String ,IS_DEFAULT_BEAR int ,EPS_BEARER_ID 
String ,QCI int ,USER_FILTER String ,ANALYSIS_PERIOD String, UP_THROUGHPUT 
int,DOWN_THROUGHPUT int,UP_PKT_NUM int,DOWN_PKT_NUM int,APP_REQUEST_NUM 
int,PKT_NUM_LEN_1_64 int,PKT_NUM_LEN_64_128 int,PKT_NUM_LEN_128_256 
int,PKT_NUM_LEN_256_512 int,PKT_NUM_LEN_512_768 int,PKT_NUM_LEN_768_1024 
int,PKT_NUM_LEN_1024_ALL int,IP_FLOW_MARK int) STORED BY 
'org.apache.carbondata.format'

2: Load the Data

LOAD DATA INPATH 'HDFS_URL/FACT_UNITED_DATA_INFO_sample_cube.csv' INTO table 
traffic_2g_3g_4g OPTIONS ('DELIMITER'=',' , 
'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='')

3: Perform the Select Query

select MSISDN,sum(UP_THROUGHPUT)+sum(DOWN_THROUGHPUT) as total from  
traffic_2g_3g_4g  where TERMINAL_BRAND='HTC' and 
APP_CATEGORY_NAME='Web_Browsing' group by MSISDN

Error on ThriftServer
Job aborted due to stage failure: Task 1 in stage 12259.0 failed 4 times, most 
recent failure: Lost task 1.3 in stage 12259.0 (TID 642677, hadoop-slave-3, 
executor 9): 
org.apache.carbondata.core.datastore.exception.IndexBuilderException: Block 
B-tree loading failed
at 
org.apache.carbondata.core.datastore.BlockIndexStore.fillLoadedBlocks(BlockIndexStore.java:264)
at 
org.apache.carbondata.core.datastore.BlockIndexStore.getAll(BlockIndexStore.java:189)
at 
org.apache.carbondata.core.scan.executor.impl.AbstractQueryExecutor.initQuery(AbstractQueryExecutor.java:131)
at 
org.apache.carbondata.core.scan.executor.impl.AbstractQueryExecutor.getBlockExecutionInfos(AbstractQueryExecutor.java:186)
at 
org.apache.carbondata.core.scan.executor.impl.DetailQueryExecutor.execute(DetailQueryExecutor.java:39)
at 
org.apache.carbondata.hadoop.CarbonRecordReader.initialize(CarbonRecordReader.java:79)
at 
org.apache.carbondata.spark.rdd.CarbonScanRDD.compute(CarbonScanRDD.scala:204)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at 
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at 
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:96)
at 
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: 
org.apache.thrift.protocol.TProtocolException: don't know what type: 15
at

[jira] [Assigned] (CARBONDATA-808) Create PrestoExample

2017-03-23 Thread Pallavi Singh (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallavi Singh reassigned CARBONDATA-808:


Assignee: Pallavi Singh

> Create PrestoExample
> 
>
> Key: CARBONDATA-808
> URL: https://issues.apache.org/jira/browse/CARBONDATA-808
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: hadoop-integration
>Reporter: Liang Chen
>Assignee: Pallavi Singh
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-809) Union with alias is returning wrong result.

2017-03-23 Thread Ravindra Pesala (JIRA)

Ravindra Pesala created CARBONDATA-809:
--

 Summary: Union with alias is returning wrong result.
 Key: CARBONDATA-809
 URL: https://issues.apache.org/jira/browse/CARBONDATA-809
 Project: CarbonData
  Issue Type: Bug
Reporter: Ravindra Pesala


Union with alias is returning wrong result.

Testcase 
{code}
SELECT t.c1 a FROM (select c1 from  carbon_table1 union all  select c1 from  
carbon_table2) t
{code}

The above query returns the data from only one table and also duplicated.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-808) Create PrestoExample

2017-03-23 Thread Liang Chen (JIRA)

Liang Chen created CARBONDATA-808:
-

 Summary: Create PrestoExample
 Key: CARBONDATA-808
 URL: https://issues.apache.org/jira/browse/CARBONDATA-808
 Project: CarbonData
  Issue Type: Sub-task
Reporter: Liang Chen
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

75 matches

Mail list logo