[
https://issues.apache.org/jira/browse/HIVE-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495864#comment-14495864
]
tangjunjie commented on HIVE-10260:
-----------------------------------
I know the root cause. This is because Table schema is differement from Table's
parition schema.But hive 0.10 always
use Table schema to serde row, hive 0.11 use parition schema to serde row see
https://issues.apache.org/jira/browse/HIVE-3833.
> hive 1.1.0 return NULL value
> ----------------------------
>
> Key: HIVE-10260
> URL: https://issues.apache.org/jira/browse/HIVE-10260
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.1.0
> Environment: hive 1.1.0 hadoop 2.3.0
> Reporter: tangjunjie
>
> hive 0.10 correct result:
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM 2357378283356 91501191044440048
> 7326356 2015-01-19 10:44:44
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM 2357378283356 121501191035580028
> 7326356 2015-01-19 10:35:58
> UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG 2362223711289 161501191549050061
> 14837289 2015-01-19 15:49:05
> Y49EY895ACABHS95DRQEE8DVFEB8JSE1 2360853052224 111501191426280023
> 115883224 2015-01-19 14:26:28
> hive 1.1.0
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM 2357378283356 91501191044440048
> 7326356 NULL
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM 2357378283356 121501191035580028
> 7326356 NULL
> UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG 2362223711289 161501191549050061
> 14837289 NULL
> Y49EY895ACABHS95DRQEE8DVFEB8JSE1 2360853052224 111501191426280023
> 115883224 NULL
> I found difference from log:
> In hive 1.1.0
> DEBUG lazy.LazySimpleSerDe:
> org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with:
> columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id,
> landing_page_type_id, landing_track_time, landing_url, nav_refer_tracker_id,
> nav_refer_page_type_id, nav_refer_page_value, nav_refer_link_position,
> nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
> nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers,
> nav_link_position, nav_button_position, nav_track_time, nav_next_tracker_id,
> sessn_last_time, sessn_pv, detl_tracker_id, detl_page_type_id,
> detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
> cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion,
> cart_button_position, cart_position_track_id, cart_prod_id, ordr_tracker_id,
> ordr_page_type_id, ordr_code, updt_time, cart_pm_id, brand_code, categ_type,
> os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
> detl_button_position, manul_flag, manul_track_date, nav_refer_tpa,
> nav_refer_tpa_id, nav_refer_tpc, nav_refer_tpi, nav_refer_tcs,
> nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
> nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs,
> nav_tcsa, nav_tcdt, nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa,
> detl_tpc, detl_tpi, detl_tcs, detl_tcsa, detl_tcdt, detl_tcd, detl_tci,
> detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi, cart_tcs,
> cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type]
> columnTypes=[string, bigint, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, int, string, string, string, string, string, string,
> int, string, string, string, bigint, string, string, string, string, string,
> string, string, string, bigint, string, string, string, string, bigint,
> string, int, string, string, string, int, string, string, int, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string] separator=[[B@e50bca4] nullstring=\N
> lastColumnTakesRest=false
> In hive 0.10
> DEBUG lazy.LazySimpleSerDe:
> org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with:
> columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id,
> landing_page_type_id, landing_track_time, landing_url, nav_refer_tracker_id,
> nav_refer_page_type_id, nav_refer_page_value, nav_refer_link_position,
> nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
> nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers,
> nav_link_position, nav_button_position, nav_track_time, nav_next_tracker_id,
> sessn_last_time, sessn_pv, detl_tracker_id, detl_page_type_id,
> detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
> cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion,
> cart_button_position, cart_position_track_id, cart_prod_id, ordr_tracker_id,
> ordr_page_type_id, ordr_code, updt_time, cart_pm_id, brand_code, categ_type,
> os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
> detl_button_position, manul_flag, manul_track_date, nav_refer_tpa,
> nav_refer_tpa_id, nav_refer_tpc, nav_refer_tpi, nav_refer_tcs,
> nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
> nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs,
> nav_tcsa, nav_tcdt, nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa,
> detl_tpc, detl_tpi, detl_tcs, detl_tcsa, detl_tcdt, detl_tcd, detl_tci,
> detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi, cart_tcs,
> cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type, sessn_chanl_id,
> gu_sec_flg, detl_refer_page_type_id, detl_refer_page_value, detl_event_id,
> nav_refer_intrn_reslt_sum, nav_intrn_reslt_sum, nav_refer_intrn_kw,
> nav_intrn_kw, detl_track_time, cart_track_time] columnTypes=[string, bigint,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string, int,
> string, string, string, string, string, string, int, string, string, string,
> bigint, string, string, string, string, string, string, string, string,
> bigint, string, string, string, string, bigint, string, int, string, string,
> string, int, string, string, int, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> string, string, string, string, string, string, string, string, string,
> bigint, bigint, string, string, string, string, string, string, string,
> string, string] separator=[[B@116265c3] nullstring=\N
> lastColumnTakesRest=false
> You see hive 1.1.0 lost some column info. Why? BTW, My meta database schema
> is hive 0.10 not update to hive 1.1.0.
> When I start hive 0.10 meta store and hive 1.1.0 remote connect it.Hive 1.1.0
> return right result.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
