Anubhav Tarar created SPARK-37353:
-------------------------------------
Summary: Resolved attribute(s) region_id#7993 missing from
lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677 when doing left join
Key: SPARK-37353
URL: https://issues.apache.org/jira/browse/SPARK-37353
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 2.4.0
Reporter: Anubhav Tarar
For this Code i m getting error
var df = totalTimeFootfallDf.join(dwellTimeDf,Seq(groupByKeys: _*),"left_outer")
org.apache.spark.sql.AnalysisException: Resolved attribute(s) region_id#7993
missing from
lm_tam_code#2666,ld_month#2697,geo_sub_district_id#2677,lm_subldm_id#2652,geo_province_name_th#2689,lm_amp_code#2665,lm_cat_name_t#2675,lm_prov_code#2664,lm_sub_name_t#2672,lm_name_branch#2694,region_id#422,lm_update_dttm#2669,mkt_region_name_en#2692,lm_radius#369,geo_province_id#2679,lm_name#2655,geo_province_name_en#2684,lm_name_fld_t#2656,geo_region_name_en#2686,geo_district_name_th#2688,geo_sub_region_id#2680,ld_day#2698,lm_master#2653,lm_location_t#2660,lm_zone#2668,lm_latitude#2671,lm_branch_t#2658,geo_sub_district_name_th#2687,lm_cat_id#2674,geo_district_id#2678,lm_symbol#2649,lm_id#2648,lm_name_t#2654,lm_cat_name#2676,geo_district_name_en#2683,lm_name_fld#2657,lm_master_branch#2663,lm_longitude#2670,lm_branch#2659,mkt_sub_region_id#2690,lm_sub_cat_id#2650,geo_sub_region_name_en#2685,lm_sub_cat_name#316,mkt_sub_region_name_en#2691,grid_id#2695,lm_floor#2667,lm_location#2661,geo_sub_district_name_en#2682,lm_master_branch_t#2662,data_date#2693,lm_ldmtag#2651,ld_year#2696
in operator !Project [lm_id#2648, lm_symbol#2649, lm_sub_cat_id#2650,
lm_ldmtag#2651, lm_subldm_id#2652, lm_master#2653, lm_name_t#2654,
lm_name#2655, lm_name_fld_t#2656, lm_name_fld#2657, lm_branch_t#2658,
lm_branch#2659, lm_location_t#2660, lm_location#2661, lm_master_branch_t#2662,
lm_master_branch#2663, lm_prov_code#2664, lm_amp_code#2665, lm_tam_code#2666,
lm_floor#2667, lm_zone#2668, lm_update_dttm#2669, lm_longitude#2670,
lm_latitude#2671, ... 28 more fields]. Attribute(s) with the same name appear
in the operation: region_id. Please check if the right attribute(s) are used.;;
Join LeftOuter
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
