Ignored :-) I do not believe that you're hitting exactly SQOOP-204. It seems that SQOOP-204 has failed during creating Input Splits for your job. But you seem to be dying after your job is being executed on hadoop cluster.
I'm afraid that I do not know how to help you at the moment. Would you mind upgrading on current 1.4.1 version? Jarcec On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote: > Hi Jarek , > Please ignore my first problem for getting no hdfs results as it turns out > to be my silly mistake during copying of the query. sorry for the annoyance. > The second problem of adding --split-by turns out to be SQOOP-204, but it > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it? > > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian <weidong....@gmail.com> wrote: > > > also when I'm adding the --split-by a.prod_inst_id to the sqoop command as > > in: > > QUERY="SELECT a.*, > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > > c.cust_code,c.root_cust_code, > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name > > FROM prc_idap_pi_root a > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail > > WHERE para_id=84) AND \$CONDITIONS" > > sqoop import \ > > --verbose \ > > --driver oracle.jdbc.OracleDriver \ > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \ > > --username *** \ > > --password ****** \ > > --query "$QUERY" \ > > --split-by a.prod_inst_id \ > > --target-dir /home/wbian/test > > > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly > > ended" Exception is threw. > > And I'm testing this sqoop command on a stand-alone hadoop node. > > The output when adding the split-by is as follows: > > > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging. > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on the > > command-line is insecure. Consider using -P instead. > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory: > > com.cloudera.sqoop.manager.DefaultManagerFactory > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory: > > com.cloudera.sqoop.manager.DefaultManagerFactory > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of 1000 > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1 > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters > > specified. Using regular API for making connection. > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next > > query: 1000 > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT > > a.*, > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > > c.cust_code,c.root_cust_code, > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name > > FROM prc_idap_pi_root a > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail > > WHERE para_id=84) AND (1 = 0) > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next > > query: 1000 > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: SELECT > > a.*, > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > > c.cust_code,c.root_cust_code, > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name > > FROM prc_idap_pi_root a > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail > > WHERE para_id=84) AND (1 = 0) > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns: > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_INST_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CRM_ASSET_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INTEGRATION_CD > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_STAT_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STD_PRD_CD > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STD_PRD_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_SPEC_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_SPEC_CODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PREPAY_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STOP_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: UNINSTALL_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BILL_ASSET_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BILL_PROD_INST_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CARRIER_ASSET_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CARRIER_PROD_INST_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: COMP_PAR_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CENTREX_SUB_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CUST_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_ACCESS_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_MONTHLY_HOURS > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_INSTALL_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_INSTALL_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_WATCH_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_PHONE_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_SPEED_RATE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_BUREAU_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_BUREAU_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_INTERNET_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_ITEM_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_GROUP_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_START_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_END_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_CONTINUE_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_YEAR_PAY_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEXT_PROM_ITEM_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEXT_PROM_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_AGR_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_AGR_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_START_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_END_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_ADDR_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_ADDR_POSTCODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_AREA_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_BUREAU_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_BUREAU_CD > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGENT_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGENT_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_001_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_002_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_003_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_004_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_005_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_006_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_007_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_008_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_009_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_010_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_011_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_012_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_013_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_014_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_015_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_016_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_017_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_018_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_019_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_020_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_021_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_022_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_023_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_024_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_025_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_026_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_027_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_028_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_029_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_030_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_031_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_032_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_033_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_034_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_035_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_036_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_037_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_038_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_039_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_040_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PHS_SERIES_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_TELEPHONE_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_UN_ACTIVE_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_ACTIVE_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PAY_CUST_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: OWN_CUST_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: USE_CUST_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_STAT_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_041_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_042_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: FREE_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_043_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: QUERY_PHONE_NUMBER_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CREATE_TMP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CREATE_BY > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: LST_UPD_TMP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: LST_UPD_BY > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUSI_KEY > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SRC_SYS > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_SUB_STAT_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_PACK_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEW_CUST_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CDMA_SEG_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: UIM_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IMSI > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_START_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_END_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_EXP_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: VPN_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_BUREAU_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: EJ_T_GROUP_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: EJ_T_PROM_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUILDING_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IVPN_NUM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_ID_CRM > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: USER_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADD_GROUP_IID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CDMA_PROD_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACT_OP_RATE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_CD > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_EXPERIENCE_UP_RATE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_EXPERIENCE_DOWN_RATE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE_A > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE_B > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_BUSI_TYPE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ATTR_USE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_163_ONLINENET > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ISP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_SPEED_RATE_AVL > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CHURN_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: RESTRICT_CHURN_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PHS_SERIES_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: OPEN_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CHURN_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_ACTION_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_CONT_SYSAUTO_FLG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GUANGWANG_FLAG > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IPTV_PROM_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_ADDR_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_ADDR_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_ADDR > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_ADDR > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MOBILE_TERM_TYPE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_INTG_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_INTG_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_CONST_START_DT > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_NO > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADDR_ID > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: POSTCODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_RMND_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PRINT_TP > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MEDIA_TYPE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CUST_CODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ROOT_CUST_CODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MDF_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_BUREAU_CODE > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUREAU_CD > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADM_SUB_BUREAU_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUREAU_NAME > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12, > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12, > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12, > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12, > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12, > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12, > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, GH_INSTALL_TP:12, > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12, > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12, > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, DATA_INTERNET_FLG:12, > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12, > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12, > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, SUB_AGR_ID:2, > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:93, > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, DEV_GRID_ID:2, > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12, > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1, > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1, > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1, > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1, > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1, > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1, > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1, > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1, > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1, > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1, > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12, > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12, > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12, > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:12, > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, PI_SUB_STAT_TP:12, > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12, > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93, > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12, > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2, > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12, > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12, > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:12, > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12, > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12, > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93, > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12, > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12, > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12, > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12, > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12, > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12, > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12, > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12, > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is > > /usr/lib/hadoop > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar at: > > /usr/lib/hadoop/hadoop-core.jar > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with args: > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -sourcepath > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -d > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -classpath > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/etc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/commons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../sqoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > Note: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.java > > uses or overrides a deprecated API. > > Note: Recompile with -Xlint:deprecation for details. > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class files > > in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile: > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.class > > -> QueryResult.class > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar file > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query import. > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing > > class: QueryResult > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar > > through URL: > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/ > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader is > > sun.misc.Launcher$AppClassLoader@28df6ccd > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar: > > QueryResult > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into current > > JVM: > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar!/ > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for jar > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar: > > java.net.FactoryURLClassLoader@1638fff7 > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table class: > > QueryResult > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat: > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with > > processName=JobTracker, sessionId= > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load native-hadoop > > library for your platform... using builtin-java classes where applicable > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001 > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db record > > reader for db product: ORACLE > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: SELECT > > a.*, > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > > c.cust_code,c.root_cust_code, > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name > > FROM prc_idap_pi_root a > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 ) > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next query: > > 1000 > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.*, > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > > c.cust_code,c.root_cust_code, > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name > > FROM prc_idap_pi_root a > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id > > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM etl.etl_para_cfg_detail > > WHERE para_id=84) AND ( 1=1 ) AND ( 1=1 ) > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing > > auto-progress thread to quit. > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for progress > > thread shutdown... > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress thread > > is finished. keepGoing=false > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread > > shutdown detected. > > 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is > > done. And is in the process of commiting > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner: > > 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_0 is > > allowed to commit now > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of task > > 'attempt_local_0001_m_000000_0' to /home/wbian/test > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner: > > 12/03/01 15:24:32 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0' > > done. > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_1153766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_1153759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: Deleted > > path > > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_1151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > 12/03/01 15:24:33 INFO mapred.JobClient: map 100% reduce 0% > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001 > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6 > > 12/03/01 15:24:33 INFO mapred.JobClient: FileSystemCounters > > 12/03/01 15:24:33 INFO mapred.JobClient: FILE_BYTES_READ=37482 > > 12/03/01 15:24:33 INFO mapred.JobClient: FILE_BYTES_WRITTEN=96083 > > 12/03/01 15:24:33 INFO mapred.JobClient: Map-Reduce Framework > > 12/03/01 15:24:33 INFO mapred.JobClient: Map input records=0 > > 12/03/01 15:24:33 INFO mapred.JobClient: Spilled Records=0 > > 12/03/01 15:24:33 INFO mapred.JobClient: SPLIT_RAW_BYTES=87 > > 12/03/01 15:24:33 INFO mapred.JobClient: Map output records=0 > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in > > 2.9865 seconds (0 bytes/sec) > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records. > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader: > > sun.misc.Launcher$AppClassLoader@28df6ccd > > > > Thanks&Regards, > > Bruce > > > > > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho <jar...@apache.org>wrote: > > > >> Hi Bruce, > >> would you mind sending entire sqoop command that you've used as well as > >> entire output that it generates with "--verbose" flag? > >> > >> Jarcec > >> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote: > >> > Hi there, > >> > When I'm using sqoop free-form query import to import the data from > >> Oracle > >> > to HDFS with some ETL process in the query, the results in HDFS contains > >> > nothing. > >> > The query is as follows: > >> > > >> > SELECT a.*, > >> > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >> > c.cust_code,c.root_cust_code, > >> > > >> d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_name > >> > FROM prc_idap_pi_root a > >> > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=b.acnt_id > >> > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=c.cust_id > >> > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=d.area_id > >> > WHERE lst_upd_tmp >= (SELECT date_val - 1/240 FROM > >> etl.etl_para_cfg_detail > >> > WHERE para_id=84) AND \$CONDITIONS > >> > > >> > The same query has been executed successfully in oracle(without the > >> > $CONDITIONS of course). Is it because the query contains sub-query in > >> it? > >> > > >> > Thanks&Regards, > >> > Bruce > >> > > > >
signature.asc
Description: Digital signature