Yes, the hdfs:/lobs directory is there. Here it is on the two machines that ran executor last night:
[svarnau@slave-cdh51-10 ~]$ sudo -u hdfs hadoop dfs -ls /lobs DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. Found 10 items -rw-r--r-- 3 jenkins supergroup 0 2014-12-02 09:59 /lobs/LOBP_00069857936158921811_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 09:59 /lobs/LOBP_00069857936158921811_0001.desc -rw-r--r-- 3 jenkins supergroup 14 2014-12-02 11:03 /lobs/LOBP_00069857936158923164_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 11:03 /lobs/LOBP_00069857936158923164_0001.desc -rw-r--r-- 3 jenkins supergroup 15 2014-12-02 11:03 /lobs/LOBP_00069857936158923771_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 11:03 /lobs/LOBP_00069857936158923771_0001.desc -rw-r--r-- 3 jenkins supergroup 15 2014-12-02 11:03 /lobs/LOBP_00069857936158923771_0002 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 11:03 /lobs/LOBP_00069857936158923771_0002.desc -rw-r--r-- 3 jenkins supergroup 0 2014-12-02 10:00 /lobs/LOBP_00069857936158924625_0002 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 10:00 /lobs/LOBP_00069857936158924625_0002.desc [svarnau@slave-hdp21-02 ~]$ sudo -u hdfs hadoop dfs -ls /lobs DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. Found 20 items -rw-r--r-- 3 jenkins supergroup 0 2014-12-02 12:58 /lobs/LOBP_00072672696636709536_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 12:58 /lobs/LOBP_00072672696636709536_0001.desc -rw-r--r-- 3 jenkins supergroup 14 2014-12-02 14:02 /lobs/LOBP_00072672696636710917_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 14:02 /lobs/LOBP_00072672696636710917_0001.desc -rw-r--r-- 3 jenkins supergroup 15 2014-12-02 14:02 /lobs/LOBP_00072672696636711538_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 14:02 /lobs/LOBP_00072672696636711538_0001.desc -rw-r--r-- 3 jenkins supergroup 15 2014-12-02 14:02 /lobs/LOBP_00072672696636711538_0002 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 14:02 /lobs/LOBP_00072672696636711538_0002.desc -rw-r--r-- 3 jenkins supergroup 0 2014-12-02 12:58 /lobs/LOBP_00072672696636712527_0002 -rw-r--r-- 3 jenkins supergroup 16 2014-12-02 12:58 /lobs/LOBP_00072672696636712527_0002.desc -rw-r--r-- 3 jenkins supergroup 0 2014-11-27 17:25 /lobs/LOBP_00114330577209288636_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-11-27 17:25 /lobs/LOBP_00114330577209288636_0001.desc -rw-r--r-- 3 jenkins supergroup 14 2014-11-27 18:29 /lobs/LOBP_00114330577209290233_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-11-27 18:29 /lobs/LOBP_00114330577209290233_0001.desc -rw-r--r-- 3 jenkins supergroup 15 2014-11-27 18:29 /lobs/LOBP_00114330577209290933_0001 -rw-r--r-- 3 jenkins supergroup 16 2014-11-27 18:29 /lobs/LOBP_00114330577209290933_0001.desc -rw-r--r-- 3 jenkins supergroup 15 2014-11-27 18:29 /lobs/LOBP_00114330577209290933_0002 -rw-r--r-- 3 jenkins supergroup 16 2014-11-27 18:29 /lobs/LOBP_00114330577209290933_0002.desc -rw-r--r-- 3 jenkins supergroup 0 2014-11-27 17:25 /lobs/LOBP_00114330577209291965_0002 -rw-r--r-- 3 jenkins supergroup 16 2014-11-27 17:25 /lobs/LOBP_00114330577209291965_0002.desc -Steve From: Sundaresan, Sandhya Sent: Tuesday, December 02, 2014 12:45 To: Varnau, Steve (Trafodion); Johnson, Stacey; [email protected] Cc: Marton, Roberta S; Hanlon, Mike; Varshneya, Renu Subject: RE: Daily build 2014-12-02 08:30:00 UTC of trafodion/core -- Test Failures For executor/TEST130 - I thought Steve , you were going to ensure permissions were setup correctly. We exchanged emails on this last week. We need to be able to create a /lobs folder on hdfs just like /bulkload. catman/TEST137 - Mike or Roberta can you check if it's really a general filter issue ? I think you suspected that but why is only this test failing ? It happened after your change for QI. charset/TEST004 - I (Sandhya) will submit an expected file change by tomorrow. Thanks Sandhya From: Trafodion-firefighters [mailto:trafodion-firefighters-bounces+sandhya.sundaresan=hp....@lists.launchpad.net] On Behalf Of Varnau, Steve (Trafodion) Sent: Tuesday, December 02, 2014 10:59 AM To: Johnson, Stacey; [email protected]<mailto:[email protected]> Subject: Re: [Trafodion-firefighters] Daily build 2014-12-02 08:30:00 UTC of trafodion/core -- Test Failures Hi, I already did a look through the failures. There were 2 infrastructure problems that hit several jobs. 1) HDFS was not running on one of the cm5.1 nodes, which caused hbase clean-up/start not to work. I'm submitting a fix to check/start HDFS. 2) git got hung-up causing 3 jobs to hang/time-out. I've not seen this failure before, and am investigating this. There are several interesting failures that developers may want to look at: a) executor - TEST130 failed on hdp and cdh platforms. b) catman - TEST137 failed only on hdp. c) charset - TEST004 failed on cdh and cm platforms. d) phoenix_part1_T2 - one test failed on each of cdh and hdp, but different tests. -Steve From: Trafodion-firefighters [mailto:trafodion-firefighters-bounces+steve.varnau=hp....@lists.launchpad.net] On Behalf Of Johnson, Stacey Sent: Tuesday, December 02, 2014 10:49 To: [email protected]<mailto:[email protected]> Subject: [Trafodion-firefighters] Daily build 2014-12-02 08:30:00 UTC of trafodion/core -- Test Failures Build failed. - traf-pub-release http://logs.trafodion.org/daily/traf-pub-release/3d1570d : SUCCESS in 40m 47s - traf-pub-debug http://logs.trafodion.org/daily/traf-pub-debug/2c9f208 : SUCCESS in 29m 36s - core-regress-core-cdh5.1 http://logs.trafodion.org/daily/core-regress-core-cdh5.1/97e1d49 : FAILURE in 3h 01m 02s - core-regress-core-cm5.1 http://logs.trafodion.org/daily/core-regress-core-cm5.1/19262de : SUCCESS in 2h 24m 20s - core-regress-core-hdp2.1 http://logs.trafodion.org/daily/core-regress-core-hdp2.1/b04cf8c : FAILURE in 3h 00m 15s - core-regress-charsets-cdh5.1 http://logs.trafodion.org/daily/core-regress-charsets-cdh5.1/1db2ab2 : FAILURE in 1h 14m 46s - core-regress-charsets-cm5.1 http://logs.trafodion.org/daily/core-regress-charsets-cm5.1/ef36f64 : FAILURE in 1h 26m 46s - core-regress-charsets-hdp2.1 http://logs.trafodion.org/daily/core-regress-charsets-hdp2.1/5bb2b40 : FAILURE in 3h 00m 53s - core-regress-qat-cdh5.1 http://logs.trafodion.org/daily/core-regress-qat-cdh5.1/8cff54b : SUCCESS in 1h 05m 48s - core-regress-qat-cm5.1 http://logs.trafodion.org/daily/core-regress-qat-cm5.1/6aea915 : FAILURE in 38m 23s - core-regress-qat-hdp2.1 http://logs.trafodion.org/daily/core-regress-qat-hdp2.1/bc6d058 : SUCCESS in 1h 08m 54s - core-regress-udr-cdh5.1 http://logs.trafodion.org/daily/core-regress-udr-cdh5.1/bbacf61 : SUCCESS in 55m 11s - core-regress-udr-cm5.1 http://logs.trafodion.org/daily/core-regress-udr-cm5.1/fa91995 : FAILURE in 37m 40s - core-regress-udr-hdp2.1 http://logs.trafodion.org/daily/core-regress-udr-hdp2.1/fe9010f : SUCCESS in 56m 08s - core-regress-catman1-cdh5.1 http://logs.trafodion.org/daily/core-regress-catman1-cdh5.1/de6ed4e : SUCCESS in 1h 45m 33s - core-regress-catman1-cm5.1 http://logs.trafodion.org/daily/core-regress-catman1-cm5.1/ecef6e3 : FAILURE in 38m 27s - core-regress-catman1-hdp2.1 http://logs.trafodion.org/daily/core-regress-catman1-hdp2.1/cf5e907 : FAILURE in 1h 47m 52s - core-regress-compGeneral-cdh5.1 http://logs.trafodion.org/daily/core-regress-compGeneral-cdh5.1/8106e83 : SUCCESS in 1h 26m 23s - core-regress-compGeneral-cm5.1 http://logs.trafodion.org/daily/core-regress-compGeneral-cm5.1/d798d3b : SUCCESS in 1h 47m 37s - core-regress-compGeneral-hdp2.1 http://logs.trafodion.org/daily/core-regress-compGeneral-hdp2.1/ca7ed78 : SUCCESS in 1h 26m 28s - core-regress-executor-cdh5.1 http://logs.trafodion.org/daily/core-regress-executor-cdh5.1/66a5025 : FAILURE in 1h 37m 22s - core-regress-executor-cm5.1 http://logs.trafodion.org/daily/core-regress-executor-cm5.1/e9b2b3a : FAILURE in 38m 35s - core-regress-executor-hdp2.1 http://logs.trafodion.org/daily/core-regress-executor-hdp2.1/7221118 : FAILURE in 1h 35m 16s - core-regress-fullstack2-cdh5.1 http://logs.trafodion.org/daily/core-regress-fullstack2-cdh5.1/79e1d2f : SUCCESS in 41m 38s - core-regress-fullstack2-cm5.1 http://logs.trafodion.org/daily/core-regress-fullstack2-cm5.1/ee45a84 : SUCCESS in 1h 07m 37s - core-regress-fullstack2-hdp2.1 http://logs.trafodion.org/daily/core-regress-fullstack2-hdp2.1/857bd74 : SUCCESS in 43m 11s - core-regress-hive-cdh5.1 http://logs.trafodion.org/daily/core-regress-hive-cdh5.1/a9fa92f : SUCCESS in 1h 18m 25s - core-regress-hive-cm5.1 http://logs.trafodion.org/daily/core-regress-hive-cm5.1/53ff030 : FAILURE in 38m 07s - core-regress-hive-hdp2.1 http://logs.trafodion.org/daily/core-regress-hive-hdp2.1/4c7b396 : SUCCESS in 1h 24m 02s - core-regress-seabase-cdh5.1 http://logs.trafodion.org/daily/core-regress-seabase-cdh5.1/d20086b : SUCCESS in 1h 32m 37s - core-regress-seabase-cm5.1 http://logs.trafodion.org/daily/core-regress-seabase-cm5.1/11caf83 : FAILURE in 38m 01s - core-regress-seabase-hdp2.1 http://logs.trafodion.org/daily/core-regress-seabase-hdp2.1/df7e427 : SUCCESS in 1h 30m 39s - phoenix_part1_T4-cdh5.1 http://logs.trafodion.org/daily/phoenix_part1_T4-cdh5.1/738df1c : SUCCESS in 1h 41m 02s - phoenix_part2_T4-cdh5.1 http://logs.trafodion.org/daily/phoenix_part2_T4-cdh5.1/2400aef : SUCCESS in 1h 43m 08s - phoenix_part1_T4-cm5.1 http://logs.trafodion.org/daily/phoenix_part1_T4-cm5.1/4856cfe : SUCCESS in 2h 19m 47s - phoenix_part2_T4-cm5.1 http://logs.trafodion.org/daily/phoenix_part2_T4-cm5.1/b05699d : FAILURE in 2h 22m 00s - phoenix_part1_T4-hdp2.1 http://logs.trafodion.org/daily/phoenix_part1_T4-hdp2.1/d2de221 : SUCCESS in 1h 39m 24s - phoenix_part2_T4-hdp2.1 http://logs.trafodion.org/daily/phoenix_part2_T4-hdp2.1/b17525b : SUCCESS in 1h 40m 41s - phoenix_part1_T2-cdh5.1 http://logs.trafodion.org/daily/phoenix_part1_T2-cdh5.1/a66070b : FAILURE in 1h 59m 20s (non-voting) - phoenix_part2_T2-cdh5.1 http://logs.trafodion.org/daily/phoenix_part2_T2-cdh5.1/9befa78 : SUCCESS in 1h 53m 23s (non-voting) - phoenix_part1_T2-cm5.1 http://logs.trafodion.org/daily/phoenix_part1_T2-cm5.1/17479a9 : FAILURE in 29m 48s (non-voting) - phoenix_part2_T2-cm5.1 http://logs.trafodion.org/daily/phoenix_part2_T2-cm5.1/c792823 : FAILURE in 30m 22s (non-voting) - phoenix_part1_T2-hdp2.1 http://logs.trafodion.org/daily/phoenix_part1_T2-hdp2.1/24f6c4b : FAILURE in 1h 54m 33s (non-voting) - phoenix_part2_T2-hdp2.1 http://logs.trafodion.org/daily/phoenix_part2_T2-hdp2.1/704fc79 : SUCCESS in 1h 55m 06s (non-voting) - pyodbc_test-cdh5.1 http://logs.trafodion.org/daily/pyodbc_test-cdh5.1/cb882e3 : SUCCESS in 35m 50s - pyodbc_test-cm5.1 http://logs.trafodion.org/daily/pyodbc_test-cm5.1/c48281d : FAILURE in 29m 19s - pyodbc_test-hdp2.1 http://logs.trafodion.org/daily/pyodbc_test-hdp2.1/1fb4fe0 : SUCCESS in 38m 00s - jdbc_test-cdh5.1 http://logs.trafodion.org/daily/jdbc_test-cdh5.1/0af5132 : SUCCESS in 39m 58s - jdbc_test-cm5.1 http://logs.trafodion.org/daily/jdbc_test-cm5.1/bc89782 : FAILURE in 31m 11s - jdbc_test-hdp2.1 http://logs.trafodion.org/daily/jdbc_test-hdp2.1/30c6339 : SUCCESS in 39m 54s
-- Mailing list: https://launchpad.net/~trafodion-firefighters Post to : [email protected] Unsubscribe : https://launchpad.net/~trafodion-firefighters More help : https://help.launchpad.net/ListHelp
