[
https://issues.apache.org/jira/browse/HIVE-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884175#comment-13884175
]
Brock Noland commented on HIVE-6310:
------------------------------------
I checked on the slave nodes and there is plenty of space.
{noformat}
[hiveptest@ip-10-74-94-52 ~]$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/xvde1 40G 4.7G 33G 13% /
{noformat}
Below is the error messages for the two failed tests. Both times there is a
runtime exception followed by some hadoop exceptions.
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-1059/failed/TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q/source/itests/qtest/target/tmp/history/done/version-1/localhost_1390912810566_/2014/01/28/000000/job_20140128044010447_0005_1390912971033_hiveptest_--+Test+join+on+three+tables+on+d...c.value%2529%2528Stage
{noformat}
Task TASKID="task_20140128044010447_0005_r_000000" TASK_TYPE="REDUCE"
START_TIME="1390912978019" SPLITS="" .
Task TASKID="task_20140128044010447_0005_r_000001" TASK_TYPE="REDUCE"
START_TIME="1390912978081" SPLITS="" .
Task TASKID="task_20140128044010447_0005_r_000002" TASK_TYPE="REDUCE"
START_TIME="1390912978117" SPLITS="" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_20140128044010447_0005_r_000000"
TASK_ATTEMPT_ID="attempt_20140128044010447_0005_r_000000_0"
START_TIME="1390912978026"
TRACKER_NAME="tracker_host0\.foo\.com:localhost/127\.0\.0\.1:60535"
HTTP_PORT="53633" LOCALITY="OFF_SWITCH" AVATAAR="VIRGIN" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_20140128044010447_0005_r_000000"
TASK_ATTEMPT_ID="attempt_20140128044010447_0005_r_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912983112" HOSTNAME="host0\.foo\.com"
ERROR="java\.lang\.IllegalArgumentException: Null user
at
org\.apache\.hadoop\.security\.UserGroupInformation\.createRemoteUser(UserGroupInformation\.java:887)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:241)
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044010447_0005_m_000000"
TASK_ATTEMPT_ID="attempt_20140128044010447_0005_m_000000_0"
START_TIME="1390912974953"
TRACKER_NAME="tracker_host0\.foo\.com:localhost/127\.0\.0\.1:60535"
HTTP_PORT="53633" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044010447_0005_m_000000"
TASK_ATTEMPT_ID="attempt_20140128044010447_0005_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912977965" HOSTNAME="host0\.foo\.com"
ERROR="Map output lost, rescheduling:
getMapOutput(attempt_20140128044010447_0005_m_000000_0,2) failed :
org\.apache\.hadoop\.util\.DiskChecker$DiskErrorException: Could not find
taskTracker/hiveptest/jobcache/job_20140128044010447_0005/attempt_20140128044010447_0005_m_000000_0/output/file\.out\.index
in any of the configured local directories
at
org\.apache\.hadoop\.fs\.LocalDirAllocator$AllocatorPerContext\.getLocalPathToRead(LocalDirAllocator\.java:429)
at
org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathToRead(LocalDirAllocator\.java:160)
at
org\.apache\.hadoop\.mapred\.TaskTracker$MapOutputServlet\.doGet(TaskTracker\.java:4053)
at javax\.servlet\.http\.HttpServlet\.service(HttpServlet\.java:707)
at javax\.servlet\.http\.HttpServlet\.service(HttpServlet\.java:820)
at
org\.mortbay\.jetty\.servlet\.ServletHolder\.handle(ServletHolder\.java:511)
at
org\.mortbay\.jetty\.servlet\.ServletHandler$CachedChain\.doFilter(ServletHandler\.java:1221)
at
org\.apache\.hadoop\.http\.HttpServer$QuotingInputFilter\.doFilter(HttpServer\.java:914)
at
org\.mortbay\.jetty\.servlet\.ServletHandler$CachedChain\.doFilter(ServletHandler\.java:1212)
at
org\.mortbay\.jetty\.servlet\.ServletHandler\.handle(ServletHandler\.java:399)
at
org\.mortbay\.jetty\.security\.SecurityHandler\.handle(SecurityHandler\.java:216)
at
org\.mortbay\.jetty\.servlet\.SessionHandler\.handle(SessionHandler\.java:182)
at
org\.mortbay\.jetty\.handler\.ContextHandler\.handle(ContextHandler\.java:766)
at
org\.mortbay\.jetty\.webapp\.WebAppContext\.handle(WebAppContext\.java:450)
at
org\.mortbay\.jetty\.handler\.ContextHandlerCollection\.handle(ContextHandlerCollection\.java:230)
at
org\.mortbay\.jetty\.handler\.HandlerWrapper\.handle(HandlerWrapper\.java:152)
at org\.mortbay\.jetty\.Server\.handle(Server\.java:322)
at
org\.mortbay\.jetty\.HttpConnection\.handleRequest(HttpConnection\.java:542)
at
org\.mortbay\.jetty\.HttpConnection$RequestHandler\.headerComplete(HttpConnection\.java:928)
at org\.mortbay\.jetty\.HttpParser\.parseNext(HttpParser\.java:549)
at org\.mortbay\.jetty\.HttpParser\.parseAvailable(HttpParser\.java:212)
at org\.mortbay\.jetty\.HttpConnection\.handle(HttpConnection\.java:404)
at
org\.mortbay\.io\.nio\.SelectChannelEndPoint\.run(SelectChannelEndPoint\.java:410)
at
org\.mortbay\.thread\.QueuedThreadPool$PoolThread\.run(QueuedThreadPool\.java:582)
" .
{noformat}
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-1059/failed/TestMinimrCliDriver-external_table_with_space_in_location_path.q-infer_bucket_sort_merge.q-auto_sortmerge_join_16.q-and-1-more/source/itests/qtest/target/tmp/history/done/version-1/localhost_1390912806507_/2014/01/28/000000/job_20140128044006356_0003_1390912970454_hiveptest_select+%250Aa.key+%252C+%250Aa.value+%252C+%250Ab.value...b.key%2529%2528Stage
{noformat}
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000003"
TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000003_0"
START_TIME="1390912978252"
TRACKER_NAME="tracker_host2\.foo\.com:localhost/127\.0\.0\.1:58706"
HTTP_PORT="37104" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000003"
TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000003_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912987227" HOSTNAME="host2\.foo\.com"
ERROR="java\.lang\.NullPointerException
at
org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.init(HiveInputFormat\.java:257)
at
org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.pushProjectionsAndFilters(HiveInputFormat\.java:439)
at
org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.pushProjectionsAndFilters(HiveInputFormat\.java:432)
at
org\.apache\.hadoop\.hive\.ql\.io\.BucketizedHiveInputFormat\.getRecordReader(BucketizedHiveInputFormat\.java:71)
at
org\.apache\.hadoop\.mapred\.MapTask$TrackedRecordReader\.<init>(MapTask\.java:191)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:412)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:366)
at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
at java\.security\.AccessController\.doPrivileged(Native Method)
at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
at
org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1190)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000006"
TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000006_0"
START_TIME="1390912978652"
TRACKER_NAME="tracker_host1\.foo\.com:localhost/127\.0\.0\.1:59914"
HTTP_PORT="45568" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000006"
TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000006_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912987977" HOSTNAME="host1\.foo\.com"
ERROR="org\.apache\.hadoop\.util\.DiskChecker$DiskErrorException: Could not
find any valid local directory for output/spill0\.out
at
org\.apache\.hadoop\.fs\.LocalDirAllocator$AllocatorPerContext\.getLocalPathForWrite(LocalDirAllocator\.java:381)
at
org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathForWrite(LocalDirAllocator\.java:146)
at
org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathForWrite(LocalDirAllocator\.java:127)
at
org\.apache\.hadoop\.mapred\.MapOutputFile\.getSpillFileForWrite(MapOutputFile\.java:121)
at
org\.apache\.hadoop\.mapred\.MapTask$MapOutputBuffer\.sortAndSpill(MapTask\.java:1397)
at
org\.apache\.hadoop\.mapred\.MapTask$MapOutputBuffer\.flush(MapTask\.java:1303)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:431)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:366)
at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
at java\.security\.AccessController\.doPrivileged(Native Method)
at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
at
org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1190)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
{noformat}
> Fix a few minimr test failures
> ------------------------------
>
> Key: HIVE-6310
> URL: https://issues.apache.org/jira/browse/HIVE-6310
> Project: Hive
> Issue Type: Bug
> Components: Testing Infrastructure
> Affects Versions: 0.13.0
> Reporter: Xuefu Zhang
> Assignee: Xuefu Zhang
> Attachments: HIVE-6310.1.patch, HIVE-6310.2.patch, HIVE-6310.patch
>
>
> These test cases are:
> {code}
> ql/src/test/queries/clientpositive/import_exported_table.q
> ql/src/test/queries/clientpositive/load_hdfs_file_with_space_in_the_name.q
> ql/src/test/queries/clientpositive/root_dir_external_table.q
> {code}
> They are failing because of existing hdfs:///tmp/test, possible left over by
> other tests.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
