Mike Smith wrote:
Hi Dennis,
But it doesn't make sense since the reducers' keys are URLs and the
heartbeat cannot be sent when the reduce task is called. Since I am
truncating my http content to be less than 100K and I don't get any file,
how come reducing a single record which is a single URL and writing its
parsed data into DFS takes more than 10 min!! Even if you load the
cluster
that should never happen. There should be another bug involved.
Could you try to produce a thread dump of a task in such state? (kill
-SIGQUIT pid)
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
