Hi Doug, On Sat, Feb 28, 2009 at 7:29 PM, Doug Judd <[email protected]> wrote: > Hi Mateusz, > > The 63658 is the scanner ID. The error message is not very descriptive. I > will fix it now. But basically, the error was INVALID_SCANNER_ID. It may > have been deleted due to inactivity, given that you see these errors in your > log: > > Destroying scanner 26999 because it has not been used in 120000 > > Is it possible that you're overloading the RangeServer with query requests > and it is getting bogged down? This last error looks very strange: > > 1235831665 FATAL Hypertable.RangeServer : > (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/CellStoreScannerV0.cc:372) > Problem checking out block from cache file_id=15, offset=897365 > > Can you post your config file and the HQL statements that you used to create > your tables (or do a "SHOW CREATE TABLE")?
I am having two tables, one is called tweets, the other is called twitter_word_index. Their schemas are as follows CREATE TABLE tweets ( text, date, ACCESS GROUP default (text, date) ) CREATE TABLE twitter_word_index ( locations MAX_VERSIONS=2, meta MAX_VERSIONS=1, ACCESS GROUP default (locations, meta) ) What I am doing is doing a complete pass over a whole tweets table and getting text column only. This text column is then tokenized and for each token I am looking it up in twitter_word_index table, using this particular token as a row key. I am then updating the row with a pair of tweet id and an offset within the tweet. I am not doing explicit flushes on the mutator. I understand that this method is not the most effective one for constructing an index but it also does not result in huge load on the hypertable. It just suddenly stops working. Could you suggest any other way for achieving the similar effect? I'm running this on a x86_64 single node setup with a local fs. Mateusz I'm doing a full table pass over tweets > > - Doug > > On Sat, Feb 28, 2009 at 7:50 AM, Mateusz Berezecki <[email protected]> > wrote: >> >> Hi List, >> >> I figured out I should be a bit more specific and here's the console >> output after running my application: >> >> 1235831730 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT from=91.193.185.50:38060; Problem connecting to >> Root RangeServer, will retry in 8000 milliseconds... >> 1235831733 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831733 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831734 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831734 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831736 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831736 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831738 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831738 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831738 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT "COMM connect error" from=91.193.185.50:38060; >> Problem connecting to Root RangeServer, will retry in 8000 >> milliseconds... >> 1235831741 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831741 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831746 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT "COMM connect error" from=91.193.185.50:38060; >> Problem connecting to Root RangeServer, will retry in 8000 >> milliseconds... >> 1235831746 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831746 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831754 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831754 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831754 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT "COMM connect error" from=91.193.185.50:38060; >> Problem connecting to Root RangeServer, will retry in 8000 >> milliseconds... >> 1235831762 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT "COMM connect error" from=91.193.185.50:38060; >> Problem connecting to Root RangeServer, will retry in 8000 >> milliseconds... >> 1235831765 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831765 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831770 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT "COMM connect error" from=91.193.185.50:38060; >> Problem connecting to Root RangeServer, will retry in 8000 >> milliseconds... >> 1235831778 INFO corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/ConnectionManager.cc:272) >> Event: type=DISCONNECT "COMM connect error" from=91.193.185.50:38060; >> Problem connecting to Root RangeServer, will retry in 8000 >> milliseconds... >> 1235831783 ERROR corpusgen : >> (/home/mateusz/hypertable/src/cc/AsyncComm/Comm.cc:214) No connection >> for 91.193.185.50:38060 >> 1235831783 WARN corpusgen : >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:300) >> Comm::send_request to 91.193.185.50:38060 failed - COMM not connected >> 1235831783 ERROR corpusgen : dump_error_history >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.h:132): >> Hypertable::Exception: Problem creating scanner for start row >> '0:22:http' on METADATA[..??] - COMM not connected >> at int Hypertable::RangeLocator::find(const >> Hypertable::TableIdentifier*, const char*, >> Hypertable::RangeLocationInfo*, Hypertable::Timer&, bool) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.cc:293) >> at void Hypertable::RangeServerClient::send_message(const >> sockaddr_in&, Hypertable::CommBufPtr&, Hypertable::DispatchHandler*) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:302): >> Comm::send_request to 91.193.185.50:38060 failed >> 1235831783 ERROR corpusgen : dump_error_history >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.h:132): >> Hypertable::Exception: Problem creating scanner for start row >> '0:22:http' on METADATA[..??] - COMM not connected >> at int Hypertable::RangeLocator::find(const >> Hypertable::TableIdentifier*, const char*, >> Hypertable::RangeLocationInfo*, Hypertable::Timer&, bool) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.cc:293) >> at void Hypertable::RangeServerClient::send_message(const >> sockaddr_in&, Hypertable::CommBufPtr&, Hypertable::DispatchHandler*) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:302): >> Comm::send_request to 91.193.185.50:38060 failed >> 1235831783 ERROR corpusgen : dump_error_history >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.h:132): >> Hypertable::Exception: Problem creating scanner for start row >> '0:22:http' on METADATA[..??] - COMM not connected >> at int Hypertable::RangeLocator::find(const >> Hypertable::TableIdentifier*, const char*, >> Hypertable::RangeLocationInfo*, Hypertable::Timer&, bool) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.cc:293) >> at void Hypertable::RangeServerClient::send_message(const >> sockaddr_in&, Hypertable::CommBufPtr&, Hypertable::DispatchHandler*) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:302): >> Comm::send_request to 91.193.185.50:38060 failed >> 1235831783 ERROR corpusgen : dump_error_history >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.h:132): >> Hypertable::Exception: Problem creating scanner for start row >> '0:22:http' on METADATA[..??] - COMM not connected >> at int Hypertable::RangeLocator::find(const >> Hypertable::TableIdentifier*, const char*, >> Hypertable::RangeLocationInfo*, Hypertable::Timer&, bool) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeLocator.cc:293) >> at void Hypertable::RangeServerClient::send_message(const >> sockaddr_in&, Hypertable::CommBufPtr&, Hypertable::DispatchHandler*) >> (/home/mateusz/hypertable/src/cc/Hypertable/Lib/RangeServerClient.cc:302): >> Comm::send_request to 91.193.185.50:38060 failed >> terminate called after throwing an instance of 'Hypertable::Exception' >> what(): Locating range for row='http' >> Aborted >> >> The Master complains in a log file about RangeServer being offline, >> while the last lines >> of the RangeServer log file are >> >> 1235831614 WARN Hypertable.RangeServer : >> (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/ScannerMap.cc:78) >> Destroying scanner 26997 because it has not been used in 120000 >> milliseconds >> 1235831614 WARN Hypertable.RangeServer : >> (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/ScannerMap.cc:78) >> Destroying scanner 26998 because it has not been used in 120000 >> milliseconds >> 1235831614 WARN Hypertable.RangeServer : >> (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/ScannerMap.cc:78) >> Destroying scanner 26999 because it has not been used in 120000 >> milliseconds >> 1235831614 INFO Hypertable.RangeServer : >> >> (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/RangeServer.cc:1915) >> Memory Usage: 80250544 bytes >> 1235831614 INFO Hypertable.RangeServer : >> >> (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/RangeServer.cc:1972) >> Cleaning log (threshold=486308100) >> 1235831665 FATAL Hypertable.RangeServer : >> >> (/home/mateusz/hypertable/src/cc/Hypertable/RangeServer/CellStoreScannerV0.cc:372) >> Problem checking out block from cache file_id=15, offset=897365 >> >> And in the attachment there's a code I am running when this happens. >> Is this my code's fault or a hypertable bug? >> >> Mateusz >> >> > > > > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/hypertable-dev?hl=en -~----------~----~----~----~------~----~------~--~---
