After I made sure that the version of lucene in nutch 1.2 and solr 1.4 (I downgraded nutch to the version in solr 1.4) was the same I was able to get solrindex to run. After switching lock type to native, I was able to use multiple map reduce tasks (at least I don't get connection refused errors that I had in nutch 1.0), however I just got a strange error:
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201011071953_0001_r_000000" TASK_ATTEMPT_ID="attempt_201011071953_0001_r_000000_0" TASK_STATUS="FAILED" FINISH_TIME="1289179629246" HOSTNAME="search1" ERROR="org\.apache\.solr\.c ommon\.SolrException: Severe errors in solr configuration\. Check your log files for more detailed information on what may be wrong\. If you want solr to continue after configuration errors, change: <abortOnConfigurationError>false</abortOnConfigurationError> in solrconfig\.xml ------------------------------------------------------------- java\.lang\.RuntimeException: java\.io\.IOException: Cannot create directory: /nutchnew/crawl/spellCheckerDefault at org\.apache\.solr\.spelling\.AbstractLuceneSpellChecker\.init(AbstractLuceneSpellChecker\.java:104) at org\.apache\.solr\.spelling\.IndexBasedSpellChecker\.init(IndexBasedSpellChecker\.java:56) at org\.apache\.solr\.handler\.component\.SpellCheckComponent\.inform(SpellCheckComponent\.java:274) at org\.apache\.solr\.core\.SolrResourceLoader\.inform(SolrResourceLoader\.java:486) at org\.apache\.solr\.core\.SolrCore\.<init>(SolrCore\.java:588) at org\.apache\.solr\.core\.CoreContainer$Initializer\.initialize(CoreContainer\.java:137) at org\.apache\.solr\.servlet\.SolrDispatchFilter\.init(SolrDispatchFilter\.java:83) at org\.apache\.catalina\.core\.ApplicationFilterConfig\.getFilter(ApplicationFilterConfig\.java:259) at org\.apache\.catalina\.core\.ApplicationFilterChain\.internalDoFilter(ApplicationFilterChain\.java:237) at org\.apache\.catalina\.core\.ApplicationFilterChain\.doFilter(ApplicationFilterChain\.java:215) at org\.apache\.catalina\.core\.StandardWrapperValve\.invoke(StandardWrapperValve\.java:277) at org\.apache\.catalin What's strange about the error is that it did create the spellCheckerDefault directory. drwxr-sr-x 3 glassfish gfadmin 1024 Nov 7 18:58 crawldb drwxrwsr-x 2 glassfish gfadmin 1024 Nov 7 19:52 index drwxrwsr-x 3 glassfish gfadmin 1024 Nov 7 19:04 linkdb drwxr-sr-x 17 glassfish gfadmin 1024 Nov 7 18:52 segments drwxrwsr-x 2 glassfish gfadmin 1024 Nov 7 20:26 spellchecker2 drwxrwsr-x 2 glassfish gfadmin 1024 Nov 7 20:34 spellCheckerDefault I am wondering if the map reduce task that tried to create the directory failed because the directory had been created by another mapreduce task, but since its make directory failed it reported a failure and shutdown. Shouldn't it check to see if the directory is there before it tries to create it? Thanks, Steve Cohen
