[
https://issues.apache.org/jira/browse/NUTCH-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750493#comment-13750493
]
Alex McLintock commented on NUTCH-1477:
---------------------------------------
Hi Folks, I've tried the patch using Nutch 2.2.1 released source, and Gora 0.4
SNAPSHOT (today's trunk) and it doesn't compile for me. Can someone confirm the
patch still works for them?
compile-core:
[javac] Compiling 109 source files to
/home/alex/projects/benrush/apache-nutch-2.2.1/build/classes
[javac]
/home/alex/projects/benrush/apache-nutch-2.2.1/src/java/org/apache/nutch/fetcher/FetcherReducer.java:345:
cannot find symbol
[javac] symbol : method getInt(java.lang.String,int)
[javac] location: class org.apache.nutch.storage.Host
[javac] host.getInt("q_mt",
maxThreads),
[javac] ^
[javac]
/home/alex/projects/benrush/apache-nutch-2.2.1/src/java/org/apache/nutch/fetcher/FetcherReducer.java:346:
cannot find symbol
[javac] symbol : method getLong(java.lang.String,long)
[javac] location: class org.apache.nutch.storage.Host
[javac] host.getLong("q_cd",
crawlDelay),
[javac] ^
[javac]
/home/alex/projects/benrush/apache-nutch-2.2.1/src/java/org/apache/nutch/fetcher/FetcherReducer.java:347:
cannot find symbol
[javac] symbol : method getLong(java.lang.String,long)
[javac] location: class org.apache.nutch.storage.Host
[javac] host.getLong("q_mcd",
minCrawlDelay));
[javac] ^
[javac]
/home/alex/projects/benrush/apache-nutch-2.2.1/src/java/org/apache/nutch/parse/ParserChecker.java:114:
cannot find symbol
[javac] symbol : method isSuccess()
[javac] location: class org.apache.nutch.storage.ProtocolStatus
[javac] if(!protocolOutput.getStatus().isSuccess()) {
[javac] ^
[javac] Note:
/home/alex/projects/benrush/apache-nutch-2.2.1/src/java/org/apache/nutch/storage/Host.java
uses unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 4 errors
> NPE when injecting with DataFileAvroStore
> -----------------------------------------
>
> Key: NUTCH-1477
> URL: https://issues.apache.org/jira/browse/NUTCH-1477
> Project: Nutch
> Issue Type: Bug
> Components: storage
> Affects Versions: 2.1
> Environment: Java 1.6.0_35
> Reporter: Mike Baranczak
> Assignee: Julien Nioche
> Priority: Critical
> Fix For: 2.4
>
> Attachments: gora-core-0.2.1.jar, NUTCH-1477.patch, webpage.avsc,
> webpage.avsc, webpage.avsc, webpage.avsc
>
>
> Fresh installation of Nutch 2.1, configured to use DataFileAvroStore.
> Injection job throws NullPointerException, see below. No error when I switch
> to MemStore.
> java.lang.NullPointerException
> at org.apache.avro.io.BinaryEncoder.writeString(BinaryEncoder.java:133)
> at
> org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:176)
> at
> org.apache.avro.generic.GenericDatumWriter.writeString(GenericDatumWriter.java:171)
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:72)
> at
> org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:89)
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:62)
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:55)
> at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:245)
> at
> org.apache.gora.avro.store.DataFileAvroStore.put(DataFileAvroStore.java:54)
> at
> org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:639)
> at
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> at
> org.apache.nutch.crawl.InjectorJob$UrlMapper.map(InjectorJob.java:185)
> at org.apache.nutch.crawl.InjectorJob$UrlMapper.map(InjectorJob.java:85)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
