[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce API
[ https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Nagel updated NUTCH-1226: --- Fix Version/s: 1.15 > Migrate CrawlDbReader to MapReduce API > -- > > Key: NUTCH-1226 > URL: https://issues.apache.org/jira/browse/NUTCH-1226 > Project: Nutch > Issue Type: Sub-task >Reporter: Markus Jelsma >Assignee: Markus Jelsma >Priority: Minor > Fix For: 1.15 > > Attachments: NUTCH-1226-1.5-1.patch > > > Hadoop 0.21 only! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce API
[ https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma updated NUTCH-1226: - Fix Version/s: (was: 1.5) 1.6 20120304-push-1.6 > Migrate CrawlDbReader to MapReduce API > -- > > Key: NUTCH-1226 > URL: https://issues.apache.org/jira/browse/NUTCH-1226 > Project: Nutch > Issue Type: Sub-task >Reporter: Markus Jelsma >Assignee: Markus Jelsma >Priority: Minor > Fix For: 1.6 > > Attachments: NUTCH-1226-1.5-1.patch > > > Hadoop 0.21 only! -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce API
[
https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Markus Jelsma updated NUTCH-1226:
-
Attachment: NUTCH-1226-1.5-1.patch
First crack! Had a lot of trouble with some deprecated stuff and could not find
it all. Only remaining issue is finding the sequencefile readers.
{code}
[javac] Compiling 1 source file to
/home/markus/projects/apache/nutch/trunk/build/classes
[javac]
/home/markus/projects/apache/nutch/trunk/src/java/org/apache/nutch/crawl/CrawlDbReader.java:312:
cannot find symbol
[javac] symbol : method
getReaders(org.apache.hadoop.fs.Path,org.apache.hadoop.conf.Configuration)
[javac] location: class
org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat
[javac] SequenceFile.Reader[] readers =
SequenceFileOutputFormat.getReaders(tmpFolder, conf);
[javac] ^
[javac] Note:
/home/markus/projects/apache/nutch/trunk/src/java/org/apache/nutch/crawl/CrawlDbReader.java
uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error
{code}
> Migrate CrawlDbReader to MapReduce API
> --
>
> Key: NUTCH-1226
> URL: https://issues.apache.org/jira/browse/NUTCH-1226
> Project: Nutch
> Issue Type: Sub-task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Minor
> Fix For: 1.5
>
> Attachments: NUTCH-1226-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1226) Migrate CrawlDbReader to MapReduce API
[ https://issues.apache.org/jira/browse/NUTCH-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Jelsma updated NUTCH-1226: - Description: Hadoop 0.21 only! Patch Info: Patch Available > Migrate CrawlDbReader to MapReduce API > -- > > Key: NUTCH-1226 > URL: https://issues.apache.org/jira/browse/NUTCH-1226 > Project: Nutch > Issue Type: Sub-task >Reporter: Markus Jelsma >Assignee: Markus Jelsma >Priority: Minor > Fix For: 1.5 > > Attachments: NUTCH-1226-1.5-1.patch > > > Hadoop 0.21 only! -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
