[jira] Commented: (NUTCH-356) Plugin repository cache can lead to memory leak

[ http://issues.apache.org/jira/browse/NUTCH-356?page=comments#action_12431548 ] Enis Soztutar commented on NUTCH-356: - I observed strange behaviour, when one of the plug-ins could not be included. For example the plugin system fails to

[jira] Created: (NUTCH-389) a url tokenizer implementation for tokenizing index fields : url and host

a url tokenizer implementation for tokenizing index fields : url and host -- Key: NUTCH-389 URL: http://issues.apache.org/jira/browse/NUTCH-389 Project: Nutch Issue

[jira] Updated: (NUTCH-389) a url tokenizer implementation for tokenizing index fields : url and host

[ http://issues.apache.org/jira/browse/NUTCH-389?page=all ] Enis Soztutar updated NUTCH-389: Attachment: urlTokenizer.diff patch for url tokenization a url tokenizer implementation for tokenizing index fields : url and host

[jira] Updated: (NUTCH-389) a url tokenizer implementation for tokenizing index fields : url and host

[ http://issues.apache.org/jira/browse/NUTCH-389?page=all ] Enis Soztutar updated NUTCH-389: Description: NutchAnalysis.jj tokenizes the input by threating and _ as non token seperators, which is in the case of the urls not appropriate. So i have

[jira] Commented: (NUTCH-389) a url tokenizer implementation for tokenizing index fields : url and host

[ http://issues.apache.org/jira/browse/NUTCH-389?page=comments#action_12445512 ] Enis Soztutar commented on NUTCH-389: - Otis you can test the tokenizer using the TestUrlTokenizer junit test case. And you cab test the NutchDocumentTokenizer

[jira] Updated: (NUTCH-389) a url tokenizer implementation for tokenizing index fields : url and host

[ http://issues.apache.org/jira/browse/NUTCH-389?page=all ] Enis Soztutar updated NUTCH-389: Attachment: urlTokenizer-improved.diff This is an improvement and a minor bug fix over the previous url tokenizer. This version first replaces characters,

[jira] Commented: (NUTCH-393) Indexer doesn't handle null documents returned by filters

[ http://issues.apache.org/jira/browse/NUTCH-393?page=comments#action_12447787 ] Enis Soztutar commented on NUTCH-393: - Also IndexingException is catched by the Indexer, in which case the whole document is not added to the writer (the

[jira] Updated: (NUTCH-289) CrawlDatum should store IP address

[ http://issues.apache.org/jira/browse/NUTCH-289?page=all ] Enis Soztutar updated NUTCH-289: Attachment: ipInCrawlDatumDraftV5.1.patch The version 5 patch does not run on the current build. So i have fixed it and resend the patch(did not changed any

[jira] Updated: (NUTCH-251) Administration GUI

[ http://issues.apache.org/jira/browse/NUTCH-251?page=all ] Enis Soztutar updated NUTCH-251: Attachment: Nutch-251-AdminGUI.tar.gz I have updated the patch written by stephan. This version works with Nutch-0.9-dev and hadoop-0.7.1 (current version of

[jira] Created: (NUTCH-439) Top Level Domains Indexing / Scoring

Top Level Domains Indexing / Scoring Key: NUTCH-439 URL: https://issues.apache.org/jira/browse/NUTCH-439 Project: Nutch Issue Type: New Feature Components: indexer Affects Versions: 0.9.0

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: tld_plugin_v1.0.patch This is a plugin implementation for indexing and scoring top

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: tld_plugin_v1.1.patch I have forgotten to unset http.agent.name in the v1.0

[jira] Created: (NUTCH-445) Domain İndexing / Query Filter

Domain İndexing / Query Filter -- Key: NUTCH-445 URL: https://issues.apache.org/jira/browse/NUTCH-445 Project: Nutch Issue Type: New Feature Components: indexer, searcher Affects Versions: 0.9.0

[jira] Updated: (NUTCH-445) Domain İndexing / Query Filter

[ https://issues.apache.org/jira/browse/NUTCH-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-445: Attachment: index_query_domain_v1.0.patch Patch for index-domain and query-domain plugins.

[jira] Updated: (NUTCH-445) Domain İndexing / Query Filter

[ https://issues.apache.org/jira/browse/NUTCH-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-445: Attachment: TranslatingRawFieldQueryFilter_v1.0.patch This patch complements

[jira] Updated: (NUTCH-445) Domain İndexing / Query Filter

[ https://issues.apache.org/jira/browse/NUTCH-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-445: Attachment: index_query_domain_v1.2.patch This patch is an update of the previous three patches.

[jira] Created: (NUTCH-455) dedup on tokenized fields is faulty

dedup on tokenized fields is faulty --- Key: NUTCH-455 URL: https://issues.apache.org/jira/browse/NUTCH-455 Project: Nutch Issue Type: Bug Components: searcher Affects Versions: 0.9.0

[jira] Commented: (NUTCH-455) dedup on tokenized fields is faulty

[ https://issues.apache.org/jira/browse/NUTCH-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12479262 ] Enis Soztutar commented on NUTCH-455: - (from LUCENE-252) In nutch we have 3 options : 1st is to disallow

[jira] Commented: (NUTCH-466) Flexible segment format

[ https://issues.apache.org/jira/browse/NUTCH-466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12485977 ] Enis Soztutar commented on NUTCH-466: - This patch will indeed resolve many issues related to storing extra

[jira] Commented: (NUTCH-466) Flexible segment format

[ https://issues.apache.org/jira/browse/NUTCH-466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12485996 ] Enis Soztutar commented on NUTCH-466: - There may be many parts that use the same key/value classes in MapFiles.

[jira] Created: (NUTCH-471) Fix synchronization in NutchBean creation

Fix synchronization in NutchBean creation - Key: NUTCH-471 URL: https://issues.apache.org/jira/browse/NUTCH-471 Project: Nutch Issue Type: Bug Components: searcher Affects Versions:

[jira] Updated: (NUTCH-471) Fix synchronization in NutchBean creation

[ https://issues.apache.org/jira/browse/NUTCH-471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-471: Attachment: NutchBeanCreationSync_v1.patch this patch synchronizes NutchBean.get((ServletContext

[jira] Commented: (NUTCH-471) Fix synchronization in NutchBean creation

[ https://issues.apache.org/jira/browse/NUTCH-471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491313 ] Enis Soztutar commented on NUTCH-471: - Nice trick with the unsynchronized check. :) Wow, indeed i have used a

[jira] Commented: (NUTCH-475) Adaptive crawl delay

[ https://issues.apache.org/jira/browse/NUTCH-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491882 ] Enis Soztutar commented on NUTCH-475: - we can use a formula like : delay = alpha * delay + (1 - alpha) * (k *

[jira] Updated: (NUTCH-471) Fix synchronization in NutchBean creation

[ https://issues.apache.org/jira/browse/NUTCH-471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-471: Attachment: NutchBeanCreationSync_v2.patch From

[jira] Created: (NUTCH-510) IndexMerger delete working dir

IndexMerger delete working dir -- Key: NUTCH-510 URL: https://issues.apache.org/jira/browse/NUTCH-510 Project: Nutch Issue Type: Improvement Components: indexer Affects Versions: 1.0.0

[jira] Updated: (NUTCH-510) IndexMerger delete working dir

[ https://issues.apache.org/jira/browse/NUTCH-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-510: Attachment: index.merger.delete.temp.dirs.patch Attached patch deletes working dirs on finally

[jira] Issue Comment Edited: (NUTCH-510) IndexMerger delete working dir

[ https://issues.apache.org/jira/browse/NUTCH-510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511043 ] Enis Soztutar edited comment on NUTCH-510 at 7/9/07 5:32 AM: - Attached patch deletes

[jira] Commented: (NUTCH-508) ${hadoop.log.dir} and ${hadoop.log.file} are not propagated to the tasktracker

[ https://issues.apache.org/jira/browse/NUTCH-508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511121 ] Enis Soztutar commented on NUTCH-508: - Tasktracker invokes another jvm calling TaskTracker$Child but

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: tld_plugin_v2.0.patch I have made major improvements to the code and configuration

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: domain.suffixes_v2.1.patch Very nice patch! Thanks ! IP_PATTERN - it could be

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: (was: domain.suffixes_v2.1.patch) Top Level Domains Indexing / Scoring

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: tld_plugin_v2.1.patch Oops, it seems that i've uploaded the wrong file. This is the

[jira] Created: (NUTCH-518) Fix OpicScoringFilter to respect scoring filter chaining

Fix OpicScoringFilter to respect scoring filter chaining Key: NUTCH-518 URL: https://issues.apache.org/jira/browse/NUTCH-518 Project: Nutch Issue Type: Bug Components:

[jira] Updated: (NUTCH-517) build encoding should be UTF-8

[ https://issues.apache.org/jira/browse/NUTCH-517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-517: Attachment: build.encoding.patch Patch for UTF-8 is attached build encoding should be UTF-8

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: tld_plugin_v2.2.patch This patch includes core domain utilities and the tld plugin, but

[jira] Commented: (NUTCH-518) Fix OpicScoringFilter to respect scoring filter chaining

[ https://issues.apache.org/jira/browse/NUTCH-518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12513819 ] Enis Soztutar commented on NUTCH-518: - Since there is no ordering among scoring filters, if we do something

[jira] Commented: (NUTCH-518) Fix OpicScoringFilter to respect scoring filter chaining

[ https://issues.apache.org/jira/browse/NUTCH-518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12513826 ] Enis Soztutar commented on NUTCH-518: - I think removing initial score arguments and merging scores in

[jira] Updated: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-439: Attachment: tld_plugin_v2.3.patch bq. TLDScoringFilter contains a misspelled field, tldEnties, it

[jira] Created: (NUTCH-541) Index url field untokenized

Index url field untokenized --- Key: NUTCH-541 URL: https://issues.apache.org/jira/browse/NUTCH-541 Project: Nutch Issue Type: New Feature Components: indexer, searcher Affects Versions: 1.0.0

[jira] Commented: (NUTCH-439) Top Level Domains Indexing / Scoring

[ https://issues.apache.org/jira/browse/NUTCH-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12521033 ] Enis Soztutar commented on NUTCH-439: - Recently Matt Cutts have written about parts of the urls :

[jira] Commented: (NUTCH-442) Integrate Solr/Nutch

[ https://issues.apache.org/jira/browse/NUTCH-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534869 ] Enis Soztutar commented on NUTCH-442: - Using nutch with solr has been a very demanding request, so it will be

[jira] Commented: (NUTCH-442) Integrate Solr/Nutch

[ https://issues.apache.org/jira/browse/NUTCH-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537954 ] Enis Soztutar commented on NUTCH-442: - Due to the method signature bug

[jira] Commented: (NUTCH-574) Including inlink anchor text in index can create irrelevant search results.

[ https://issues.apache.org/jira/browse/NUTCH-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541326 ] Enis Soztutar commented on NUTCH-574: - Why don't you just refactor indexing anchor code into another plugin, say

[jira] Commented: (NUTCH-574) Including inlink anchor text in index can create irrelevant search results.

[ https://issues.apache.org/jira/browse/NUTCH-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541359 ] Enis Soztutar commented on NUTCH-574: - Honestly, i don't think not indexing anchor words that do not appear in

[jira] Assigned: (NUTCH-573) Multiple Domains - Query Search

[ https://issues.apache.org/jira/browse/NUTCH-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar reassigned NUTCH-573: --- Assignee: Enis Soztutar Multiple Domains - Query Search ---

[jira] Updated: (NUTCH-573) Multiple Domains - Query Search

[ https://issues.apache.org/jira/browse/NUTCH-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-573: Attachment: multiTermQuery_v1.patch Here is a patch that enables querying multiple values for the

[jira] Commented: (NUTCH-573) Multiple Domains - Query Search

[ https://issues.apache.org/jira/browse/NUTCH-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542389 ] Enis Soztutar commented on NUTCH-573: - bq. Using commas is IMHO not intuitive With your respect I should

[jira] Commented: (NUTCH-573) Multiple Domains - Query Search

[ https://issues.apache.org/jira/browse/NUTCH-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542449 ] Enis Soztutar commented on NUTCH-573: - @Andrzej I recall google over comma delimited syntax, but now it doesn't

[jira] Commented: (NUTCH-573) Multiple Domains - Query Search

[ https://issues.apache.org/jira/browse/NUTCH-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12543067 ] Enis Soztutar commented on NUTCH-573: - So, how shall we proceed with this one? I give +1 to commit this, and

[jira] Created: (NUTCH-583) FeedParser empty links for items

FeedParser empty links for items Key: NUTCH-583 URL: https://issues.apache.org/jira/browse/NUTCH-583 Project: Nutch Issue Type: Bug Affects Versions: 1.0.0 Reporter: Enis Soztutar

[jira] Updated: (NUTCH-586) Add option to run compiled classes w/o job file

[ https://issues.apache.org/jira/browse/NUTCH-586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-586: Attachment: run-core_v1.patch Attached file adds -core option to bin/nutch. Add option to run

[jira] Created: (NUTCH-586) Add option to run compiled classes w/o job file

Add option to run compiled classes w/o job file --- Key: NUTCH-586 URL: https://issues.apache.org/jira/browse/NUTCH-586 Project: Nutch Issue Type: New Feature Affects Versions: 1.0.0

[jira] Commented: (NUTCH-586) Add option to run compiled classes w/o job file

[ https://issues.apache.org/jira/browse/NUTCH-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12548198 ] Enis Soztutar commented on NUTCH-586: - Can someone review this ? Add option to run compiled classes w/o job

[jira] Updated: (NUTCH-586) Add option to run compiled classes w/o job file

[ https://issues.apache.org/jira/browse/NUTCH-586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated NUTCH-586: Attachment: run-core_v2.patch bq. I think you also need to put a comment, which clarifies that this

[jira] Resolved: (NUTCH-588) Help Need

[ https://issues.apache.org/jira/browse/NUTCH-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved NUTCH-588. - Resolution: Invalid Jira is not for asking questions. You should ask your questions on nutch-user

[jira] Commented: (NUTCH-442) Integrate Solr/Nutch

[ https://issues.apache.org/jira/browse/NUTCH-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637489#action_12637489 ] Enis Soztutar commented on NUTCH-442: - I personally believe this patch should be in

[jira] Created: (NUTCH-808) Evaluate ORM Frameworks which support non-relational column-oriented datastores and RDBMs

Evaluate ORM Frameworks which support non-relational column-oriented datastores and RDBMs -- Key: NUTCH-808 URL: https://issues.apache.org/jira/browse/NUTCH-808

[jira] Commented: (NUTCH-808) Evaluate ORM Frameworks which support non-relational column-oriented datastores and RDBMs

[ https://issues.apache.org/jira/browse/NUTCH-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852840#action_12852840 ] Enis Soztutar commented on NUTCH-808: - A candidate framework is DataNucleus. It has the

[jira] Commented: (NUTCH-808) Evaluate ORM Frameworks which support non-relational column-oriented datastores and RDBMs

[ https://issues.apache.org/jira/browse/NUTCH-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12856124#action_12856124 ] Enis Soztutar commented on NUTCH-808: - So, this is the results so far : DataNucleus

[jira] Commented: (NUTCH-808) Evaluate ORM Frameworks which support non-relational column-oriented datastores and RDBMs

[ https://issues.apache.org/jira/browse/NUTCH-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12856360#action_12856360 ] Enis Soztutar commented on NUTCH-808: - bq. What do you mean by current implementation?

[jira] Closed: (NUTCH-808) Evaluate ORM Frameworks which support non-relational column-oriented datastores and RDBMs

[ https://issues.apache.org/jira/browse/NUTCH-808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar closed NUTCH-808. --- Resolution: Fixed We have decided to go on with implementing an ORM layer as per the discussion on

[jira] Commented: (NUTCH-811) Develop an ORM framework

[ https://issues.apache.org/jira/browse/NUTCH-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865226#action_12865226 ] Enis Soztutar commented on NUTCH-811: - Hi Piet, The code for Gora will reside in GitHub