[ 
https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604999#comment-14604999
 ] 

ASF GitHub Bot commented on NUTCH-2038:
---------------------------------------

GitHub user asitang opened a pull request:

    https://github.com/apache/nutch/pull/38

    NUTCH-2038

    Made new changes suggested and corrections by Sebastian.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/asitang/nutch NUTCH-2038

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/nutch/pull/38.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #38
    
----
commit b0ce4a157dbd0bfd8ea368f3fa230a90c7117ae2
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-17T16:11:42Z

    patch 1.0 for NUTCH-2038

commit e243cc5e626106a4cd8dfca8d9c2ec93e9648560
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-17T16:14:37Z

    patch 1.0 for NUTCH-2038

commit 711f44d8d4af51538ff1764145ac743445b6f43b
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-17T16:35:28Z

    patch 1.0 for NUTCH-2038

commit e0e924e15c247d3fa3dd92f387fe53ba7effd78a
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-18T15:09:30Z

    final commir for pattch 1.0

commit cca768bc1c790a976594136433485fe899465cb8
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-19T20:13:34Z

    Patch 2.0 for NUTCH-2038

commit 0e80bf471b7d40965cf3bdad908252f5ce577d85
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-24T15:45:50Z

    commit for 3.0 patch of NUTCH-2038

commit 63efcfecd2eda339c3c55a6236cb88c7a08698bc
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-24T15:46:46Z

    commit for 3.0 patch of NUTCH-2038

commit 3a7bf466c76e8cffef96063101a39a77c328d657
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-24T15:55:22Z

    commit for 3.1 patch of NUTCH-2038

commit ae89456e9f4078111653273fe0ac52c26c568c36
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-24T15:58:12Z

    commit for 3.2 patch of NUTCH-2038

commit ae639ec40263fafbd6c0273c619d425ee482f7f0
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-24T17:31:09Z

    commit for 3.3 patch of NUTCH-2038

commit 5ba14790c1367deeb54d4d61f87be3d602cecedf
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-25T22:59:45Z

    patch 4.0 for NUTCH-2038

commit 4b5597a5fac0d3d94a38aace9b8a386d956da4e3
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-25T23:00:40Z

    patch 4.0 for NUTCH-2038

commit 9ebcae33284d325f86bdbcfa18ef2c9a5744e67d
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-25T23:05:20Z

    patch 4.1 for NUTCH-2038

commit 830f05bfe77abf79b2877c2a9c388fa24b3df526
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-25T23:07:44Z

    patch 4.1 for NUTCH-2038

commit 5e907b1109c8e623bfcdb25b4b467dd53fbec9f3
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-28T23:51:58Z

    Patch 5.0 for NUTCH-2038

commit b984cdfac2d30ef38b1aebbc0330ba7eee1e12bf
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-28T23:53:22Z

    Patch 5.0 for NUTCH-2038

commit ecbd4c27ae71b8c04e011c6b7106cc1fb324e04a
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-28T23:53:52Z

    Patch 5.0 for NUTCH-2038

commit aba64fc941ed7616153d19410dbe9b9a0f8ef387
Author: Asitang Mishra <asit...@gmail.com>
Date:   2015-06-29T00:03:43Z

    Patch 5.0 for NUTCH-2038

----


> Naive Bayes classifier based html Parse filter (for filtering outlinks)
> -----------------------------------------------------------------------
>
>                 Key: NUTCH-2038
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2038
>             Project: Nutch
>          Issue Type: New Feature
>          Components: fetcher, injector, parser
>            Reporter: Asitang Mishra
>            Assignee: Chris A. Mattmann
>              Labels: memex, nutch
>             Fix For: 1.11
>
>
> A html parse filter that will filter out the outlinks in two stages. 
> Classify the parse text and decide if the parent page is relevant. If 
> relevant then don't filter the outlinks. If irrelevant then go thru each 
> outlink and see if the url contains any of the important words from a list. 
> If it does then let it pass.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to