[
https://issues.apache.org/jira/browse/FLINK-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15353421#comment-15353421
]
Greg Hogan commented on FLINK-3879:
-----------------------------------
Using CombineHint.HASH the HITS timings dropped from/to:
scale 10: 1,034 ms -> 1,106 ms
scale 12: 1,115 ms -> 1,090 ms
scale 14: 1,974 ms -> 1,608 ms
scale 16: 5,843 ms -> 3,841 ms
scale 18: 21,927 ms -> 13,345 ms
scale 20: 93,488 ms -> 54,570 ms
Impressive [~ggevay]!
> Native implementation of HITS algorithm
> ---------------------------------------
>
> Key: FLINK-3879
> URL: https://issues.apache.org/jira/browse/FLINK-3879
> Project: Flink
> Issue Type: New Feature
> Components: Gelly
> Affects Versions: 1.1.0
> Reporter: Greg Hogan
> Assignee: Greg Hogan
> Fix For: 1.1.0
>
>
> Hyperlink-Induced Topic Search (HITS, also "hubs and authorities") is
> presented in [0] and described in [1].
> "[HITS] is a very popular and effective algorithm to rank documents based on
> the link information among a set of documents. The algorithm presumes that a
> good hub is a document that points to many others, and a good authority is a
> document that many documents point to."
> [https://pdfs.semanticscholar.org/a8d7/c7a4c53a9102c4239356f9072ec62ca5e62f.pdf]
> This implementation differs from FLINK-2044 by providing for convergence,
> outputting both hub and authority scores, and completing in half the number
> of iterations.
> [0] http://www.cs.cornell.edu/home/kleinber/auth.pdf
> [1] https://en.wikipedia.org/wiki/HITS_algorithm
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
