stream-lib?? It comes with Spark and T-digest is part of Stream-lib. But we may need to package that separately (as is being done since 0.9) for Mrlegacy.
On Tue, Mar 31, 2015 at 7:31 PM, Andrew Palumbo <[email protected]> wrote: > > Is it on the classpath in our version? > > > On 03/31/2015 07:19 PM, Suneel Marthi wrote: > >> oh yes!! Stream-lib from AddThis. So do we stop including T-digest >> separately then? The legacy clustering code is using T-digest, may be we >> package t-figest separately in mrlegacy and not mahout-spark. >> >> On Tue, Mar 31, 2015 at 7:08 PM, Dmitriy Lyubimov <[email protected]> >> wrote: >> >> FYI t-digest is now is also part of spark classpath, part of stream-lib. >>> >>> On Tue, Mar 31, 2015 at 4:05 PM, Suneel Marthi (JIRA) <[email protected]> >>> wrote: >>> >>> [ >>>> >>>> https://issues.apache.org/jira/browse/MAHOUT-1655?page= >>> com.atlassian.jira.plugin.system.issuetabpanels:comment- >>> tabpanel&focusedCommentId=14389588#comment-14389588 >>> >>>> ] >>>> >>>> Suneel Marthi commented on MAHOUT-1655: >>>> --------------------------------------- >>>> >>>> Speaking of t-digest, it needs to be updated to the latest version. >>>> T-Digest was first added in 0.9 for Cluster Quality summarizers. >>>> >>>> Refactor module dependencies >>>>> ---------------------------- >>>>> >>>>> Key: MAHOUT-1655 >>>>> URL: https://issues.apache.org/ >>>>> jira/browse/MAHOUT-1655 >>>>> Project: Mahout >>>>> Issue Type: Improvement >>>>> Components: mrlegacy >>>>> Affects Versions: 0.9 >>>>> Reporter: Pat Ferrel >>>>> Assignee: Andrew Musselman >>>>> Priority: Critical >>>>> Fix For: 0.10.0 >>>>> >>>>> >>>>> Make a new module, call it mahout-hadoop. Move anything there that is >>>>> >>>> currently in mrlegacy but used in math-scala or spark. Remove >>>> >>> dependencies >>> >>>> on mrlegacy altogether if possible by using other core classes. >>>> >>>>> The goal is to have math-scala and spark module depend on math, and a >>>>> >>>> small module called mahout-hadoop (much smaller than mrlegacy). >>>> >>>> >>>> >>>> -- >>>> This message was sent by Atlassian JIRA >>>> (v6.3.4#6332) >>>> >>>> >
