[ https://issues.apache.org/jira/browse/SYSTEMML-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Boehm closed SYSTEMML-1977. ------------------------------------ Resolution: Fixed Assignee: Matthias Boehm Fix Version/s: SystemML 1.0 > Codegen spark row ops failing w/ index-out-of-bounds > ---------------------------------------------------- > > Key: SYSTEMML-1977 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1977 > Project: SystemML > Issue Type: Bug > Reporter: Matthias Boehm > Assignee: Matthias Boehm > Fix For: SystemML 1.0 > > > On Kmeans, the fusion heuristic fnr is failing with index of of bounds on > distributed (i.e., spark) codegen row operations. The root cause is misplaced > meta data management, that implicitly assumes that the first side input is > broadcast, which fails if this side input is also large and taken as an > additional rdd input. Specifically, its failing when executing the following > operator: > {code} > public final class TMP64 extends SpoofRowwise { > public TMP64() { > super(RowType.COL_AGG_B1_T, -1, false, 1); > } > protected void genexec(double[] a, int ai, SideInput[] b, double[] scalars, > double[] c, int len, int rix) { > LibSpoofPrimitives.vectOuterMultAdd(a, b[0].values(rix), c, ai, > b[0].pos(rix), 0, len, b[0].clen); > } > protected void genexec(double[] avals, int[] aix, int ai, SideInput[] b, > double[] scalars, double[] c, int alen, int len, int rix) { > LibSpoofPrimitives.vectOuterMultAdd(avals, b[0].values(rix), c, aix, ai, > b[0].pos(rix), 0, alen, len, b[0].clen); > } > } > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)