[jira] [Created] (SPARK-1552) GraphX performs type comparison incorrectly

Ankur Dave created SPARK-1552: - Summary: GraphX performs type comparison incorrectly Key: SPARK-1552 URL: https://issues.apache.org/jira/browse/SPARK-1552 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1552) GraphX performs type comparison incorrectly

[ https://issues.apache.org/jira/browse/SPARK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1552: -- Description: In GraphImpl, mapVertices and outerJoinVertices use a more efficient implementation when

[jira] [Updated] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1931: -- Description: Commit 905173df57b90f90ebafb22e43f55164445330e6 introduced a bug in partitionBy where,

[jira] [Created] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

Ankur Dave created SPARK-1931: - Summary: Graph.partitionBy does not reconstruct routing tables Key: SPARK-1931 URL: https://issues.apache.org/jira/browse/SPARK-1931 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008985#comment-14008985 ] Ankur Dave commented on SPARK-1931: --- The fix is in PR #885:

[jira] [Issue Comment Deleted] (SPARK-1750) EdgePartition is not serialized properly

[ https://issues.apache.org/jira/browse/SPARK-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1750: -- Comment: was deleted (was: Resolved in PR #742: https://github.com/apache/spark/pull/742)

[jira] [Resolved] (SPARK-1750) EdgePartition is not serialized properly

[ https://issues.apache.org/jira/browse/SPARK-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-1750. --- Resolution: Fixed Fix Version/s: 1.0.0 https://github.com/apache/spark/pull/742

[jira] [Commented] (SPARK-1750) EdgePartition is not serialized properly

[ https://issues.apache.org/jira/browse/SPARK-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008988#comment-14008988 ] Ankur Dave commented on SPARK-1750: --- Resolved in PR #742:

[jira] [Commented] (SPARK-1577) GraphX mapVertices with KryoSerialization

[ https://issues.apache.org/jira/browse/SPARK-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008992#comment-14008992 ] Ankur Dave commented on SPARK-1577: --- Resolved by re-enabling Kryo reference tracking in

[jira] [Commented] (SPARK-1329) ArrayIndexOutOfBoundsException if graphx.Graph has more edge partitions than node partitions

[ https://issues.apache.org/jira/browse/SPARK-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008994#comment-14008994 ] Ankur Dave commented on SPARK-1329: --- This was resolved by #368:

[jira] [Commented] (SPARK-1311) Use map side distinct in collect vertex ids from edges graphx

[ https://issues.apache.org/jira/browse/SPARK-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008997#comment-14008997 ] Ankur Dave commented on SPARK-1311: --- This was resolved by PR #497, which removed

[jira] [Resolved] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-1931. --- Resolution: Fixed Fix Version/s: 1.0.0 Graph.partitionBy does not reconstruct routing tables

[jira] [Updated] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1931: -- Description: Commit 905173df57b90f90ebafb22e43f55164445330e6 introduced a bug in partitionBy where,

[jira] [Updated] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1931: -- Description: Commit 905173df57b90f90ebafb22e43f55164445330e6 introduced a bug in partitionBy where,

[jira] [Updated] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1931: -- Description: Commit 905173df57b90f90ebafb22e43f55164445330e6 introduced a bug in partitionBy where,

[jira] [Commented] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010340#comment-14010340 ] Ankur Dave commented on SPARK-1931: --- Since the fix didn't make it into Spark 1.0.0, a

[jira] [Comment Edited] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010340#comment-14010340 ] Ankur Dave edited comment on SPARK-1931 at 5/27/14 9:47 PM:

[jira] [Created] (SPARK-1955) VertexRDD can incorrectly assume index sharing

Ankur Dave created SPARK-1955: - Summary: VertexRDD can incorrectly assume index sharing Key: SPARK-1955 URL: https://issues.apache.org/jira/browse/SPARK-1955 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1501) Assertions in Graph.apply test are never executed

[ https://issues.apache.org/jira/browse/SPARK-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-1501. --- Resolution: Fixed Assignee: William Benton Assertions in Graph.apply test are never executed

[jira] [Created] (SPARK-1986) lib.Analytics should be in org.apache.spark.examples

Ankur Dave created SPARK-1986: - Summary: lib.Analytics should be in org.apache.spark.examples Key: SPARK-1986 URL: https://issues.apache.org/jira/browse/SPARK-1986 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1986) lib.Analytics should be in org.apache.spark.examples

[ https://issues.apache.org/jira/browse/SPARK-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1986: -- Issue Type: Improvement (was: Bug) lib.Analytics should be in org.apache.spark.examples

[jira] [Created] (SPARK-1988) Enable storing edges out-of-core

Ankur Dave created SPARK-1988: - Summary: Enable storing edges out-of-core Key: SPARK-1988 URL: https://issues.apache.org/jira/browse/SPARK-1988 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-1991) Support custom StorageLevels for vertices and edges

Ankur Dave created SPARK-1991: - Summary: Support custom StorageLevels for vertices and edges Key: SPARK-1991 URL: https://issues.apache.org/jira/browse/SPARK-1991 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-1991) Support custom StorageLevels for vertices and edges

[ https://issues.apache.org/jira/browse/SPARK-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-1991. --- Resolution: Fixed Fix Version/s: 1.1.0 Resolved by https://github.com/apache/spark/pull/946

[jira] [Created] (SPARK-2011) Eliminate duplicate join in Pregel

Ankur Dave created SPARK-2011: - Summary: Eliminate duplicate join in Pregel Key: SPARK-2011 URL: https://issues.apache.org/jira/browse/SPARK-2011 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1552) GraphX performs type comparison incorrectly

[ https://issues.apache.org/jira/browse/SPARK-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017340#comment-14017340 ] Ankur Dave commented on SPARK-1552: --- Proposed fix:

[jira] [Assigned] (SPARK-2025) EdgeRDD persists after pregel iteration

[ https://issues.apache.org/jira/browse/SPARK-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reassigned SPARK-2025: - Assignee: Ankur Dave EdgeRDD persists after pregel iteration

[jira] [Commented] (SPARK-2025) EdgeRDD persists after pregel iteration

[ https://issues.apache.org/jira/browse/SPARK-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018402#comment-14018402 ] Ankur Dave commented on SPARK-2025: --- Proposed fix:

[jira] [Updated] (SPARK-1988) Enable storing edges out-of-core

[ https://issues.apache.org/jira/browse/SPARK-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-1988: -- Priority: Minor (was: Major) Enable storing edges out-of-core

[jira] [Updated] (SPARK-2011) Eliminate duplicate join in Pregel

[ https://issues.apache.org/jira/browse/SPARK-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-2011: -- Priority: Minor (was: Major) Eliminate duplicate join in Pregel --

[jira] [Resolved] (SPARK-1988) Enable storing edges out-of-core

[ https://issues.apache.org/jira/browse/SPARK-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-1988. --- Resolution: Fixed This is mitigated by SPARK-1991, because the user can increase the number of edge

[jira] [Updated] (SPARK-2062) VertexRDD.apply does not use the mergeFunc

[ https://issues.apache.org/jira/browse/SPARK-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-2062: -- Component/s: GraphX VertexRDD.apply does not use the mergeFunc

[jira] [Created] (SPARK-2062) VertexRDD.apply does not use the mergeFunc

Ankur Dave created SPARK-2062: - Summary: VertexRDD.apply does not use the mergeFunc Key: SPARK-2062 URL: https://issues.apache.org/jira/browse/SPARK-2062 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

Ankur Dave created SPARK-2365: - Summary: Add IndexedRDD, an efficient updatable key-value store Key: SPARK-2365 URL: https://issues.apache.org/jira/browse/SPARK-2365 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052127#comment-14052127 ] Ankur Dave commented on SPARK-2365: --- Proposed implementation:

[jira] [Created] (SPARK-2374) Pattern matching of paths in graphs

Ankur Dave created SPARK-2374: - Summary: Pattern matching of paths in graphs Key: SPARK-2374 URL: https://issues.apache.org/jira/browse/SPARK-2374 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-2374) Pattern matching of paths in graphs

[ https://issues.apache.org/jira/browse/SPARK-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052831#comment-14052831 ] Ankur Dave commented on SPARK-2374: --- Proposed implementation:

[jira] [Created] (SPARK-2455) VertexPartition is not serializable

Ankur Dave created SPARK-2455: - Summary: VertexPartition is not serializable Key: SPARK-2455 URL: https://issues.apache.org/jira/browse/SPARK-2455 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2455) VertexPartition is not serializable

[ https://issues.apache.org/jira/browse/SPARK-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059436#comment-14059436 ] Ankur Dave commented on SPARK-2455: --- Proposed fix:

[jira] [Updated] (SPARK-2374) Pattern matching of paths in graphs

[ https://issues.apache.org/jira/browse/SPARK-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-2374: -- Target Version/s: (was: 1.1.0) Pattern matching of paths in graphs

[jira] [Commented] (SPARK-2347) Graph object can not be set to StorageLevel.MEMORY_ONLY_SER

[ https://issues.apache.org/jira/browse/SPARK-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062783#comment-14062783 ] Ankur Dave commented on SPARK-2347: --- SPARK-2455 should have fixed this, so I'm closing

[jira] [Resolved] (SPARK-2347) Graph object can not be set to StorageLevel.MEMORY_ONLY_SER

[ https://issues.apache.org/jira/browse/SPARK-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-2347. --- Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Ankur Dave Graph object can not be

[jira] [Commented] (SPARK-1955) VertexRDD can incorrectly assume index sharing

[ https://issues.apache.org/jira/browse/SPARK-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062792#comment-14062792 ] Ankur Dave commented on SPARK-1955: --- IndexedRDD fixes this issue. VertexRDD can

[jira] [Updated] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-2365: -- Attachment: 2014-07-07-IndexedRDD-design-review.pdf Slides explaining the motivation, design, and

[jira] [Comment Edited] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065694#comment-14065694 ] Ankur Dave edited comment on SPARK-2365 at 7/17/14 10:31 PM: -

[jira] [Commented] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108193#comment-14108193 ] Ankur Dave commented on SPARK-3190: --- I haven't tried to reproduce this yet, but counting

[jira] [Comment Edited] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108193#comment-14108193 ] Ankur Dave edited comment on SPARK-3190 at 8/23/14 11:31 PM: -

[jira] [Comment Edited] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108193#comment-14108193 ] Ankur Dave edited comment on SPARK-3190 at 8/23/14 11:33 PM: -

[jira] [Assigned] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reassigned SPARK-3190: - Assignee: Ankur Dave Creation of large graph( 2.15 B nodes) seems to be broken:possible

[jira] [Closed] (SPARK-1986) lib.Analytics should be in org.apache.spark.examples

[ https://issues.apache.org/jira/browse/SPARK-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave closed SPARK-1986. - Resolution: Fixed Fix Version/s: 1.2.0 lib.Analytics should be in org.apache.spark.examples

[jira] [Closed] (SPARK-2981) PartitionStrategy: VertexID hash overflow

[ https://issues.apache.org/jira/browse/SPARK-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave closed SPARK-2981. - Resolution: Fixed Fix Version/s: 1.0.3 1.2.0 1.1.1

[jira] [Resolved] (SPARK-2823) GraphX jobs throw IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-2823. --- Resolution: Fixed Fix Version/s: 1.0.3 1.1.1 1.2.0 Issue

[jira] [Resolved] (SPARK-3263) PR #720 broke GraphGenerator.logNormal

[ https://issues.apache.org/jira/browse/SPARK-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3263. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 2168

[jira] [Updated] (SPARK-3373) Filtering operations should optionally rebuild routing tables

[ https://issues.apache.org/jira/browse/SPARK-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3373: -- Summary: Filtering operations should optionally rebuild routing tables (was: trim some useless

[jira] [Updated] (SPARK-3373) Filtering operations should optionally rebuild routing tables

[ https://issues.apache.org/jira/browse/SPARK-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3373: -- Description: Graph operations that filter the edges (subgraph, mask, groupEdges) currently reuse the

[jira] [Commented] (SPARK-3206) Error in PageRank values

[ https://issues.apache.org/jira/browse/SPARK-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120525#comment-14120525 ] Ankur Dave commented on SPARK-3206: --- I think the `run` method is incorrect due to a bug

[jira] [Reopened] (SPARK-3123) override the setName function to set EdgeRDD's name manually just as VertexRDD does.

[ https://issues.apache.org/jira/browse/SPARK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reopened SPARK-3123: --- Reopening so I can change the status from Closed to Resolved. override the setName function to set

[jira] [Resolved] (SPARK-3123) override the setName function to set EdgeRDD's name manually just as VertexRDD does.

[ https://issues.apache.org/jira/browse/SPARK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3123. --- Resolution: Fixed Issue resolved by pull request 2033 https://github.com/apache/spark/pull/2033

[jira] [Issue Comment Deleted] (SPARK-3123) override the setName function to set EdgeRDD's name manually just as VertexRDD does.

[ https://issues.apache.org/jira/browse/SPARK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3123: -- Comment: was deleted (was: Reopening so I can change the status from Closed to Resolved.) override

[jira] [Created] (SPARK-3400) GraphX unit tests fail nondeterministically

Ankur Dave created SPARK-3400: - Summary: GraphX unit tests fail nondeterministically Key: SPARK-3400 URL: https://issues.apache.org/jira/browse/SPARK-3400 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-3400) GraphX unit tests fail nondeterministically

[ https://issues.apache.org/jira/browse/SPARK-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3400. --- Resolution: Fixed Fix Version/s: 1.1.0 1.3.0 1.0.1 Issue

[jira] [Reopened] (SPARK-2823) GraphX jobs throw IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reopened SPARK-2823: --- I had to revert this because of SPARK-3400. GraphX jobs throw IllegalArgumentException

[jira] [Created] (SPARK-3427) Standalone version of static PageRank

Ankur Dave created SPARK-3427: - Summary: Standalone version of static PageRank Key: SPARK-3427 URL: https://issues.apache.org/jira/browse/SPARK-3427 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3427) Avoid unnecessary active vertex tracking in static PageRank

[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3427: -- Summary: Avoid unnecessary active vertex tracking in static PageRank (was: Standalone version of

[jira] [Updated] (SPARK-3427) Avoid active vertex tracking in static PageRank

[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3427: -- Description: GraphX's current implementation of static (fixed iteration count) PageRank uses the

[jira] [Updated] (SPARK-3427) Avoid active vertex tracking in static PageRank

[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3427: -- Summary: Avoid active vertex tracking in static PageRank (was: Avoid unnecessary active vertex

[jira] [Updated] (SPARK-3400) GraphX unit tests fail nondeterministically

[ https://issues.apache.org/jira/browse/SPARK-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3400: -- Affects Version/s: 1.1.0 Fix Version/s: (was: 1.3.0) (was: 1.0.1)

[jira] [Updated] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3190: -- Fix Version/s: (was: 1.1.1) 1.1.0 Creation of large graph( 2.15 B nodes) seems

[jira] [Commented] (SPARK-3400) GraphX unit tests fail nondeterministically

[ https://issues.apache.org/jira/browse/SPARK-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136109#comment-14136109 ] Ankur Dave commented on SPARK-3400: --- [~aash] There isn't another ticket yet. Would you

[jira] [Created] (SPARK-3578) GraphGenerators.sampleLogNormal sometimes returns too-large result

Ankur Dave created SPARK-3578: - Summary: GraphGenerators.sampleLogNormal sometimes returns too-large result Key: SPARK-3578 URL: https://issues.apache.org/jira/browse/SPARK-3578 Project: Spark

[jira] [Updated] (SPARK-3578) GraphGenerators.sampleLogNormal sometimes returns too-large result

[ https://issues.apache.org/jira/browse/SPARK-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3578: -- Description: GraphGenerators.sampleLogNormal is supposed to return an integer strictly less than

[jira] [Commented] (SPARK-3578) GraphGenerators.sampleLogNormal sometimes returns too-large result

[ https://issues.apache.org/jira/browse/SPARK-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138638#comment-14138638 ] Ankur Dave commented on SPARK-3578: --- [~pwendell] Sorry, I forgot to do that this time.

[jira] [Created] (SPARK-3649) ClassCastException in GraphX custom serializers when sort-based shuffle spills

Ankur Dave created SPARK-3649: - Summary: ClassCastException in GraphX custom serializers when sort-based shuffle spills Key: SPARK-3649 URL: https://issues.apache.org/jira/browse/SPARK-3649 Project:

[jira] [Updated] (SPARK-3649) ClassCastException in GraphX custom serializers when sort-based shuffle spills

[ https://issues.apache.org/jira/browse/SPARK-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3649: -- Description: As

[jira] [Updated] (SPARK-3649) ClassCastException in GraphX custom serializers when sort-based shuffle spills

[ https://issues.apache.org/jira/browse/SPARK-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3649: -- Description: As

[jira] [Created] (SPARK-3664) Graduate GraphX from alpha to stable

Ankur Dave created SPARK-3664: - Summary: Graduate GraphX from alpha to stable Key: SPARK-3664 URL: https://issues.apache.org/jira/browse/SPARK-3664 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3665: -- Component/s: GraphX Java API for GraphX --- Key: SPARK-3665

[jira] [Created] (SPARK-3665) Java API for GraphX

Ankur Dave created SPARK-3665: - Summary: Java API for GraphX Key: SPARK-3665 URL: https://issues.apache.org/jira/browse/SPARK-3665 Project: Spark Issue Type: Improvement Reporter:

[jira] [Created] (SPARK-3666) Extract interfaces for EdgeRDD and VertexRDD

Ankur Dave created SPARK-3666: - Summary: Extract interfaces for EdgeRDD and VertexRDD Key: SPARK-3666 URL: https://issues.apache.org/jira/browse/SPARK-3666 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-3667) Deprecate Graph#unpersistVertices and document how to correctly unpersist graphs

Ankur Dave created SPARK-3667: - Summary: Deprecate Graph#unpersistVertices and document how to correctly unpersist graphs Key: SPARK-3667 URL: https://issues.apache.org/jira/browse/SPARK-3667 Project:

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3665: -- Description: The Java API will wrap the Scala API in a similar manner as JavaRDD. Components will

[jira] [Updated] (SPARK-3664) Graduate GraphX from alpha to stable

[ https://issues.apache.org/jira/browse/SPARK-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3664: -- Description: The GraphX API is officially marked as alpha but has been moving toward stability. This

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3665: -- Description: The Java API will wrap the Scala API in a similar manner as JavaRDD. Components will

[jira] [Created] (SPARK-3668) Support for arbitrary key types in IndexedRDD

Ankur Dave created SPARK-3668: - Summary: Support for arbitrary key types in IndexedRDD Key: SPARK-3668 URL: https://issues.apache.org/jira/browse/SPARK-3668 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3668) Support for arbitrary key types in IndexedRDD

[ https://issues.apache.org/jira/browse/SPARK-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3668: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-2365 Support for arbitrary key types in

[jira] [Created] (SPARK-3669) Extract IndexedRDD interface

Ankur Dave created SPARK-3669: - Summary: Extract IndexedRDD interface Key: SPARK-3669 URL: https://issues.apache.org/jira/browse/SPARK-3669 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-3670) Add log-structured updates with merge

Ankur Dave created SPARK-3670: - Summary: Add log-structured updates with merge Key: SPARK-3670 URL: https://issues.apache.org/jira/browse/SPARK-3670 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-3671) Batch multiput updates within partitions

Ankur Dave created SPARK-3671: - Summary: Batch multiput updates within partitions Key: SPARK-3671 URL: https://issues.apache.org/jira/browse/SPARK-3671 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-3672) Add a non-updatable implementation for read performance

Ankur Dave created SPARK-3672: - Summary: Add a non-updatable implementation for read performance Key: SPARK-3672 URL: https://issues.apache.org/jira/browse/SPARK-3672 Project: Spark Issue Type:

[jira] [Created] (SPARK-3673) Move IndexedRDD from a pull request into a separate repository

Ankur Dave created SPARK-3673: - Summary: Move IndexedRDD from a pull request into a separate repository Key: SPARK-3673 URL: https://issues.apache.org/jira/browse/SPARK-3673 Project: Spark

[jira] [Commented] (SPARK-2365) Add IndexedRDD, an efficient updatable key-value store

[ https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145698#comment-14145698 ] Ankur Dave commented on SPARK-2365: --- [~imranr] Thanks for the comments and

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3665: -- Component/s: Java API Java API for GraphX --- Key: SPARK-3665

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3665: -- Description: The Java API will wrap the Scala API in a similar manner as JavaRDD. Components will

[jira] [Resolved] (SPARK-3635) Find Strongly Connected Components with Graphx has a small bug

[ https://issues.apache.org/jira/browse/SPARK-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3635. --- Resolution: Fixed Fix Version/s: 1.1.1 1.2.0 Issue resolved by pull request

[jira] [Created] (SPARK-3818) Graph coarsening

Ankur Dave created SPARK-3818: - Summary: Graph coarsening Key: SPARK-3818 URL: https://issues.apache.org/jira/browse/SPARK-3818 Project: Spark Issue Type: New Feature Components:

[jira] [Created] (SPARK-4086) Fold-style aggregation for VertexRDD

Ankur Dave created SPARK-4086: - Summary: Fold-style aggregation for VertexRDD Key: SPARK-4086 URL: https://issues.apache.org/jira/browse/SPARK-4086 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4086) Fold-style aggregation for VertexRDD

[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-4086: -- Description: VertexRDD currently supports creations and joins only through a reduce-style interface

[jira] [Created] (SPARK-4173) EdgePartitionBuilder uses wrong value for first clustered index

Ankur Dave created SPARK-4173: - Summary: EdgePartitionBuilder uses wrong value for first clustered index Key: SPARK-4173 URL: https://issues.apache.org/jira/browse/SPARK-4173 Project: Spark

[jira] [Resolved] (SPARK-4249) A problem of EdgePartitionBuilder in Graphx

[ https://issues.apache.org/jira/browse/SPARK-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-4249. --- Resolution: Fixed Fix Version/s: 1.0.3 1.1.1 1.2.0 Issue

[jira] [Resolved] (SPARK-4173) EdgePartitionBuilder uses wrong value for first clustered index

[ https://issues.apache.org/jira/browse/SPARK-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-4173. --- Resolution: Fixed Fix Version/s: 1.0.3 1.1.1 1.2.0 Issue

  1   2   >