[jira] [Comment Edited] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14231734#comment-14231734 ] Larry Xiao edited comment on SPARK-3523 at 12/2/14 4:50 PM: Hi

[jira] [Commented] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14231734#comment-14231734 ] Larry Xiao commented on SPARK-3523: --- Hi [~lianhuiwang], that's great! As you can see, to

[jira] [Commented] (SPARK-1987) More memory-efficient graph construction

[ https://issues.apache.org/jira/browse/SPARK-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14228143#comment-14228143 ] Larry Xiao commented on SPARK-1987: --- [~maropu] I think it needs slight change in build s

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Shepherd: (was: ankurdave) > GraphX graph partitioning strategy > -- >

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Updated] (SPARK-3523) GraphX graph partitioning strategy

[ https://issues.apache.org/jira/browse/SPARK-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-3523: -- Description: We implemented some algorithms for partitioning on GraphX, and evaluated. And find the par

[jira] [Created] (SPARK-3523) GraphX graph partitioning strategy

Larry Xiao created SPARK-3523: - Summary: GraphX graph partitioning strategy Key: SPARK-3523 URL: https://issues.apache.org/jira/browse/SPARK-3523 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1987) More memory-efficient graph construction

[ https://issues.apache.org/jira/browse/SPARK-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099476#comment-14099476 ] Larry Xiao commented on SPARK-1987: --- ok. I understand. I'll try to implement it > More

[jira] [Updated] (SPARK-2981) PartitionStrategy: VertexID hash overflow

[ https://issues.apache.org/jira/browse/SPARK-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-2981: -- Description: In EdgePartition1D, a PartitionID is calculated by multiplying VertexId with a mixingPrim

[jira] [Updated] (SPARK-2981) PartitionStrategy: VertexID hash overflow

[ https://issues.apache.org/jira/browse/SPARK-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry Xiao updated SPARK-2981: -- Description: In PartitionStrategy.scala a PartitionID is calculated by multiplying VertexId with a mix

[jira] [Created] (SPARK-2981) PartitionStrategy: VertexID hash overflow

Larry Xiao created SPARK-2981: - Summary: PartitionStrategy: VertexID hash overflow Key: SPARK-2981 URL: https://issues.apache.org/jira/browse/SPARK-2981 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-2062) VertexRDD.apply does not use the mergeFunc

[ https://issues.apache.org/jira/browse/SPARK-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092381#comment-14092381 ] Larry Xiao commented on SPARK-2062: --- Is anyone working on it? I want to take it. My plan

[jira] [Commented] (SPARK-1987) More memory-efficient graph construction

[ https://issues.apache.org/jira/browse/SPARK-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088953#comment-14088953 ] Larry Xiao commented on SPARK-1987: --- Hi Ankur What do you mean by custom sort routine?

[jira] [Commented] (SPARK-1153) Generalize VertexId in GraphX so that UUIDs can be used as vertex IDs.

[ https://issues.apache.org/jira/browse/SPARK-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085676#comment-14085676 ] Larry Xiao commented on SPARK-1153: --- I like npanj's approach. It's universal. You treat

[jira] [Commented] (SPARK-1986) lib.Analytics should be in org.apache.spark.examples

[ https://issues.apache.org/jira/browse/SPARK-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084423#comment-14084423 ] Larry Xiao commented on SPARK-1986: --- Hi Ankur Yes I like Analytics to be in examples And

[jira] [Comment Edited] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080594#comment-14080594 ] Larry Xiao edited comment on SPARK-2728 at 7/31/14 7:24 AM: I

[jira] [Comment Edited] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080594#comment-14080594 ] Larry Xiao edited comment on SPARK-2728 at 7/31/14 7:23 AM: I

[jira] [Commented] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080594#comment-14080594 ] Larry Xiao commented on SPARK-2728: --- I checked-out newest commit <5a110da25f15694773d6f7

[jira] [Commented] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14080452#comment-14080452 ] Larry Xiao commented on SPARK-2728: --- I want to try :) > Integer overflow in partition i

[jira] [Commented] (SPARK-2660) Enable pretty-printing SchemaRDD Rows

[ https://issues.apache.org/jira/browse/SPARK-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072687#comment-14072687 ] Larry Xiao commented on SPARK-2660: --- I think this one is suitable for newbie like me, th