[jira] [Commented] (FLINK-8403) Flink Gelly examples hanging without returning result
[ https://issues.apache.org/jira/browse/FLINK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321886#comment-16321886 ] flora karniav commented on FLINK-8403: -- Yes, that was it! I think it would be a good idea for this to be pointed out in the documentation. Thank you so much, I am closing the issue. > Flink Gelly examples hanging without returning result > - > > Key: FLINK-8403 > URL: https://issues.apache.org/jira/browse/FLINK-8403 > Project: Flink > Issue Type: Bug > Components: Gelly >Affects Versions: 1.3.2 > Environment: CentOS Linux release 7.3.1611 >Reporter: flora karniav > Labels: examples, gelly, performance > Original Estimate: 72h > Remaining Estimate: 72h > > Hello, I am currently running and measuring Flink Gelly examples (Connected > components and Pagerank algorithms) with different SNAP datasets. When > running with the Twitter dataset for example > (https://snap.stanford.edu/data/egonets-Twitter.html) which has 81,306 > vertices everything executes and finishes OK and I get the reported job > runtime. On the other hand, executions with datasets having a bigger number > of vertices, e.g. https://snap.stanford.edu/data/com-Youtube.html with > 1,134,890 vertices, hang with no result and reported time, while at the same > time I get "Job execution switched to status FINISHED." > I thought that this could be a memory issue so I reached 125GB of RAM > assigned to my taskmanagers (and jobmanager), but still no luck. > The exact command I am running is: > ./bin/flink run examples/gelly/flink-gelly-examples_*.jar --algorithm > PageRank --directed false --input_filename hdfs://sith0:9000/user/xx.txt > --input CSV --type integer --input_field_delimiter $' ' --output print -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-8403) Flink Gelly examples hanging without returning result
[ https://issues.apache.org/jira/browse/FLINK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321032#comment-16321032 ] Greg Hogan commented on FLINK-8403: --- Could this be due to the [{{akka.framesize}}|https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#distributed-coordination-via-akka] limit (default: 10 MiB)? Does the job succeed when you write the output to CSV? > Flink Gelly examples hanging without returning result > - > > Key: FLINK-8403 > URL: https://issues.apache.org/jira/browse/FLINK-8403 > Project: Flink > Issue Type: Bug > Components: Gelly >Affects Versions: 1.3.2 > Environment: CentOS Linux release 7.3.1611 >Reporter: flora karniav > Labels: examples, gelly, performance > Original Estimate: 72h > Remaining Estimate: 72h > > Hello, I am currently running and measuring Flink Gelly examples (Connected > components and Pagerank algorithms) with different SNAP datasets. When > running with the Twitter dataset for example > (https://snap.stanford.edu/data/egonets-Twitter.html) which has 81,306 > vertices everything executes and finishes OK and I get the reported job > runtime. On the other hand, executions with datasets having a bigger number > of vertices, e.g. https://snap.stanford.edu/data/com-Youtube.html with > 1,134,890 vertices, hang with no result and reported time, while at the same > time I get "Job execution switched to status FINISHED." > I thought that this could be a memory issue so I reached 125GB of RAM > assigned to my taskmanagers (and jobmanager), but still no luck. > The exact command I am running is: > ./bin/flink run examples/gelly/flink-gelly-examples_*.jar --algorithm > PageRank --directed false --input_filename hdfs://sith0:9000/user/xx.txt > --input CSV --type integer --input_field_delimiter $' ' --output print -- This message was sent by Atlassian JIRA (v6.4.14#64029)