GitHub user shghatge opened a pull request:
https://github.com/apache/flink/pull/846
Csv read graph
[FLINK-1520]Read edges and vertices from CSV files
Changes done->
1) Added a GraphCsvReader class which has 2 CsvReaders as members
EdgeReader and VertexReader
To make smooth chaining of functions possible for configuration of the
member CsvReaders implemented the configuration methods in CsvReader in
GraphCsvReader so that all the configurations can be done on both CsvReaders on
calling the function once and the methods again return a GraphCsvReader
Only the methods to specify which fields are supposed to be chosen from the
individual files are separate for Edge and Vertex reader.
Since specifying types is necessary because of type-erasure, implemented a
types method in the GraphCsvReader class that returns a Graph with the
specified types as the type for VertexID, Vertex Value and Edge Value. Other
way for doing this was sending the types in a method to construct the graph
itself but to make it as similar to CsvReader as possible this approach was
taken.
2) Added 3 methods in Graph.java similar to other methods for Graph
creation. These methods use one mandatory path and one optional path and
optional mapper for Graph Creation. Only difference is that these methods
return an instance of GraphCsvReader instead of Graph.
3)Added appropriate methods in GraphCreationITCase and
GraphCreationWithMapperITCase,java
Also added createTempFile() method to both to help with the tests.
4) Added the documentation for the new functionalities to gelly_guide.md
3)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shghatge/flink csv_readGraph
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/846.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #846
----
commit e8a5250b4588326b606b2f29d2f2c2f6e4554925
Author: Shivani <[email protected]>
Date: 2015-06-10T11:22:37Z
[FLINK-2093][gelly] Added difference Method
commit b0a9228540fbafe819d1883e07087c4f59f4e4bb
Author: Shivani <[email protected]>
Date: 2015-06-10T13:04:48Z
[FLINK-2093][gelly] Minor Changes in the Graph.java file
commit 24c7567b6fe533cd1a7cff1d9bb812ee5d8433fc
Author: Shivani <[email protected]>
Date: 2015-06-15T10:37:00Z
Merge branch 'master' of https://github.com/apache/flink into difference_new
commit e726507d41a588888abbc9a6abe2ead4e9e83b09
Author: Shivani <[email protected]>
Date: 2015-06-15T12:13:58Z
[FLINK-2093][gelly]Added difference method
commit 760047dc78739b9eb750757aea442aa947c2fc34
Author: Shivani <[email protected]>
Date: 2015-06-15T13:01:32Z
[FLINK-2093][gelly]Added difference method
commit 57f1b315f7fbb87c74085c9a68108fcd3ff58440
Author: Shivani <[email protected]>
Date: 2015-06-15T14:09:29Z
[FLINK-2093][gelly]Added difference method
commit 9ca5d7485708c3dca7e41bf6d19b5bd9d492125f
Author: Shivani <[email protected]>
Date: 2015-06-15T14:12:50Z
[FLINK-2093][gelly]Added difference method
commit eff14eff8c1ac1b88a76438257ad74c7a004bbd3
Author: Shivani <[email protected]>
Date: 2015-06-16T16:37:36Z
[FLINK-1520]Read edges and vertices from CSV files
commit 1ae9eadc792500311c7fc24a8647364bc60902ec
Author: Shivani <[email protected]>
Date: 2015-06-16T16:38:20Z
[FLINK-1520]Read edges and vertices from CSV files
commit c5f4410acf30d3d0bd12c4f215005aa517938dd2
Author: Shivani <[email protected]>
Date: 2015-06-16T16:39:39Z
Merge branch 'master' of https://github.com/apache/flink into csv_readGraph
commit 342225af5f17fa7be906885ee3dcd1b2f6a6d176
Author: Shivani <[email protected]>
Date: 2015-06-17T11:39:48Z
[FLINK-1520]Read edges and vertices from CSV files
commit 553e676003ee1419710146ddbe0a13e17fd3d237
Author: Shivani <[email protected]>
Date: 2015-06-17T11:42:26Z
[FLINK-1520]Read edges and vertices from CSV files
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
