[
https://issues.apache.org/jira/browse/S2GRAPH-226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hwansung Yu updated S2GRAPH-226:
Priority: Minor (was: Major)
> Provide example spark jobs to explain how to utilize WAL log.
> -
>
> Key: S2GRAPH-226
> URL: https://issues.apache.org/jira/browse/S2GRAPH-226
> Project: S2Graph
> Issue Type: New Feature
> Components: s2core, s2jobs
>Reporter: DOYUNG YOON
>Assignee: DOYUNG YOON
>Priority: Minor
> Original Estimate: 336h
> Remaining Estimate: 336h
>
> Even though s2graph publish all incoming vertex/edge into Kafka, there is no
> example showing how to use this WAL log.
> I suggest adding a simple example showing how to process WAL and let me
> explain what use cases this example can benefit.
> At kakao, s2graph have been used as the fact storage, which store all user's
> activities such as click content, buy a product, search query.
> {noformat}
> [{
> "timestamp": 1,
> "elem": "e",
> "from": "steamshon",
> "to": "s2graph",
> "label": "search_query",
> "props": {}
> }, {
> "timestamp": 10,
> "elem": "e",
> "from": "steamshon",
> "to": "github.com/apache/incubator-s2graph",
> "label": "content_click",
> "props": {}
> }, {
> "timestamp": 12,
> "elem": "v",
> "id": "steamshon",
> "serviceName": "s2graph",
> "columnName": "user",
> "props": {
> "gender": "M"
> }
> }]
> {noformat}
> Each activity, label in s2graph words, consisting of their own graph, but
> when they are all connected together, then it gives much more information.
> Above edges can be aggregated as Vertex.
> It is up to users how to connect each graph, but in our case, we used `user`
> to merge multiple graphs. for example, we made each activity such as click
> content, buy a product, search query all use the same `userId` for the same
> `user`.
> Below is simple example data.
> {noformat}
> {
> "timestamp": 10,
> "elem": "v",
> "id": "steamshon",
> "serviceName": "s2graph",
> "columnName": "user",
> "props": {
> "gender": "M",
> "edges": [{
> "timestamp": 1,
> "to": "s2graph",
> "label": "search_query",
> "props": {}
> }, {
> "timestamp": 10,
> "to": "github.com/apache/incubator-s2graph",
> "label": "content_click",
> "props": {}
> }]
> }
> }
> {noformat}
> This connected graph can be used not only for OLTP but also OLAP.
> I believe s2graph WAL log is good way to integrate OLTP and OLAP, and adding
> this example can help for user to understand how to leverage it.
> [desing doc(work in
> progress)|https://docs.google.com/document/d/12vsJFWTKoDrYxD-NhOoCaJdvFg8it2wYqIABA0DXYeA/edit?usp=sharing]
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
