[
https://issues.apache.org/jira/browse/PIRK-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431660#comment-15431660
]
ASF GitHub Bot commented on PIRK-21:
------------------------------------
GitHub user ellisonanne opened a pull request:
https://github.com/apache/incubator-pirk/pull/76
[PIRK-21] [WIP] - Initial Spark Streaming Responder Implementation
The initial Spark Streaming Responder implementation, including
corresponding distributed tests. Initial input adaptors only include HDFS and
Elasticsearch; additional adaptors (Kafka, etc) will be added as subsequent
JIRAs.
Marking this PR as a WIP until scale testing is completed; functional
testing via new streaming tests within the DistributedTestSuite is complete.
Comments/suggestions welcome!
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ellisonanne/incubator-pirk pirk-21
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-pirk/pull/76.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #76
----
commit 74a6f11a1af491cc3b722af3fbb25b9342025b64
Author: ellisonanne <eawilli...@apache.org>
Date: 2016-07-29T19:45:21Z
Merge pull request #5 from apache/master
up
commit 42f3e8400f810377a4bae06638fc13c0e37707f3
Author: ellisonanne <eawilli...@apache.org>
Date: 2016-07-31T17:47:15Z
Merge pull request #6 from apache/master
updating fork
commit 887358883d26940845a3486b0dc87cd0cc6c3807
Author: ellisonanne <eawilli...@apache.org>
Date: 2016-08-01T13:06:35Z
Merge pull request #7 from apache/master
up
commit 2ad5c619084af2517cd135374f93be20410cc45c
Author: ellisonanne <eawilli...@apache.org>
Date: 2016-08-02T16:22:53Z
Merge pull request #8 from apache/master
updating fork
commit d3c6eeb37a0300ea882c0bb2bcd2939132e7e5cb
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-06T14:23:24Z
Merge pull request #9 from apache/master
updating fork
commit 381f3529f97fa38b7b06be015c7b82471c8b95d5
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-11T13:22:15Z
Merge pull request #10 from apache/master
updating fork
commit 6ab035dd32fc4e3464cfb377ccb3493ecf9a313d
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-12T21:19:23Z
Merge pull request #11 from apache/master
up
commit 47a933f9c1d6c6c80f7b61ba5856a84af8162dca
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-13T12:31:25Z
Merge pull request #12 from apache/master
up
commit 6ba5ed4b3ce4983f1e1aa958b6f55180613fa1a1
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-16T13:30:13Z
Merge pull request #13 from apache/master
updating fork
commit 43818205074456b8e16aa09bb408706bfb9608ed
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-18T17:38:55Z
Merge pull request #14 from apache/master
updating fork
commit 9da10044342663526b3456aa894f204f697a2866
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-19T13:54:59Z
Merge pull request #15 from apache/master
updating fork
commit 195c518a8e4d0b131d47fbbe84f8183bdde164ec
Author: Ellison Anne Williams <eawilli...@apache.org>
Date: 2016-08-19T19:00:44Z
Merge pull request #16 from apache/master
various cleanup items - closes apache/incubator-pirk#73
commit b2cb424017a726ad1334818ee7b1f8d5cc6a6581
Author: eawilliams <eawilli...@apache.org>
Date: 2016-08-22T20:56:08Z
initial spark streaming responder
commit d306c6e85b264064d52b3c34929347e4401970c8
Author: eawilliams <eawilli...@apache.org>
Date: 2016-08-22T21:28:08Z
updating DistTestSuite
----
> Apache Spark Streaming Implementation
> -------------------------------------
>
> Key: PIRK-21
> URL: https://issues.apache.org/jira/browse/PIRK-21
> Project: PIRK
> Issue Type: Improvement
> Components: Responder
> Reporter: Ellison Anne Williams
> Assignee: Ellison Anne Williams
>
> Provide a Spark streaming implementation for Pirk.
> Although there is discussion and a forthcoming JIRA issue for Pirk
> integration with Apache Beam, we can, at the very least, use this
> implementation to benchmark straight Spark Streaming vs Beam + Spark
> Streaming.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
