[
https://issues.apache.org/jira/browse/BEAM-7668?focusedWorklogId=270491&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-270491
]
ASF GitHub Bot logged work on BEAM-7668:
----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Jul/19 22:08
Start Date: 01/Jul/19 22:08
Worklog Time Spent: 10m
Work Description: chadrik commented on pull request #8977: [BEAM-7668]
Add GetPipeline method to gRPC JobService
URL: https://github.com/apache/beam/pull/8977
This adds a `GetPipeline` method to the gRPC `JobService` and implements it
for `InMemoryJobService`. The method is quite similar to the existing
`GetState` method in design/behavior.
As described in the Jira issue, I see this feature as being a useful first
step towards making the job api capable of serving as a backend to a web app
for submitting, viewing, and monitoring Beam jobs. The next step after this PR
would be to add a `GetJobs` method that sends a summary of all of the active
jobs and their ids.
Remaining issues:
- go: I have not implemented anything for the go sdk yet. I'm still trying
to figure out which version of `protoc` I need to use with `go generate`: 3.6
and 3.7 produced significant diffs, with a lot of style changes, so I assume
it's something older. Any help here would be greatly appreciated.
- tests: I've looked at the related tests for Java and Python and they
don't seem to actually be testing the rpc service endpoints. The python tests
in `portable_runner_test` seem to be largely starting the service and shutting
it down in different ways, without actually actually running any test methods.
Basically what I'm saying is I don't see a clear framework for testing RPC
methods in any language, but feel free to point me in the right direction.
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python3_Verify/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
<br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/lastCompletedBuild/)
Pre-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
--- |Java | Python | Go | Website
--- | --- | --- | --- | ---
Non-portable | [](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/)
Portable | --- | [](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/)
| --- | ---
See
[.test-infra/jenkins/README](https://github.com/apache/beam/blob/master/.test-infra/jenkins/README.md)
for trigger phrase, status and link of all Jenkins jobs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 270491)
Time Spent: 10m
Remaining Estimate: 0h
> Add ability to query a pipeline from a gRPC JobService
> ------------------------------------------------------
>
> Key: BEAM-7668
> URL: https://issues.apache.org/jira/browse/BEAM-7668
> Project: Beam
> Issue Type: Improvement
> Components: beam-model
> Reporter: Chad Dombrova
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> As a developer I want to query the pipeline definition of jobs that have
> already been submitted to the Job Service, so that I can write a UI to view
> and monitor Beam pipelines via the portability model.
>
> PR is coming soon!
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
