[
https://issues.apache.org/jira/browse/BEAM-7079?focusedWorklogId=277396&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277396
]
ASF GitHub Bot logged work on BEAM-7079:
----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Jul/19 10:19
Start Date: 16/Jul/19 10:19
Worklog Time Spent: 10m
Work Description: mwalenia commented on issue #8939: [BEAM-7079] Add
Chicago Taxi Example running on Dataflow
URL: https://github.com/apache/beam/pull/8939#issuecomment-511757501
@angoenka thanks for the reply.
That's correct, most of the code comes from the TFX repo. However, I believe
that it doesn't make sense to use unchanged code from there to run those tests
- it would be impossible to gather metrics using Metrics API, which would make
the results not representative of real Beam performance in this scenario.
Also, the recommended way of running the example from the TFX repo is to use
Airflow to orchestrate everything, which would create another big dependency
that would need to be set up and torn down automatically on Jenkins.
I think that this approach is the most beneficial. I agree that if the
pipelines in TFX example change or if we drop Python 2 support, it will be
necessary to update the code, but I think this won't be very time-consuming.
WDYT?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 277396)
Time Spent: 19h 50m (was: 19h 40m)
> Run Chicago Taxi Example on Dataflow
> ------------------------------------
>
> Key: BEAM-7079
> URL: https://issues.apache.org/jira/browse/BEAM-7079
> Project: Beam
> Issue Type: Test
> Components: testing
> Reporter: Michal Walenia
> Assignee: Michal Walenia
> Priority: Minor
> Time Spent: 19h 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
