[
https://issues.apache.org/jira/browse/BEAM-5528?focusedWorklogId=151361&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-151361
]
ASF GitHub Bot logged work on BEAM-5528:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Oct/18 20:38
Start Date: 04/Oct/18 20:38
Worklog Time Spent: 10m
Work Description: angoenka commented on issue #6523: [BEAM-5528] Re-add
CREATE_VIEW in portable Flink translators
URL: https://github.com/apache/beam/pull/6523#issuecomment-427160991
I was thinking of utilizing beam_fnapi flag to construct the graph
differently for legacy and portable runner.
However this adds its own complication over time and there is no real good
way to other than removing createview from various transforms on per case basis.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 151361)
Time Spent: 1h 50m (was: 1h 40m)
> Java PortableRunner pipeline fails on FlinkRunner due to CREATE_VIEW
> --------------------------------------------------------------------
>
> Key: BEAM-5528
> URL: https://issues.apache.org/jira/browse/BEAM-5528
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Priority: Critical
> Labels: portability-flink
> Fix For: 2.8.0
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> We recently removed the CREATE_VIEW translation which was a NOOP. Turns out
> we still need to support it until it is removed.
> {noformat}
> java.lang.IllegalArgumentException: Unknown type of URN
> beam:transform:create_view:v1 for PTransform with id
> TextIO.Write/WriteFiles/GatherTempFileResults/View.AsList/View.CreatePCollectionView.
> at
> org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.urnNotFound(FlinkBatchPortablePipelineTranslator.java:578)
> at
> org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.translate(FlinkBatchPortablePipelineTranslator.java:233)
> at
> org.apache.beam.runners.flink.FlinkJobInvocation.runPipeline(FlinkJobInvocation.java:112)
> at
> org.apache.beam.repackaged.beam_runners_flink_2.11.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:111)
> at
> org.apache.beam.repackaged.beam_runners_flink_2.11.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:58)
> at
> org.apache.beam.repackaged.beam_runners_flink_2.11.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:75)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
