[
https://issues.apache.org/jira/browse/BEAM-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17121718#comment-17121718
]
Kenneth Knowles commented on BEAM-9150:
---------------------------------------
This issue is assigned but has not received an update in 30 days so it has been
labeled "stale-assigned". If you are still working on the issue, please give an
update and remove the label. If you are no longer working on the issue, please
unassign so someone else may work on it. In 7 days the issue will be
automatically unassigned.
> beam_PostRelease_Python_Candidate fails
> ---------------------------------------
>
> Key: BEAM-9150
> URL: https://issues.apache.org/jira/browse/BEAM-9150
> Project: Beam
> Issue Type: Bug
> Components: build-system
> Reporter: Udi Meiri
> Assignee: Yifan Zou
> Priority: P2
> Labels: stale-assigned
>
> https://builds.apache.org/job/beam_PostRelease_Python_Candidate/171/timestamps/?time=HH:mm:ss&timeZone=GMT-8&appendLog&locale=en_US
> Some interesting lines:
> {code}
> 17:48:36
> release/src/main/python-release/run_release_candidate_python_quickstart.sh:
> line 144: 20935 Killed python -m
> apache_beam.examples.streaming_wordcount --input_topic
> projects/$PROJECT_ID/topics/$PUBSUB_TOPIC1 --output_topic
> projects/$PROJECT_ID/topics/$PUBSUB_TOPIC2 --streaming
> {code}
> {code}
> 18:05:25
> ############################################################################
> 18:05:25 Running HourlyTeamScore example with DirectRunner
> 18:05:25
> ############################################################################
> 18:05:25
> /tmp/tmp.gnpMNIFhcL/temp_virtualenv_python2.7/local/lib/python2.7/site-packages/apache_beam/__init__.py:84:
> UserWarning: You are using Apache Beam with Python 2. New releases of Apache
> Beam will soon support Python 3 only.
> 18:05:25 'You are using Apache Beam with Python 2. '
> 18:05:33 INFO:root:Missing pipeline option (runner). Executing pipeline
> using the default runner: DirectRunner.
> 18:05:33 INFO:root:Setting socket default timeout to 60 seconds.
> 18:05:33 INFO:root:socket default timeout is 60.0 seconds.
> 18:05:33 INFO:oauth2client.transport:Attempting refresh to obtain initial
> access_token
> 18:05:34
> /tmp/tmp.gnpMNIFhcL/temp_virtualenv_python2.7/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py:1220:
> BeamDeprecationWarning: options is deprecated since First stable release.
> References to <pipeline>.options will not be supported
> 18:05:34 experiments = p.options.view_as(DebugOptions).experiments or []
> 18:05:37 INFO:root:==================== <function
> annotate_downstream_side_inputs at 0x7f131dc46f50> ====================
> 18:05:37 INFO:root:==================== <function
> fix_side_input_pcoll_coders at 0x7f131dc3e0c8> ====================
> 18:05:37 INFO:root:==================== <function lift_combiners at
> 0x7f131dc3e140> ====================
> 18:05:37 INFO:root:==================== <function expand_sdf at
> 0x7f131dc3e1b8> ====================
> 18:05:37 INFO:root:==================== <function expand_gbk at
> 0x7f131dc3e230> ====================
> 18:05:37 INFO:root:==================== <function sink_flattens at
> 0x7f131dc3e320> ====================
> 18:05:37 INFO:root:==================== <function greedily_fuse at
> 0x7f131dc3e398> ====================
> 18:05:37 INFO:root:==================== <function read_to_impulse at
> 0x7f131dc3e410> ====================
> 18:05:37 INFO:root:==================== <function impulse_to_input at
> 0x7f131dc3e488> ====================
> 18:05:37 INFO:root:==================== <function inject_timer_pcollections
> at 0x7f131dc3e5f0> ====================
> 18:05:37 INFO:root:==================== <function sort_stages at
> 0x7f131dc3e668> ====================
> 18:05:37 INFO:root:==================== <function window_pcollection_coders
> at 0x7f131dc3e6e0> ====================
> 18:05:37 INFO:root:Creating state cache with size 100
> 18:05:37 INFO:root:Created Worker handler
> <apache_beam.runners.portability.fn_api_runner.EmbeddedWorkerHandler object
> at 0x7f12fc89c290> for environment urn: "beam:env:embedded_python:v1"
> 18:05:37
> 18:05:37 INFO:root:Running
> ((ref_AppliedPTransform_ReadInputText/Read/_SDFBoundedSourceWrapper/Impulse_5)+(ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/PairWithRestriction))+((ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/SplitAndSizeRestriction)+(ref_PCollection_PCollection_1_split/Write))
> 18:05:38 INFO:root:Running
> (ref_PCollection_PCollection_1_split/Read)+((((ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/Process)+((ref_AppliedPTransform_HourlyTeamScore/ParseGameEventFn_8)+((ref_AppliedPTransform_HourlyTeamScore/FilterStartTime_9)+((ref_AppliedPTransform_HourlyTeamScore/FilterEndTime_10)+((ref_AppliedPTransform_HourlyTeamScore/AddEventTimestamps_11)+((ref_AppliedPTransform_HourlyTeamScore/FixedWindowsTeam_12)+(ref_AppliedPTransform_HourlyTeamScore/ExtractAndSumScore/Map(<lambda
> at
> hourly_team_score.py:142>)_14)))))))+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Precombine))+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Group/Write))
> 18:05:39 INFO:root:Running
> ((HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Group/Read)+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Merge))+((HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/ExtractOutputs)+((ref_AppliedPTransform_TeamScoresDict_22)+((ref_AppliedPTransform_WriteTeamScoreSums/ConvertToRow_24)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination_27)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds_28)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/AddRandomKeys_30)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/Map(reify_timestamps)_32)+(WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/GroupByKey/Write))))))))
> 18:05:39 INFO:root:Running
> (WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/GroupByKey/Read)+(((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/FlatMap(restore_timestamps)_37)+(ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/RemoveRandomKeys_38))+(ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)_40))
> 18:05:40 bq head -n 500 $DATASET.hourly_team_score_python_$1
> 18:05:43 Did not find team scores, retry left: 2
> 18:05:58 bq head -n 500 $DATASET.hourly_team_score_python_$1
> 18:06:00 Did not find team scores, retry left: 1
> 18:06:15 bq head -n 500 $DATASET.hourly_team_score_python_$1
> 18:06:17 Did not find team scores, retry left: 0
> 18:06:32 FAILED: HourlyTeamScore example failed running on direct-runner.
> Did not found scores of team AntiqueBrassPlatypus in
> beam_postrelease_mobile_gaming.leader_board
> 18:06:32
> ############################################################################
> 18:06:32 Validation FAILED
> 18:06:32
> ############################################################################
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
