[
https://issues.apache.org/jira/browse/BEAM-9150?focusedWorklogId=734386&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-734386
]
ASF GitHub Bot logged work on BEAM-9150:
----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Mar/22 07:46
Start Date: 01/Mar/22 07:46
Worklog Time Spent: 10m
Work Description: emilymye commented on pull request #16955:
URL: https://github.com/apache/beam/pull/16955#issuecomment-1055120533
Given that these files shouldn't affect Java PreCommit at all (all release
scripts), I feel safe ignoring the Java PreCommit failure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 734386)
Time Spent: 2h (was: 1h 50m)
> beam_PostRelease_Python_Candidate fails
> ---------------------------------------
>
> Key: BEAM-9150
> URL: https://issues.apache.org/jira/browse/BEAM-9150
> Project: Beam
> Issue Type: Bug
> Components: build-system
> Reporter: Udi Meiri
> Priority: P2
> Time Spent: 2h
> Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostRelease_Python_Candidate/171/timestamps/?time=HH:mm:ss&timeZone=GMT-8&appendLog&locale=en_US
> Some interesting lines:
> {code}
> 17:48:36
> release/src/main/python-release/run_release_candidate_python_quickstart.sh:
> line 144: 20935 Killed python -m
> apache_beam.examples.streaming_wordcount --input_topic
> projects/$PROJECT_ID/topics/$PUBSUB_TOPIC1 --output_topic
> projects/$PROJECT_ID/topics/$PUBSUB_TOPIC2 --streaming
> {code}
> {code}
> 18:05:25
> ############################################################################
> 18:05:25 Running HourlyTeamScore example with DirectRunner
> 18:05:25
> ############################################################################
> 18:05:25
> /tmp/tmp.gnpMNIFhcL/temp_virtualenv_python2.7/local/lib/python2.7/site-packages/apache_beam/__init__.py:84:
> UserWarning: You are using Apache Beam with Python 2. New releases of Apache
> Beam will soon support Python 3 only.
> 18:05:25 'You are using Apache Beam with Python 2. '
> 18:05:33 INFO:root:Missing pipeline option (runner). Executing pipeline
> using the default runner: DirectRunner.
> 18:05:33 INFO:root:Setting socket default timeout to 60 seconds.
> 18:05:33 INFO:root:socket default timeout is 60.0 seconds.
> 18:05:33 INFO:oauth2client.transport:Attempting refresh to obtain initial
> access_token
> 18:05:34
> /tmp/tmp.gnpMNIFhcL/temp_virtualenv_python2.7/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py:1220:
> BeamDeprecationWarning: options is deprecated since First stable release.
> References to <pipeline>.options will not be supported
> 18:05:34 experiments = p.options.view_as(DebugOptions).experiments or []
> 18:05:37 INFO:root:==================== <function
> annotate_downstream_side_inputs at 0x7f131dc46f50> ====================
> 18:05:37 INFO:root:==================== <function
> fix_side_input_pcoll_coders at 0x7f131dc3e0c8> ====================
> 18:05:37 INFO:root:==================== <function lift_combiners at
> 0x7f131dc3e140> ====================
> 18:05:37 INFO:root:==================== <function expand_sdf at
> 0x7f131dc3e1b8> ====================
> 18:05:37 INFO:root:==================== <function expand_gbk at
> 0x7f131dc3e230> ====================
> 18:05:37 INFO:root:==================== <function sink_flattens at
> 0x7f131dc3e320> ====================
> 18:05:37 INFO:root:==================== <function greedily_fuse at
> 0x7f131dc3e398> ====================
> 18:05:37 INFO:root:==================== <function read_to_impulse at
> 0x7f131dc3e410> ====================
> 18:05:37 INFO:root:==================== <function impulse_to_input at
> 0x7f131dc3e488> ====================
> 18:05:37 INFO:root:==================== <function inject_timer_pcollections
> at 0x7f131dc3e5f0> ====================
> 18:05:37 INFO:root:==================== <function sort_stages at
> 0x7f131dc3e668> ====================
> 18:05:37 INFO:root:==================== <function window_pcollection_coders
> at 0x7f131dc3e6e0> ====================
> 18:05:37 INFO:root:Creating state cache with size 100
> 18:05:37 INFO:root:Created Worker handler
> <apache_beam.runners.portability.fn_api_runner.EmbeddedWorkerHandler object
> at 0x7f12fc89c290> for environment urn: "beam:env:embedded_python:v1"
> 18:05:37
> 18:05:37 INFO:root:Running
> ((ref_AppliedPTransform_ReadInputText/Read/_SDFBoundedSourceWrapper/Impulse_5)+(ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/PairWithRestriction))+((ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/SplitAndSizeRestriction)+(ref_PCollection_PCollection_1_split/Write))
> 18:05:38 INFO:root:Running
> (ref_PCollection_PCollection_1_split/Read)+((((ReadInputText/Read/_SDFBoundedSourceWrapper/ParDo(SDFBoundedSourceDoFn)/Process)+((ref_AppliedPTransform_HourlyTeamScore/ParseGameEventFn_8)+((ref_AppliedPTransform_HourlyTeamScore/FilterStartTime_9)+((ref_AppliedPTransform_HourlyTeamScore/FilterEndTime_10)+((ref_AppliedPTransform_HourlyTeamScore/AddEventTimestamps_11)+((ref_AppliedPTransform_HourlyTeamScore/FixedWindowsTeam_12)+(ref_AppliedPTransform_HourlyTeamScore/ExtractAndSumScore/Map(<lambda
> at
> hourly_team_score.py:142>)_14)))))))+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Precombine))+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Group/Write))
> 18:05:39 INFO:root:Running
> ((HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Group/Read)+(HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/Merge))+((HourlyTeamScore/ExtractAndSumScore/CombinePerKey(sum)/ExtractOutputs)+((ref_AppliedPTransform_TeamScoresDict_22)+((ref_AppliedPTransform_WriteTeamScoreSums/ConvertToRow_24)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination_27)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds_28)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/AddRandomKeys_30)+((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/Map(reify_timestamps)_32)+(WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/GroupByKey/Write))))))))
> 18:05:39 INFO:root:Running
> (WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/GroupByKey/Read)+(((ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/ReshufflePerKey/FlatMap(restore_timestamps)_37)+(ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/RemoveRandomKeys_38))+(ref_AppliedPTransform_WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)_40))
> 18:05:40 bq head -n 500 $DATASET.hourly_team_score_python_$1
> 18:05:43 Did not find team scores, retry left: 2
> 18:05:58 bq head -n 500 $DATASET.hourly_team_score_python_$1
> 18:06:00 Did not find team scores, retry left: 1
> 18:06:15 bq head -n 500 $DATASET.hourly_team_score_python_$1
> 18:06:17 Did not find team scores, retry left: 0
> 18:06:32 FAILED: HourlyTeamScore example failed running on direct-runner.
> Did not found scores of team AntiqueBrassPlatypus in
> beam_postrelease_mobile_gaming.leader_board
> 18:06:32
> ############################################################################
> 18:06:32 Validation FAILED
> 18:06:32
> ############################################################################
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
