[jira] [Commented] (BEAM-9815) beam_PostCommit_Go perma red due to failing to start container

[Robert Burke (Jira)]

    [ 
https://issues.apache.org/jira/browse/BEAM-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092397#comment-17092397
 ] 

Robert Burke commented on BEAM-9815:
------------------------------------

The provision info for dataflow has no depenencies listed (though the pipeline 
proto does have one listed), and also no retrieval token. So a "quick" fix 
might be to hack it to assume something is there.

The data there was not at the "assumed" path on the worker, and it never used 
the staging location for the worker binary.

https://pantheon.corp.google.com/storage/browser/temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-1-1587852331972351853/?forceOnBucketsSortingFiltering=false&project=apache-beam-testing

But the model was able to be found at the staging location (which makes sense 
since we can see it in the dataflow explorer there).
I 2020-04-25T22:06:49.848812Z Downloading: 
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1587852331972428268/model
 to /tmp/tmp/download.0.148567144/file.0 (size: 3 Kb, MD5: 
sceqVeC8VgLLgWXiRJ0Kvg==) 
I 2020-04-25T22:06:49.952462Z Download completed: 
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1587852331972428268/model
 (duration: 103 ms @ 37 Kb/s) 


So, I'm going to look now where the model is actually getting downloaded (since 
it's doing that somewhere, and printing it out), and see why the worker binary 
is  not getting the same treatment.

> beam_PostCommit_Go perma red due to failing to start container
> --------------------------------------------------------------
>
>                 Key: BEAM-9815
>                 URL: https://issues.apache.org/jira/browse/BEAM-9815
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-go, test-failures
>            Reporter: Chamikara Madhusanka Jayalath
>            Assignee: Robert Bradshaw
>            Priority: Critical
>              Labels: currently-failing
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> For example,
> [https://builds.apache.org/job/beam_PostCommit_Go/6847/]
> [https://pantheon.corp.google.com/logs/viewer?project=apache-beam-testing&folder&organizationId&minLogLevel=500&expandAll=false&timestamp=2020-04-24T15:09:13.455000000Z&customFacets=&limitCustomFacetWidth=true&interval=NO_LIMIT&resource=dataflow_step%2Fjob_id%2F2020-04-24_05_03_49-5495819388067192698&scrollTimestamp=2020-04-24T13:03:38.313084000Z]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)