Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-13 Thread Sarah Clements
The reason my answer has been overly broad is because the type of data that is being parsed by TinderboxPrint lines is inconsistent. Some of its CPU/resource stats that should be reported to Perfherder, some of it is urls embedded in html, and some is other bits of data (for example): ``` "tit

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-13 Thread Nicholas Alexander
Hi all, On Mon, Apr 13, 2020 at 10:29 AM Sarah Clements wrote: > Nick, > > I want to clarify something I said in my previous email that might be > confusing: > > We currently process data from the jobInfo and extra.artifacts > properties of jobs we ingest (this goes into the JobDetails table). >

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-13 Thread Sarah Clements
Nick, I want to clarify something I said in my previous email that might be confusing: > We currently process data from the jobInfo and extra.artifacts properties of jobs we ingest (this goes into the JobDetails table). Disregard this, it's mostly specific to Treeherder (I think we're primarily u

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-13 Thread Sarah Clements
Hi Steve, You will still be able to see all uploaded artifacts in the Treeherder job detail panel. The difference is that we will be retrieving them from taskcluster directly rather than storing them in our database and retrieving them that way. Regarding your use of log lines, if you can create

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-10 Thread ISHIKAWA,chiaki
On 2020/04/11 3:03, Steve Fink wrote: On 4/10/20 10:06 AM, Andrew McCreight wrote: On Thu, Apr 9, 2020 at 6:51 PM Sarah Clements wrote: Hello, As part of maintenance work and performance improvements to Treeherder, we're making changes to some of the data that's stored in our database. On

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-10 Thread KWierso
On Friday, April 10, 2020 at 11:08:14 AM UTC-7, Sarah Clements wrote: > Otherwise, this is the API: > https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task//runs/0/artifacts > <-- for all artifacts or with `/` to select just one specific > artifact. Just as a side note, that "0" in the URL

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-10 Thread Sarah Clements
Hi Nick and Andrew, Thanks for the questions. The job details panel in the UI will continue to display uploaded artifacts, the difference is we'll be retrieving them from taskcluster directly rather than storing them in JobDetails API and then retrieving them that way. I mentioned this in case an

Deprecation notice - change to Treeherder's jobdetail API

2020-04-10 Thread Sarah Clements
Hello, As part of maintenance work and performance improvements to Treeherder, we're making changes to some of the data that's stored in our database. On *April 30th*, we will no longer be retrieving uploaded artifacts for jobs and storing them in the JobDetail table. Uploaded artifacts can be re

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-10 Thread Steve Fink
On 4/10/20 10:06 AM, Andrew McCreight wrote: On Thu, Apr 9, 2020 at 6:51 PM Sarah Clements wrote: Hello, As part of maintenance work and performance improvements to Treeherder, we're making changes to some of the data that's stored in our database. On *April 30th*, we will no longer be retri

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-10 Thread Andrew McCreight
On Thu, Apr 9, 2020 at 6:51 PM Sarah Clements wrote: > Hello, > > As part of maintenance work and performance improvements to Treeherder, > we're making changes to some of the data that's stored in our database. On > *April > 30th*, we will no longer be retrieving uploaded artifacts for jobs and

Re: Deprecation notice - change to Treeherder's jobdetail API

2020-04-09 Thread Nicholas Alexander
Hello Sarah, others, On Thu, Apr 9, 2020 at 6:51 PM Sarah Clements wrote: > Hello, > > As part of maintenance work and performance improvements to Treeherder, > we're making changes to some of the data that's stored in our database. On > *April > 30th*, we will no longer be retrieving uploaded