On Tue, 01 May 2018 17:02:13 +0000
Xiongqi ZHANG <[email protected]> wrote:

> On Tue, May 1, 2018 at 9:38 AM Arnav Sastry <[email protected]> wrote:
> >
> > Hi all,
> >
> > I'm trying to figure out why all of my judgments were skipped for
> > Mysterious Road Signs (2nd problem) in Google Code Jam 2018 Round 1B.
> >
> > Based on the FAQ, the system should score either your last submission, or
> > your earliest submission that passed the most visible test cases:
> > https://codejam.withgoogle.com/codejam/resources/faq#how-score-determined
> >
> > In my case, I had the following attempts:
> > Attempt 1: Fail, ?
> > Attempt 2: Pass, ?
> > Attempt 3: Fail, ?
> > Attempt 4: Pass, ?
> > Attempt 5: Pass, ?
> > Attempt 6: Fail, ?
> >
> > I'd expect Attempt 2 to be judged on the large test set and used for my
> > score. However, all 6 attempts show "The judgment was skipped." Can someone
> > explain to me why this is?
>
> In your case, hidden test will only be run on Attempt 6. And since your
> Attempt 6 failed the visible test, hidden test will be skipped too.

I think that it would make a lot of sense to run the hidden test
for the last submission that passed visible tests. And in the
example above it would be "Attempt 5".

I mean, if the last submission happens to be broken and even
fails visible tests, then re-submitting some variant that at least
passed visible tests is a purely mechanical action for a contestant.
The GCJ website could still judge it automatically as a convenience
feature rather than not running *any* hidden tests at all.

Anyone who passed visible tests should be eligible for exactly one
hidden test run.

Also it would be perfect if upon "Attempt 6" failure, the GCJ website
could explicitly suggest the contestant to re-upload "Attempt 2",
"Attempt 4" or "Attempt 5" if the contestant has nothing better
to submit. Maybe provide some nice radio buttons, which are
switchable between "Attempt 2", "Attempt 4" and "Attempt 5" for
even more convenience. Or do you think that this can be exploited
in some way?

-- 
Best regards,
Siarhei Siamashka aka 'ssvb'

-- 
You received this message because you are subscribed to the Google Groups 
"Google Code Jam" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-code/20180508032823.1b164726%40i7.
For more options, visit https://groups.google.com/d/optout.

Reply via email to