[
https://issues.apache.org/jira/browse/TINKERPOP-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stephen mallette closed TINKERPOP-2013.
---------------------------------------
Resolution: Done
Fix Version/s: 3.3.5
3.4.0
Basically made it so that {{OptOut}} are explicit - no more tricky background
auto-ignores for translators/remotes.
https://github.com/apache/tinkerpop/commit/8d5fb675c685a54ab67078afe65a775c7730af5c
> Process tests that are auto-ignored stink
> -----------------------------------------
>
> Key: TINKERPOP-2013
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2013
> Project: TinkerPop
> Issue Type: Improvement
> Components: test-suite
> Affects Versions: 3.2.9
> Reporter: stephen mallette
> Assignee: stephen mallette
> Priority: Major
> Fix For: 3.4.0, 3.3.5
>
>
> I think I've had it with {{GremlinProcessRunner}} and any other related
> infrastructure that auto-ignores batches of tests unknowingly. The typical
> scenario is that a new test gets added, we build the project and everything
> works without failures. Then something starts misbehaving and we wonder why.
> After a lot of cycles and looking in the wrong places we realize that the
> tests that should have caught the problem are simply being ignored.
> There was a reason for making things work this way as we had assumed that
> certain tests failing in a certain way was expected behavior, but that is not
> always the case. We’ve learned that assumption doesn’t always apply and it
> would be better to be more explicit in dealing with those failures.
> Not sure how this is going to be resolved, but I think that something needs
> to change. Perhaps we need to identify all the auto-ignored tests and do any
> of the following:
> 1. Make them work
> 2. Explicitly ignore them
> 3. Re-organize tests so that it's not assumed that they just are part of the
> process suite
> 4. Something else??
> May also need to extend this into all the ignored GLV tests that aren't
> supported for various reasons. Perhaps the assertion language needs more
> expressiveness.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
