[jira] [Commented] (TINKERPOP-1892) GLV test failures for .NET

2018-03-12 Thread Florian Hockmann (JIRA) 

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395745#comment-16395745
 ] 

Florian Hockmann commented on TINKERPOP-1892:
-

{quote}is it possible that when a failure occurs, that the rest of the feature 
file stops testing, so that tests following the failure in that particular 
feature file aren't counted?
{quote}
Turns out that you were nearly right: The {{GherkinTestRunner}} stopped 
processing a feature file after one scenario was _skipped_. This was simply 
causes by a {{break}} that should be a {{continue}}.

I fixed that with a CTR commit:

[https://github.com/apache/tinkerpop/commit/b25b9767547b2956f224cbe6fb55c756d5df612e]

This also showed yet another category of test failures in Gremlin.Net for which 
I created TINKERPOP-1922.

Now I'm getting on {{tp32}}: _Total scenarios: 451. Passed: 417. Failed: 0. 
Skipped: 34._

So the total number is right although 34 scenarios are skipped.

> GLV test failures for .NET
> --
>
> Key: TINKERPOP-1892
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1892
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.2.7
>Reporter: stephen mallette
>Priority: Major
> Fix For: 3.2.8, 3.3.2
>
>
> There are a number of test failures with the latest updates to the GLV test 
> suite on TINKERPOP-1857. Those tests have been "ignored" in 
> {{GherkinTestRunner}}. I wasn't able to discern a pattern there to make this 
> ticket any more specific. Hopefully once someone digs into this one, a better 
> title can be written or more specific JIRA issues can be produced. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-1892) GLV test failures for .NET

2018-03-12 Thread stephen mallette (JIRA) 

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395632#comment-16395632
 ] 

stephen mallette commented on TINKERPOP-1892:
-

is it possible that when a failure occurs, that the rest of the feature file 
stops testing, so that tests following the failure in that particular feature 
file aren't counted?

> GLV test failures for .NET
> --
>
> Key: TINKERPOP-1892
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1892
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.2.7
>Reporter: stephen mallette
>Priority: Major
> Fix For: 3.2.8, 3.3.2
>
>
> There are a number of test failures with the latest updates to the GLV test 
> suite on TINKERPOP-1857. Those tests have been "ignored" in 
> {{GherkinTestRunner}}. I wasn't able to discern a pattern there to make this 
> ticket any more specific. Hopefully once someone digs into this one, a better 
> title can be written or more specific JIRA issues can be produced. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-1892) GLV test failures for .NET

2018-03-12 Thread Jorge Bay (JIRA) 

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394976#comment-16394976
 ] 

Jorge Bay commented on TINKERPOP-1892:
--

There might be something wrong in the test harness...
Including only the feature file that is affected might give us a clue: 
https://github.com/apache/tinkerpop/blob/bbb13772a791ae7116551ba1d62ea7d136fe60c7/gremlin-dotnet/test/Gremlin.Net.IntegrationTest/Gherkin/GherkinTestRunner.cs#L375

> GLV test failures for .NET
> --
>
> Key: TINKERPOP-1892
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1892
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.2.7
>Reporter: stephen mallette
>Priority: Major
> Fix For: 3.2.8, 3.3.2
>
>
> There are a number of test failures with the latest updates to the GLV test 
> suite on TINKERPOP-1857. Those tests have been "ignored" in 
> {{GherkinTestRunner}}. I wasn't able to discern a pattern there to make this 
> ticket any more specific. Hopefully once someone digs into this one, a better 
> title can be written or more specific JIRA issues can be produced. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-1892) GLV test failures for .NET

2018-03-11 Thread Florian Hockmann (JIRA) 

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394531#comment-16394531
 ] 

Florian Hockmann commented on TINKERPOP-1892:
-

I think I identified the problems leading to those test failures and created 
tickets for them: TINKERPOP-1918, TINKERPOP-1919, and TINKERPOP-1920.

However, I also found something else I don't quite understand: There were only 
3 scenarios ignored explicitly in Gremlin.Net on {{tp32}} (not counting the 
lambda scenarios), but when I re-enabled them, I didn't get 3 failed tests, but 
9 and the total number of scenarios went up from 424 to 451:
 * Current state on {{tp32}}: _Total scenarios: 424. Passed: 394. Failed: 0. 
Skipped: 30_.
 * After re-enabling the 3 scenarios: _Total scenarios: 451. Passed: 415. 
Failed: 9. Skipped: 27_.

[~jorgebg], do you know what's happening there?

> GLV test failures for .NET
> --
>
> Key: TINKERPOP-1892
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1892
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.2.7
>Reporter: stephen mallette
>Priority: Major
> Fix For: 3.2.8, 3.3.2
>
>
> There are a number of test failures with the latest updates to the GLV test 
> suite on TINKERPOP-1857. Those tests have been "ignored" in 
> {{GherkinTestRunner}}. I wasn't able to discern a pattern there to make this 
> ticket any more specific. Hopefully once someone digs into this one, a better 
> title can be written or more specific JIRA issues can be produced. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-1892) GLV test failures for .NET

2018-03-01 Thread stephen mallette (JIRA) 

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382385#comment-16382385
 ] 

stephen mallette commented on TINKERPOP-1892:
-

Many of these tests are fixed now - just a few left ignored in 
GherkinTestRunner.

> GLV test failures for .NET
> --
>
> Key: TINKERPOP-1892
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1892
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.2.7
>Reporter: stephen mallette
>Priority: Major
> Fix For: 3.2.8, 3.3.2
>
>
> There are a number of test failures with the latest updates to the GLV test 
> suite on TINKERPOP-1857. Those tests have been "ignored" in 
> {{GherkinTestRunner}}. I wasn't able to discern a pattern there to make this 
> ticket any more specific. Hopefully once someone digs into this one, a better 
> title can be written or more specific JIRA issues can be produced. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)