Re: Language constructs for listing running queries and cancelling them

[kARTHIK R]

Yes, scoping this to bytecode is a good idea. Is there any risks in trying
to support this for HTTP requests? (Supporting sessions and scripts may
easily bloat up the scope. so your concern there is very valid).

Either way, what would be the next steps to take this forward?

Karthik

On Wed, Nov 7, 2018 at 9:07 AM Stephen Mallette 
wrote:

> I like the thought for explicit cancellation, but I think that before we
> get into what that would look like or how it would work, we'd need to
> determine the scope of what we wanted to allow cancellation of.  We have
> scripts (both with and without a session) and we have bytecode based
> requests. I suppose the scope could be such that we only attempted to
> cancel bytecode based traversals which is what your proposal reads like.
> That might be acceptable since we are trying to move folks away from
> scripts. This would be another feature that makes bytecode a better choice
> over scripts. Any thoughts on having some asymmetry there?
>
> On Tue, Nov 6, 2018 at 3:26 PM kARTHIK R  wrote:
>
> > Hi Team,
> >
> > This is a followup of a SO discussion[1] with Stephen where I wanted to
> see
> > if we can add language constructs for 1) Listing running queries 2)
> > Cancelling a running query. Something straightforward would look like
> this:
> >
> > g.query() or g.Q() -> Iterator for all running queries
> > g.query("132" or g.Q("123") -> project a single query
> > g.query("123").cancel() or g.Q("123").cancel() -> to cancel the query
> >
> > Later, the same can be extended with .profile() and other statistics
> steps.
> > Interested in hearing your thoughts.
> >
> > Karthik R
> >
> > [1]
> >
> >
> https://stackoverflow.com/questions/53053463/how-do-i-list-running-gremlin-queries-how-can-i-cancel-slow-or-long-running-que
> >
>

[jira] [Closed] (TINKERPOP-237) Tree -> Graph

[stephen mallette (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stephen mallette closed TINKERPOP-237.
--
Resolution: Won't Do

A lot of time has passed on this one and I don't see us making this happen 
given the problems identified and the direction of GLVs. Could be value in the 
idea of doing {{Tree}} as "path of paths" but that's not really the topic of 
this issue - see the linked ticket for where that might be useful. 

> Tree -> Graph
> -
>
> Key: TINKERPOP-237
> URL: https://issues.apache.org/jira/browse/TINKERPOP-237
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: process, structure
>Affects Versions: 3.0.2-incubating
>Reporter: Marko A. Rodriguez
>Priority: Major
>
> Take a {{Tree}} instance and convert it to a {{Graph}}. The graph must 
> support user supplied ids (e.g. TinkerGraph).
> {code:java}
> myTree.toGraph(TinkerGraph.class)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-2063) Support for tree() and subgraph() in GLVs

[stephen mallette (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680742#comment-16680742
 ] 

stephen mallette commented on TINKERPOP-2063:
-

In TINKERPOP-237 it was suggested that {{Tree}} is just a type of {{Path}} - if 
we did that GLVs would be ready to go with {{tree()}} as no additional data 
structure would be needed on the GLV side

> Support for tree() and subgraph() in GLVs
> -
>
> Key: TINKERPOP-2063
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2063
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: dotnet, javascript, python
>Affects Versions: 3.3.3
>Reporter: stephen mallette
>Priority: Minor
>
> This is a bit of a placeholder to act as a reminder that there still remain 
> some functionality that works on the JVM but does not work in GLVs. Need to 
> think through ways to deal with that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work started] (TINKERPOP-2010) Generate jsdoc for gremlin-javascript

[stephen mallette (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on TINKERPOP-2010 started by stephen mallette.
---
> Generate jsdoc for gremlin-javascript
> -
>
> Key: TINKERPOP-2010
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2010
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: build-release, documentation, javascript
>Affects Versions: 3.2.9
>Reporter: stephen mallette
>Assignee: stephen mallette
>Priority: Major
>
> There are two parts to this...first we need to automate jsdoc generation with 
> maven and then second we need to take that output and publish it as part of 
> {{bin/publish-docs.sh}}. Perhaps [~jorgebg] can handle the first part and 
> [~dkuppitz] can look into the second part?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-2010) Generate jsdoc for gremlin-javascript

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680734#comment-16680734
 ] 

ASF GitHub Bot commented on TINKERPOP-2010:
---

spmallette opened a new pull request #991: TINKERPOP-2010 Generate JSDoc for 
gremlin-javascript
URL: https://github.com/apache/tinkerpop/pull/991
 
 
   https://issues.apache.org/jira/browse/TINKERPOP-2010
   
   Docs generate with a standard build. Fastest way to see them is with `mvn 
process-resources -pl gremlin-javascript` which will generate them to 
`gremlin-javascript/src/main/javascript/gremlin-javascript/doc/`.
   
   Updated `publish-docs.sh` to push jsdoc to 
`http://tinkerpop.apache.org/jsdocs/x.y.z/` on the website. Haven't actually 
executed that shell script yet.
   
   VOTE +1


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Generate jsdoc for gremlin-javascript
> -
>
> Key: TINKERPOP-2010
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2010
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: build-release, documentation, javascript
>Affects Versions: 3.2.9
>Reporter: stephen mallette
>Assignee: Jorge Bay
>Priority: Major
>
> There are two parts to this...first we need to automate jsdoc generation with 
> maven and then second we need to take that output and publish it as part of 
> {{bin/publish-docs.sh}}. Perhaps [~jorgebg] can handle the first part and 
> [~dkuppitz] can look into the second part?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] [tinkerpop] spmallette opened pull request #991: TINKERPOP-2010 Generate JSDoc for gremlin-javascript

[GitHub]

https://issues.apache.org/jira/browse/TINKERPOP-2010

Docs generate with a standard build. Fastest way to see them is with `mvn 
process-resources -pl gremlin-javascript` which will generate them to 
`gremlin-javascript/src/main/javascript/gremlin-javascript/doc/`.

Updated `publish-docs.sh` to push jsdoc to 
`http://tinkerpop.apache.org/jsdocs/x.y.z/` on the website. Haven't actually 
executed that shell script yet.

VOTE +1

[ Full content available at: https://github.com/apache/tinkerpop/pull/991 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[jira] [Closed] (TINKERPOP-1931) Allow integration tests to be executed against Gremlin Endpoints which don't allow anonymous connections

[stephen mallette (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stephen mallette closed TINKERPOP-1931.
---
Resolution: Won't Do

i keep coming back to this one every once in a while as I like its general 
sentiment. Given that there hasn't been any other discussion around it i'm not 
sure anyone is coming along to do this. the more i kick this around in my head 
the less i feel like the GLV test suites are meant to validate operations for 
graphs like CosmosDB...it's just not their role. Their tests are designed to 
test GLV operations and not so much graph operations. Using CosmosDB as the 
example since it was mentioned on this ticket, I think that the correct 
approach for testing with the TinkerPop test suite would be for CosmosDB to 
leverage the Java process test suite directly or implement a processor for our 
gherkin tests - the latter might be the better approach. Either of these two 
approaches is exactly how all other graphs handle testing. As we look to the 
future for TP4, I think we will be elevating the gherkin suite to being the 
primary test suite for TinkerPop providers and we'll think more carefully on 
how we ensure it's accessibility to all the providers that we service (language 
providers, graph providers, etc..) 

> Allow integration tests to be executed against Gremlin Endpoints which don't 
> allow anonymous connections
> 
>
> Key: TINKERPOP-1931
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1931
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: dotnet
>Affects Versions: 3.3.1
>Reporter: Roman Kreisel
>Priority: Major
>
> Right now, it's not possible to run the Gremlin.NET integration tests against 
> Gremlin Endpoints, which don't allow connections without user and/or 
> password. Some even might only support SSL connections, which also isn't 
> supported by most unit tests..
> One of those databases is Microsoft's Cosmos DB.
> Since especially Gremlin.NET might be used often in context of Azure and the 
> Cosmos DB, it might be very helpful to have working integration tests against 
> this database as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-2038) Make groovy script cache size configurable

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680493#comment-16680493
 ] 

ASF GitHub Bot commented on TINKERPOP-2038:
---

spmallette opened a new pull request #990: TINKERPOP-2038 Made the 
GremlinGroovyScriptEngine cache configurable
URL: https://github.com/apache/tinkerpop/pull/990
 
 
   https://issues.apache.org/jira/browse/TINKERPOP-2038
   
   Exposed as a configuration option on the GroovyCompilerGremlinPlugin where 
the config is set via a Caffeine specification string.
   
   All tests pass with `docker/build.sh -t -i`
   
   VOTE +1


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Make groovy script cache size configurable
> --
>
> Key: TINKERPOP-2038
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2038
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: groovy
>Affects Versions: 3.2.9
>Reporter: Robert Dale
>Assignee: stephen mallette
>Priority: Minor
>
> See 
> [thread|https://groups.google.com/d/msg/gremlin-users/fm6Og2i1uXw/0J3F309IBAAJ]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] [tinkerpop] spmallette commented on issue #986: TINKERPOP-2059 Modulation of valueMap()

[GitHub]

nice job - VOTE +1

[ Full content available at: https://github.com/apache/tinkerpop/pull/986 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] spmallette opened pull request #990: TINKERPOP-2038 Made the GremlinGroovyScriptEngine cache configurable

[GitHub]

https://issues.apache.org/jira/browse/TINKERPOP-2038

Exposed as a configuration option on the GroovyCompilerGremlinPlugin where the 
config is set via a Caffeine specification string.

All tests pass with `docker/build.sh -t -i`

VOTE +1

[ Full content available at: https://github.com/apache/tinkerpop/pull/990 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[jira] [Closed] (TINKERPOP-2064) Add status attributes to results for gremlin-javascript

[Jorge Bay (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jorge Bay closed TINKERPOP-2064.

Resolution: Done

> Add status attributes to results for gremlin-javascript
> ---
>
> Key: TINKERPOP-2064
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2064
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: javascript
>Affects Versions: 3.3.3
>Reporter: stephen mallette
>Assignee: Jorge Bay
>Priority: Major
> Fix For: 3.4.0
>
>
> This feature was made possible on TINKERPOP-1913 for all other clients except 
> this one which didn't have the notion of a "result". Basically, we just need 
> a way for users to get the status attributes returned on the response for a 
> request.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (TINKERPOP-2091) Wrong/Missing feature requirements in StructureStandardTestSuite

[Frank Hammon (JIRA)]

Frank Hammon created TINKERPOP-2091:
---

 Summary: Wrong/Missing feature requirements in 
StructureStandardTestSuite
 Key: TINKERPOP-2091
 URL: https://issues.apache.org/jira/browse/TINKERPOP-2091
 Project: TinkerPop
  Issue Type: Bug
  Components: test-suite
Affects Versions: 3.3.4
Reporter: Frank Hammon


Some tests fail as they don't have the correct feature requirement set.
{color:#00}test {color}{color:#00}={color}{color:#00} 
{color}{color:#008800}"org.apache.tinkerpop.gremlin.structure.PropertyTest$PropertyFeatureSupportTest"{color}{color:#00},{color}{color:#00}
method {color}{color:#00}={color}{color:#00} 
{color}{color:#008800}"shouldSetValueOnVertex"{color}{color:#00},{color}
{color:#00}test {color}{color:#00}={color}{color:#00} 
{color}{color:#008800}"org.apache.tinkerpop.gremlin.structure.PropertyTest$PropertyFeatureSupportTest"{color}{color:#00},{color}{color:#00}
method {color}{color:#00}={color}{color:#00} 
{color}{color:#008800}"shouldSetValueOnVertexOnAdd"{color}{color:#00},{color}
Both tests in the StructureStandardSuite are failing due to testing boolean 
array support under string array feature.
 
{color:#00}test {color}{color:#00}={color}{color:#00} 
{color}{color:#008800}"org.apache.tinkerpop.gremlin.structure.util.star.StarGraphTest"{color}{color:#00},{color}{color:#00}
method {color}{color:#00}={color}{color:#00} 
{color}{color:#008800}"shouldHandleSelfLoops"{color}{color:#00},{color}
This test uses string properties on edges without having set this as a feature 
requirement (add property on edges is set as requirement though).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (TINKERPOP-1849) Provide a way to fold() with an index

[stephen mallette (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stephen mallette reassigned TINKERPOP-1849:
---

Assignee: Daniel Kuppitz

> Provide a way to fold() with an index
> -
>
> Key: TINKERPOP-1849
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1849
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: process
>Affects Versions: 3.3.0
>Reporter: stephen mallette
>Assignee: Daniel Kuppitz
>Priority: Major
>
> In Groovy you can call {{withIndex()}} to generate output like this:
> {code}
> gremlin> g.V().fold().next().withIndex()
> ==>[v[1],0]
> ==>[v[2],1]
> ==>[v[3],2]
> ==>[v[4],3]
> ==>[v[5],4]
> ==>[v[6],5]
> {code}
> We can currently simulate this with Gremlin via:
> {code}
> gremlin> 
> g.V().project("a","b").by().by(select("x").count(local)).store("x").map(union(select('a'),
>  select('b')).fold()).fold().next()
> ==>[v[1],0]
> ==>[v[2],1]
> ==>[v[3],2]
> ==>[v[4],3]
> ==>[v[5],4]
> ==>[v[6],5]
> {code}
> but it's not easy to follow, efficient, or potentially foolproof. Perhaps we 
> can add an option to {{fold()}} that would take an enum of "fold operators".



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Closed] (TINKERPOP-2091) Wrong/Missing feature requirements in StructureStandardTestSuite

[stephen mallette (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-2091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stephen mallette closed TINKERPOP-2091.
---
   Resolution: Fixed
 Assignee: stephen mallette
Fix Version/s: 3.3.5
   3.4.0

> Wrong/Missing feature requirements in StructureStandardTestSuite
> 
>
> Key: TINKERPOP-2091
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2091
> Project: TinkerPop
>  Issue Type: Bug
>  Components: test-suite
>Affects Versions: 3.3.4
>Reporter: Frank Hammon
>Assignee: stephen mallette
>Priority: Minor
> Fix For: 3.4.0, 3.3.5
>
>
> Some tests fail as they don't have the correct feature requirement set.
> {color:#00}test {color}{color:#00}={color}{color:#00} 
> {color}{color:#008800}"org.apache.tinkerpop.gremlin.structure.PropertyTest$PropertyFeatureSupportTest"{color}{color:#00},{color}{color:#00}
> method {color}{color:#00}={color}{color:#00} 
> {color}{color:#008800}"shouldSetValueOnVertex"{color}{color:#00},{color}
> {color:#00}test {color}{color:#00}={color}{color:#00} 
> {color}{color:#008800}"org.apache.tinkerpop.gremlin.structure.PropertyTest$PropertyFeatureSupportTest"{color}{color:#00},{color}{color:#00}
> method {color}{color:#00}={color}{color:#00} 
> {color}{color:#008800}"shouldSetValueOnVertexOnAdd"{color}{color:#00},{color}
> Both tests in the StructureStandardSuite are failing due to testing boolean 
> array support under string array feature.
>  
> {color:#00}test {color}{color:#00}={color}{color:#00} 
> {color}{color:#008800}"org.apache.tinkerpop.gremlin.structure.util.star.StarGraphTest"{color}{color:#00},{color}{color:#00}
> method {color}{color:#00}={color}{color:#00} 
> {color}{color:#008800}"shouldHandleSelfLoops"{color}{color:#00},{color}
> This test uses string properties on edges without having set this as a 
> feature requirement (add property on edges is set as requirement though).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-2064) Add status attributes to results for gremlin-javascript

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679565#comment-16679565
 ] 

ASF GitHub Bot commented on TINKERPOP-2064:
---

jorgebay closed pull request #985: TINKERPOP-2064 Expose response attributes in 
JavaScript Driver
URL: https://github.com/apache/tinkerpop/pull/985
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Add status attributes to results for gremlin-javascript
> ---
>
> Key: TINKERPOP-2064
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2064
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: javascript
>Affects Versions: 3.3.3
>Reporter: stephen mallette
>Assignee: Jorge Bay
>Priority: Major
> Fix For: 3.4.0
>
>
> This feature was made possible on TINKERPOP-1913 for all other clients except 
> this one which didn't have the notion of a "result". Basically, we just need 
> a way for users to get the status attributes returned on the response for a 
> request.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work started] (TINKERPOP-2038) Make groovy script cache size configurable

[stephen mallette (JIRA)]

 [ 
https://issues.apache.org/jira/browse/TINKERPOP-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on TINKERPOP-2038 started by stephen mallette.
---
> Make groovy script cache size configurable
> --
>
> Key: TINKERPOP-2038
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2038
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: groovy
>Affects Versions: 3.2.9
>Reporter: Robert Dale
>Assignee: stephen mallette
>Priority: Minor
>
> See 
> [thread|https://groups.google.com/d/msg/gremlin-users/fm6Og2i1uXw/0J3F309IBAAJ]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-1849) Provide a way to fold() with an index

[Daniel Kuppitz (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680108#comment-16680108
 ] 

Daniel Kuppitz commented on TINKERPOP-1849:
---

I don't know when I will start to work on this, so - as a reminder - here are 
just the thoughts from our latest discussion:

We should only implement a local version of this step, because

# it's not too much to ask a user to do the {{fold()}}
# by explicitly using {{fold()}} the user is made aware of the memory 
consumption
# it will just work in OLTP and OLAP

This is how could look like:

{noformat}
gremlin> g.V().index()
==>[v[1], 0]
==>[v[2], 0]
==>[v[3], 0]
==>[v[4], 0]
==>[v[5], 0]
==>[v[6], 0]
gremlin> g.V().fold().index()
==>[[v[1],0],[v[2],1],[v[3],2],[v[4],3],[v[5],4],[v[6],5]]
gremlin> g.V().fold().index().by('e').by('i')
==>[[e:v[1],i:0],[e:v[2],i:1],[e:v[3],i:2],[e:v[4],i:3],[e:v[5],i:4],[e:v[6],i:5]]
{noformat}

> Provide a way to fold() with an index
> -
>
> Key: TINKERPOP-1849
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1849
> Project: TinkerPop
>  Issue Type: Improvement
>  Components: process
>Affects Versions: 3.3.0
>Reporter: stephen mallette
>Assignee: Daniel Kuppitz
>Priority: Major
>
> In Groovy you can call {{withIndex()}} to generate output like this:
> {code}
> gremlin> g.V().fold().next().withIndex()
> ==>[v[1],0]
> ==>[v[2],1]
> ==>[v[3],2]
> ==>[v[4],3]
> ==>[v[5],4]
> ==>[v[6],5]
> {code}
> We can currently simulate this with Gremlin via:
> {code}
> gremlin> 
> g.V().project("a","b").by().by(select("x").count(local)).store("x").map(union(select('a'),
>  select('b')).fold()).fold().next()
> ==>[v[1],0]
> ==>[v[2],1]
> ==>[v[3],2]
> ==>[v[4],3]
> ==>[v[5],4]
> ==>[v[6],5]
> {code}
> but it's not easy to follow, efficient, or potentially foolproof. Perhaps we 
> can add an option to {{fold()}} that would take an enum of "fold operators".



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (TINKERPOP-2090) After running backend for a day or so System.IO.IOException keep throwing

[Florian Hockmann (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679590#comment-16679590
 ] 

Florian Hockmann commented on TINKERPOP-2090:
-

You can simply dispose the client and create a new one which closes all 
connections and creates new ones for the new client.

> After running backend for a day or so System.IO.IOException keep throwing
> -
>
> Key: TINKERPOP-2090
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2090
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.4.0
> Environment: .NET Core 2.1.5
> Microsoft Azure
>Reporter: Saber Karmous
>Priority: Critical
>
> .NET Core 2.1.5
> Gremlin.NET 3.4.0-rc2 
> We're using the latest RC of the Gremlin client. And we have a gremlin client 
> that's being injected as a singleton through out IoC container. After running 
> the backend for a day or two it keeps throwing System.IO.IOExceptions. If we 
> restart the application it works again.
> We use Polly for out retry strategy, and retrying for 9 times. But it keeps 
> failing.
> I added the stack trace below. Reproducing is a bit of a pain in the behind, 
> you have to wait for a day or two for the exception to occur.
> {noformat}
> *no* System.IO.IOException:
>  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
>  (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Runtime.CompilerServices.ConfiguredValueTaskAwaitable+ConfiguredValueTaskAwaiter.GetResult
>  (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Net.Security.SslStreamInternal+d`1.MoveNext
>  (System.Net.Security, Version=4.1.1.0, Culture=neutral, 
> PublicKeyToken=b03f5f7f11d50a3a)
>  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
>  (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Runtime.CompilerServices.ConfiguredValueTaskAwaitable+ConfiguredValueTaskAwaiter.GetResult
>  (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Net.Security.SslStreamInternal+d`1.MoveNext
>  (System.Net.Security, Version=4.1.1.0, Culture=neutral, 
> PublicKeyToken=b03f5f7f11d50a3a)
>  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
>  (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at Gremlin.Net.Driver.WebSocketConnection+d__7.MoveNext 
> (Gremlin.Net, Version=3.4.0.0, Culture=neutral, 
> PublicKeyToken=d2035e9aa387a711)
>  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
> System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
>  (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at Gremlin.Net.Driver.Connection+d__13.MoveNext (Gremlin.Net, 
> Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711)
>  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess 
> (System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, 
> PublicKeyToken=7cec85d7bea7798e)
>  at 
>

[jira] [Commented] (TINKERPOP-2090) After running backend for a day or so System.IO.IOException keep throwing

[Greg Pepin (JIRA)]

[ 
https://issues.apache.org/jira/browse/TINKERPOP-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680081#comment-16680081
 ] 

Greg Pepin commented on TINKERPOP-2090:
---

I am also experiencing a similar issue.

Here is the error information and portion of the stack trace beginning with 
Gremlin.Net. What is generally happening is that a request is made to cosmosDb 
and 1-10 minutes later this error is returned, even for very simple traversals 
such a g.V(id).

Message:
An internal WebSocket error occurred. Please see the innerException, if 
present, for more details. Unable to read data from the transport connection: 
An existing connection was forcibly closed by the remote host. An existing 
connection was forcibly closed by the remote host

Exception Type:
System.Net.Sockets.SocketException

Failed Method:
Gremlin.Net.Driver.WebSocketConnection+d__8.MoveNext

Callstack:
System.Net.WebSockets.WebSocketException: at 
System.Net.WebSockets.WebSocketBase.ThrowIfConvertibleException (System, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Net.WebSockets.WebSocketBase+d__45.MoveNext (System, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.WebSocketConnection+d__8.MoveNext 
(Gremlin.Net, Version=3.4.0.0, Culture=neutral, 
PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.Connection+d__14`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.Connection+d__8`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.ProxyConnection+d__3`1.MoveNext 
(Gremlin.Net, Version=3.4.0.0, Culture=neutral, 
PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.GremlinClient+d__6`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.GremlinClientExtensions+d__4`1.MoveNext 
(Gremlin.Net, Version=3.4.0.0, Culture=neutral, 
PublicKeyToken=d2035e9aa387a711) at

 

> After running backend for a day or so System.IO.IOException keep throwing
> -
>
> Key: TINKERPOP-2090
> URL: https://issues.apache.org/jira/browse/TINKERPOP-2090
> Project: TinkerPop
>  Issue Type: Bug
>  Components: dotnet
>Affects Versions: 3.4.0
> Environment: .NET Core 2.1.5
> Microsoft Azure
>Reporter: Saber Karmous
>Priority: Critical
>
> .NET Core 2.1.5
> Gremlin.NET 3.4.0-rc2 
> We're using the latest RC of the Gremlin client. And we have a gremlin client 
> that's being injected as a singleton through out IoC container. After running 
> the backend for a day or two it keeps throwing System.IO.IOExceptions. If we 
> restart the application it works again.
> We use Polly for out retry strategy, and retrying for 9 times. But it keeps 
> failing.
> I added the stack trace below. Reproducing is a bit of a pain

Uniqueness of property ids

[Daniel Kuppitz]

Working on TINKERPOP-2051
, I thought I found a
pretty easy solution: In order to allow locally unique property ids, we
only need to compare the ids of two properties as well as the ids of their
parent elements. That was basically a one-line change and had the expected
effect:


gremlin> g = TinkerGraph.open().traversal()
==>graphtraversalsource[tinkergraph[vertices:0 edges:0], standard]
gremlin> g.addV("person").property("name", "alice", id, "name").as("a").
..1>   addV("person").property("name", "bob", id, "name").
..2>   addE("knows").from("a")
==>e[2][0-knows->1]
gremlin>
gremlin> g.V().properties("name")
==>vp[name->alice]
==>vp[name->bob]
gremlin> g.V().properties("name").dedup()
==>vp[name->alice]
==>vp[name->bob]


Without the change in id comparison, the last statement would have only
returned 1 of the properties. Looked easy enough, but - of course - it
broke the test suite. This change had an impact on 2 types of tests:

   - those, that deal with serialization and deserialization
   - those, that make use of bytecode

Perhaps the latter can be seen as a more specific case of the former. The
problem is that serialized/deserialized/detached properties no longer have
a reference to their former parent element. I thought about skipping the
parent id comparison in case one of the elements parents is *null*, but at
some point that just felt wrong and made me think of all kind of horror
scenarios this could/would lead to.

So my question is, what would be the smartest way to handle that? Adjust
all test cases, so they no longer rely on full equality? Fix
(de)serialization to include parent element ids? Something else?

*Example of a failing test:*

[ERROR]   SerializationTest$GryoV1d0Test.shouldSerializeTree:254 The
objects differ
expected:
org.apache.tinkerpop.gremlin.process.traversal.step.util.Tree<{v[1]={v[2]={vp[name->vadas]={}},
v[3]={vp[name->lop]={}}, v[4]={vp[name->josh]={>
but was:
org.apache.tinkerpop.gremlin.process.traversal.step.util.Tree<{v[1]={v[2]={vp[name->vadas]={}},
v[3]={vp[name->lop]={}}, v[4]={vp[name->josh]={>


Crazy thought: We could just change the tests to compare the toString()
versions of results

Cheers,
Daniel

[GitHub] [tinkerpop] papa-pep commented on issue #903: Gremlin.Net: Add ConnectionPool min and max sizes TINKERPOP-1774

[GitHub]

I'll check out that ticket, thanks.

FYI - Here is the error information and portion of the stack trace beginning 
with Gremlin.Net.  What is generally happening is that a request is made to 
cosmosDb and 1-10 minutes later this error is returned, even for very simple 
traversals such a g.V(id).

Message:
An internal WebSocket error occurred. Please see the innerException, if 
present, for more details. Unable to read data from the transport connection: 
An existing connection was forcibly closed by the remote host. An existing 
connection was forcibly closed by the remote host 

Exception Type:
System.Net.Sockets.SocketException

Failed Method:
Gremlin.Net.Driver.WebSocketConnection+d__8.MoveNext

Callstack:
System.Net.WebSockets.WebSocketException: at 
System.Net.WebSockets.WebSocketBase.ThrowIfConvertibleException (System, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Net.WebSockets.WebSocketBase+d__45.MoveNext (System, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.WebSocketConnection+d__8.MoveNext 
(Gremlin.Net, Version=3.4.0.0, Culture=neutral, 
PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleN
 onSuccessAndDebuggerNotification (mscorlib, Version=4.0.0.0, Culture=neutral, 
PublicKeyToken=b77a5c561934e089) at 
Gremlin.Net.Driver.Connection+d__14`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.Connection+d__8`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToke
 n=b77a5c561934e089) at 
Gremlin.Net.Driver.ProxyConnection+d__3`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.GremlinClient+d__6`1.MoveNext (Gremlin.Net, 
Version=3.4.0.0, Culture=neutral, PublicKeyToken=d2035e9aa387a711) at 
System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (mscorlib, 
Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) at 
System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification
 (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089) 
at Gremlin.Net.Driver.GremlinClientExtensions+d__4`1
 .MoveNext (Gremlin.Net, Version=3.4.0.0, Culture=neutral, 
PublicKeyToken=d2035e9aa387a711) at 



[ Full content available at: https://github.com/apache/tinkerpop/pull/903 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] FlorianHockmann commented on issue #972: TINKERPOP-2067 Allow getting raw JToken data from Gremlin.Net.Driver.GremlinClient.

[GitHub]

Sure, I can take care of the merge, but if you want to do it, then by all means 
go ahead! It's not like I own the code or anything 😅

[ Full content available at: https://github.com/apache/tinkerpop/pull/972 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] spmallette commented on issue #972: TINKERPOP-2067 Allow getting raw JToken data from Gremlin.Net.Driver.GremlinClient.

[GitHub]

VOTE +1 

@FlorianHockmann will you be handling this merge? if not, i can do it...

[ Full content available at: https://github.com/apache/tinkerpop/pull/972 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] spmallette commented on issue #968: TINKERPOP-2078 Added AnonymousTraversalSource

[GitHub]

I think that this is "final" now. I just pushed the changes to python to 
include a form of `AnonymousTraversalSource` like the javascript approach 
@jorgebay added. Fixed up docs. Hopefully, everyone is happy with this one now 
and we can merge. I'd like to do that tomorrow as this issue is holding up 
other work. 

[ Full content available at: https://github.com/apache/tinkerpop/pull/968 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] spmallette commented on issue #989: Fixed/added missing feature requirements for tests

[GitHub]

Thanks for this - cherry picked to tp33 and merged to master: 
48a1af3eabeb08bb9c757d61b3870fd63f45d4c7

[ Full content available at: https://github.com/apache/tinkerpop/pull/989 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] spmallette closed pull request #989: Fixed/added missing feature requirements for tests

[GitHub]

[ pull request closed by spmallette ]

[ Full content available at: https://github.com/apache/tinkerpop/pull/989 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] fhammon opened pull request #989: Fixed/added missing feature requirements for tests

[GitHub]

Found wrong/missing feature requirements in tests

[ Full content available at: https://github.com/apache/tinkerpop/pull/989 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] jorgebay closed pull request #985: TINKERPOP-2064 Expose response attributes in JavaScript Driver

[GitHub]

[ pull request closed by jorgebay ]

[ Full content available at: https://github.com/apache/tinkerpop/pull/985 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org

[GitHub] [tinkerpop] jorgebay commented on issue #968: TINKERPOP-2078 Added AnonymousTraversalSource

[GitHub]

I've introduced `AnonymousTraversalSource` in gremlin-javascript.

[ Full content available at: https://github.com/apache/tinkerpop/pull/968 ]
This message was relayed via gitbox.apache.org for dev@tinkerpop.apache.org