[
https://issues.apache.org/jira/browse/TINKERPOP-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046028#comment-15046028
]
Marko A. Rodriguez commented on TINKERPOP-1023:
-----------------------------------------------
This is now possible once https://issues.apache.org/jira/browse/TINKERPOP-1027
is merged. I copied the model that Spark JobServer uses to avoid garbage
collection of persisted RDDs. Once
https://issues.apache.org/jira/browse/TINKERPOP-1027 is merged, I will create a
{{spark.ls()}}, {{spark.rmr()}}, etc. style console helper.
> Add a spark variable in SparkGremlinPlugin like we do hdfs for
> HadoopGremlinPlugin
> ----------------------------------------------------------------------------------
>
> Key: TINKERPOP-1023
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1023
> Project: TinkerPop
> Issue Type: Improvement
> Components: hadoop
> Affects Versions: 3.1.0-incubating
> Reporter: Marko A. Rodriguez
> Assignee: Marko A. Rodriguez
> Fix For: 3.1.1-incubating
>
>
> It would be good if from the Gremlin Console we could do things like this:
> {code}
> gremlin> spark.getRDDs()
> gremlin> spark.removeRDD("graphRDD")
> gremlin> spark.getMaster()
> gremlin> spark.isPersisted()
> {code}
> With the ability to have persisted context's, its confusing as to what is
> persisted and what is not. With a {{spark}} like we have with {{hdfs}} it
> will make it more clear.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)