koert kuipers created SPARK-1801:
------------------------------------
Summary: Open up sime private APIs related to creating new RDDs
for developers
Key: SPARK-1801
URL: https://issues.apache.org/jira/browse/SPARK-1801
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 1.0.0
Reporter: koert kuipers
Priority: Minor
in writing my own RDD i ran into a few issues with respect to stuff being
private in spark.
in compute i would like to return an iterator that respects task killing (as
HadoopRDD does), but the mechanics for that are inside the private
InterruptibleIterator. also the exception i am supposed to throw
(TaskKilledException) is private to spark.
See also:
http://apache-spark-user-list.1001560.n3.nabble.com/Re-writing-my-own-RDD-td5558.html
--
This message was sent by Atlassian JIRA
(v6.2#6252)
