I brought this up last year and there was a Jira raised: https://issues.apache.org/jira/browse/SPARK-14151
For now I just have my SInk and Source in an o.a.s package name which is not ideal but the only way round this. On Fri, 7 Oct 2016 at 08:30 Reynold Xin <r...@databricks.com> wrote: > They have always been private, haven't they? > > > https://github.com/apache/spark/blob/branch-1.6/core/src/main/scala/org/apache/spark/metrics/source/Source.scala > > > > On Thu, Oct 6, 2016 at 7:38 AM, Alexander Oleynikov <oleyniko...@gmail.com > > wrote: > > Hi. > > As of v2.0.1, the traits `org.apache.spark.metrics.source.Source` and > `org.apache.spark.metrics.sink.Sink` are defined as private to ‘spark’ > package, so it becomes troublesome to create a new implementation in the > user’s code (but still possible in a hacky way). > This seems to be the only missing piece to allow extension of the metrics > system and I wonder whether is was conscious design decision to limit the > visibility. Is it possible to broaden the visibility scope for these traits > in the future versions? > > Thanks, > Alexander > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > >
