Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/4101#issuecomment-70611362
So on this one, it took me a minute to figure out why this is breaking. The
issue is that our workaround of casting to classtag[Any] doesn't work because
we actually do need to pass a specific class when the `NewHadoopRDD` is created
and down the chain Spark grabs this from the ClassTag:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L765
In terms of removing this, from what I can tell, this definitely would
immediately fail for anyone who wanted to use this at runtime since it will
always assume `Object` is the input format. So it seems fine to just remove the
old method. Would you be okay with removing it @srowen?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
