[
https://issues.apache.org/jira/browse/CRUNCH-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044756#comment-15044756
]
Tom White commented on CRUNCH-583:
----------------------------------
The following shows the problem:
{code}
import org.apache.crunch.scrunch._
val pipeline = new Pipeline(new
org.apache.crunch.impl.mr.MRPipeline(classOf[org.apache.hadoop.conf.Configuration],
new org.apache.hadoop.conf.Configuration()))
val pcol: PCollection[String] = pipeline.readTextFile("/tmp/in")
pcol.materialize.foreach(println) // works
case class content(val a: Int)
val pcolc: PCollection[content] = pcol.map(s => content(s.toInt))
pcolc.materialize.foreach(println) // fails
{code}
Where the file _/tmp/in_ contains a few lines of integer values.
> Scrunch classloader failure in distcache
> ----------------------------------------
>
> Key: CRUNCH-583
> URL: https://issues.apache.org/jira/browse/CRUNCH-583
> Project: Crunch
> Issue Type: Bug
> Components: Core, Scrunch
> Affects Versions: 0.13.0
> Reporter: Tom White
> Assignee: Tom White
>
> This is the same as CRUNCH-571, but in DistCache.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
