Thanks for the reply, even though I was kind of rude. I'm using the API.
The evaluator gives me suspiciously high metrics, and the cross validator
fails out as mentioned.
The code is in Scala:
def linesToStream(lines:Array[String]) = {
val charset = Charset.forName(CHARSET)
new NameSampleDataStream(
new PlainTextByLineStream(
new
ByteArrayInputStream(lines.mkString("\n").getBytes(CHARSET)), charset))
}
I train the model with the above:
NameFinderME.train("en", entityName, linesToStream(lines),
TrainingParameters.defaultParams(),
null:Array[Byte], Collections.emptyMap[String, Object]());
When it comes time to evaluate, I recreate the stream to try to circumvent
these kinds of problems ("resetting" it also throws the same error):
val crossValidator = new TokenNameFinderCrossValidator("en",
entityName, TrainingParameters.defaultParams(),
null:Array[Byte], Collections.emptyMap[String, Object](),
listener)
crossValidator.evaluate(sampleStream, 10)
Thanks
On Wed, Nov 20, 2013 at 3:43 PM, William Colen <[email protected]>wrote:
> Are you using the API or the command line tools? Can you send a code
> snippet showing how do you load the ObjectStream?
>
>
> 2013/11/20 Walrus theCat <[email protected]>
>
> > I'm getting "java.io.IOException: Stream not marked" when calling
> > TokenNameFinderCrossValidator.evaluate with a NameSampleDataStream. This
> > works when I use a TokenNameFinderEvaluator instead. I'm led to believe
> > that .reset isn't called on the stream in the CrossValidator.
> >
>
