RE: Best ways to use Spark with .NET code

2013-12-16 Thread Silvio Fiorito
Have you looked at ikvm? http://www.ikvm.net/devguide/java2net.html From: Kenneth Tranmailto:o...@kentran.net Sent: ‎12/‎16/‎2013 7:43 PM To: usermailto:user@spark.incubator.apache.org Subject: Re: Best ways to use Spark with .NET code Hi Matei, 1. If I

Shark cached table eviction

2013-11-20 Thread Silvio Fiorito
Is there a way to programmatically evict a cached table from the cluster cache? Is it just a matter of dropping the table or is there something else available?

Re: Reading custom inputformat from hadoop dfs

2013-10-28 Thread Silvio Fiorito
I was having the same probs trying to read from HCatalog with Scala API. The way around this was that I created a wrapper InputFormat in Java that uses Spark's SerializableWritable. I hacked this up Friday afternoon, tested a few times, and it seemed to work well. Here's an example: