Just in case you are in San Francisco, we are having a meetup by Prof John
Canny
http://www.meetup.com/SF-Big-Analytics/events/220427049/
Chester
Sorry for the many typos as I was typing from my cell phone. Hope you still
can get the idea.
On Sat, Feb 7, 2015 at 1:55 PM, Chester @work ches...@alpinenow.com wrote:
I just implemented this in our application. The impersonation is done
before the job is submitted. In spark yarn (we are
Ron,
Which distribution and Version of Hadoop are you using ?
I just looked at CDH5 ( hadoop-mapreduce-client-core-
2.3.0-cdh5.0.0),
MRJobConfig does have the field :
java.lang.String DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH;
Chester
On Sun, Jul 13, 2014 at 6:49 PM, Ron Gonzalez
I don't have experience deploying to EC2. can you use add.jar conf to add
the missing jar at runtime ? I haven't tried this myself. Just a guess.
On Mon, Jul 7, 2014 at 12:16 PM, Chester Chen ches...@alpinenow.com wrote:
with provided scope, you need to provide the provided jars
believe the redirect error has
little to do with Spark itself, but more to do with how you set up the
cluster. I have actually run into this myself, but I haven't found a
workaround. Let me know if you find anything.
2014-07-07 12:07 GMT-07:00 Chester Chen ches...@alpinenow.com:
As Andrew
Yes, they have announced that Shark is no longer under development and be
replaced with Spark SQL in Spark Summit 2014.
Chester
On Wed, Jul 2, 2014 at 3:53 PM, Subacini B subac...@gmail.com wrote:
Hi,
Matei,
If we use different Akka actors to process different user's requests, (not
different threads), is the SparkContext still safe to use for different users ?
Yes, it would be nice to disable UI via configuration,especially when we
develop locally. We use sbt-web plugin to debug tomcat
, you can configure Akka to
spawn more threads and in that case it would probably be okay. See
http://doc.akka.io/docs/akka/snapshot/java/dispatchers.html for some details on
Akka thread usage and how to configure it.
Matei
On Jun 9, 2014, at 4:54 PM, Chester Chen chesterxgc...@yahoo.com
Hi,
This is not related to Spark. But I thought you might be interested in the
second SF Scala conference is coming this August. The SF Scala conference was
called Sillicon Valley Scala Symposium last year. From now on, it will be
known as Scala By The Bay.
I just updated and got the following:
[error] (external-mqtt/*:update) sbt.ResolveException: unresolved dependency:
org.eclipse.paho#mqtt-client;0.4.0: not found
[error] Total time: 7 s, completed Apr 10, 2014 4:27:09 PM
Chesters-MacBook-Pro:spark chester$ git branch
* branch-1.0
master
10 matches
Mail list logo
