How to start Thrift JDBC server as part of standalone spark application?

2015-04-23 Thread Vladimir Grigor
table %s for data source %s.format(tableName, sourceFile)) HiveThriftServer2.startWithContext(sqlContext) } } Best, Vladimir Grigor

Re: spark-submit --py-files remote: Only local additional python files are supported

2015-01-21 Thread Vladimir Grigor
workaround then is to just copy the files to your local machine. -Andrew 2015-01-20 7:38 GMT-08:00 Vladimir Grigor vladi...@kiosked.com: Hi all! I found this problem when I tried running python application on Amazon's EMR yarn cluster. It is possible to run bundled example applications on EMR

spark-submit --py-files remote: Only local additional python files are supported

2015-01-20 Thread Vladimir Grigor
Hi all! I found this problem when I tried running python application on Amazon's EMR yarn cluster. It is possible to run bundled example applications on EMR but I cannot figure out how to run a little bit more complex python application which depends on some other python scripts. I tried adding

spark-submit --py-files remote: Only local additional python files are supported

2015-01-20 Thread Vladimir Grigor
Hi all! I found this problem when I tried running python application on Amazon's EMR yarn cluster. It is possible to run bundled example applications on EMR but I cannot figure out how to run a little bit more complex python application which depends on some other python scripts. I tried adding

Re: EC2 VPC script

2015-01-19 Thread Vladimir Grigor
I also found this issue. I have reported it as a bug https://issues.apache.org/jira/browse/SPARK-5242 and submitted a fix. You can find link to fixed fork in the comments on the issue page. Please vote on the issue, hopefully guys will accept pull request faster then :) Regards, Vladimir On Mon,