Re: .NET for Apache Spark interactive interpreter support

2020-01-13 Thread Jeff Zhang
IIUC, donet spark is just a wrapper of spark. Besides adding DotNetSparkInterpreter, what kind of other things user need to do ? For now, user also need to specify SPARK_HOME at least, but to support donet, what other things user need to do. Saisai Shao 于2020年1月14日周二 上午11:01写道: > I see your

Re: [VOTE] Release Livy 0.7.0 based on RC4

2020-01-13 Thread Jeff Zhang
+1 Bikas Saha 于2020年1月11日周六 下午9:40写道: > +1 > > Bikas > > From: mingchao zhao > Sent: Wednesday, January 8, 2020 6:16 PM > To: dev@livy.incubator.apache.org > Subject: Re: [VOTE] Release Livy 0.7.0 based on RC4 > > Tested the general functionality of

Re: .NET for Apache Spark interactive interpreter support

2020-01-13 Thread Saisai Shao
I see your point. Personally I don't have a strong opinion on this, I'm not sure what others think about it. Why don't you start a design doc and call for a vote about this feature. Thanks Saisai Steve Suh 于2020年1月14日周二 上午10:12写道: > @Saisai > > This will not be a wrapper around the REST API.

Re: Livy metrics

2020-01-13 Thread Yiheng Wang
+1 On Fri, Jan 10, 2020 at 10:00 AM 安辉 wrote: > In my company, We are maintaining a metrc version of livy, I am willing to > submit this patch, if you do not mind. > > -邮件原件- > 发件人: Saisai Shao [mailto:sai.sai.s...@gmail.com] > 发送时间: 2020年1月10日 9:39 > 收件人: dev@livy.incubator.apache.org

Re: .NET for Apache Spark interactive interpreter support

2020-01-13 Thread Steve Suh
@Saisai This will not be a wrapper around the REST API. The plan is to support a Livy POST /sessions request where kind == "sparkdotnet". Livy will eventually push this request down to the ReplDriver, and in turn the ReplDriver will create a new SparkDotnet Interpreter class. This will be

RE: Livy metrics

2020-01-13 Thread Shanyu Zhao
+1 I just created a JIRA to track this effort: LIVY-743: Support Livy metrics based on dropwizard Anhui, do you want to write a design doc for it? At lease you can attach your PR to the JIRA first. Thanks Shanyu -Original Message- From: Bikas Saha [mailto:bi...@apache.org] Sent: