Re: Fw: [VOTE][SPARK-29018][SPIP]:Build spark thrift server based on protocol v11

2020-01-01 Thread angers . zhu







Hi all,Blow is our working repohttps://github.com/spark-thriftserver/spark-thriftserver




Hope for your good suggestions.

  










angers.zhu




angers@gmail.com








签名由
网易邮箱大师
定制

 


On 12/30/2019 14:38,Sandeep Katta wrote: 


+1On Mon, 30 Dec 2019 at 10:24, Gengliang  wrote:+1On Sun, Dec 29, 2019 at 8:33 PM Wenchen Fan  wrote:+1 for the new thrift server to get rid of the Hive dependencies!On Mon, Dec 23, 2019 at 7:55 PM Yuming Wang  wrote:I'm  +1 for this SPIP for these two reasons:1. The current thriftserver has some issues that are not easy to solve, such as: SPARK-28636.2. The difference between the version of ORC we are using and the built-in Hive is using is getting bigger and bigger. We can't ensure that there will be no compatibility issues in the future. If thriftserver does not depend on Hive, it will be much easier to upgrade the built-in Hive in the future.On Sat, Dec 21, 2019 at 9:28 PM angers.zhu  wrote:







Hi all, I have complete a Design doc about how to use and config this new thrift server, and some design detail about change and impersonation. Hope for your suggestions and ideas.SPIP DOC : https://docs.google.com/document/d/1ug4K5e2okF5Q2Pzi3qJiUILwwqkn0fVQaQ-Q95HEcJQ/edit#heading=h.x97c6tj78zo0Design DOC : https://docs.google.com/document/d/1UKE9QTtHqSZBq0V_vEn54PlWaWPiRAKf_JvcT0skaSo/edit#heading=h.q1ed5q1ldh14Thrift server about configurations https://docs.google.com/document/d/1uI35qJmQO4FKE6pr0h3zetZqww-uI8QsQjxaYY_qb1s/edit?usp=drive_web=110963191229426834922




Best Regards

  










angers.zhu




angers@gmail.com








签名由
网易邮箱大师
定制

 


- Forwarded Message -



From: 


 angers.zhu



 

Date: 
12/18/2019 22:29

 

To: 


 dev-ow...@spark.apache.org

 


  

Subject: 
Re: [VOTE][SPARK-29018][SPIP]:Build spark thrift server based on protocol v11













Add spark-dev group access privilege to google.

  










angers.zhu




angers@gmail.com








签名由
网易邮箱大师
定制

 


On 12/18/2019 22:02,Sandeep Katta wrote: 


I couldn't access the doc, please give permission to the spark-dev groupOn Wed, 18 Dec 2019 at 18:05, angers.zhu  wrote:











With the development of Spark and Hive,in current sql/hive-thriftserver module, we need to do a lot of work to solve code conflicts for different built-in hive versions.It's an annoying and unending work in current ways. And these issues have limited our ability and convenience to develop new features for Spark’s thrift server. We suppose to implement a new thrift server and JDBC 

Re: Revisiting Python / pandas UDF (new proposal)

2020-01-01 Thread Hyukjin Kwon
Thanks for comments Maciej - I am addressing them.
adding Li Jin too.

I plan to proceed this late this week or early next week to make it on time
before code freeze.
I am going to pretty actively respond so please give feedback if there's
any :-).



2019년 12월 30일 (월) 오후 6:45, Hyukjin Kwon 님이 작성:

> Hi all,
>
> I happen to come up with another idea about pandas redesign.
> Thanks Reynold, Bryan, Xiangrui, Takuya and Tim for offline discussions and
> helping me to write this proposal.
>
> Please take a look and let me know what you guys think.
>
> -
> https://docs.google.com/document/d/1-kV0FS_LF2zvaRh_GhkV32Uqksm_Sq8SvnBBmRyxm30/edit?usp=sharing
> - https://issues.apache.org/jira/browse/SPARK-28264
>
> I know it's a holiday season but please have some time to take a look so
> we can make it on time before code freeze (31st Jan).
>
>


unsubscribe

2020-01-01 Thread vijay krishna



unsubscribe

2020-01-01 Thread Narendra M