Re: [DISCUSS] Drop Python 2, 3.4 and 3.5

2020-07-02 Thread Hyukjin Kwon
Thanks Dongjoon. That makes much more sense now! 2020년 7월 3일 (금) 오전 12:11, Dongjoon Hyun 님이 작성: > Thank you, Hyukjin. > > According to the Python community, Python 3.5 is also EOF at 2020-09-13 > (only two months left). > > - https://www.python.org/downloads/ > > So, targeting live Python

Re: m2 cache issues in Jenkins?

2020-07-02 Thread Jungtaek Lim
Looks like Jenkins service itself becomes unstable. It took considerable time to just open the test report for a specific build, and Jenkins doesn't pick the request on rebuild (retest this, please) in Github comment. On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon wrote: > Ah, okay. Actually there

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread Prakhar Jain
+1 (non-binding) -- Prakhar Jain On Thu, Jul 2, 2020 at 12:03 PM devesh.agra...@gmail.com < devesh.agra...@gmail.com> wrote: > +1 > > This proposal will improve the operation and cost of Spark on cloud > environments. > > > > -- > Sent from:

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread Wenchen Fan
+1 On Fri, Jul 3, 2020 at 12:06 AM DB Tsai wrote: > +1 > > On Thu, Jul 2, 2020 at 8:59 AM Ryan Blue > wrote: > >> +1 >> >> On Thu, Jul 2, 2020 at 8:00 AM Dongjoon Hyun >> wrote: >> >>> +1. >>> >>> Thank you, Holden. >>> >>> Bests, >>> Dongjoon. >>> >>> On Thu, Jul 2, 2020 at 6:43 AM wuyi

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread DB Tsai
+1 On Thu, Jul 2, 2020 at 8:59 AM Ryan Blue wrote: > +1 > > On Thu, Jul 2, 2020 at 8:00 AM Dongjoon Hyun > wrote: > >> +1. >> >> Thank you, Holden. >> >> Bests, >> Dongjoon. >> >> On Thu, Jul 2, 2020 at 6:43 AM wuyi wrote: >> >>> +1 for having this feature in Spark >>> >>> >>> >>> -- >>> Sent

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread Ryan Blue
+1 On Thu, Jul 2, 2020 at 8:00 AM Dongjoon Hyun wrote: > +1. > > Thank you, Holden. > > Bests, > Dongjoon. > > On Thu, Jul 2, 2020 at 6:43 AM wuyi wrote: > >> +1 for having this feature in Spark >> >> >> >> -- >> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ >> >>

Re: [DISCUSS] Drop Python 2, 3.4 and 3.5

2020-07-02 Thread Dongjoon Hyun
Thank you, Hyukjin. According to the Python community, Python 3.5 is also EOF at 2020-09-13 (only two months left). - https://www.python.org/downloads/ So, targeting live Python versions at Apache Spark 3.1.0 (December 2020) looks reasonable to me. For old Python versions, we still have Apache

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread Dongjoon Hyun
+1. Thank you, Holden. Bests, Dongjoon. On Thu, Jul 2, 2020 at 6:43 AM wuyi wrote: > +1 for having this feature in Spark > > > > -- > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ > > - > To

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread wuyi
+1 for having this feature in Spark -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [DISCUSS] Apache Spark 3.0.1 Release

2020-07-02 Thread Prashant Sharma
Thank you, Holden. Folks, My health has gone down a bit. So, I will start working on this in a few days. If this needs to be published sooner, then maybe someone else has to help out. On Thu, Jul 2, 2020 at 10:11 AM Holden Karau wrote: > I’m happy to have Prashant do 2.4.7 :) > > On Wed,

[no subject]

2020-07-02 Thread vtygoss
Hi devs, question: how to convert hive output format to spark sql datasource format? spark version: spark 2.3.0 scene: there are many small files on hdfs(hive) generated by spark sql applications when dynamic partition is enabled or setting spark.sql.shuffle.partitions >200. so i am

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread Takeshi Yamamuro
+1; Looks a great feature. On Thu, Jul 2, 2020 at 3:33 PM devesh.agra...@gmail.com < devesh.agra...@gmail.com> wrote: > +1 > > This proposal will improve the operation and cost of Spark on cloud > environments. > > > > -- > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ >

Re: [VOTE] Decommissioning SPIP

2020-07-02 Thread devesh.agra...@gmail.com
+1 This proposal will improve the operation and cost of Spark on cloud environments. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org