Re: [build system] jenkins wedged again, rebooting master node

2019-03-18 Thread shane knapp
ok, i dug through the logs and noticed that rsyslogd was dropping messages to do imuxsock being spammed by postfix... which i then tracked down to our installation of fail2ban being incorrectly configured and attempting to send IP ban/unban status emails to 'em...@example.com'. since we're a

Re: queryable state & streaming

2019-03-18 Thread Stavros Kontopoulos
Not really, if we agree that we want this, I can put together a design document and take it from there. There was also a discussion in another thread about adding RockDB as a memory storage that is related to this task. Best, Stavros On Sun, Mar 17, 2019 at 4:42 AM kant kodali wrote: > Any

Re: [VOTE] [SPARK-24615] SPIP: Accelerator-aware Scheduling

2019-03-18 Thread Xingbo Jiang
Hi all, I updated the SPIP doc and stories , I hope it now contains clear scope of the changes and

Re: understanding the plans of spark sql

2019-03-18 Thread Reynold Xin
This is more of a question for the connector. It depends on how the connector is implemented. Some implements aggregate pushdown, but most don't. On Mon, Mar 18, 2019 at 10:05 AM, asma zgolli < zgollia...@gmail.com > wrote: > > Hello, > > > I'm executing using spark SQL an SQL workload on

understanding the plans of spark sql

2019-03-18 Thread asma zgolli
Hello, I'm executing using spark SQL an SQL workload on data stored in MongoDB. i have a question about the locality of execution of the aggregation. I m wondering if the aggregation is pushed down to MongoDB (like pushing down filters and projection) or executed in spark. I m displaying the