Re: "Too many open files" error

2019-10-07 Thread Faraz Mateen
tors and increased memory usage. > > > Kind regards, > > Alexey > > On Fri, Oct 4, 2019 at 4:21 AM Faraz Mateen wrote: > >> Hi all, >> >> I am facing a problem with my kudu setup where tablet server crashes with >> "too many open files"

Re: Inconsistent read performance with Spark

2019-02-14 Thread Faraz Mateen
thus there were less > blocks to scan. Also would you mind sharing the screen shot of the tablet > server web UI page when your scans took place (to do a comparison between > the 'good' and 'bad' scans) ? > > Best, > Hao > > On Wed, Feb 13, 2019 at 9:37 AM Faraz Mateen wrote: &g

Re: Inconsistent read performance with Spark

2019-02-13 Thread Faraz Mateen
e I was performing these queries. I did not notice any compaction either. On Wed, Feb 13, 2019 at 2:15 AM Hao Hao wrote: > Hi Faraz, > > Answered inline below. > > Best, > Hao > > On Tue, Feb 12, 2019 at 6:59 AM Faraz Mateen wrote: > >> Hi all, >> >>

Inconsistent read performance with Spark

2019-02-12 Thread Faraz Mateen
is hash partitioned on the basis of an ID with 3 buckets. It is also range partitioned on the basis of datetime with a new partition for each month. - Kafka version 1.1. - Standalone Spark 2.3.0 deployed on a server with 2 vCPU 4 GB RAM. -- Faraz Mateen