Matthias, Kunal gives very good information about how to start from the high level to debug this, but you should also be suspicious of the lower levels. For instance, are you sure that your file system is working correctly? Is the file actually stored on MapR?
How long does it take to run something like wc on this file on the same node? This should take much less than a second if you have competent I/O system, but it would not be unheard of to hear that this is much slower than expected due any number of reasons. On Thu, Nov 29, 2018 at 9:13 AM Rosenthaler Matthias (PS-DI/ETF1.1) < [email protected]> wrote: > Hi, > > I am using apache drill to query huge parquet files (100 MB) on a single > node. > A SELECT * query takes around 90 Seconds. 80 Seconds are "Waiting time". > Can you explain what this waiting time means and how I am able to optimize > it? > > Mit freundlichen Grüßen / Best regards > > Matthias Rosenthaler > > Powertrain Solutions, Engine Testing (PS-DI/ETF1.1) > Robert Bosch AG | Robert-Bosch-Straße 1 | 4020 Linz | AUSTRIA | > www.bosch.at<http://www.bosch.at> > Tel. +43 732 7667-479 | [email protected]<mailto: > [email protected]> > > Sitz: Robert Bosch Aktiengesellschaft, A-1030 Wien, Göllnergasse 15-17 , > Registergericht: FN 55722 w HG-Wien > Aufsichtsratsvorsitzender: Dr. Uwe Thomas; Geschäftsführung: Dr. Klaus > Peter Fouquet > DVR-Nr.: 0418871- ARA-Lizenz-Nr.: 1831 - UID-Nr.: ATU14719303 - > Steuernummer 140/4988 > > >
