Hello Uwe, By default Drill temporary files & other data such as query profiles and configuration files are written to the local file system. To configure this refer to http://drill.apache.org/docs/persistent-configuration-storage/ (for configuration storage) and https://drill.apache.org/docs/start-up-options/ (for configuring external spill directories).
Regards, Abhishek On Fri, Jul 31, 2015 at 5:25 AM, Geercken, Uwe <[email protected]> wrote: > Abdelhakim, > > Looking a bit further, I saw that my /tmp folder on the drillbit ran out > of diskspace - it was not the NFS share which I though initially. > > Can you point me to the configuration where the location for temporary > files is defined? I would like to change it but don't know where. Meanwhile > I have simply created a softlink to point it to a place where there is > sufficient space. > > Regards, > > Uwe > > > -----Original Message----- > From: Abdel Hakim Deneche [mailto:[email protected]] > Sent: Donnerstag, 30. Juli 2015 16:56 > To: user > Subject: Re: coversion to parquet from TSV files (CTAS) fails > > This is Drill's way of saying that something went wrong and we are > probably leaking memory. Generally you would get an error message > describing what went wrong and not the "memory leak" error message, so I > don't know what happened here. > > Can you take a look at the logs if there are any errors prior to this > error ? > You can use the error Id displayed along the error message ( > 0deb0877-cc1d-4de6-b564-302666213488) to jump to exact position in the log > where this error was reported, and look prior to it if you see if there are > any other errors. > > On Thu, Jul 30, 2015 at 4:28 AM, Geercken, Uwe <[email protected] > > > wrote: > > > I have a TSV file which I would like to convert to parquet files. I > > have one drillbit in distributed mode. The file is around 44mio > > records. I can run the process with 1mio records and it's fine. But if > > I try to import all then I get following error: > > > > Query Failed: An Error Occurred > > org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: > > IllegalStateException: Failure while closing accountor. Expected > > private and shared pools to be set to initial values. However, one or > > more were not. Stats are zone init allocated delta private 10000000 > > 8610302 1389698 shared 10000000 10000000 0. Fragment 0:0 [Error Id: > > 0deb0877-cc1d-4de6-b564-302666213488 on > > chzrh0spsv0159.swissport.aero:31010] > > > > I don't understand the error message. Can anybody help? > > > > Uwe > > > > > > -- > > Abdelhakim Deneche > > Software Engineer > > <http://www.mapr.com/> > > > Now Available - Free Hadoop On-Demand Training < > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > >
