Distributed. (MapR FS, but via NFS) On Mon, May 23, 2016 at 3:26 PM, Abdel Hakim Deneche <[email protected]> wrote:
> One question about the missing query profile: do you store the query > profiles in the local file system or the distributed file system ? > > On Mon, May 23, 2016 at 9:31 AM, John Omernik <[email protected]> wrote: > > > Hey all, this is separate, yet related issue to my other posts RE > Parquet, > > however, I thought I'd post this to see if this is normal or should be > > handled (and/or JIRAed) > > > > I am running Drill 1.6, if you've read the other posts, I am trying to > CTAS > > a large amount of data (largish) 120 GB from Parquet to better Parquet. > > > > As I am running, I sometimes get the Index Out of Bounds (as in the other > > threads), but depending on source data and/or settings like using the new > > parquet reader, I get a odd situation. > > > > When I refresh the profile in the WebUII get an error "VALIDATION ERROR: > no > > profile with given query id '' exists" > > > > I am running this in sqlline, and at this point, there is no error, but I > > can't access my query profile. > > > > Other notes: > > > > 1. The webui is HORRIBLY slow > > 2. If I cancel the query, it will show me some written parquet, but > obvious > > it wasn't finished > > 3. There are no errors in any of the drillbits log files (except the > forman > > which starts to get "WARN" "Messos of mode (REQUEST OR RESPONSE) of type > 8 > > (or type 1) too longer than 500ms Actual duration was (high number of ms > > betwen 1900 and 3500 ms) > > 4. Like I said, no errors, just everything appears to hang. > > > > My memory and such seems good here, I have 96 GB of ram DIRECT per node, > > and 12 GB of HEAP per node, 5 nodes,. > > > > The cluster seems really sluggish and out of sorts until I restart drill > > bits... This seems like a very bad "error state" > > > > Has anyone seen this? Any thoughts on this? Should I open a JIRA? > > > > > > Thanks, > > John > > > > > > -- > > Abdelhakim Deneche > > Software Engineer > > <http://www.mapr.com/> > > > Now Available - Free Hadoop On-Demand Training > < > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > >
