Hangout link?

Re: Hangout link?

Sorry about the delay, there you go: https://plus.google.com/hangouts/_/event/ci4rdiju8bv04a64efj5fedd0lc On Tue, May 31, 2016 at 9:57 AM, John Omernik wrote: > > -- Abdelhakim Deneche Software Engineer Now Available - Free Hadoop On-Demand

Re: Clarification on Drill Options

I added a JIRA related to this: https://issues.apache.org/jira/browse/DRILL-4699 On Sun, May 29, 2016 at 6:55 AM, John Omernik wrote: > Hey all, when looking at the drill options, and specifically as I was > trying to understand the parquet options, I realized that the naming

Minutes from 5/31/16 Drill Hangout

Attendees: Arina, John O, Subhu, Vitalii, Hakim, Parth, Aman, Paul, Jinfeng, Aditya, Zelaine 1) John noted that he's hitting a lot of problems with Drill scripts. Paul indicated that he's fixing a lot of these issues as part of his work to integrate Drill with YARN. John said he's writing up a

Profiles Gone in Web UI: The great profile heist

I am scratching my head at this one... I made some minor changes to my drill-env.sh to enable gclogging, and was using the profiles in the webui just fine. Due to some previously mentioned issues, I've had to restart drill bits due to GC issues etc. Now, while my profiles directory still exists,

Re: Oracle Query Problem

Can you enable verbose logging and post the resulting error message? You can do this by executing the following statement, and then the failing query. SET `exec.errors.verbose` = true; Thank you, Sudheesh > On May 31, 2016, at 11:27 AM, SanjiV SwaraJ wrote: > > Hello I

Do i need hadoop installed to use dfs storage?

I'm trying to test running drill on gz json files in s3 and i keep getting. VALIDATION ERROR: From line 1, column 15 to line 1, column 17: Table 's3_file.gz' not found I downloaded the file and unzipped it, setup a new storage plugin to point to the local file { "type": "file",

Re: Profiles Gone in Web UI: The great profile heist

are you storing the profiles in a local folder or in nfs ? On Tue, May 31, 2016 at 12:49 PM, John Omernik wrote: > I am scratching my head at this one... I made some minor changes to my > drill-env.sh to enable gclogging, and was using the profiles in the webui > just fine.

Re: Do i need hadoop installed to use dfs storage?

Hi Scott, You definitely don't need to have Hadoop to query your local file system. Could you list the exact command to Drill that gave you this error? Best, Nathan Griffith Technical Writer Dremio On Tue, May 31, 2016 at 1:26 PM, Scott Kinney wrote: > > I'm trying to

Re: Profiles Gone in Web UI: The great profile heist

Odds are one of your profiles is corrupt. Last I checked, there was a bug that a corrupt profile would cause no profiles to show up in list. Check if any of your profiles are zero bytes and delete them. The UI should really handle this. -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, May

Re: Partition reading problem (like operator) while using hive partition table in drill

I didn't get any response or updates on this jira ticket ( DRILL-4665). Does anyone looking into this? On 11 May 2016 03:31, "Aman Sinha" wrote: > The Drill test team was able to repro this and is now filed as: > https://issues.apache.org/jira/browse/DRILL-4665 > > On Tue,

HiveMetastore HA with Drill

Anyone has any insights into how the Hive storage plug-in can handle Hive MetaStore HA? The Hive storage plug-in has only one property for hive.metastore.uris and it takes only one IP:port. When I add a second one, the update of the storage plug-in fails. "configProps": {

Reading GC Logs

I am looking at the GC logs for some big queries (now that I know how to enabled them, thanks Paul!) and found the item below, it worries, "it says, failure, it too 8 seconds) Should I be worried about that? I know my HEAP is set fairly high (24GB) how should I interpret this? John 1924.138:

Elasticsearch

Hi I am going to get data from apache drill to do a simple queries, I would like to use it in elasticsearch. And now I don't see where I do that with apache drill. Have you thought any version for do that? Thanks [cid:image001.jpg@01D133FA.7A806350] Jesús C. Villagrá Laso Gerente de

Re: Elasticsearch

The way I read your question, you might be wanting to use Drill to query Elasticsearch, or are you might be trying to index Drill query results with Elasticsearch. If the first, this project looks cool: https://github.com/Anchormen/sql4es You could use

Re: Reading GC Logs

Also: Doing a CTAS using the new reader and dictionary encoding is producing this, everything is hung at this point. The query in sqlline is not returning, the web UI is running extremely slowly, and when it does return, shows the running query, however, when I click on it, the profile shows an

Re: Reading GC Logs

My understanding (which is incomplete) is that both the "new reader" and "dictionary encoding" are not stable yet and can cause failures or worse, incorrect data. That's why they are disabled by default. The "Allocation Failure" means that the JVM had to run a Full GC because it couldn't allocate

Re: Reading GC Logs

Oh, the query just stopped showing up in the profiles webui, completely gone like it never happened. Seems to be responding a bit better, the sqlline is still hung though. (Yes this is all related to my CTAS of the parquet data, at this point I am just looking for ways to handle the data and not

Re: Reading GC Logs

It's just a flat select (via a view) . basically select field1, field2, field100 from view_mytable where dir0 = '2016-05-01' there is no aggregation or anything happening. As to the dictionary encoding and the new reader some thoughts: 1. Based on what I've read, the new reader is faster for