Re: 回复： 回复： 回复： error when querying a csv file with drill.
Hi Bevin,
These are the steps to build directly from the source:
// Get Drill Source
$ git clone https://github.com/apache/incubator-drill.git
$ cd incubator-drill
// Inside /DRILL DIR/
$ mvn clean install -DskipTests
// Install Drill
$ mkdir /opt/drill
$ tar xvzf distribution/target/*.tar.gz --strip=1 -C /opt/drill
// Switch to installed directory
$ cd /opt/drill
$ sudo bin/sqlline -u jdbc:drill:zk=local -n admin -p admin
0: jdbc:drill:zk=local
select * from dfs.`/home/yash/git/Drill/data.json`;
Let me know if this works.
Peace Yash
On Sat, May 24, 2014 at 12:10 PM, 南在南方 i02...@qq.com wrote:
Hi, thank you for your reply.
I failed the query again this morning.
I can query json file correctly. (oddly, I use jsonl schema which defined
in storage-engines.json and there query with “select * from file.json ”,
not back ticks).
I use binary version of drill, Is that can be a reason I failed to query?
I would appreciate it if you send your entire Drill directory zip package
to me. i02...@qq.com or bevi...@gmail.com .
THANKS
-- 原始邮件 --
发件人: Yash Sharma;yash...@gmail.com;
发送时间: 2014年5月24日(星期六) 凌晨1:52
收件人: drill-userdrill-user@incubator.apache.org;
主题: Re: 回复： 回复： error when querying a csv file with drill.
Hi All,
Is the main issue on connecting/querying to the json/csv data sources.
Here is what I did for querying Json/Csv data Sources.
Let me know if this is what we are looking for... or I am missing the
context here..
1. I did not modify the storage-plugin.json.
https://github.com/apache/incubator-drill/blob/master/distribution/src/resources/storage-plugins.json
*2 Created Json Data:* in Path /home/yash/git/Drill/data.json
The content of Json is pasted in the end of mail.
*3. Start Drill: *Drill is started by
bin/sqlline -u jdbc:drill:zk=local -n admin -p admin
*4. Query Json Data:* pass path with dfsdot`path\to\data.json`; (path in
back-tick)
0: jdbc:drill:zk=local
select * from dfs.`/home/yash/git/Drill/data.json`;
*5. Output*
+++++++
| title|name| width| height | image|text
|
+++++++
| Transparent Window | trn_window | 500| 500|
{alignment:center,hOffset:250,name:sun1,src:Images/Sun.png,vOffset:250}
| {alignm |
| White Window | white_window | 500| 500|
{alignment:center,hOffset:250,name:sun1,src:Images/Sun.png,vOffset:250}
| {alignment |
| black window | black_window | 500| 500|
{alignment:center,hOffset:250,name:sun1,src:Images/Sun.png,vOffset:250}
| {alignment |
+++++++
3 rows selected (0.095 seconds)
Same procedure for *CSV* Data:
*Query:*
select * from dfs.`/home/yash/Desktop/Drill/data.csv`;
select columns from dfs.`/home/yash/Desktop/Drill/data.csv`;
select columns[1] from dfs.`/home/yash/Desktop/Drill/data.csv`;
Hope it helps.
Peace,
Yash
JSON Data:
{
title: Transparent Window,
name: trn_window,
width: 500,
height: 500,
image: {
src: Images/Sun.png,
name: sun1,
hOffset: 250,
vOffset: 250,
alignment: center
},
text: {
data: Click Here,
size: 36,
style: bold,
name: text1,
hOffset: 250,
vOffset: 100,
alignment: center,
onMouseUp: sun1.opacity = (sun1.opacity / 100) * 90;
}
}
{
title: White Window,
name: white_window,
width: 500,
height: 500,
image: {
src: Images/Sun.png,
name: sun1,
hOffset: 250,
vOffset: 250,
alignment: center
},
text: {
data: Click Here,
size: 36,
style: bold,
name: text1,
hOffset: 250,
vOffset: 100,
alignment: center,
onMouseUp: sun1.opacity = (sun1.opacity / 100) * 90;
}
}
{
title: black window,
name: black_window,
width: 500,
height: 500,
image: {
src: Images/Sun.png,
name: sun1,
hOffset: 250,
vOffset: 250,
alignment: center
},
text: {
data: Click Here,
size: 36,
style: bold,
name: text1,
hOffset: 250,
vOffset: 100,
alignment: center,
onMouseUp: sun1.opacity = (sun1.opacity / 100) * 90;
}
}
CSV Data:
u1,purchase,iphone
u1,purchase,ipad
u2,purchase,nexus
u2,purchase,galaxy
u3,purchase,surface
u4,purchase,iphone
u4,purchase,galaxy
u1,view,iphone
u1,view,ipad
u1,view,nexus
u1,view,galaxy
u2,view,iphone
u2,view,ipad
u2,view,nexus
u2,view,galaxy
u3,view,surface
u3,view,nexus
u4,view,iphone
u4,view,ipad
u4,view,galaxy
On Fri, May 23, 2014 at 9:06 PM, Jason Altekruse
altekruseja...@gmail.comwrote:
Sorry, that was a bit of a roundabout way of describing the process. The
normal connection should just give you a session where you can query all
schemas (in your config file, dfs is the only schema listed). You simply
need to write it as dfs
Re: 回复： 回复： 回复： 回复： 回复： 回复： 回复： error when querying a csv file with drill.
No current connection pops out sometimes if your JAVA_HOME is not set. Can you plz check that? On Sat, May 24, 2014 at 1:25 PM, 南在南方 i02...@qq.com wrote: Thanks I compile m2 version successfully. Looks like readme.md file doesn't update to m2 . lol. No known driver to handle jdbc:drill:zk=local occurs. and run sqlline: bevin@le:/opt/drill$ sqlline -u jdbc:drill:zk=local -n admin -p admin scan complete in 109ms scan complete in 894ms No known driver to handle jdbc:drill:zk=local sqlline version 1.0.2 by Marc Prud'hommeaux sqlline select * from `/home/data.csv`; No current connection sqlline select * from dfs.`/home/data.csv`; No current connection -- 原始邮件 -- 发件人: Yash Sharma;yash...@gmail.com; 发送时间: 2014年5月24日(星期六) 下午4:21 收件人: drill-userdrill-user@incubator.apache.org; 主题: Re: 回复： 回复： 回复： 回复： 回复： 回复： error when querying a csv file with drill. Try the new binaries out: https://www.dropbox.com/sm/create/apache-drill-1.0.0-m2-incubating-SNAPSHOT-binary-release.tar.gz Its ~90 Megs. Extract the tar to the installation dir as before and execute the queries on it. Also you can try this old method on the M1 version of binaries. This was the old way of querying Sqlline: http://www.confusedcoders.com/bigdata/apache-drill/apache-drill-executing-sample-sql-queries-on-json-data Let me know if either one works. Peace, Yash On Sat, May 24, 2014 at 1:15 PM, Yash Sharma yash...@gmail.com wrote: Building from source would give you M2 version. Let me put my binary tarball on dropbox. On Sat, May 24, 2014 at 1:10 PM, 南在南方 i02...@qq.com wrote: Is that Apache Drill Milestone 1 - (Drill Alpha) is the newest version? -- 原始邮件 -- 发件人: 南在南方i02...@qq.com; 发送时间: 2014年5月24日(星期六) 下午3:34 收件人: drill-userdrill-user@incubator.apache.org; 主题: 回复： 回复： 回复： 回复： 回复： 回复： error when querying a csv file with drill. I think not, now I git the newest package . Can I use your compiled drill directly in my computer? -- 原始邮件 -- 发件人: Yash Sharma;yash...@gmail.com; 发送时间: 2014年5月24日(星期六) 下午3:57 收件人: drill-userdrill-user@incubator.apache.org; 主题: Re: 回复： 回复： 回复： 回复： 回复： error when querying a csv file with drill. Is this error message on a fresh pull? On Sat, May 24, 2014 at 12:49 PM, 南在南方 i02...@qq.com wrote: ERROR :No known driver to handle x, That why I turn to binary. ==~ bevin@le:~/compiled-drill/bin$ sqlline -u jdbc:drill:zk=local -n admin -p admin scan complete in 81ms scan complete in 984ms No known driver to handle jdbc:drill:zk=local sqlline version 1.0.2 by Marc Prud'hommeaux sqlline !quit bevin@le:~/compiled-drill/bin$ sqlline -u jdbc:drill:schmea=dfs -n admin -p admin scan complete in 119ms scan complete in 825ms No known driver to handle jdbc:drill:schmea=dfs sqlline version 1.0.2 by Marc Prud'hommeaux sqlline -- 原始邮件 -- 发件人: Yash Sharma;yash...@gmail.com; 发送时间: 2014年5月24日(星期六) 下午3:37 收件人: drill-userdrill-user@incubator.apache.org; 主题: Re: 回复： 回复： 回复： 回复： error when querying a csv file with drill. I am not sure of the root cause Bevin. I would try to run queries on the binaries and let you know. Peace, Yash On Sat, May 24, 2014 at 12:31 PM, 南在南方 i02...@qq.com wrote: Thanks. I compiled it before, but now I use drill in my cluster environment where Network isn't available. but I would try again in my own ubuntu ma chine. So is this version problem with binary installed drill package? -- 原始邮件 -- 发件人: Yash Sharmayash...@gmail.com; 发送时间: 2014年5月24日(星期六) 下午3:17 收件人: drill-userdrill-user@incubator.apache.org; 主题: Re: 回复： 回复： 回复： error when querying a csv file with drill. Hi Bevin, These are the steps to build directly from the source: // Get Drill Source $ git clone https://github.com/apache/incubator-drill.git $ cd incubator-drill // Inside /DRILL DIR/ $ mvn clean install -DskipTests // Install Drill $ mkdir /opt/drill $ tar xvzf distribution/target/*.tar.gz --strip=1 -C /opt/drill // Switch to installed directory $ cd /opt/drill $ sudo bin/sqlline -u jdbc:drill:zk=local -n admin -p admin 0: jdbc:drill:zk=local select * from dfs.`/home/yash/git/Drill/data.json`; Let me know if this works. Peace Yash On Sat, May 24, 2014 at 12:10 PM, 南在南方 i02...@qq.com wrote: Hi, thank you for your reply. I failed the query again this morning. I can query json file correctly. (oddly, I use jsonl schema which defined in storage-engines.json and there query with “select * from file.json ”, not back ticks). I use binary version of drill
