For dfs/hdfs data sources you can create Drill Views, which will then be visible to tools like QlikSense and Tableau.
You can also look at customs SQL options in both tools, where you can enter the SQL to access the dfs/hdfs data. By default most BI/Analytic tools will only access data which have metadata in INFORMATION_SCHEMA. Using Drill Views makes this easily accessible to all users, or you can look at custom SQL in the tool itself. —Andries > On Oct 22, 2015, at 6:03 AM, ganesh <[email protected]> wrote: > > Attached snapshot. > > No data shown ... as compared to examples in site. > > On Thu, Oct 22, 2015 at 6:29 PM, ganesh <[email protected] > <mailto:[email protected]>> wrote: > Hi, > > Thanks I was writing to you only. Yes you are right. > Once I craeted a view from DRILL EXPLORER and saved it in dfs.tmp ........... > I can find that in TABLEAU too > > Though Still I am not able to figure out how to work in Tableau as all > examples shows that once COLUMN and ROWS are filles with some names in SHEET, > it will show data, but mine is empty... > > Let me try more ............... already following apache-drill site links > http://drill.apache.org/docs/tableau-examples/ > <http://drill.apache.org/docs/tableau-examples/> > > But currently no success > > On Thu, Oct 22, 2015 at 6:26 PM, Mustafa Engin Sözer > <[email protected] <mailto:[email protected]>> wrote: > That's true. The thing is these tools are most of the time expecting a > certain defined schema, thus a view or a table. If you create a view on > your files, you should be able to see your views from hdfs. > > On 22 October 2015 at 14:34, ganesh <[email protected] > <mailto:[email protected]>> wrote: > > > Hi, > > > > Attached are two snapshots. > > 1) When I select hadoop or DFS, I cant find anything under table. > > > > Is that normal. How to proceed ? ... Do you mean after creating view it > > may be visible here. > > > > > > 2) When I select Hive, I can see all Hive tables, > > > > I havent proceeded after that in TABLEAU, because of this. > > > > Following: > > https://drill.apache.org/docs/using-apache-drill-with-tableau-9-desktop/ > > <https://drill.apache.org/docs/using-apache-drill-with-tableau-9-desktop/> > > It says: > > Tableau can natively work with Hive tables and Drill views. > > > > > > On Thu, Oct 22, 2015 at 6:00 PM, Mustafa Engin Sözer < > > [email protected] <mailto:[email protected]>> wrote: > > > >> I can think of two possibilities: > >> > >> 1) Check your ODBC connection string, advanced properties. Make sure dfs > >> is > >> not excluded. > >> > >> 2) I've not used Qlik Sense but one suggestion is: try create a view out > >> of > >> your files using drill prompt. That will create a table entry in the > >> INFORMATION_SCHEMA. Check if you'll see your view that way. > >> > >> CREATE VIEW myview AS SELECT .... FROM myfile; > >> > >> On 22 October 2015 at 14:13, ganesh <[email protected] > >> <mailto:[email protected]>> wrote: > >> > >> > Hi, > >> > > >> > 1) I tried Tableau and qlicksense for chart / tables. But cant see files > >> > from hdfs. > >> > > >> > will share the snapshot soon > >> > > >> > 2) from apache prompt, I can access hdfs files and can also query them. > >> > > >> > > >> > > >> > On Thu, Oct 22, 2015 at 5:37 PM, Mustafa Engin Sözer < > >> > [email protected] <mailto:[email protected]>> > >> > wrote: > >> > > >> > > 1) As I said, you can use various SQL clients to query Drill through > >> > > jdbc/odbc. That's quite practical and we've a similar setup for our > >> > > end-users here. Some SQL clients should be able to create basic charts > >> > etc. > >> > > using your queries. > >> > > > >> > > 2) So what's the output when you try to see the files from dfs plugin > >> via > >> > > Drill prompt: > >> > > > >> > > select files from dfs.`/user`; > >> > > > >> > > If you receive an error, can you please share it here? > >> > > > >> > > On 22 October 2015 at 13:45, ganesh <[email protected] > >> > > <mailto:[email protected]>> > >> wrote: > >> > > > >> > > > Hi, > >> > > > > >> > > > Here is the storage plugin. Copied from default DFS storage plugin. > >> > > > I can query data from apache drill prompt. > >> > > > > >> > > > But to make a presentation, I would like to query from soem > >> > applications > >> > > to > >> > > > have visualisation .. may be table / charts > >> > > > > >> > > > > >> > > > ================================================================= > >> > > > > >> > > > { > >> > > > "type": "file", > >> > > > "enabled": true, > >> > > > "connection": "hdfs://localhost:54310/", > >> > > > "workspaces": { > >> > > > "root": { > >> > > > "location": "/user", > >> > > > "writable": false, > >> > > > "defaultInputFormat": null > >> > > > }, > >> > > > "tmp": { > >> > > > "location": "/tmp", > >> > > > "writable": true, > >> > > > "defaultInputFormat": null > >> > > > } > >> > > > }, > >> > > > "formats": { > >> > > > "psv": { > >> > > > "type": "text", > >> > > > "extensions": [ > >> > > > "tbl" > >> > > > ], > >> > > > "delimiter": "|" > >> > > > }, > >> > > > "csv": { > >> > > > > >> > > > > >> > > > ================================================================= > >> > > > > >> > > > On Thu, Oct 22, 2015 at 5:01 PM, Mustafa Engin Sözer < > >> > > > [email protected] <mailto:[email protected]>> > >> > > > wrote: > >> > > > > >> > > > > Hi, > >> > > > > > >> > > > > If you only need to show the data but not some sort of report > >> (e.g. > >> > as > >> > > in > >> > > > > Microstrategy, Tableau), then you can basically use most SQL > >> clients, > >> > > for > >> > > > > instance SQuirrel, Heidi SQL etc. via jdbc or odbc connection . > >> The > >> > > > > following links should help you manage that: > >> > > > > > >> > > > > https://drill.apache.org/docs/odbc-jdbc-interfaces/ > >> > > > > <https://drill.apache.org/docs/odbc-jdbc-interfaces/> > >> > > > > https://drill.apache.org/docs/using-the-jdbc-driver/ > >> > > > > <https://drill.apache.org/docs/using-the-jdbc-driver/> > >> > > > > > >> > > > > For the Hadoop data problem, can you share your storage plugin > >> > > settings? > >> > > > > Normally you shouldn't have any problems with seeing or querying > >> hdfs > >> > > > data. > >> > > > > > >> > > > > On 22 October 2015 at 13:18, ganesh <[email protected] > >> > > > > <mailto:[email protected]>> > >> > wrote: > >> > > > > > >> > > > > > Hello, > >> > > > > > > >> > > > > > I am new to un-structured world and just started 1 week back on > >> > > APACHE > >> > > > > > DRILL after suggestion from my collegues. We have a semi > >> structured > >> > > > data > >> > > > > > where we have constraint that we do not know number of columns > >> > > > > > > >> > > > > > I heard that APACHE DRILL is column free applicationa nd with > >> > support > >> > > > of > >> > > > > > JSON format, it allows to create columns on-fly, > >> > > > > > I converted my data from CSV-like-format to JSON and trying to > >> > figure > >> > > > out > >> > > > > > if it will work for me. > >> > > > > > > >> > > > > > Here I hit two issues :- > >> > > > > > 1) My column were like : 3100.2.1.2 <tel:3100.2.1.2> and values > >> > > > > > like '-2303" or > >> > > > > '01/01/2015 > >> > > > > > 02:02:00" > >> > > > > > > >> > > > > > Challenge was that column cant be started with Numeric value. > >> So I > >> > > had > >> > > > to > >> > > > > > change key as: "t3100.2.1.2" > >> > > > > > After that things were quite OK, > >> > > > > > > >> > > > > > Now I need some help from you guys. To proceed I have to > >> present my > >> > > > work > >> > > > > to > >> > > > > > management as an example. > >> > > > > > But querying on apache drill console, doesnt seem to be an > >> > attractive > >> > > > way > >> > > > > > to present things. > >> > > > > > > >> > > > > > I tried drill explorer too.But didnt find that so good. > >> > > > > > One thing to note, I am playing with files on Hadoop standalone > >> > mode > >> > > in > >> > > > > > UBUNTU. > >> > > > > > > >> > > > > > To make it appear more good looking, I started with QLIK SENSE > >> .. > >> > but > >> > > > was > >> > > > > > unable to connect it with hadoop file system. It only showed me > >> > HIVE > >> > > > > FILES. > >> > > > > > Then I downloaded TABLEAU Trial version ... but I am unable to > >> get > >> > > > Hadoop > >> > > > > > data here too... > >> > > > > > > >> > > > > > Please help me how to proceed. I have presentation on coming > >> > Monday. > >> > > > > > Queries are quite ready .. I just need to show in visualization > >> > form > >> > > > > > ........ using OPEN SOURCE applications only. > >> > > > > > > >> > > > > > > >> > > > > > Guys please help me. > >> > > > > > -- > >> > > > > > *Name: Ganesh Semalty* > >> > > > > > *Location: Gurgaon,Haryana(India)* > >> > > > > > *Email Id: [email protected] > >> > > > > > <mailto:[email protected]> <[email protected] > >> > > > > > <mailto:[email protected]> > >> >* > >> > > > > > > >> > > > > > > >> > > > > > P > >> > > > > > > >> > > > > > *Please consider the environment before printing this e-mail - > >> SAVE > >> > > > > TREE.* > >> > > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > -- > >> > > > > > >> > > > > *M. Engin Sözer* > >> > > > > Junior Datawarehouse Manager > >> > > > > [email protected] <mailto:[email protected]> > >> > > > > > >> > > > > Goodgame Studios > >> > > > > Theodorstr. 42-90, House 9 > >> > > > > 22761 Hamburg, Germany > >> > > > > Phone: +49 (0)40 219 880 -0 > >> > > > > <tel:%2B49%20%280%2940%20219%20880%20-0> > >> > > > > *www.goodgamestudios.com <http://www.goodgamestudios.com/> > >> > > > > <http://www.goodgamestudios.com <http://www.goodgamestudios.com/>>* > >> > > > > > >> > > > > Goodgame Studios is a brand of Altigi GmbH > >> > > > > Altigi GmbH, District court Hamburg, HRB 99869 > >> > > > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, > >> > Fabian > >> > > > > Ritter > >> > > > > > >> > > > > >> > > > > >> > > > > >> > > > -- > >> > > > *Name: Ganesh Semalty* > >> > > > *Location: Gurgaon,Haryana(India)* > >> > > > *Email Id: [email protected] > >> > > > <mailto:[email protected]> <[email protected] > >> > > > <mailto:[email protected]>>* > >> > > > > >> > > > > >> > > > P > >> > > > > >> > > > *Please consider the environment before printing this e-mail - SAVE > >> > > TREE.* > >> > > > > >> > > > >> > > > >> > > > >> > > -- > >> > > > >> > > *M. Engin Sözer* > >> > > Junior Datawarehouse Manager > >> > > [email protected] <mailto:[email protected]> > >> > > > >> > > Goodgame Studios > >> > > Theodorstr. 42-90, House 9 > >> > > 22761 Hamburg, Germany > >> > > Phone: +49 (0)40 219 880 -0 <tel:%2B49%20%280%2940%20219%20880%20-0> > >> > > *www.goodgamestudios.com <http://www.goodgamestudios.com/> > >> > > <http://www.goodgamestudios.com <http://www.goodgamestudios.com/>>* > >> > > > >> > > Goodgame Studios is a brand of Altigi GmbH > >> > > Altigi GmbH, District court Hamburg, HRB 99869 > >> > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian > >> > > Ritter > >> > > > >> > > >> > > >> > > >> > -- > >> > *Name: Ganesh Semalty* > >> > *Location: Gurgaon,Haryana(India)* > >> > *Email Id: [email protected] <mailto:[email protected]> > >> > <[email protected] <mailto:[email protected]>>* > >> > > >> > > >> > P > >> > > >> > *Please consider the environment before printing this e-mail - SAVE > >> TREE.* > >> > > >> > >> > >> > >> -- > >> > >> *M. Engin Sözer* > >> Junior Datawarehouse Manager > >> [email protected] <mailto:[email protected]> > >> > >> Goodgame Studios > >> Theodorstr. 42-90, House 9 > >> 22761 Hamburg, Germany > >> Phone: +49 (0)40 219 880 -0 <tel:%2B49%20%280%2940%20219%20880%20-0> > >> *www.goodgamestudios.com <http://www.goodgamestudios.com/> > >> <http://www.goodgamestudios.com <http://www.goodgamestudios.com/>>* > >> > >> Goodgame Studios is a brand of Altigi GmbH > >> Altigi GmbH, District court Hamburg, HRB 99869 > >> Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian > >> Ritter > >> > > > > > > > > -- > > *Name: Ganesh Semalty* > > *Location: Gurgaon,Haryana(India)* > > *Email Id: [email protected] <mailto:[email protected]> > > <[email protected] <mailto:[email protected]>>* > > > > > > P > > > > *Please consider the environment before printing this e-mail - SAVE TREE.* > > > > > > -- > > *M. Engin Sözer* > Junior Datawarehouse Manager > [email protected] <mailto:[email protected]> > > Goodgame Studios > Theodorstr. 42-90, House 9 > 22761 Hamburg, Germany > Phone: +49 (0)40 219 880 -0 <tel:%2B49%20%280%2940%20219%20880%20-0> > *www.goodgamestudios.com <http://www.goodgamestudios.com/> > <http://www.goodgamestudios.com <http://www.goodgamestudios.com/>>* > > Goodgame Studios is a brand of Altigi GmbH > Altigi GmbH, District court Hamburg, HRB 99869 > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian > Ritter > > > > -- > Name: Ganesh Semalty > Location: Gurgaon,Haryana(India) > Email Id: [email protected] <mailto:[email protected]> > > P > Please consider the environment before printing this e-mail - SAVE TREE. > > > > -- > Name: Ganesh Semalty > Location: Gurgaon,Haryana(India) > Email Id: [email protected] <mailto:[email protected]> > > P > Please consider the environment before printing this e-mail - SAVE TREE.
