That's true. The thing is these tools are most of the time expecting a certain defined schema, thus a view or a table. If you create a view on your files, you should be able to see your views from hdfs.
On 22 October 2015 at 14:34, ganesh <[email protected]> wrote: > Hi, > > Attached are two snapshots. > 1) When I select hadoop or DFS, I cant find anything under table. > > Is that normal. How to proceed ? ... Do you mean after creating view it > may be visible here. > > > 2) When I select Hive, I can see all Hive tables, > > I havent proceeded after that in TABLEAU, because of this. > > Following: > https://drill.apache.org/docs/using-apache-drill-with-tableau-9-desktop/ > It says: > Tableau can natively work with Hive tables and Drill views. > > > On Thu, Oct 22, 2015 at 6:00 PM, Mustafa Engin Sözer < > [email protected]> wrote: > >> I can think of two possibilities: >> >> 1) Check your ODBC connection string, advanced properties. Make sure dfs >> is >> not excluded. >> >> 2) I've not used Qlik Sense but one suggestion is: try create a view out >> of >> your files using drill prompt. That will create a table entry in the >> INFORMATION_SCHEMA. Check if you'll see your view that way. >> >> CREATE VIEW myview AS SELECT .... FROM myfile; >> >> On 22 October 2015 at 14:13, ganesh <[email protected]> wrote: >> >> > Hi, >> > >> > 1) I tried Tableau and qlicksense for chart / tables. But cant see files >> > from hdfs. >> > >> > will share the snapshot soon >> > >> > 2) from apache prompt, I can access hdfs files and can also query them. >> > >> > >> > >> > On Thu, Oct 22, 2015 at 5:37 PM, Mustafa Engin Sözer < >> > [email protected]> wrote: >> > >> > > 1) As I said, you can use various SQL clients to query Drill through >> > > jdbc/odbc. That's quite practical and we've a similar setup for our >> > > end-users here. Some SQL clients should be able to create basic charts >> > etc. >> > > using your queries. >> > > >> > > 2) So what's the output when you try to see the files from dfs plugin >> via >> > > Drill prompt: >> > > >> > > select files from dfs.`/user`; >> > > >> > > If you receive an error, can you please share it here? >> > > >> > > On 22 October 2015 at 13:45, ganesh <[email protected]> >> wrote: >> > > >> > > > Hi, >> > > > >> > > > Here is the storage plugin. Copied from default DFS storage plugin. >> > > > I can query data from apache drill prompt. >> > > > >> > > > But to make a presentation, I would like to query from soem >> > applications >> > > to >> > > > have visualisation .. may be table / charts >> > > > >> > > > >> > > > ================================================================= >> > > > >> > > > { >> > > > "type": "file", >> > > > "enabled": true, >> > > > "connection": "hdfs://localhost:54310/", >> > > > "workspaces": { >> > > > "root": { >> > > > "location": "/user", >> > > > "writable": false, >> > > > "defaultInputFormat": null >> > > > }, >> > > > "tmp": { >> > > > "location": "/tmp", >> > > > "writable": true, >> > > > "defaultInputFormat": null >> > > > } >> > > > }, >> > > > "formats": { >> > > > "psv": { >> > > > "type": "text", >> > > > "extensions": [ >> > > > "tbl" >> > > > ], >> > > > "delimiter": "|" >> > > > }, >> > > > "csv": { >> > > > >> > > > >> > > > ================================================================= >> > > > >> > > > On Thu, Oct 22, 2015 at 5:01 PM, Mustafa Engin Sözer < >> > > > [email protected]> wrote: >> > > > >> > > > > Hi, >> > > > > >> > > > > If you only need to show the data but not some sort of report >> (e.g. >> > as >> > > in >> > > > > Microstrategy, Tableau), then you can basically use most SQL >> clients, >> > > for >> > > > > instance SQuirrel, Heidi SQL etc. via jdbc or odbc connection . >> The >> > > > > following links should help you manage that: >> > > > > >> > > > > https://drill.apache.org/docs/odbc-jdbc-interfaces/ >> > > > > https://drill.apache.org/docs/using-the-jdbc-driver/ >> > > > > >> > > > > For the Hadoop data problem, can you share your storage plugin >> > > settings? >> > > > > Normally you shouldn't have any problems with seeing or querying >> hdfs >> > > > data. >> > > > > >> > > > > On 22 October 2015 at 13:18, ganesh <[email protected]> >> > wrote: >> > > > > >> > > > > > Hello, >> > > > > > >> > > > > > I am new to un-structured world and just started 1 week back on >> > > APACHE >> > > > > > DRILL after suggestion from my collegues. We have a semi >> structured >> > > > data >> > > > > > where we have constraint that we do not know number of columns >> > > > > > >> > > > > > I heard that APACHE DRILL is column free applicationa nd with >> > support >> > > > of >> > > > > > JSON format, it allows to create columns on-fly, >> > > > > > I converted my data from CSV-like-format to JSON and trying to >> > figure >> > > > out >> > > > > > if it will work for me. >> > > > > > >> > > > > > Here I hit two issues :- >> > > > > > 1) My column were like : 3100.2.1.2 and values like '-2303" or >> > > > > '01/01/2015 >> > > > > > 02:02:00" >> > > > > > >> > > > > > Challenge was that column cant be started with Numeric value. >> So I >> > > had >> > > > to >> > > > > > change key as: "t3100.2.1.2" >> > > > > > After that things were quite OK, >> > > > > > >> > > > > > Now I need some help from you guys. To proceed I have to >> present my >> > > > work >> > > > > to >> > > > > > management as an example. >> > > > > > But querying on apache drill console, doesnt seem to be an >> > attractive >> > > > way >> > > > > > to present things. >> > > > > > >> > > > > > I tried drill explorer too.But didnt find that so good. >> > > > > > One thing to note, I am playing with files on Hadoop standalone >> > mode >> > > in >> > > > > > UBUNTU. >> > > > > > >> > > > > > To make it appear more good looking, I started with QLIK SENSE >> .. >> > but >> > > > was >> > > > > > unable to connect it with hadoop file system. It only showed me >> > HIVE >> > > > > FILES. >> > > > > > Then I downloaded TABLEAU Trial version ... but I am unable to >> get >> > > > Hadoop >> > > > > > data here too... >> > > > > > >> > > > > > Please help me how to proceed. I have presentation on coming >> > Monday. >> > > > > > Queries are quite ready .. I just need to show in visualization >> > form >> > > > > > ........ using OPEN SOURCE applications only. >> > > > > > >> > > > > > >> > > > > > Guys please help me. >> > > > > > -- >> > > > > > *Name: Ganesh Semalty* >> > > > > > *Location: Gurgaon,Haryana(India)* >> > > > > > *Email Id: [email protected] <[email protected] >> >* >> > > > > > >> > > > > > >> > > > > > P >> > > > > > >> > > > > > *Please consider the environment before printing this e-mail - >> SAVE >> > > > > TREE.* >> > > > > > >> > > > > >> > > > > >> > > > > >> > > > > -- >> > > > > >> > > > > *M. Engin Sözer* >> > > > > Junior Datawarehouse Manager >> > > > > [email protected] >> > > > > >> > > > > Goodgame Studios >> > > > > Theodorstr. 42-90, House 9 >> > > > > 22761 Hamburg, Germany >> > > > > Phone: +49 (0)40 219 880 -0 >> > > > > *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> > > > > >> > > > > Goodgame Studios is a brand of Altigi GmbH >> > > > > Altigi GmbH, District court Hamburg, HRB 99869 >> > > > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, >> > Fabian >> > > > > Ritter >> > > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > *Name: Ganesh Semalty* >> > > > *Location: Gurgaon,Haryana(India)* >> > > > *Email Id: [email protected] <[email protected]>* >> > > > >> > > > >> > > > P >> > > > >> > > > *Please consider the environment before printing this e-mail - SAVE >> > > TREE.* >> > > > >> > > >> > > >> > > >> > > -- >> > > >> > > *M. Engin Sözer* >> > > Junior Datawarehouse Manager >> > > [email protected] >> > > >> > > Goodgame Studios >> > > Theodorstr. 42-90, House 9 >> > > 22761 Hamburg, Germany >> > > Phone: +49 (0)40 219 880 -0 >> > > *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> > > >> > > Goodgame Studios is a brand of Altigi GmbH >> > > Altigi GmbH, District court Hamburg, HRB 99869 >> > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian >> > > Ritter >> > > >> > >> > >> > >> > -- >> > *Name: Ganesh Semalty* >> > *Location: Gurgaon,Haryana(India)* >> > *Email Id: [email protected] <[email protected]>* >> > >> > >> > P >> > >> > *Please consider the environment before printing this e-mail - SAVE >> TREE.* >> > >> >> >> >> -- >> >> *M. Engin Sözer* >> Junior Datawarehouse Manager >> [email protected] >> >> Goodgame Studios >> Theodorstr. 42-90, House 9 >> 22761 Hamburg, Germany >> Phone: +49 (0)40 219 880 -0 >> *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> >> Goodgame Studios is a brand of Altigi GmbH >> Altigi GmbH, District court Hamburg, HRB 99869 >> Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian >> Ritter >> > > > > -- > *Name: Ganesh Semalty* > *Location: Gurgaon,Haryana(India)* > *Email Id: [email protected] <[email protected]>* > > > P > > *Please consider the environment before printing this e-mail - SAVE TREE.* > -- *M. Engin Sözer* Junior Datawarehouse Manager [email protected] Goodgame Studios Theodorstr. 42-90, House 9 22761 Hamburg, Germany Phone: +49 (0)40 219 880 -0 *www.goodgamestudios.com <http://www.goodgamestudios.com>* Goodgame Studios is a brand of Altigi GmbH Altigi GmbH, District court Hamburg, HRB 99869 Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian Ritter
