Attached snapshot. No data shown ... as compared to examples in site.
On Thu, Oct 22, 2015 at 6:29 PM, ganesh <[email protected]> wrote: > Hi, > > Thanks I was writing to you only. Yes you are right. > Once I craeted a view from DRILL EXPLORER and saved it in dfs.tmp > ........... I can find that in TABLEAU too > > Though Still I am not able to figure out how to work in Tableau as all > examples shows that once COLUMN and ROWS are filles with some names in > SHEET, it will show data, but mine is empty... > > Let me try more ............... already following apache-drill site links > http://drill.apache.org/docs/tableau-examples/ > > But currently no success > > On Thu, Oct 22, 2015 at 6:26 PM, Mustafa Engin Sözer < > [email protected]> wrote: > >> That's true. The thing is these tools are most of the time expecting a >> certain defined schema, thus a view or a table. If you create a view on >> your files, you should be able to see your views from hdfs. >> >> On 22 October 2015 at 14:34, ganesh <[email protected]> wrote: >> >> > Hi, >> > >> > Attached are two snapshots. >> > 1) When I select hadoop or DFS, I cant find anything under table. >> > >> > Is that normal. How to proceed ? ... Do you mean after creating view it >> > may be visible here. >> > >> > >> > 2) When I select Hive, I can see all Hive tables, >> > >> > I havent proceeded after that in TABLEAU, because of this. >> > >> > Following: >> > >> https://drill.apache.org/docs/using-apache-drill-with-tableau-9-desktop/ >> > It says: >> > Tableau can natively work with Hive tables and Drill views. >> > >> > >> > On Thu, Oct 22, 2015 at 6:00 PM, Mustafa Engin Sözer < >> > [email protected]> wrote: >> > >> >> I can think of two possibilities: >> >> >> >> 1) Check your ODBC connection string, advanced properties. Make sure >> dfs >> >> is >> >> not excluded. >> >> >> >> 2) I've not used Qlik Sense but one suggestion is: try create a view >> out >> >> of >> >> your files using drill prompt. That will create a table entry in the >> >> INFORMATION_SCHEMA. Check if you'll see your view that way. >> >> >> >> CREATE VIEW myview AS SELECT .... FROM myfile; >> >> >> >> On 22 October 2015 at 14:13, ganesh <[email protected]> wrote: >> >> >> >> > Hi, >> >> > >> >> > 1) I tried Tableau and qlicksense for chart / tables. But cant see >> files >> >> > from hdfs. >> >> > >> >> > will share the snapshot soon >> >> > >> >> > 2) from apache prompt, I can access hdfs files and can also query >> them. >> >> > >> >> > >> >> > >> >> > On Thu, Oct 22, 2015 at 5:37 PM, Mustafa Engin Sözer < >> >> > [email protected]> wrote: >> >> > >> >> > > 1) As I said, you can use various SQL clients to query Drill >> through >> >> > > jdbc/odbc. That's quite practical and we've a similar setup for our >> >> > > end-users here. Some SQL clients should be able to create basic >> charts >> >> > etc. >> >> > > using your queries. >> >> > > >> >> > > 2) So what's the output when you try to see the files from dfs >> plugin >> >> via >> >> > > Drill prompt: >> >> > > >> >> > > select files from dfs.`/user`; >> >> > > >> >> > > If you receive an error, can you please share it here? >> >> > > >> >> > > On 22 October 2015 at 13:45, ganesh <[email protected]> >> >> wrote: >> >> > > >> >> > > > Hi, >> >> > > > >> >> > > > Here is the storage plugin. Copied from default DFS storage >> plugin. >> >> > > > I can query data from apache drill prompt. >> >> > > > >> >> > > > But to make a presentation, I would like to query from soem >> >> > applications >> >> > > to >> >> > > > have visualisation .. may be table / charts >> >> > > > >> >> > > > >> >> > > > ================================================================= >> >> > > > >> >> > > > { >> >> > > > "type": "file", >> >> > > > "enabled": true, >> >> > > > "connection": "hdfs://localhost:54310/", >> >> > > > "workspaces": { >> >> > > > "root": { >> >> > > > "location": "/user", >> >> > > > "writable": false, >> >> > > > "defaultInputFormat": null >> >> > > > }, >> >> > > > "tmp": { >> >> > > > "location": "/tmp", >> >> > > > "writable": true, >> >> > > > "defaultInputFormat": null >> >> > > > } >> >> > > > }, >> >> > > > "formats": { >> >> > > > "psv": { >> >> > > > "type": "text", >> >> > > > "extensions": [ >> >> > > > "tbl" >> >> > > > ], >> >> > > > "delimiter": "|" >> >> > > > }, >> >> > > > "csv": { >> >> > > > >> >> > > > >> >> > > > ================================================================= >> >> > > > >> >> > > > On Thu, Oct 22, 2015 at 5:01 PM, Mustafa Engin Sözer < >> >> > > > [email protected]> wrote: >> >> > > > >> >> > > > > Hi, >> >> > > > > >> >> > > > > If you only need to show the data but not some sort of report >> >> (e.g. >> >> > as >> >> > > in >> >> > > > > Microstrategy, Tableau), then you can basically use most SQL >> >> clients, >> >> > > for >> >> > > > > instance SQuirrel, Heidi SQL etc. via jdbc or odbc connection . >> >> The >> >> > > > > following links should help you manage that: >> >> > > > > >> >> > > > > https://drill.apache.org/docs/odbc-jdbc-interfaces/ >> >> > > > > https://drill.apache.org/docs/using-the-jdbc-driver/ >> >> > > > > >> >> > > > > For the Hadoop data problem, can you share your storage plugin >> >> > > settings? >> >> > > > > Normally you shouldn't have any problems with seeing or >> querying >> >> hdfs >> >> > > > data. >> >> > > > > >> >> > > > > On 22 October 2015 at 13:18, ganesh <[email protected] >> > >> >> > wrote: >> >> > > > > >> >> > > > > > Hello, >> >> > > > > > >> >> > > > > > I am new to un-structured world and just started 1 week back >> on >> >> > > APACHE >> >> > > > > > DRILL after suggestion from my collegues. We have a semi >> >> structured >> >> > > > data >> >> > > > > > where we have constraint that we do not know number of >> columns >> >> > > > > > >> >> > > > > > I heard that APACHE DRILL is column free applicationa nd with >> >> > support >> >> > > > of >> >> > > > > > JSON format, it allows to create columns on-fly, >> >> > > > > > I converted my data from CSV-like-format to JSON and trying >> to >> >> > figure >> >> > > > out >> >> > > > > > if it will work for me. >> >> > > > > > >> >> > > > > > Here I hit two issues :- >> >> > > > > > 1) My column were like : 3100.2.1.2 and values like >> '-2303" or >> >> > > > > '01/01/2015 >> >> > > > > > 02:02:00" >> >> > > > > > >> >> > > > > > Challenge was that column cant be started with Numeric value. >> >> So I >> >> > > had >> >> > > > to >> >> > > > > > change key as: "t3100.2.1.2" >> >> > > > > > After that things were quite OK, >> >> > > > > > >> >> > > > > > Now I need some help from you guys. To proceed I have to >> >> present my >> >> > > > work >> >> > > > > to >> >> > > > > > management as an example. >> >> > > > > > But querying on apache drill console, doesnt seem to be an >> >> > attractive >> >> > > > way >> >> > > > > > to present things. >> >> > > > > > >> >> > > > > > I tried drill explorer too.But didnt find that so good. >> >> > > > > > One thing to note, I am playing with files on Hadoop >> standalone >> >> > mode >> >> > > in >> >> > > > > > UBUNTU. >> >> > > > > > >> >> > > > > > To make it appear more good looking, I started with QLIK >> SENSE >> >> .. >> >> > but >> >> > > > was >> >> > > > > > unable to connect it with hadoop file system. It only showed >> me >> >> > HIVE >> >> > > > > FILES. >> >> > > > > > Then I downloaded TABLEAU Trial version ... but I am unable >> to >> >> get >> >> > > > Hadoop >> >> > > > > > data here too... >> >> > > > > > >> >> > > > > > Please help me how to proceed. I have presentation on coming >> >> > Monday. >> >> > > > > > Queries are quite ready .. I just need to show in >> visualization >> >> > form >> >> > > > > > ........ using OPEN SOURCE applications only. >> >> > > > > > >> >> > > > > > >> >> > > > > > Guys please help me. >> >> > > > > > -- >> >> > > > > > *Name: Ganesh Semalty* >> >> > > > > > *Location: Gurgaon,Haryana(India)* >> >> > > > > > *Email Id: [email protected] < >> [email protected] >> >> >* >> >> > > > > > >> >> > > > > > >> >> > > > > > P >> >> > > > > > >> >> > > > > > *Please consider the environment before printing this e-mail >> - >> >> SAVE >> >> > > > > TREE.* >> >> > > > > > >> >> > > > > >> >> > > > > >> >> > > > > >> >> > > > > -- >> >> > > > > >> >> > > > > *M. Engin Sözer* >> >> > > > > Junior Datawarehouse Manager >> >> > > > > [email protected] >> >> > > > > >> >> > > > > Goodgame Studios >> >> > > > > Theodorstr. 42-90, House 9 >> >> > > > > 22761 Hamburg, Germany >> >> > > > > Phone: +49 (0)40 219 880 -0 >> >> > > > > *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> >> > > > > >> >> > > > > Goodgame Studios is a brand of Altigi GmbH >> >> > > > > Altigi GmbH, District court Hamburg, HRB 99869 >> >> > > > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, >> >> > Fabian >> >> > > > > Ritter >> >> > > > > >> >> > > > >> >> > > > >> >> > > > >> >> > > > -- >> >> > > > *Name: Ganesh Semalty* >> >> > > > *Location: Gurgaon,Haryana(India)* >> >> > > > *Email Id: [email protected] <[email protected] >> >* >> >> > > > >> >> > > > >> >> > > > P >> >> > > > >> >> > > > *Please consider the environment before printing this e-mail - >> SAVE >> >> > > TREE.* >> >> > > > >> >> > > >> >> > > >> >> > > >> >> > > -- >> >> > > >> >> > > *M. Engin Sözer* >> >> > > Junior Datawarehouse Manager >> >> > > [email protected] >> >> > > >> >> > > Goodgame Studios >> >> > > Theodorstr. 42-90, House 9 >> >> > > 22761 Hamburg, Germany >> >> > > Phone: +49 (0)40 219 880 -0 >> >> > > *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> >> > > >> >> > > Goodgame Studios is a brand of Altigi GmbH >> >> > > Altigi GmbH, District court Hamburg, HRB 99869 >> >> > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, >> Fabian >> >> > > Ritter >> >> > > >> >> > >> >> > >> >> > >> >> > -- >> >> > *Name: Ganesh Semalty* >> >> > *Location: Gurgaon,Haryana(India)* >> >> > *Email Id: [email protected] <[email protected]>* >> >> > >> >> > >> >> > P >> >> > >> >> > *Please consider the environment before printing this e-mail - SAVE >> >> TREE.* >> >> > >> >> >> >> >> >> >> >> -- >> >> >> >> *M. Engin Sözer* >> >> Junior Datawarehouse Manager >> >> [email protected] >> >> >> >> Goodgame Studios >> >> Theodorstr. 42-90, House 9 >> >> 22761 Hamburg, Germany >> >> Phone: +49 (0)40 219 880 -0 >> >> *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> >> >> >> Goodgame Studios is a brand of Altigi GmbH >> >> Altigi GmbH, District court Hamburg, HRB 99869 >> >> Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian >> >> Ritter >> >> >> > >> > >> > >> > -- >> > *Name: Ganesh Semalty* >> > *Location: Gurgaon,Haryana(India)* >> > *Email Id: [email protected] <[email protected]>* >> > >> > >> > P >> > >> > *Please consider the environment before printing this e-mail - SAVE >> TREE.* >> > >> >> >> >> -- >> >> *M. Engin Sözer* >> Junior Datawarehouse Manager >> [email protected] >> >> Goodgame Studios >> Theodorstr. 42-90, House 9 >> 22761 Hamburg, Germany >> Phone: +49 (0)40 219 880 -0 >> *www.goodgamestudios.com <http://www.goodgamestudios.com>* >> >> Goodgame Studios is a brand of Altigi GmbH >> Altigi GmbH, District court Hamburg, HRB 99869 >> Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian >> Ritter >> > > > > -- > *Name: Ganesh Semalty* > *Location: Gurgaon,Haryana(India)* > *Email Id: [email protected] <[email protected]>* > > > P > > *Please consider the environment before printing this e-mail - SAVE TREE.* > -- *Name: Ganesh Semalty* *Location: Gurgaon,Haryana(India)* *Email Id: [email protected] <[email protected]>* P *Please consider the environment before printing this e-mail - SAVE TREE.*
