Thanks for the great responses. Glad to know these things are already being worked on.
Devaraj: HCatalog will soon have a tool that can import data schema to the > metadata store. At Yahoo!, the plan is to use this tool to migrate all old > data. All new data should be directly registered in HCatalog by the data > producers. Would this suffice? > A one-time load would suffice, provided there was a solution to the custom column properties functionality, since our column schemas contain some custom fields. We'd also need to have a way to access this HCatalog data from Python Hadoop streaming jobs. I see Hadoop streaming support is not yet available, but is planned. Any idea how high on the roadmap streaming support falls? Just trying to get a sense for how far out this functionality it. On Fri, Apr 29, 2011 at 12:10 PM, Devaraj Das <[email protected]> wrote: > > > Sent from my iPhone > On Apr 29, 2011, at 11:35 AM, "Carl Steinbach" <[email protected]> wrote: > > Hi Devaraj, > > >> >> - Web UI >> Are there any know web UIs (or plans for one) to expose and even >> modify HCatalog data? We'd like to build a web UI that would help with >> data discovery. IIRC, facebook had something similar at one point. >> >> Devaraj: At Yahoo!, there is some internal effort going on in this >> direction. > > Is Y! planning to open-source this work? If so, do you have any idea when we > can expect that to happen? > Thanks. > Carl > > Don't know for sure since the work is happening in a different group. I'll > touch base with them and get back..
