Hi Eric,
Eric Yang wrote:
Hi Kirk,
I am working on a design which removes MySQL from Chukwa. I am making this
departure from MySQL because MDL framework was for prototype purpose. It
will not scale in production system where Chukwa could be host on large
hadoop cluster. HICC will serve data directly from HDFS in the future.
Meanwhile, the dbAdmin.sh from Chukwa 0.3 is still compatible with trunk
version of Chukwa. You can load ChukwaRecords using
org.apache.hadoop.chukwa.dataloader.MetricDataLoader class or mdl.sh from
Chukwa 0.3.
I'm to the point where the "df" example is working and demux is storing
ChukwaRecord data in HDFS. When I run dbAdmin.sh from 0.3.0, no data is
getting updated in the database.
My question is: what's the process to get a custom Demux implementation
to be viewable in HICC? Are the database tables magically created and
populated for me? Does HICC generate a widget for me?
HICC looks very nice, but when I try to add a widget to my dashboard,
the preview always reads, "No Data Available." I'm running
$CHUKWA_HOME/bin/start-all.sh followed by $CHUKWA_HOME/bin/dbAdmin.sh
(which I've manually copied to the bin directory).
What am I missing?
Thanks,
Kirk
MetricDataLoader class will be mark as deprecated, and it will not be
supported once we make transition to Avro + Tfile.
Regards,
Eric
On 3/15/10 11:56 AM, "Kirk True" <k...@mustardgrain.com> wrote:
Hi all,
I recently switched to trunk as I was experiencing a lot of issues with
0.3.0. In 0.3.0, there was a dbAdmin.sh script that would run and try to
stick data in MySQL from HDFS. However, that script is gone and when I
run the system as built from trunk, nothing is ever populated in the
database. Where are the instructions for setting up the HDFS -> MySQL
data migration for HICC?
Thanks,
Kirk