Hello, My setup is Pig + Hadoop + Cassandra for my "big data" and MySql for my "relational/meta data". Up until now that has been fine, but now I need to start creating metrics that "cross the lines". In particular, I need to create aggregations of Cassandra data based on lookups from MySql.
After doing some research, it seems like my best option is using something like Sqoop to map the meta/relational data I need from MySql -> HDFS, and then use HDFS inside of Pig for the actual lookups. I'd like to confirm that general strategy is correct (or any other tips). Thanks! will
