Hi folks,
We(BAM team, Sumedha) had a discussion about the $Subject and following
are the suggested improvements for the Cassandra data archival feature in
BAM.
- Remove hive script based archiving and use hector API to directly issue
archive queries to Cassandra (Current implementation is based
on hive where it generates hive script and archiving process uses
map-reduce jobs to achieve the task and it has a limitation of discarding
custom key value pares in column family)
- Use Task component for scheduling purposes
- Archive data to external Cassandra ring
- Major UI improvements
- List the current archiving tasks
- Edit, Remove and Schedule archiving tasks
- Add new archiving task
If there is any additional requirements please raise.
Thanks,
Malith
--
Malith Dhanushka
Engineer - Data Technologies
*WSO2, Inc. : wso2.com*
*Mobile* : +94 716 506 693
_______________________________________________
Architecture mailing list
[email protected]
https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
