Hi Marcos People are doing very similar things, but its not immediately clear from the way the use cases are described in the PoweredBy page (I believe the company Visible Measures may be one example).
If you are storing API usage information in a log, you can use Hadoop to examine the logs, group the usage information by user, pivot on user usage by specific API and then aggregate on the last collection to determine the charges. This kind of log analysis is a very common pattern in Hadoop and it works and scales very well (to answer your questions about viability and stability). You can do this via writing Map-Reduce Jobs in Java, using a higher order language like Pig or a higher order UI (like Apache Hive or IBM BigSheets) Kind regards Steve Watt From: Marcos Medrado Rubinelli <[email protected]> To: <[email protected]> Date: 03/23/2010 06:06 AM Subject: Hadoop for accounting? Hi, The wiki's "Powered By" page ( http://wiki.apache.org/hadoop/PoweredBy ) lists dozens of companies using Hadoop in production, some of them for mission-critical operations, but is anyone using it - or planning to - for anything that involves money, like calculating a bill from API usage, or microtransactions? If not, what are your main concerns? What parts would you consider stable enough for this kind of use? Thanks, Marcos
