hi steve, all! i just discovered apache streams. it looks great! can't wait to dig in more.
i'm the main developer on a similar project called granary: https://github.com/snarfed/granary https://granary-demo.appspot.com it has a lot of the same functionality as streams. it's focused on social networking data, so it doesn't do databases or data processing pipelines like streams, but it supports writing to silo APIs as well as reading them, and it supports a few formats streams doesn't: Flickr, Atom, microformats HTML and JSON. we've spent a fair amount of effort adapting to silo changes over time, eg Facebook's 2.x API, reconstructing Twitter @-reply chains, scraping Instagram's HTML now that they've disabled their API for many apps. I'd be happy to compare notes if you're interested. keep up the good work! -- https://snarfed.org/
