I've dealt with the likes of that before. Illl be atvkeynoard this evening and take a look On Tue, Feb 28, 2017 at 2:22 PM Ian Young <[email protected]> wrote:
> Yikes, is that one giant unterminated array? I feel like you're not going > to be able to parse that with most JSON tools because until the end > arrives, it's not really valid JSON. > > A lot of streaming libraries let you set a callback that responds to a > "chunk" of input after it has read a certain number of bytes on the > request, but it'll be tough to deal with if there's (likely) no guarantee > that the chunks line up to record boundaries. Maybe you can keep a buffer > of what you've received so far and pull as many valid hash objects off the > string as you can, and leave the rest to prepend to the next chunk. > > Good luck! 🙂 > > > On Tue, Feb 28, 2017, at 04:15 PM, Chris McCann wrote: > > I'm looking into processing a stream of aircraft position data provided > here: > > http://pub-vrs.adsbexchange.com:32005 > > This effectively returns a JSON array of data structures with > aircraft-reported information including latitude and longitude > positioning. There are typically about 6000-7000 "records" provided every > 5 seconds. > > How does one parse a stream like this? You can *curl *that endpoint and > see the data, I just can't sort out how to process each record into a JSON > object to then do other stuff with. > > I've tried Ruby, Python, and Elixir but haven't come up with a solution > yet. Anyone out there have experience parsing a stream like this? > > Cheers, > > Chris > > > -- > -- > SD Ruby mailing list > [email protected] > http://groups.google.com/group/sdruby > --- > You received this message because you are subscribed to the Google Groups > "SD Ruby" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > > > -- > -- > SD Ruby mailing list > [email protected] > http://groups.google.com/group/sdruby > --- > You received this message because you are subscribed to the Google Groups > "SD Ruby" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- Peter Fitzgibbons (224) 307-9689 -- -- SD Ruby mailing list [email protected] http://groups.google.com/group/sdruby --- You received this message because you are subscribed to the Google Groups "SD Ruby" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
