[twitter-dev] Re: Looking for Java class/package for Firehose

2010-10-02 Thread D. Smith
If I was looking for the least efficient way to parse streaming API, I would go with this solution, but since I am looking for more efficient, I decided to use a language that supports multithreading and Java is one of those languages. On Oct 1, 6:52 pm, Justin justin.carl...@gmail.com wrote:

[twitter-dev] Re: Looking for Java class/package for Firehose

2010-10-01 Thread D. Smith
perl has the same limitation as php, I decided to use Java for streaming API because of support for threads. On Sep 30, 12:54 pm, M. Edward (Ed) Borasky zn...@borasky- research.net wrote: I've used the Perl AnyEvent::Twitter::Stream CPAN module and the Ruby   tweetstream gem. Both of them work

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-10-01 Thread M. Edward (Ed) Borasky
Yeah, the Perl library uses AnyEvent to achieve threading. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting D. Smith emai...@sharedlog.com: perl has the same limitation as php, I

[twitter-dev] Re: Looking for Java class/package for Firehose

2010-10-01 Thread Justin
Alternatively, you can just dump to disk and have a separate process read through the queue. That would be ideal as you wouldn't lose any messages if your database goes down. (I guess I'm assuming your db is on it's own machine). On Oct 1, 12:11 pm, M. Edward (Ed) Borasky zn...@borasky-

[twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread D. Smith
Oh, man, I am new to Java, don't even know what Scala is... I've heard about it that it's like based on Java and it's supposed to be easier to code than in Java, but have not look at it, Will it even work in Eclipse or will I need Eclipse plugin? Just don't feed like learning yet another language

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread John Kalucki
Twitter4J seems to be popular, but I don't have first-hand experience with it. -John On Thu, Sep 30, 2010 at 8:32 AM, D. Smith emai...@sharedlog.com wrote: Oh, man, I am new to Java, don't even know what Scala is... I've heard about it that it's like based on Java and it's supposed to be

[twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread D. Smith
I am looking for something specifically for Firehose. I must use threads to pass the jobs to and i must have some mechanism to forking and staying alive like a daemon or something like that, and ideally it would automatically handle reconnecting in case of error. On Sep 30, 11:33 am, John

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread John Kalucki
We have internal consumers here at Twitter that use Twitter4J to consume streams. Many of the data-driven features you see on Twitter.com, and many more that you can't see run on Twitter4J. -John On Thu, Sep 30, 2010 at 8:36 AM, D. Smith emai...@sharedlog.com wrote: I am looking for something

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread Taylor Singletary
There's also this Java-based library by the developers behind Gist, though it hasn't seen an update in about a year: http://github.com/gistinc/twitterclient On Thu, Sep 30, 2010 at 8:38 AM, John Kalucki j...@twitter.com wrote: We have internal consumers here at Twitter that use Twitter4J to