Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-30 Thread Abraham Williams
They ditched the effort to switch the status store to Cassandra though. http://engineering.twitter.com/2010/07/cassandra-at-twitter-today.html Abraham - Abraham Williams | Hacker Advocate | http://abrah.am @abraham | http://projects.abrah.am | http://blog.abrah.am This email is: [ ]

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-30 Thread M. Edward (Ed) Borasky
Yeah - at my current scale, I have absolutely no desire to use anything but PostgreSQL. It has a bunch of neat stuff like full text search and some key-value store capabilities, plus JSON storage is coming (in about a year). Solid as a rock and no licensing problems (except from Oracle

[twitter-dev] Re: help with accessing the streaming api

2010-09-29 Thread mynameisgabe
I've been googling like crazy and searching the streaming api docs for the answer to this question: Where would I find the latest definition for json objects returned by the stream? Specifically I'm looking for field names, data types and max lengths (if available) that will be returned. I'm

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-29 Thread M. Edward (Ed) Borasky
Quoting mynameisgabe mynameisg...@gmail.com: I've been googling like crazy and searching the streaming api docs for the answer to this question: Where would I find the latest definition for json objects returned by the stream? Specifically I'm looking for field names, data types and max

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-29 Thread Gabriel Harriman
Oh wow, I like the NoSQL data store idea. =) On Sep 29, 2010, at 3:55 PM, M. Edward (Ed) Borasky wrote: Quoting mynameisgabe mynameisg...@gmail.com: I've been googling like crazy and searching the streaming api docs for the answer to this question: Where would I find the latest definition

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-29 Thread Abraham Williams
This is about as close as you will get and it is probably outdated already. http://mehack.com/map-of-a-twitter-status-object Abraham - Abraham Williams | Hacker Advocate | http://abrah.am @abraham | http://projects.abrah.am | http://blog.abrah.am This email is: [ ] shareable [x] ask

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-29 Thread M. Edward (Ed) Borasky
Yeah - lots of them to choose from, although Twitter has invested a fair amount of time in Cassandra and Hadoop/Pig. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Gabriel

[twitter-dev] Re: help with accessing the streaming api

2010-09-11 Thread omri
I request this URL : http://stream.twitter.com/1/statuses/firehose.json i get this message on my compiler : WARNING 2010-09-11 07:31:30,447 urlfetch_stub.py:284] Stripped prohibited headers from URLFetch request: ['Host'] i think something is wrong with my permission. I read this doc. This is

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-11 Thread John Kalucki
I think the best debugging process is to reproduce your problem in curl, then show the curl -v output (passwords elided, naturally). If curl works and your home-rolled client does not, then you can use tcpdump(1) or some other packet sniffer and work out the deltas between the working solution and

[twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread omri
hi, now it returns the 401 error. It seems like I don't know what is the username and password i should insert. is this ths oauth token? what is the title of this fields? API key, Consumer key, Consumer secret? thanks On 7 ספטמבר, 17:16, John Kalucki j...@twitter.com wrote: The Streaming API

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
What text message does it return with the 401 error? You can still use basic auth with streaming. Does that work for you? You should use your screenname and password for basic auth. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Sep 9, 2010 at 2:48 AM, omri

[twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread omri
this is the message i get : File quot;C:\Python26\lib\urllib2.pyquot;, line 516, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 401: Unauthorized i think i dont know which username and password to type in the header - 'Authorization'

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread Taylor Singletary
Hi Omri, With basic auth, you don't use your consumer key or secret at all. Consumer key and secret are used when authorizing through OAuth, and the implementation is a bit more detailed than putting them in a header. In your case, you want to use basic authorization, which should be easier for

[twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread omri
so.. succeded with the username and password but now i have : HTTPError: HTTP Error 403: Forbidden I need something special to have access to the streaming resources? On 9 ספטמבר, 17:03, Taylor Singletary taylorsinglet...@twitter.com wrote: Hi Omri, With basic auth, you don't use your

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread Taylor Singletary
Hi Omri, The Streaming API has various levels of access. The most basic doesn't require any kind of permission, and that's utilizing the sampling resource, documentation for which can be found here: http://dev.twitter.com/pages/streaming_api_methods#statuses-sample and

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
Which URL are you requesting? What is the text message returned? Does this doc help? http://dev.twitter.com/pages/streaming_api_response_codes -John On Thu, Sep 9, 2010 at 7:45 AM, omri omridek...@gmail.com wrote: so.. succeded with the username and password but now i have : HTTPError: HTTP