Re: [twitter-dev] Streaming API JSON Samples
Hi Juliano, From filter stream we received just two types of messages: 'status' (tweets itself) and 'limit' (show how many tweets was suppressed since last reconnection). Abraços da UFRGS!! On Sun, May 1, 2011 at 3:40 PM, Juliano Bortolozzo Solanho juliano.sola...@gmail.com wrote: Hello there, Does anyone know of some sort of community maintained repository of message types sent by the Streaming API? With a sample of every known type of json message found in the site/user/filter streams. - Juliano -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: A way to improve the Streamin API
+1 On Fri, Apr 8, 2011 at 4:31 AM, maxf3r massimo.ferr...@gmail.com wrote: I agree with you. For sure a large part of data inside the tweet object is redundant for any apps want to parse only tweet data to achieve more derivate information For example, to be clear and to open some sort of discussion: tweet info (id; created_at; text; entities) coordinates place (if any, I really hope so) minimal user info (screen_name; profile_url;... ) massimo On Apr 8, 1:12 am, Mamadou Bobo Diallo dia...@gurumades.com wrote: Actualy, we need access to the Site Streaming api to be able to start building our start-up product, we've been waiting for week now. I understand that the beta is about to improve the system and make sure it is able to scale when it goes live. One way to make the system scale better would be to allow some special streaming access: for example, for our product, we don't need all details of a tweet: having only some basic information on the tweet is enough, no need to have the information of the author attached. Allowing us to connect to the Streaming API with this minimalistic way will make less data (data that we don't need) goes througth the systeme and increase throughtput by 40%. I'm sure that there is many app out there that don't need all those informations. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Streaming API Rate Limiting
I'm getting very similar count to United States, my average is 499,380 tweets/day. On Mon, Apr 4, 2011 at 3:08 PM, Khandelwal khandel...@gmail.com wrote: So, it turns out that I was an order of magnitude off when I mentioned numbers above. We receive 500,000 tweets/day not 50,000. On Apr 1, 3:49 pm, Colin Surprenant colin.surpren...@gmail.com wrote: Well, first, In the Gnip Power Track documentationhttp:// docs.gnip.com/w/page/35663947/Power-Trackat the has:geo section they say Currently, 'has:geo' is about 2-4% of the full firehose. Also, I ran some tests a few weeks ago to see the difference in content between the search api and the streaming api for equivalent geolocalized searches. See this threadhttp:// groups.google.com/group/twitter-development-talk/browse_thread... My results showed that the streaming API returns a very small fraction (3% in my tests) of what the search API returns. This is because the streaming API only uses the geotagging API to locate tweets, but the search API uses both the geotagging API and the user location field. For example, I can get around 250 000 tweets/day for San Francisco using the search api but the streaming api will return around 7000 tweets/day. At 7000 tweets/day for San Francisco, 50 000 for the whole US seems small. Colin On Apr 1, 2:40 pm, Augusto Santos augu...@gemeos.org wrote: Sorry Colin, but where did you get this information? Doesn't match with the reality. Not at all. On Fri, Apr 1, 2011 at 12:35 PM, Colin Surprenant colin.surpren...@gmail.com wrote: As a side note, currently only 3-4% of the total tweets (firehose) are geo-tagged and are eligible to be selected in a stream location bounding box. If the current firehose rate is about 140M tweets/day, that makes ~5M eligible tweets/day. I do not know what the proportion of tweets from the US is but I would think 50% seem reasonable and would result in ~2.5M tweets/day. Even if we lower that proportion, your 50 000 tweets/day seems way off. There are 3 possibilities, 1) you are being rate limited more than you think, 2) your bounding box is wrong or 3) your bounding box is too large and Twitter has reduced it somehow. I remember I read somewhere in the api doc that each bounding box could not be more than 1 degree square enough to cover most metropolitan areas - but I cannot find that back. Colin On Mar 31, 4:08 pm, Data Gatherer gatherer...@gmail.com wrote: We have a bounding box set for the United States. Even though it's a large box, we only receive about 50,000 tweets a day. However, I see that we get rate limited at least once a week already. The box is large, but the number of matching results is fairly low. Knowing how the rate limiting works more specifically would be important when trying to gather data for other projects (more bounding boxes, other keywords). On Mar 31, 3:50 pm, Jeremy Dunck jdu...@gmail.com wrote: On Thu, Mar 31, 2011 at 2:48 PM, Augusto Santos augu...@gemeos.org wrote: No it won't. Streaming has rate limit with around 1% of firehose, if your search term os too much generic. If your search term or bouding box get too many tweets, you will start receive 'limit' status message as doc said. http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses Sure, I understand that, I just meant to say that 1% of all tweets is a lot (140M average per day now). If your terms are not very general, you have a lot of head room. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter:http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter Streaming Question ...Automating getting by KW - Cron Job
User http://code.google.com/p/phirehose/ as deamon. No cron job needed.
On Sun, Apr 3, 2011 at 2:05 AM, Digga digga...@gmail.com wrote:
How should I set up a cron job for twitter stream? I have a php file
that consumes and adds data to database ...
f(! ($line = stream_get_line($instream, 2, \n))) {
What would be the best way to put that on a cron job, will this go
infinite if I put it on a schedule, or do I need to run the script
every half hour or something?
while(! feof($instream)) {
if(! ($line = stream_get_line($instream, 2,
\n))) {
continue;
}else{
$tweet = json_decode($line);
SaveData($tweet);
}
this how I consume the tweet, and save it. How can I do this on a
schedule? right now I run it in the browser, do I set this script to
go off every hour or so? or just let it run in the background?
Please let me know.
Sam.
--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk
--
氣
--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Selecting tweets based on geo_enabled
As said several times in this list, only Streaming API, with locations method, do geo_enable=true filtering. On Fri, Apr 1, 2011 at 11:05 PM, Mark Murphy mobitin...@gmail.com wrote: Hi, I've given this question a fairly long search and not found an answer. In my first experiments with the search API I've been trying to obtain tweets from a specific lat/lon's radius. The responses however include those with geo_enabled = false. Is there a way to filter to obtain only tweets tagged with an actual lat/lon? I was thinking of obtaining first the geoid's nearby and then getting the tweets near those thinking that they would need to be from geo_enabled users. Also I was wondering if the streaming API might give me what I need. Some further playing around should yield an answer but if anyone's been down the path already I'd appreciate some advice. Thanks! -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Streaming API Rate Limiting
Sorry Colin, but where did you get this information? Doesn't match with the reality. Not at all. On Fri, Apr 1, 2011 at 12:35 PM, Colin Surprenant colin.surpren...@gmail.com wrote: As a side note, currently only 3-4% of the total tweets (firehose) are geo-tagged and are eligible to be selected in a stream location bounding box. If the current firehose rate is about 140M tweets/day, that makes ~5M eligible tweets/day. I do not know what the proportion of tweets from the US is but I would think 50% seem reasonable and would result in ~2.5M tweets/day. Even if we lower that proportion, your 50 000 tweets/day seems way off. There are 3 possibilities, 1) you are being rate limited more than you think, 2) your bounding box is wrong or 3) your bounding box is too large and Twitter has reduced it somehow. I remember I read somewhere in the api doc that each bounding box could not be more than 1 degree square enough to cover most metropolitan areas - but I cannot find that back. Colin On Mar 31, 4:08 pm, Data Gatherer gatherer...@gmail.com wrote: We have a bounding box set for the United States. Even though it's a large box, we only receive about 50,000 tweets a day. However, I see that we get rate limited at least once a week already. The box is large, but the number of matching results is fairly low. Knowing how the rate limiting works more specifically would be important when trying to gather data for other projects (more bounding boxes, other keywords). On Mar 31, 3:50 pm, Jeremy Dunck jdu...@gmail.com wrote: On Thu, Mar 31, 2011 at 2:48 PM, Augusto Santos augu...@gemeos.org wrote: No it won't. Streaming has rate limit with around 1% of firehose, if your search term os too much generic. If your search term or bouding box get too many tweets, you will start receive 'limit' status message as doc said. http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses Sure, I understand that, I just meant to say that 1% of all tweets is a lot (140M average per day now). If your terms are not very general, you have a lot of head room. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Streaming API Rate Limiting
Clearer Information: From 10th Mar to 31th Mar the average was 1,1M/day and 860K/day of these with lat/long information. On Fri, Apr 1, 2011 at 4:03 PM, Augusto Santos augu...@gemeos.org wrote: Since 6th March setting location via Broswer has been disable, which correponded of around 50% geotagged tweets. And now I'am getting values very similar with you Adam. On Fri, Apr 1, 2011 at 3:56 PM, Adam Green 140...@gmail.com wrote: All of my experiences with geotagging show that about 0.3% to 0.5% of tweets have these codes. I'd be curious to know if that matches what others have found. On Fri, Apr 1, 2011 at 2:40 PM, Augusto Santos augu...@gemeos.org wrote: Sorry Colin, but where did you get this information? Doesn't match with the reality. Not at all. On Fri, Apr 1, 2011 at 12:35 PM, Colin Surprenant colin.surpren...@gmail.com wrote: As a side note, currently only 3-4% of the total tweets (firehose) are geo-tagged and are eligible to be selected in a stream location bounding box. If the current firehose rate is about 140M tweets/day, that makes ~5M eligible tweets/day. I do not know what the proportion of tweets from the US is but I would think 50% seem reasonable and would result in ~2.5M tweets/day. Even if we lower that proportion, your 50 000 tweets/day seems way off. There are 3 possibilities, 1) you are being rate limited more than you think, 2) your bounding box is wrong or 3) your bounding box is too large and Twitter has reduced it somehow. I remember I read somewhere in the api doc that each bounding box could not be more than 1 degree square enough to cover most metropolitan areas - but I cannot find that back. Colin On Mar 31, 4:08 pm, Data Gatherer gatherer...@gmail.com wrote: We have a bounding box set for the United States. Even though it's a large box, we only receive about 50,000 tweets a day. However, I see that we get rate limited at least once a week already. The box is large, but the number of matching results is fairly low. Knowing how the rate limiting works more specifically would be important when trying to gather data for other projects (more bounding boxes, other keywords). On Mar 31, 3:50 pm, Jeremy Dunck jdu...@gmail.com wrote: On Thu, Mar 31, 2011 at 2:48 PM, Augusto Santos augu...@gemeos.org wrote: No it won't. Streaming has rate limit with around 1% of firehose, if your search term os too much generic. If your search term or bouding box get too many tweets, you will start receive 'limit' status message as doc said. http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses Sure, I understand that, I just meant to say that 1% of all tweets is a lot (140M average per day now). If your terms are not very general, you have a lot of head room. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Adam Green Twitter API Consultant and Analyst http://140dev.com, @140dev http://2012twit.com, @2012twit 781-879-2960 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Streaming API Rate Limiting
No it won't. Streaming has rate limit with around 1% of firehose, if your search term os too much generic. If your search term or bouding box get too many tweets, you will start receive 'limit' status message as doc said. http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses On Thu, Mar 31, 2011 at 4:27 PM, Jeremy Dunck jdu...@gmail.com wrote: On Thu, Mar 31, 2011 at 1:49 PM, Data Gatherer gatherer...@gmail.com wrote: ... I would not like the data gathering for one project to affect another project. If I'm rate limited depending on how much data my single connection to the data stream receives - this would affect all projects. If this is the case, can I make multiple connections to the streaming API? The IP addresses would be similar but not the same. Since the projects are different, the accounts would be different too. I find the description of rate limiting and multiple connections on the Streaming API documentation a little confusing. I just did a stream search for the and received 2200 tweets in 30 seconds. If that sustained, it would be 6,336,000 per day. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Géolocalisation d'un tweet
But, what kind of service do you want to provide using geolocation? 2011/3/29 Nassr zied zied.na...@gmail.com salut, je suis en plein travail pour la création de mon Client Twetter pour windows phone 7. En fait, j'ai presque terminé et je veux ajouter un module de geolocalisation(c'est la première fois que je travail sur ce type de service) ...j'ai lu la documentation fournit par Twitter mais j'ai pa bien compris le principe de l'exemple ... est ce qu'il ya quelqu'un qui peut m'aider svp! Merci... -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Geo AP
As you can see at http://dev.twitter.com/doc/get/geo/nearby_places this method is *deprecated and should be replaced by geo/search But there is no place_id for Australia right now. *At least there is no geotagged tweet with a place_id that came from a Lat/Long in Australia. On Thu, Mar 24, 2011 at 12:38 PM, Daryoush Paknad dpak...@gmail.com wrote: geo/naerby_places geo/search geo/similar_places geo/reverse_geocode geo/place Specifically :http://api.twitter.com/1/geo/nearby_places Thanks. On Thu, Mar 24, 2011 at 5:30 AM, Augusto Santos augu...@gemeos.orgwrote: What you mean with geo api? geotagged tweets? trending topics per country/city? places? On Wed, Mar 23, 2011 at 9:58 PM, Daryoush dpak...@gmail.com wrote: Does twitter geo api work in Australia? -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Stream API and UserLists
You can get http://dev.twitter.com/doc/get/:user/:list_id/members and then use with http://dev.twitter.com/pages/streaming_api_methods#follow don't you? On Fri, Mar 25, 2011 at 4:11 AM, Fabien Penso fabienpe...@gmail.com wrote: +1 Is this planned ? On Tue, Mar 8, 2011 at 1:23 AM, tmurray tmurr...@gmail.com wrote: I was wondering if there is a way to use the streaming API to receive tweets associated with User Lists?? If not, what is the best way to receive tweets associated with user lists? Thanks in advance for your help!! -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Stream API and UserLists
Well, but streaming api really doesn't work for private profiles, for that you must use User Streams. On Fri, Mar 25, 2011 at 8:45 AM, Fabien Penso fabienpe...@gmail.com wrote: On Fri, Mar 25, 2011 at 12:40 PM, Augusto Santos augu...@gemeos.org wrote: You can get http://dev.twitter.com/doc/get/:user/:list_id/members and then use with http://dev.twitter.com/pages/streaming_api_methods#follow don't you? Doesn't work for private profiles. -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Geo AP
What you mean with geo api? geotagged tweets? trending topics per country/city? places? On Wed, Mar 23, 2011 at 9:58 PM, Daryoush dpak...@gmail.com wrote: Does twitter geo api work in Australia? -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Search API: Can the geocode param only give me lat/long results?
Streaming API will give what you need through locations method. http://dev.twitter.com/pages/streaming_api_methods#locations On Mon, Mar 21, 2011 at 12:22 PM, Stu stuart.batter...@gmail.com wrote: Hi, I have a pre-question before my question. With the search API's geocode based search, if it falls back on the user's profile information does it use GPS positions in their profile or some location such as 'London'. The problem is that I need much greater precision than that. Thus, if I perform this search: http://search.twitter.com/search.json?geocode=51.53,-0.14,1mi Am I able to get results back that only contain lat/long values of the tweet? The json returned here has basically no values for 'geo'. Thanks S. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Requesting increased access levels for Streaming API
I think the answer is you never will. This kind of benefit might follow the same rules that whitelist, that will no longer be supported just as the thread below said. http://groups.google.com/group/twitter-development-talk/browse_thread/thread/1acd954f8a04fa84/688b8bfe26a5c178 On Tue, Mar 15, 2011 at 6:58 AM, manusis ra...@manusis.com wrote: The streaming API mentions about different access roles but does not indicate how one could apply for them. The default access level allows up to 400 track keywords, 5,000 follow userids and 25 0.1-360 degree location boxes. Increased access levels allow 100,000 follow userids (“shadow” role), 400,000 follow userids (“birddog” role), 10,000 track keywords (“restricted track” role), 200,000 track keywords (“partner track” role), and 200 0.1-360 degree location boxes (“locRestricted” role). Increased track access levels also pass a higher proportion of statuses before limiting the stream. For our product, we need shadow and partner track access roles. Could somebody shed any light on how one could apply for the increased access levels? Thanks, Rajiv -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] support for location filter of streaming api in India
Paresh, The problem is that all geocoded tweets from India dind't have the country field filled. I use geographic database to transform Lat/Long into political boundaries information. The twitter dind't support most of countries boundaries. But if you set a bounding box at Lat/Long India area, streaming API will get a lot of tweets. Cheers, Augusto. On Mon, Feb 28, 2011 at 5:11 PM, Matt Harris thematthar...@twitter.comwrote: Hi Paresh, The Streaming API supports any latitude and longitude bounding boxes but relies on Tweets being geocoded. If the quantity of Tweets being returned is low it could that Twitter users in India do not geocode their Tweets, or the devices they use do not support geocoding Hope that answers your question, @themattharris Developer Advocate, Twitter http://twitter.com/themattharris On Sat, Feb 26, 2011 at 4:22 AM, Paresh Nakhe paresh.na...@gmail.comwrote: Hi, I have just started using location filter in statuses/filter method. Initially i tried with the coordinates given in documentation (which were for New York) and it worked fine. I then worked out the coordinates for some area in India but i am not getting any tweets at all. I understand that this filter will return tweets created using geotagging api but i am sure that atleast some people in India would have this feature enabled. Is it the case that this filter does not work in India? I feel so because i tried adding location to my tweets but cannot see any location attached to them. What could i be doing wrong? Thanks -- *Paresh Nakhe What I have is not a dream, because I will make it a reality.* -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Streaming API access level limit
Although this is specified at streaming API docs, it's possible to connect two diferent users at the same IP address. On Mon, Feb 28, 2011 at 5:25 PM, Matt Harris thematthar...@twitter.comwrote: Hi J, Glad you worked it out. The Streaming API (stream.twitter.com) does not support multiple streams - only one connection is permitted. This is explained in more detail on our developer resources site: http://dev.twitter.com/pages/streaming_api_concepts#access-rate-limiting Best, @themattharris Developer Advocate, Twitter http://twitter.com/themattharris On Mon, Feb 28, 2011 at 12:54 AM, Chen Jack S Y aquaj...@gmail.comwrote: Thanks, figured it out. Another question, how many connections are allowed with a shared IP? Any suggestions on multiple streams in one machine with one IP? J On Mon, Feb 28, 2011 at 1:50 PM, John Kalucki j...@twitter.com wrote: Are you specifying the IDs in the URL or in a POST parameter? There's a limit to the URL length that we'll parse, but we'll take huge POST parameters. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Feb 22, 2011 at 11:22 PM, aquajach aquaj...@gmail.com wrote: Hi, Just started to play with streaming API, but get confused on how many followers id could be tracked with one connection. In basic level of filter, http://dev.twitter.com/doc/post/statuses/filter says 400 followers ids http://dev.twitter.com/pages/streaming_api_methods says 5,000 followers ids Then I tried in local machine, could only follow around 320 ids ( receive 413 if more) and seems multiple connections in one IP are not allowed. Any body here know: Is there any ways to follow a few thousands ids for each authenticated account (with oauth)? Or how to apply for higher access level? Any experience share or answers are appreciated! J -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] In firehose, how to find tweet's location country and sub-country (state/province) information
Strange question, because whereever the tweets are from (firehose, sample, Spritzer, Gardenhose), the country and sub-country information are in the same place, at json tags: \\place\country \\place\full_name On Thu, Feb 17, 2011 at 8:32 PM, Priti priti.gangr...@gmail.com wrote: In firehose, how to find tweet's location country and sub-country (state/province) information -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Streaming Api returning tweets with NULL value for object place
We are reporting similar problem at this thread http://groups.google.com/group/twitter-development-talk/browse_thread/thread/8fbab48c3172b88d# and got no answer from twitter dev team. Need more information? I can give some if needed. On Thu, Feb 17, 2011 at 3:31 PM, Matt Harris thematthar...@twitter.comwrote: Hi Eric and Aci, Do you have some example tweets showing what you mean? Thanks, @themattharris Developer Advocate, Twitter http://twitter.com/themattharris On Wed, Feb 16, 2011 at 11:22 PM, Eric Charles eric.umg.char...@gmail.com wrote: Same question here. Eric On Feb 17, 12:59 am, aci acicartag...@gmail.com wrote: Hello, I am using the streaming api in order to be able to save tweets that uses the geoJSON place key of the returned json object. Tt was working fine last Tuesday, Feb 15, But now, there seems to be a problem with the place tag of the tweet object. I was just wondering if it's just me or is there some sort of bug or changes have been made in the API? Aci Cartagena -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Problem with Streaming API location filter
I think the right link might be https://twitter.com/#!/Support/status/38295036303122432 it's a 2 day delayed post, but ok. On Thu, Feb 17, 2011 at 3:49 PM, Matt Harris thematthar...@twitter.comwrote: Cross posting this reply as it is relevant. Our support team confirms that Tweeting with locations is disabled at the moment. http://twitter.com/Support/status/37747170618785793 When the service is restored @support will post an update. Best, @themattharris Developer Advocate, Twitter http://twitter.com/themattharris On Wed, Feb 16, 2011 at 11:35 AM, Andrey andre...@gmail.com wrote: same here On Feb 16, 4:40 am, Augusto Santos augu...@gemeos.org wrote: Hi folks, I'm having a huge decrease in my location filter at streaming api. Apparently it's only retrieving tweets with Lat/Long and just a few of those with place_name only. Is there a change on the filter location policy? This problem starts at 2011-02-16 01:00:00 UTC, here's my count sample With/Without Lat/Long information: month day hour WithoutLatLong WithLatLong 2 16 12 0 38 2 16 11 106 27890 2 16 10 104 25026 2 16 9 109 21680 2 16 8 129 21252 2 16 7 141 23906 2 16 6 85 23622 2 16 5 67 24928 2 16 4 76 26288 2 16 3 3498 29309 2 16 2 8413 28783 2 16 1 20145 30119 2 16 0 73797 29976 2 15 23 75647 24921 2 15 22 61369 18439 2 15 21 62640 19588 2 15 20 81359 28071 2 15 19 70744 27320 2 15 18 62021 26855 2 15 17 61765 31295 2 15 16 64631 32055 2 15 15 60821 35202 2 15 14 46371 34168 2 15 13 37315 33056 2 15 12 28220 31379 2 15 11 21489 27967 2 15 10 17298 24775 2 15 9 13815 23260 2 15 8 14880 23609 2 15 7 15560 25008 Thanks. -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Problem with Streaming API location filter
Hi folks, I'm having a huge decrease in my location filter at streaming api. Apparently it's only retrieving tweets with Lat/Long and just a few of those with place_name only. Is there a change on the filter location policy? This problem starts at 2011-02-16 01:00:00 UTC, here's my count sample With/Without Lat/Long information: month day hour WithoutLatLong WithLatLong 2 16 12 0 38 2 16 11 106 27890 2 16 10 104 25026 2 16 9 109 21680 2 16 8 129 21252 2 16 7 141 23906 2 16 6 85 23622 2 16 5 67 24928 2 16 4 76 26288 2 16 3 3498 29309 2 16 2 8413 28783 2 16 1 20145 30119 2 16 0 73797 29976 2 15 23 75647 24921 2 15 22 61369 18439 2 15 21 62640 19588 2 15 20 81359 28071 2 15 19 70744 27320 2 15 18 62021 26855 2 15 17 61765 31295 2 15 16 64631 32055 2 15 15 60821 35202 2 15 14 46371 34168 2 15 13 37315 33056 2 15 12 28220 31379 2 15 11 21489 27967 2 15 10 17298 24775 2 15 9 13815 23260 2 15 8 14880 23609 2 15 7 15560 25008 Thanks. -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Streaming API setLocations Accuracy
Any exaples of tweets outside the box and the box itself? On Mon, Feb 14, 2011 at 6:59 PM, 1537 News 1537n...@gmail.com wrote: Good Afternoon I am using the StreamingAPI with a boundary box but finding it to be inaccurate. I don't mind thinking outside the box :) but my a large % of my results are 20 miles outside my selected boundary box. I have not set any other search criteria. Any thoughts? -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] keyword search on past tweets
Google It with Realtime search feature Example: Search for 'paloalto' keywork in July 2010 tweetshttp://www.google.com/#q=paloaltohl=enprmd=ivnssource=lnmsei=teNHTcClOcPLgQfczY33BQsa=Xoi=mode_linkct=modecd=9ved=0CBEQ_AUoCAprmdo=1tbm=mbl:1tbs=mbl:1,mbl_hs:1277953200,mbl_he:1280631599fp=426d8cc361bc46e9 On Tue, Feb 1, 2011 at 1:17 AM, paloalto sungh...@gmail.com wrote: I have a client who would like to perform keyword search results on past tweets that go back as far as July 2010. Any idea where I can get (or buy) such data? -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] twitter geocode jsonp prroblem
I saw something like that at stack overflow, I thing is what you need
here the source where I found
http://stackoverflow.com/questions/2105343/twitter-geocode-to-google-maps
and here the application
http://varskaviata.nu/twittermap/
Look the source code of the application to understand how it works.
Cheers.
On Tue, Feb 1, 2011 at 1:45 PM, Taylor Singletary
taylorsinglet...@twitter.com wrote:
Hi there,
When you're executing this Javascript, are you literally making the request
to api.twitter.com/version/geo/search.json? -- It looks like you may have
forgotten to replace version with 1 -- I get the callback when I execute
a request like GET
http://api.twitter.com/1/geo/search.json?query=loverpp=10callback=aCallback
Why are you passing rpp=10? I don't believe this method supports that
parameter.
Taylor
On Mon, Jan 31, 2011 at 8:25 PM, Webdev webdev2...@gmail.com wrote:
How can i access the jsonp callback in twitter geocode api using
jquery especially lat and long values ? Once i get those values i will
try to show it on the google maps
http://dev.twitter.com/doc/get/geo/search
I was trying to access it but it wasnt returning any results.
$(document).ready(function() {
// Enable caching
$.ajaxSetup({ cache: true });
var query = http://api.twitter.com/version/geo/search.json?q=
;
query += loverpp=10callback=?
// Send JSON request
// The returned JSON object will have a property called results
where we find
// a list of the tweets matching our request query
$.getJSON(
query,
function(data) {
$.each(data.results, function(i, tweet) {
//console.log(tweet);
// Before we continue we check that we got data
if(tweet.text !== undefined) {
// Calculate how many hours ago was the tweet
posted
var date_tweet = new Date(tweet.created_at);
var date_now = new Date();
var date_diff = date_now - date_tweet;
var hours = Math.round(date_diff/
(1000*60*60));
// Build the html string for the current tweet
var tweet_html = 'div class=tweet_text';
tweet_html+= 'a href=http://
www.twitter.com/';
tweet_html+= '/status/' + tweet.id + '';
tweet_html+= tweet.text + '\/a\/div';
tweet_html+= 'div class=tweet_hours' +
hours;
tweet_html+= ' hours ago\/div';
tweet_html+= 'div
class=tweet_imgimg src=' +
tweet.profile_image_url + '';
tweet_html+= '\/div';
// Append html string to tweet_container div
$('#tweet_container').append(tweet_html);
}
});
});
});
--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk
--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk
--
氣
--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Stream API with firehorse method
You should use Search API http://dev.twitter.com/doc/get/search, remembering that results are limited to 7 days (past). On Tue, Jan 25, 2011 at 9:30 PM, Zhe Chen chenzhe@gmail.com wrote: I want to store all up to date tweets in my database and use another application to search it. The user of the application may use any search key. In this case, what kind of method should I use? Thanks On Jan 25, 1:13 pm, Tom van der Woerdt i...@tvdw.eu wrote: On 1/25/11 9:08 PM, Zhe Chen wrote: Hi, On your website, you said the Firehose is not a generally available resource. Does that mean I cannot use it in my application? What should I do if I want to use it. Thanks I don't think that you want the Firehose in your application. The Firehose is a stream with *all* Tweets that *any* Twitter user sends. Depending on your application, you may like : - Desktop application: User Streams - Web-based application: Site Streams - Search-based application: filter.json (normal streams) Tom -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] tweet location information
Hi, I don't understand very well your last question about many tags, but using the Search API or Streaming API it's possible to identify the location of a tweets, the location of a user and/or search for multiple tags at same time, since the default binary operator between the tags is OR. Cheers. On Tue, Jan 18, 2011 at 3:19 PM, Zhe Chen chenzhe@gmail.com wrote: HI, On this page, http://www.nytimes.com/interactive/2009/02/02/sports/20090202_superbowl_twitter.html?scp=1sq=twitter%20baseball%20mapst=cse Do you know what kind of information are they using to locate the tweets? To be specific, there are many tags about location information. Thanks -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Wha'ts the difference between geo and place
Search at http://groups.google.com/group/twitter-development-talk/ might help. Like: http://groups.google.com/group/twitter-development-talk/browse_thread/thread/9e4ea75178174908 On Wed, Dec 29, 2010 at 9:39 AM, Ace asit...@gmail.com wrote: Hi, Is there a detailed explanation about the differences between Geo and Place. Thanks -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Broken Json Status on Streaming API
Hi folks,
Old Issue, but Marc is definitely right. I don't know where is the problem,
but my infrastructure is poor, getting some broken status yet.
Is heavy to the streaming (and others API) server put a hash (md5) on each
status message that the client can verify it's integrity?
Thanks.
Augusto.
On Fri, Nov 12, 2010 at 10:32 PM, @IDisposable idisposa...@gmail.comwrote:
There's NO QUESTION in my mind that this is a memory/disk/network
issue. Somewhere in the chain of events leading to your parser,
someone is dropping bits and tons of ECC/Checksum logic/etc. is
missing it. I really really really doubt the feed is corrupt when
leaving twitter-land... it's getting borked on the way to your parser.
FWIW, I've never seen any of these issues... and I consume a TON of
tweets daily. The difference between T and V is one bit in ASCII (hex
0x54 versus 0x56), between u and w (0x75 vs. 0x77), between h and j
(0x68 and 0x6A). We're seeing a consistent flip-to-on of the 0x02
bit. You've probably got bad RAM if it were up to my estimation... if
you've got hardware control of this machine, try upping the voltage on
the Northbridge and DRAM if you can a notch.
Marc
On Nov 12, 6:52 am, Augusto Santos augu...@gemeos.org wrote:
In this period of wrong json status, I received either wrong date format
of
created_at
2747941206892544 Thu Nov 11 35:42:14 + 2010
2565022072963072 Thw Nov 11 03:35:23 + 2010
256213672896 Tju Nov 11 03:23:54 + 2010
2550619441209344 Thu Nov 11 02:38:0; + 2010
2545567930523648 Vhu Nov 11 02:18:05 + 2010
and so on...
Looks like was only one char problem per status, that mess up everything.
Since Thu Nov 11 15:44:37 + 2010, I get no json parser or corrupt
created_at problem.
Thanks.
On Thu, Nov 11, 2010 at 11:51 PM, Augusto Santos augu...@gemeos.org
wrote:
Hi Taylor,
First, thanks for the answer.
I'm using Phirehose lib to PHP, the native json_decode($status,TRUE)
from
PHP and after json decode I'm using mysql_real_escape_string for the
string
fields. I see now that my log routine use mysql escape either before
query.
So this examples are escaped according this mysql procedure.
Here is the amount of tweets with this problem. That's when json_decode
didn't work, so there's no id_str or new_id_str in my $status[] array,
then
it's throw an error and log it with the json status. I can send you all
these status if you want it.
DateHour(GMT-2) Count
2010-11-11 13 97
2010-11-11 1 367
2010-11-11 0 521
2010-11-10 23 598
2010-11-10 22 569
2010-11-10 21 577
2010-11-10 20 619
2010-11-10 19 606
2010-11-10 18 603
2010-11-10 17 607
2010-11-10 16 247
2010-11-10 11 9
2010-11-09 22 2
Thanks, Augusto.
On Thu, Nov 11, 2010 at 2:52 PM, Taylor Singletary
taylorsinglet...@twitter.com wrote:
Hi Augusto,
I monitored the sample stream this morning for a few hours for
instances
similar to the JSON examples you've provided below and was unable to
see the
scenario duplicated. What JSON parser are you using? Is there any
other
processing that may have occurred prior to generating your examples
below?
Do you know how your library is handling escaped quote values like
\ ?
How many of these did you observe?
Thanks,
Taylor
On Thu, Nov 11, 2010 at 5:10 AM, Augusto Santos augu...@gemeos.org
wrote:
I recevied a lot of broken json status from streaming api
Count of brojen json by day
2010-11-09 2
2010-11-10 4435
2010-11-11 888
Examples:
{in_reply_to_status_id_str:2563309119209472,text:@joi4kitten I
have that same
fear.,truncated:false,in_reply_to_user_id_str:16155805,entities:{
user_menvions:[{screen_name:joi4kitten,indices:[0,11],name:joi4ki
tten,id:16155805,id_str:16155805}],urls:[],hashtags:[]},geo:nu
ll,in_reply_to_status_id:2563309119209472,place:{country_code:US,c
ountry:The
United States of
America,bounding_box:{type:Polygon,coordinates:[[[-76.965351,38.97
1109],[-76.909147,38.971109],[-76.909147,39.022114],[-76.965353,39.022114]]
]},place_type:city,attributes:{},full_name:College
Park, MD,name:College Park,*
id:e4c17912c815124d.url:http:\/\/api.twitter.com
\/1\/geo\/id\/e4c17912c815124d.json*},favorited:false,source:\u003Ca
href=\http:\/\/mobile.twitter.com\ rel=\nofollow\\u003EMobile
Web\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:joi4kitt
en,coorfinates:null,retweet_count:null,in_reply_to_user_id:16155805,
created_at:Thu
Nov 11 03:38:52 +
2010,new_id_str:2565897919139841,new_id:2565897919139841,user:{fo
llow_request_sent:null,lang:en,time_zone:Eastern
Time (US
Canada),screen_name:kellygo,following:null,profile_sidebar_border_c
olor:0A84A5,profile_background_image_url:http:\/\/
a3.twimg.com\/profile_background_images\/8381831\/twitter_background_with_b
Re: [twitter-dev] Streaming API - Multiple connections on 1 IP?
Yes you can. On Thu, Dec 16, 2010 at 8:23 AM, epomqo wenzi0...@gmail.com wrote: Hello everyone, Just a simple question: can I launch multiple connections to Streaming API using different accounts, but on the same machine? The official document seems don't say this clearly: Each account may create only one standing connection to the Streaming API. Subsequent connections from the same account may cause previously established connections to be disconnected. Excessive connection attempts, regardless of success, will result in an automatic ban of the client's IP address. Continually failing connections will result in your IP address being blacklisted from all Twitter access. Many thanks for the help! epomqo -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Broken Json Status on Streaming API
In this period of wrong json status, I received either wrong date format of
created_at
2747941206892544 Thu Nov 11 35:42:14 + 2010
2565022072963072 Thw Nov 11 03:35:23 + 2010
256213672896 Tju Nov 11 03:23:54 + 2010
2550619441209344 Thu Nov 11 02:38:0; + 2010
2545567930523648 Vhu Nov 11 02:18:05 + 2010
and so on...
Looks like was only one char problem per status, that mess up everything.
Since Thu Nov 11 15:44:37 + 2010, I get no json parser or corrupt
created_at problem.
Thanks.
On Thu, Nov 11, 2010 at 11:51 PM, Augusto Santos augu...@gemeos.org wrote:
Hi Taylor,
First, thanks for the answer.
I'm using Phirehose lib to PHP, the native json_decode($status,TRUE) from
PHP and after json decode I'm using mysql_real_escape_string for the string
fields. I see now that my log routine use mysql escape either before query.
So this examples are escaped according this mysql procedure.
Here is the amount of tweets with this problem. That's when json_decode
didn't work, so there's no id_str or new_id_str in my $status[] array, then
it's throw an error and log it with the json status. I can send you all
these status if you want it.
DateHour(GMT-2) Count
2010-11-11 13 97
2010-11-11 1 367
2010-11-11 0 521
2010-11-10 23 598
2010-11-10 22 569
2010-11-10 21 577
2010-11-10 20 619
2010-11-10 19 606
2010-11-10 18 603
2010-11-10 17 607
2010-11-10 16 247
2010-11-10 11 9
2010-11-09 22 2
Thanks, Augusto.
On Thu, Nov 11, 2010 at 2:52 PM, Taylor Singletary
taylorsinglet...@twitter.com wrote:
Hi Augusto,
I monitored the sample stream this morning for a few hours for instances
similar to the JSON examples you've provided below and was unable to see the
scenario duplicated. What JSON parser are you using? Is there any other
processing that may have occurred prior to generating your examples below?
Do you know how your library is handling escaped quote values like \ ?
How many of these did you observe?
Thanks,
Taylor
On Thu, Nov 11, 2010 at 5:10 AM, Augusto Santos augu...@gemeos.orgwrote:
I recevied a lot of broken json status from streaming api
Count of brojen json by day
2010-11-09 2
2010-11-10 4435
2010-11-11 888
Examples:
{in_reply_to_status_id_str:2563309119209472,text:@joi4kitten I
have that same
fear.,truncated:false,in_reply_to_user_id_str:16155805,entities:{user_menvions:[{screen_name:joi4kitten,indices:[0,11],name:joi4kitten,id:16155805,id_str:16155805}],urls:[],hashtags:[]},geo:null,in_reply_to_status_id:2563309119209472,place:{country_code:US,country:The
United States of
America,bounding_box:{type:Polygon,coordinates:[[[-76.965351,38.971109],[-76.909147,38.971109],[-76.909147,39.022114],[-76.965353,39.022114]]]},place_type:city,attributes:{},full_name:College
Park, MD,name:College Park,*
id:e4c17912c815124d.url:http:\/\/api.twitter.com
\/1\/geo\/id\/e4c17912c815124d.json*},favorited:false,source:\u003Ca
href=\http:\/\/mobile.twitter.com\ rel=\nofollow\\u003EMobile
Web\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:joi4kitten,coorfinates:null,retweet_count:null,in_reply_to_user_id:16155805,created_at:Thu
Nov 11 03:38:52 +
2010,new_id_str:2565897919139841,new_id:2565897919139841,user:{follow_request_sent:null,lang:en,time_zone:Eastern
Time (US
Canada),screen_name:kellygo,following:null,profile_sidebar_border_color:0A84A5,profile_background_image_url:http:\/\/
a3.twimg.com\/profile_background_images\/8381831\/twitter_background_with_bear_2.jpg,notifications:null,description:I
am not Kelly
Osbourne.,listed_count:12,profile_background_tile:false,profile_background_color:052743,statuses_count:1559,location:College
Park,
Md.,show_all_inline_media:false,profile_use_background_image:true,favourites_count:29,profile_text_color:00,contributors_enabled:false,protected:false,geo_enabled:true,created_at:Sun
Jul 22 02:12:05 + 2007,profile_link_color:0A84A5,name:Kelly
Osborn,friends_count:235,url:http:\/\/kellygo.blogspot.com
,profile_image_url:http:\/\/a1.twimg.com
\/profile_images\/271727429\/kelly_o__posterized_normal.jpg,id:7632582,id_str:7632582,verified:false,utc_offset:-18000,profile_sidebar_fill_color:CFE9E2,followers_count:332},retweeted:false,id:2565897919139841,id_str:2565897919139841}
Here there's a dot where should be a comma, between id and url
{in_reply_to_status_id_str:2546974377119744,text:@ozdj Ah,
suddenly #TweetBurglar makes complete
sense,truncated:false,in_reply_to_user_id_str:15324154,entities:{user_mentions:[{screen_name:ozdj,indices:[0,5],name:Derek
Jenkins,id:15324154,id_str:15324154}],urls:[],hashtags:[{text:TweetBurglar,indices:[19,32]}]},geo:{type:Point,coordinates:[-33.88533896,151.20496326]},in_reply_to_status_id:2546974377119744,place:null,favorited:false,source:\u003Ca
href=\http:\/\/twitter.com\/\ rel=\nofollow\\u003ETwitter for
iPhone\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:ozdj,coordinates:{type:Point,coordinates
[twitter-dev] Broken Json Status on Streaming API
I recevied a lot of broken json status from streaming api
Count of brojen json by day
2010-11-09 2
2010-11-10 4435
2010-11-11 888
Examples:
{in_reply_to_status_id_str:2563309119209472,text:@joi4kitten I have
that same
fear.,truncated:false,in_reply_to_user_id_str:16155805,entities:{user_menvions:[{screen_name:joi4kitten,indices:[0,11],name:joi4kitten,id:16155805,id_str:16155805}],urls:[],hashtags:[]},geo:null,in_reply_to_status_id:2563309119209472,place:{country_code:US,country:The
United States of
America,bounding_box:{type:Polygon,coordinates:[[[-76.965351,38.971109],[-76.909147,38.971109],[-76.909147,39.022114],[-76.965353,39.022114]]]},place_type:city,attributes:{},full_name:College
Park, MD,name:College Park,*id:e4c17912c815124d.url:http:\/\/
api.twitter.com\/1\/geo\/id\/e4c17912c815124d.json*},favorited:false,source:\u003Ca
href=\http:\/\/mobile.twitter.com\ rel=\nofollow\\u003EMobile
Web\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:joi4kitten,coorfinates:null,retweet_count:null,in_reply_to_user_id:16155805,created_at:Thu
Nov 11 03:38:52 +
2010,new_id_str:2565897919139841,new_id:2565897919139841,user:{follow_request_sent:null,lang:en,time_zone:Eastern
Time (US
Canada),screen_name:kellygo,following:null,profile_sidebar_border_color:0A84A5,profile_background_image_url:http:\/\/
a3.twimg.com\/profile_background_images\/8381831\/twitter_background_with_bear_2.jpg,notifications:null,description:I
am not Kelly
Osbourne.,listed_count:12,profile_background_tile:false,profile_background_color:052743,statuses_count:1559,location:College
Park,
Md.,show_all_inline_media:false,profile_use_background_image:true,favourites_count:29,profile_text_color:00,contributors_enabled:false,protected:false,geo_enabled:true,created_at:Sun
Jul 22 02:12:05 + 2007,profile_link_color:0A84A5,name:Kelly
Osborn,friends_count:235,url:http:\/\/kellygo.blogspot.com
,profile_image_url:http:\/\/a1.twimg.com
\/profile_images\/271727429\/kelly_o__posterized_normal.jpg,id:7632582,id_str:7632582,verified:false,utc_offset:-18000,profile_sidebar_fill_color:CFE9E2,followers_count:332},retweeted:false,id:2565897919139841,id_str:2565897919139841}
Here there's a dot where should be a comma, between id and url
{in_reply_to_status_id_str:2546974377119744,text:@ozdj Ah, suddenly
#TweetBurglar makes complete
sense,truncated:false,in_reply_to_user_id_str:15324154,entities:{user_mentions:[{screen_name:ozdj,indices:[0,5],name:Derek
Jenkins,id:15324154,id_str:15324154}],urls:[],hashtags:[{text:TweetBurglar,indices:[19,32]}]},geo:{type:Point,coordinates:[-33.88533896,151.20496326]},in_reply_to_status_id:2546974377119744,place:null,favorited:false,source:\u003Ca
href=\http:\/\/twitter.com\/\ rel=\nofollow\\u003ETwitter for
iPhone\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:ozdj,coordinates:{type:Point,coordinates:[151.20496326,-33.88533896]},retweet_count:null,in_reply_to_user_id:15324154,created_at:Thu
Nov 11 03:38:51 +
2010,new_id_str:2565895784243200,new_id:2565895784243200,user:{lang:en,geo_enabled:true,screen_name:coffeetrails,following:null,friends_count:251,profile_sidebar_border_color:362919,verified:false,follow_request_sent:null,notifications:null,time_zone:Sydney,description:Specialising
in organic RA espresso-based coffees, organic teas, fresh sandwiches and
gourmet treats. Shop 5, 2 Lee St Sydney (Henry Deane Plaza, Railway
Sq),profile_background_color:362919,profile_background_image_url:http:\/\/
a3.twimg.com\/profile_background_images\/66956323\/CRW_3458.jpg,location:Central
Station,
Sydney,favourites_count:204,profile_text_color:362919,listed_count:29,profile_background_tile:true,protected:false,statuses_count:1298,crected_at:Wed
Oct 14 05:27:32 + 2009,profile_link_color:7a2a2a,name:Jonno,
Coffee Trails,*show_all_inline_media:fanse*
,profile_use_background_image:true,url:http:\/\/www.facebook.com
\/CoffeeTrails\/,profile_image_url:http:\/\/a2.twimg.com
\/profile_images\/624183782\/CRW_2981_normal.jpg,id:82284263,id_str:82284263,contributors_enabled:false,utc_offset:36000,profile_sidebar_fill_color:c2a887,followers_count:324},retweeted:false,id:2565895784243200,id_str:2565895784243200}
Here there's a 'fanse' in 'show_all_inline_media' where should be a 'false'
Any help?
--
氣
--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Broken Json Status on Streaming API
Hi Taylor,
First, thanks for the answer.
I'm using Phirehose lib to PHP, the native json_decode($status,TRUE) from
PHP and after json decode I'm using mysql_real_escape_string for the string
fields. I see now that my log routine use mysql escape either before query.
So this examples are escaped according this mysql procedure.
Here is the amount of tweets with this problem. That's when json_decode
didn't work, so there's no id_str or new_id_str in my $status[] array, then
it's throw an error and log it with the json status. I can send you all
these status if you want it.
DateHour(GMT-2) Count
2010-11-11 13 97
2010-11-11 1 367
2010-11-11 0 521
2010-11-10 23 598
2010-11-10 22 569
2010-11-10 21 577
2010-11-10 20 619
2010-11-10 19 606
2010-11-10 18 603
2010-11-10 17 607
2010-11-10 16 247
2010-11-10 11 9
2010-11-09 22 2
Thanks, Augusto.
On Thu, Nov 11, 2010 at 2:52 PM, Taylor Singletary
taylorsinglet...@twitter.com wrote:
Hi Augusto,
I monitored the sample stream this morning for a few hours for instances
similar to the JSON examples you've provided below and was unable to see the
scenario duplicated. What JSON parser are you using? Is there any other
processing that may have occurred prior to generating your examples below?
Do you know how your library is handling escaped quote values like \ ?
How many of these did you observe?
Thanks,
Taylor
On Thu, Nov 11, 2010 at 5:10 AM, Augusto Santos augu...@gemeos.orgwrote:
I recevied a lot of broken json status from streaming api
Count of brojen json by day
2010-11-09 2
2010-11-10 4435
2010-11-11 888
Examples:
{in_reply_to_status_id_str:2563309119209472,text:@joi4kitten I have
that same
fear.,truncated:false,in_reply_to_user_id_str:16155805,entities:{user_menvions:[{screen_name:joi4kitten,indices:[0,11],name:joi4kitten,id:16155805,id_str:16155805}],urls:[],hashtags:[]},geo:null,in_reply_to_status_id:2563309119209472,place:{country_code:US,country:The
United States of
America,bounding_box:{type:Polygon,coordinates:[[[-76.965351,38.971109],[-76.909147,38.971109],[-76.909147,39.022114],[-76.965353,39.022114]]]},place_type:city,attributes:{},full_name:College
Park, MD,name:College Park,*id:e4c17912c815124d.url:http:\/\/
api.twitter.com\/1\/geo\/id\/e4c17912c815124d.json*},favorited:false,source:\u003Ca
href=\http:\/\/mobile.twitter.com\ rel=\nofollow\\u003EMobile
Web\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:joi4kitten,coorfinates:null,retweet_count:null,in_reply_to_user_id:16155805,created_at:Thu
Nov 11 03:38:52 +
2010,new_id_str:2565897919139841,new_id:2565897919139841,user:{follow_request_sent:null,lang:en,time_zone:Eastern
Time (US
Canada),screen_name:kellygo,following:null,profile_sidebar_border_color:0A84A5,profile_background_image_url:http:\/\/
a3.twimg.com\/profile_background_images\/8381831\/twitter_background_with_bear_2.jpg,notifications:null,description:I
am not Kelly
Osbourne.,listed_count:12,profile_background_tile:false,profile_background_color:052743,statuses_count:1559,location:College
Park,
Md.,show_all_inline_media:false,profile_use_background_image:true,favourites_count:29,profile_text_color:00,contributors_enabled:false,protected:false,geo_enabled:true,created_at:Sun
Jul 22 02:12:05 + 2007,profile_link_color:0A84A5,name:Kelly
Osborn,friends_count:235,url:http:\/\/kellygo.blogspot.com
,profile_image_url:http:\/\/a1.twimg.com
\/profile_images\/271727429\/kelly_o__posterized_normal.jpg,id:7632582,id_str:7632582,verified:false,utc_offset:-18000,profile_sidebar_fill_color:CFE9E2,followers_count:332},retweeted:false,id:2565897919139841,id_str:2565897919139841}
Here there's a dot where should be a comma, between id and url
{in_reply_to_status_id_str:2546974377119744,text:@ozdj Ah, suddenly
#TweetBurglar makes complete
sense,truncated:false,in_reply_to_user_id_str:15324154,entities:{user_mentions:[{screen_name:ozdj,indices:[0,5],name:Derek
Jenkins,id:15324154,id_str:15324154}],urls:[],hashtags:[{text:TweetBurglar,indices:[19,32]}]},geo:{type:Point,coordinates:[-33.88533896,151.20496326]},in_reply_to_status_id:2546974377119744,place:null,favorited:false,source:\u003Ca
href=\http:\/\/twitter.com\/\ rel=\nofollow\\u003ETwitter for
iPhone\u003C\/a\u003E,contributors:null,in_reply_to_screen_name:ozdj,coordinates:{type:Point,coordinates:[151.20496326,-33.88533896]},retweet_count:null,in_reply_to_user_id:15324154,created_at:Thu
Nov 11 03:38:51 +
2010,new_id_str:2565895784243200,new_id:2565895784243200,user:{lang:en,geo_enabled:true,screen_name:coffeetrails,following:null,friends_count:251,profile_sidebar_border_color:362919,verified:false,follow_request_sent:null,notifications:null,time_zone:Sydney,description:Specialising
in organic RA espresso-based coffees, organic teas, fresh sandwiches and
gourmet treats. Shop 5, 2 Lee St Sydney (Henry Deane Plaza, Railway
Sq),profile_background_color:362919,profile_background_image_url:http:\/\/
a3.twimg.com
[twitter-dev] How to count tweets with snowflake?
Hi folks, Is there a way to count how many tweets are between two snowflakes id? With the ids from today I can count around 1 billion tweets per day. Thanks, Augusto. -- http://geotweets.gemeos.org/ -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Re: How to count tweets with snowflake?
Sorry, It's around 100 million tweets per day, in my diff count. On Thu, Oct 28, 2010 at 9:59 AM, Augusto Santos augu...@gemeos.org wrote: Hi folks, Is there a way to count how many tweets are between two snowflakes id? With the ids from today I can count around 1 billion tweets per day. Thanks, Augusto. -- http://geotweets.gemeos.org/ -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] How to count tweets with snowflake?
A guess so.. thanks! On Thu, Oct 28, 2010 at 11:50 AM, Tim Haines tmhai...@gmail.com wrote: No. On Thu, Oct 28, 2010 at 8:59 PM, Augusto Santos augu...@gemeos.orgwrote: Hi folks, Is there a way to count how many tweets are between two snowflakes id? With the ids from today I can count around 1 billion tweets per day. Thanks, Augusto. -- http://geotweets.gemeos.org/ -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Poor experience in Streaming API
Hi folks, I'm getting poor experience in Streaming API with status/filter using locations. A abnormal low status rate Since 5pm UTC. Anyone with the same problem? Thanks, Augusto. -- http://geotweets.gemeos.org/ 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
