Hi Taylor,

First, thanks for the answer.

I'm using Phirehose lib to PHP, the native json_decode($status,TRUE) from
PHP and after json decode I'm using mysql_real_escape_string for the string
fields. I see now that my log routine use mysql escape either before query.
So this examples are escaped according this mysql procedure.

Here is the amount of tweets with this problem. That's when json_decode
didn't work, so there's no id_str or new_id_str in my $status[] array, then
it's throw an error and log it with the json status. I can send you all
these status if you want it.

Date    Hour(GMT-2)  Count
2010-11-11 13 97
2010-11-11 1 367
2010-11-11 0 521
2010-11-10 23 598
2010-11-10 22 569
2010-11-10 21 577
2010-11-10 20 619
2010-11-10 19 606
2010-11-10 18 603
2010-11-10 17 607
2010-11-10 16 247
2010-11-10 11 9
2010-11-09 22 2

Thanks, Augusto.

On Thu, Nov 11, 2010 at 2:52 PM, Taylor Singletary <
taylorsinglet...@twitter.com> wrote:

> Hi Augusto,
>
> I monitored the sample stream this morning for a few hours for instances
> similar to the JSON examples you've provided below and was unable to see the
> scenario duplicated. What JSON parser are you using? Is there any other
> processing that may have occurred prior to generating your examples below?
> Do you know how your library is handling "escaped" quote values like \" ?
>
> How many of these did you observe?
>
> Thanks,
> Taylor
>
> On Thu, Nov 11, 2010 at 5:10 AM, Augusto Santos <augu...@gemeos.org>wrote:
>
>> I recevied a lot of broken json status from streaming api
>>
>> Count of brojen json by day
>> 2010-11-09     2
>> 2010-11-10     4435
>> 2010-11-11     888
>>
>> Examples:
>> {"in_reply_to_status_id_str":"2563309119209472","text":"@joi4kitten I have
>> that same
>> fear.","truncated":false,"in_reply_to_user_id_str":"16155805","entities":{"user_menvions":[{"screen_name":"joi4kitten","indices":[0,11],"name":"joi4kitten","id":16155805,"id_str":"16155805"}],"urls":[],"hashtags":[]},"geo":null,"in_reply_to_status_id":2563309119209472,"place":{"country_code":"US","country":"The
>> United States of
>> America","bounding_box":{"type":"Polygon","coordinates":[[[-76.965351,38.971109],[-76.909147,38.971109],[-76.909147,39.022114],[-76.965353,39.022114]]]},"place_type":"city","attributes":{},"full_name":"College
>> Park, MD","name":"College Park",*"id":"e4c17912c815124d"."url":"http:\/\/
>> api.twitter.com\/1\/geo\/id\/e4c17912c815124d.json"*},"favorited":false,"source":"\u003Ca
>> href=\"http:\/\/mobile.twitter.com\" rel=\"nofollow\"\u003EMobile
>> Web\u003C\/a\u003E","contributors":null,"in_reply_to_screen_name":"joi4kitten","coorfinates":null,"retweet_count":null,"in_reply_to_user_id":16155805,"created_at":"Thu
>> Nov 11 03:38:52 +0000
>> 2010","new_id_str":"2565897919139841","new_id":2565897919139841,"user":{"follow_request_sent":null,"lang":"en","time_zone":"Eastern
>> Time (US &
>> Canada)","screen_name":"kellygo","following":null,"profile_sidebar_border_color":"0A84A5","profile_background_image_url":"http:\/\/
>> a3.twimg.com\/profile_background_images\/8381831\/twitter_background_with_bear_2.jpg","notifications":null,"description":"I
>> am not Kelly
>> Osbourne.","listed_count":12,"profile_background_tile":false,"profile_background_color":"052743","statuses_count":1559,"location":"College
>> Park,
>> Md.","show_all_inline_media":false,"profile_use_background_image":true,"favourites_count":29,"profile_text_color":"000000","contributors_enabled":false,"protected":false,"geo_enabled":true,"created_at":"Sun
>> Jul 22 02:12:05 +0000 2007","profile_link_color":"0A84A5","name":"Kelly
>> Osborn","friends_count":235,"url":"http:\/\/kellygo.blogspot.com
>> ","profile_image_url":"http:\/\/a1.twimg.com
>> \/profile_images\/271727429\/kelly_o__posterized_normal.jpg","id":7632582,"id_str":"7632582","verified":false,"utc_offset":-18000,"profile_sidebar_fill_color":"CFE9E2","followers_count":332},"retweeted":false,"id":2565897919139841,"id_str":"2565897919139841"}
>>
>> Here there's a dot where should be a comma, between id and url
>>
>> {"in_reply_to_status_id_str":"2546974377119744","text":"@ozdj Ah, suddenly
>> #TweetBurglar makes complete
>> sense","truncated":false,"in_reply_to_user_id_str":"15324154","entities":{"user_mentions":[{"screen_name":"ozdj","indices":[0,5],"name":"Derek
>> Jenkins","id":15324154,"id_str":"15324154"}],"urls":[],"hashtags":[{"text":"TweetBurglar","indices":[19,32]}]},"geo":{"type":"Point","coordinates":[-33.88533896,151.20496326]},"in_reply_to_status_id":2546974377119744,"place":null,"favorited":false,"source":"\u003Ca
>> href=\"http:\/\/twitter.com\/\" rel=\"nofollow\"\u003ETwitter for
>> iPhone\u003C\/a\u003E","contributors":null,"in_reply_to_screen_name":"ozdj","coordinates":{"type":"Point","coordinates":[151.20496326,-33.88533896]},"retweet_count":null,"in_reply_to_user_id":15324154,"created_at":"Thu
>> Nov 11 03:38:51 +0000
>> 2010","new_id_str":"2565895784243200","new_id":2565895784243200,"user":{"lang":"en","geo_enabled":true,"screen_name":"coffeetrails","following":null,"friends_count":251,"profile_sidebar_border_color":"362919","verified":false,"follow_request_sent":null,"notifications":null,"time_zone":"Sydney","description":"Specialising
>> in organic & RA espresso-based coffees, organic teas, fresh sandwiches and
>> gourmet treats. Shop 5, 2 Lee St Sydney (Henry Deane Plaza, Railway
>> Sq)","profile_background_color":"362919","profile_background_image_url":"http:\/\/
>> a3.twimg.com\/profile_background_images\/66956323\/CRW_3458.jpg","location":"Central
>> Station,
>> Sydney","favourites_count":204,"profile_text_color":"362919","listed_count":29,"profile_background_tile":true,"protected":false,"statuses_count":1298,"crected_at":"Wed
>> Oct 14 05:27:32 +0000 2009","profile_link_color":"7a2a2a","name":"Jonno,
>> Coffee Trails",*"show_all_inline_media":fanse*
>> ,"profile_use_background_image":true,"url":"http:\/\/www.facebook.com
>> \/CoffeeTrails\/","profile_image_url":"http:\/\/a2.twimg.com
>> \/profile_images\/624183782\/CRW_2981_normal.jpg","id":82284263,"id_str":"82284263","contributors_enabled":false,"utc_offset":36000,"profile_sidebar_fill_color":"c2a887","followers_count":324},"retweeted":false,"id":2565895784243200,"id_str":"2565895784243200"}
>>
>> Here there's a 'fanse' in 'show_all_inline_media' where should be a
>> 'false'
>>
>> Any help?
>>
>> --
>> 氣
>>
>> --
>> Twitter developer documentation and resources: http://dev.twitter.com/doc
>> API updates via Twitter: http://twitter.com/twitterapi
>> Issues/Enhancements Tracker:
>> http://code.google.com/p/twitter-api/issues/list
>> Change your membership to this group:
>> http://groups.google.com/group/twitter-development-talk
>>
>
>  --
> Twitter developer documentation and resources: http://dev.twitter.com/doc
> API updates via Twitter: http://twitter.com/twitterapi
> Issues/Enhancements Tracker:
> http://code.google.com/p/twitter-api/issues/list
> Change your membership to this group:
> http://groups.google.com/group/twitter-development-talk
>



-- 
氣

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk

Reply via email to