[twitter-dev] friends_ids.json and favorites.json return content truncated to 4659 bytes

2010-07-19 Thread Marc Mims
$ curl http://api.twitter.com/1/favorites.json?screen_name=semifor |
xclip
  % Total% Received % Xferd  Average Speed   TimeTime
Time  Current
 Dload  Upload   Total   Spent
Left  Speed
100  4659  100  46590 0  13953  0 --:--:-- --:--:--
--:--:-- 19172


$ xclip -o | wc
4659

$ xclip -o
[{favorited:false,truncated:false,in_reply_to_screen_name:null,in_reply_to_user_id:null,source:a
href=\http://vimtips.mileszs.com\; rel=\nofollow\vimtips/
a,created_at:Fri Jun 11 16:00:08 +
2010,coordinates:null,user:
{profile_background_tile:false,description:Like VI or VIM?  So do
I!  Use it more effectively with daily tips. Catch them all at
http://vimtweets.com.,location:Indiana,statuses_count:361,profile_sidebar_border_color:181A1E,profile_image_url:http://a3.twimg.com/profile_images/64545277/vim_logo_normal.png,profile_use_background_image:true,followers_count:1044,contributors_enabled:false,friends_count:23,screen_name:vimtips,lang:en,geo_enabled:false,created_at:Mon
Aug 25 16:47:56 +
2008,profile_background_color:1A1B1F,favourites_count:
0,verified:false,profile_text_color:66,following:null,time_zone:Eastern
Time (US 
Canada),protected:false,profile_link_color:1f9e10,name:vimtips,profile_background_image_url:http://
s.twimg.com/a/1278188204/images/themes/theme9/bg.gif,url:http://
vimtweets.com,id:
15983724,notifications:null,utc_offset:-18000,profile_sidebar_fill_color:252429},contributors:null,place:null,geo:null,in_reply_to_status_id:null,id:
15938740582,text::%s/\\ v(.*\\ n){5}/\\ r will insert a blank line
every 5 lines (remove spaces)
http://is.gd/6PB6n},{geo:null,in_reply_to_status_id:null,in_reply_to_user_id:null,favorited:false,source:;a
href=\http://www.hootsuite.com\; rel=\nofollow\HootSuite/
a,created_at:Tue Jun 08 22:54:02 +
2010,coordinates:null,user:
{profile_sidebar_fill_color:efefef,description:We are a student
run club on the Gonzaga campus that promotes bike awareness, riding,
and the joy of being on two wheels.,location:Spokane,
WA,notifications:null,profile_background_tile:true,profile_image_url:http://
a1.twimg.com/profile_images/466800814/
gucyclingtwitternew_normal.png,statuses_count:
942,profile_sidebar_border_color:ee,profile_use_background_image:true,followers_count:
678,screen_name:GonzagaCycling,contributors_enabled:false,lang:en,created_at:Tue
Jun 09 04:42:11 + 2009,friends_count:
802,geo_enabled:true,profile_background_color:131516,favourites_count:
0,following:null,verified:false,profile_text_color:33,protected:false,time_zone:Pacific
Time (US  Canada),name:Gonzaga Cycling
Club,profile_link_color:00,url:http://
www.gucycling.com,id:45766143,profile_background_image_url:http://s.twimg.com/a/1278188204/images/themes/theme14/bg.gif,utc_offset:-28800},contributors:null,place:null,id:15738183033,in_reply_to_screen_name:null,truncated:false,text:Car
parked in bike lane? Email the info to Spokane PD at
carparkedinbikel...@spokanepolice.org
http://ow.ly/1VUFV},{favorited:false,truncated:false,in_reply_to_screen_name:null,in_reply_to_user_id:null,source:;a
href=\http://friendfeed.com\; rel=\nofollow\FriendFeed/
a,created_at:Sat May 29 00:04:21 +
2010,coordinates:null,user:
{profile_background_tile:false,description:Social Media Architect
and Developer --\r\nCEO, SocialToo.com --\r\nI blog at StayNAlive.com
--\r\nFather, Entrepreneur, Published Author,location:Salt Lake
City, UT,statuses_count:
23782,profile_sidebar_border_color:a8c7f7,profile_image_url:http://
a1.twimg.com/profile_images/
1033692604/29873_10150181968265113_683545112_12516747_3363132_n_normal.jpg,profile_use_background_image:true,followers_count:
25613,contributors_enabled:false,friends_count:
26102,screen_name:Jesse,lang:en,geo_enabled:true,created_at:Wed
Apr 25 02:48:53 +
2007,profile_background_color:022330,favourites_count:
51,verified:false,profile_text_color:33,following:null,time_zone:Mountain
Time (US 
Canada),protected:false,profile_link_color:0084B4,name:Jesse
Stay,profile_background_image_url:http://s.twimg.com/a/1278724399/
images/themes/theme15/bg.png,url:http://staynalive.com/
jessestay,id:
5485192,notifications:null,utc_offset:-25200,profile_sidebar_fill_color:C0DFEC},contributors:null,place:null,geo:null,in_reply_to_status_id:null,id:
14940747286,text:RSA Animate - Drive: The surprising truth about
what motivates us
http://ff.im/-l5LiR},{favorited:false,truncated:false,contributors:null,in_reply_to_user_id:null,in_reply_to_screen_name:null,source:web,created_at:Tue
May 18 16:37:23 + 2010,coordinates:null,user:
{profile_use_background_imag



Using Net::Twitter, capturing the HTTP request and response, I get:

Request:
GET http://api.twitter.com/1/favorites.json?screen_name=semifor
User-Agent: Net::Twitter/3.13006 (Perl)
X-Twitter-Client: Perl Net::Twitter
X-Twitter-Client-URL: http://search.cpan.org/dist/Net-Twitter/
X-Twitter-Client-Version: 3.13006


Response:
HTTP/1.1 200 OK
Cache-Control: no-cache, no-store, 

Re: [twitter-dev] friends_ids.json and favorites.json return content truncated to 4659 bytes

2010-07-19 Thread Taylor Singletary
Thanks Mark! We're looking into this. It's related in some way to the
duplicate HTTP headers we are sending and Content-Type/Content-Length
issues. This is very helpful!

Taylor

On Mon, Jul 19, 2010 at 1:19 PM, Marc Mims marc.m...@gmail.com wrote:

 $ curl http://api.twitter.com/1/favorites.json?screen_name=semifor |
 xclip
  % Total% Received % Xferd  Average Speed   TimeTime
 Time  Current
 Dload  Upload   Total   Spent
 Left  Speed
 100  4659  100  46590 0  13953  0 --:--:-- --:--:--
 --:--:-- 19172


 $ xclip -o | wc
 4659

 $ xclip -o

 [{favorited:false,truncated:false,in_reply_to_screen_name:null,in_reply_to_user_id:null,source:a
 href=\http://vimtips.mileszs.com\; rel=\nofollow\vimtips/
 a,created_at:Fri Jun 11 16:00:08 +
 2010,coordinates:null,user:
 {profile_background_tile:false,description:Like VI or VIM?  So do
 I!  Use it more effectively with daily tips. Catch them all at
 http://vimtweets.com
 .,location:Indiana,statuses_count:361,profile_sidebar_border_color:181A1E,profile_image_url:
 http://a3.twimg.com/profile_images/64545277/vim_logo_normal.png
 ,profile_use_background_image:true,followers_count:1044,contributors_enabled:false,friends_count:23,screen_name:vimtips,lang:en,geo_enabled:false,created_at:Mon
 Aug 25 16:47:56 +
 2008,profile_background_color:1A1B1F,favourites_count:

 0,verified:false,profile_text_color:66,following:null,time_zone:Eastern
 Time (US 

 Canada),protected:false,profile_link_color:1f9e10,name:vimtips,profile_background_image_url:http://
 s.twimg.com/a/1278188204/images/themes/theme9/bg.gif,url:http://
 vimtweets.com,id:

 15983724,notifications:null,utc_offset:-18000,profile_sidebar_fill_color:252429},contributors:null,place:null,geo:null,in_reply_to_status_id:null,id:
 15938740582,text::%s/\\ v(.*\\ n){5}/\\ r will insert a blank line
 every 5 lines (remove spaces)
 http://is.gd/6PB6n
 },{geo:null,in_reply_to_status_id:null,in_reply_to_user_id:null,favorited:false,source:a
 href=\http://www.hootsuite.com\; rel=\nofollow\HootSuite/
 a,created_at:Tue Jun 08 22:54:02 +
 2010,coordinates:null,user:
 {profile_sidebar_fill_color:efefef,description:We are a student
 run club on the Gonzaga campus that promotes bike awareness, riding,
 and the joy of being on two wheels.,location:Spokane,

 WA,notifications:null,profile_background_tile:true,profile_image_url:http://
 a1.twimg.com/profile_images/466800814/
 gucyclingtwitternew_normal.png,statuses_count:

 942,profile_sidebar_border_color:ee,profile_use_background_image:true,followers_count:

 678,screen_name:GonzagaCycling,contributors_enabled:false,lang:en,created_at:Tue
 Jun 09 04:42:11 + 2009,friends_count:

 802,geo_enabled:true,profile_background_color:131516,favourites_count:

 0,following:null,verified:false,profile_text_color:33,protected:false,time_zone:Pacific
 Time (US  Canada),name:Gonzaga Cycling
 Club,profile_link_color:00,url:http://
 www.gucycling.com,id:45766143,profile_background_image_url:
 http://s.twimg.com/a/1278188204/images/themes/theme14/bg.gif
 ,utc_offset:-28800},contributors:null,place:null,id:15738183033,in_reply_to_screen_name:null,truncated:false,text:Car
 parked in bike lane? Email the info to Spokane PD at
 carparkedinbikel...@spokanepolice.org
 http://ow.ly/1VUFV
 },{favorited:false,truncated:false,in_reply_to_screen_name:null,in_reply_to_user_id:null,source:a
 href=\http://friendfeed.com\; rel=\nofollow\FriendFeed/
 a,created_at:Sat May 29 00:04:21 +
 2010,coordinates:null,user:
 {profile_background_tile:false,description:Social Media Architect
 and Developer --\r\nCEO, SocialToo.com --\r\nI blog at StayNAlive.com
 --\r\nFather, Entrepreneur, Published Author,location:Salt Lake
 City, UT,statuses_count:
 23782,profile_sidebar_border_color:a8c7f7,profile_image_url:http://
 a1.twimg.com/profile_images/

 1033692604/29873_10150181968265113_683545112_12516747_3363132_n_normal.jpg,profile_use_background_image:true,followers_count:
 25613,contributors_enabled:false,friends_count:

 26102,screen_name:Jesse,lang:en,geo_enabled:true,created_at:Wed
 Apr 25 02:48:53 +
 2007,profile_background_color:022330,favourites_count:

 51,verified:false,profile_text_color:33,following:null,time_zone:Mountain
 Time (US 
 Canada),protected:false,profile_link_color:0084B4,name:Jesse
 Stay,profile_background_image_url:http://s.twimg.com/a/1278724399/
 images/themes/theme15/bg.png,url:http://staynalive.com/
 jessestay,id:

 5485192,notifications:null,utc_offset:-25200,profile_sidebar_fill_color:C0DFEC},contributors:null,place:null,geo:null,in_reply_to_status_id:null,id:
 14940747286,text:RSA Animate - Drive: The surprising truth about
 what motivates us
 http://ff.im/-l5LiR
 },{favorited:false,truncated:false,contributors:null,in_reply_to_user_id:null,in_reply_to_screen_name:null,source:web,created_at:Tue
 May 18 16:37:23 + 2010,coordinates:null,user:
 {profile_use_background_imag



 Using Net::Twitter, 

Re: [twitter-dev] friends_ids.json and favorites.json return content truncated to 4659 bytes

2010-07-19 Thread Cameron Kaiser
 Thanks Mark! We're looking into this. It's related in some way to the
 duplicate HTTP headers we are sending and Content-Type/Content-Length
 issues. This is very helpful!

Ah, ignore my last message, I see it's been acknowledged. Thanks, Taylor
and Marc.

-- 
 personal: http://www.cameronkaiser.com/ --
  Cameron Kaiser * Floodgap Systems * www.floodgap.com * ckai...@floodgap.com
-- MOVIE IDEA: Blazing E-mail Signatures --