Re: [twitter-dev] Deprecation Notice: XML Support on Streaming APIs will be dropped on Dec 6th, 2010
Hooray!!! -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Taylor Singletary taylorsinglet...@twitter.com: Hi Developers, We will end support for XML on all Streaming APIs on Dec 6th, 2010, after encouraging developers to use JSON-based output formats for some time now. This deprecation does not apply to the REST or Search APIs, but all clients requesting XML from stream.twitter.com, regardless of role and method (sample, filter, follow, etc) will be affected. If you're currently connecting to an XML-based Twitter Streaming API endpoint, you'll need to migrate your code to consume JSON by Monday December 6th, 2010 (approximately four weeks from now). According to our records, only a very small number of developers are consuming XML via streams today. Now would be a good time for streaming clients to verify that they are using JSON. If you're still using XML, please migrate to JSON as soon as possible. User/Site Streams implementations should already be JSON-only. As a reminder, we encourage using OAuth to connect to the Streaming API -- basic authentication, while supported today on stream.twitter.com, will also be deprecated at a future date. Please respond with any questions or concerns. Thanks! Taylor Singletary http://twitter.com/episod -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Announcing: Free Open Source Twitter Framework in PHP
Excellent! You may have finally motivated me to learn PHP, MySQL, Javascript and JQuery. ;-) Seriously, though, have you given any thought to signing up with SUSE Studio and packaging this up as an appliance? -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Adam Green 140...@gmail.com: I have just published the first version of a Twitter aggregation database and tweet display framework called 140dev. The code is at: http://140dev.com/free-twitter-api-source-code-library/ This is written in PHP and MySQL on the server side, and JQuery and Javascript on the client side. The functionality is pretty basic now, but I have plans to extend it over time. This code is very heavily documented, and is meant as a working tutorial for Twitter API programming. It uses the Phirehose library to access the Twitter Streaming API and collect tweets containing a set of keywords, stores the tweets into a normalized MySQL database, and then returns the most recent tweets as linkified, formatted HTML. Javascript code in the browser uses Ajax to load older tweets, and to automatically update a count of new tweets, as done on Twitter.com. The result is a real-time tweet stream that can be added to any Web page with a single line of PHP code. I'd really appreciate any comments you have on this code. It is GPLed and has a plugin architecture, so if anyone wants to add on to it, let me know. - Adam Green http://140dev.com 140...@gmail.com @140dev -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Need Help Dumping my Tweets for Analysis
I have a Perl routine that will dump your most recent 3200 tweets to a CSV file. That's the most anyone can get using the API at the moment. It's bundled in the Social Media Analytics Research Toolkit, but you can find the source in https://github.com/znmeb/SUSE-Studio-Appliances/blob/master/SMART-at-znmeb/Desktop/Demos/Tweets/Tweets.pl and https://github.com/znmeb/SUSE-Studio-Appliances/blob/master/SMART-at-znmeb/Desktop/Demos/TwitterUtilities.pm It doesn't use authentication, so it only gets 150 API calls per hour. It's based on Marc Mims' Net::Twitter::Lite. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Sarah K sarahannal...@gmail.com: Hi, First, let me start by apologizing for asking a question that I know I could answer for myself with enough googling, or simply implement myself by studying the API docs. I would do so... if I could. But that's kind of difficult for me right now. The question: can someone point me to a tool, or piece of sample code, that can dump all my tweets into a text file? Or at least, the last several months worth? Preferably Java or Python code. The reason: I may have had a small, silent heart attack about mid- September. And, strangely enough, my tweets at the time might help my doctor and I pinpoint the approximate date of the incident, because I sometimes tweet about my exercise habits. But I need the tweets all in a pile I can sort through easily. Unfortunately, given that I'm still feeling very unwell, I just don't have the energy to figure out how to get my historical tweet data in a form that would help me do this analysis, or to write the code myself to do so. Can anyone help me out with this? Somebody must have a tool to do this, right? Something that just dumps all my tweets into a plain text file, respects the API rate limits, etc? Thanks for any help you can offer. If I wind up needing to make any mods to open source code, I'll be more than happy to share any changes I make, if appropriate. Sarah K -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Best way to set up data analytics service. Firehose stream?
Quoting Incredicorp mail...@gmail.com: Goodmorning, I am of course not talking about the business side of things- however I am searching for solid information regarding the following. - We want to access as much public tweets as possible (for a 3 man startup working on userfriendly analytics apps) - Do I understand correctly that access to the firehose stream would provide us with the necessary data- and is getting access to that stream feasible (for a startup)? The Firehose Stream will provide you the most data you can get outside of Twitter. It consists of all public tweets from users deemed not to be on Twitter's list of low quality users. It may not have everything necessary to satisfy your customers' needs, but it's literally all you can get without being Twitter or having some other arrangement (like a court order.) ;-) Is getting the Firehose feasible for a startup? At one time Twitter had a program for that and I don't recall a public announcement that the program had been cancelled, so unless Twitter is ready to state otherwise, I'd say it's feasible. But it's a case by case basis, so send them a private email. - Any best practices people would like to share? Most 'knowledge' would be inferred using keywords. If you *know* up front the keywords, rather than connecting to the Firehose and doing all the filtering yourself, you should connect to one of the Filter streams. If you're finding the keywords from a statistical sample of tweets, you may be able to get a big enough sample using a Spritzer or Gardenhose level sample rather than the full Firehose. Another way to make your life easier would be if you have a list of *users* that generate a representative sample of the tweets you wish to analyze. The Follow, Shadow or Bird Dog filters will let you collect all of the tweets from a set of users. IIRC you can follow at least 5000 users this way. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter Psychological Personality Profiling
Before going too far down this path, you might want to take a look at a. The research of Dan Zarrella (@danzarrella) at HubSpot. He's done some extensive research in this area and most of it is publicly available for free (well, you *do* have to get into their email contact database) b. The various Twitter ranking services, like Twitalyzer and Klout. They have lists and searchable databases of high ranking Twitter users that collect most of these statistics automatically, and have APIs you can subscribe to. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Ciarán ciaran.mac.mathgham...@gmail.com: Hi I hope I'm not posting this in the wrong area, as I haven't posted here before and am not a developer. I am a lecturer and researcher at Dublin Business School and I've tried to find what I'm looking for elsewhere, but so far haven't found what I need. I reckon this is fairly straightforward, but I'm not a coder, so I don't know. If you think you can do this, please email me with a quote I need help with a project I'm trying to get off the ground - I'm a research psychologist with a special interest in social networking. Basically, I want to look at the personality profile of Twitter users. This has been done before with Facebook, but with self-reporting of usage data. I want an app which will, with the user's permission, produce their overall statistics:- e.g. number of followers, following, listed, tweets, date joined, number of @replies, #hashtags, retweets, and links. This will form part of an online survey which will also include personality and other psychological measures (for more information see http://www.ciaranmcmahon.ie/psychbook/social-network-profiling-project/). The basic idea is to see if there is a relationship between personality traits and actual Twitter usage. For example, I'm interested in things like the personality differences between the average Facebook and Twitter user, what types of people do or don't retweet or provide links - that type of thing Any help or advice would be greatly appreciated, Thanks, Ciarán -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] URGENT: Advice on building the correct API stream
Quoting Tom van der Woerdt i...@tvdw.eu: If the only thing you want to do is follow the tweets of some users, your best option is the filter stream. Yep - you now get 5000 users from 'filter' without applying for elevated access, and many more if you qualify for elevated access. In addition, 'filter' currently works with basic authentication as well as oAuth. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Twitter + Gnip Partnership
Ryan, what about User Streams? I'm building something around User Streams but it is a non-display analytics application. Am I at risk for Twitter inserting another business into *my* data stream as well? And I'm curious how some of the other Streaming consumers are going to react to insertion of a monopoly middleman into their data source. I briefly dealt with Gnip a while back and found their API hard to use and their pricing exorbitant. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Ryan Sarver rsar...@twitter.com: Dewald, The basic levels of all of the streaming APIs -- Spritzer, Follow, Track -- will remain open, free and direct from us. Elevated levels for non-display use will be served through Gnip. Hope that answers the question. Best, Ryan On Wed, Nov 17, 2010 at 5:44 PM, Dewald Pretorius dpr...@gmail.com wrote: Ryan, The Gnip blog post states: [QUOTE]Twitter Decahose. This volume-based product is comprised of 10% of the full firehose. Starting today, developers who want to access this sample rate will access it via Gnip instead of Twitter. Twitter will also begin to transition non-display developers with existing Twitter Gardenhose access over to Gnip.[/QUOTE] How does this affect the basic statuses/sample method of the Streaming API? Are you discontinuing it? If so, when? -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Twitter + Gnip Partnership
I quite frankly don't see *any* economic value in a downsampled Firehose. Why should *anyone* pay Gnip for 10% or 50% of the Firehose when they can negotiated *directly* with Twitter for the whole Firehose? -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Dewald Pretorius dpr...@gmail.com: The minimum Gnip charge is $500 per month, with a minimum of a year contract, if you want to use Gnip in a production application. And that's before the -- still unknown -- additional access charges for the Twitter feeds. You can't use Gnip in a production application if you are not an incorporated business, so that excludes access for many developers, even if they can afford the charges. Maybe there's a secondary market here, for an incorporated business to provide access for one-man developers to Gnip data for a fee. Meaning, Reseller Inc subscribes to Gnip and gets the data feeds, and resells them to one-man developers. I haven't checked Gnip's TOS to see if that's expressly prohibited. On Nov 17, 2:51 pm, M. Edward (Ed) Borasky zn...@borasky- research.net wrote: Ryan, what about User Streams? I'm building something around User Streams but it is a non-display analytics application. Am I at risk for Twitter inserting another business into *my* data stream as well? And I'm curious how some of the other Streaming consumers are going to react to insertion of a monopoly middleman into their data source. I briefly dealt with Gnip a while back and found their API hard to use and their pricing exorbitant. -- M. Edward (Ed) Boraskyhttp://borasky-research.nethttp://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Twitter + Gnip Partnership
Quoting Ryan Sarver rsar...@twitter.com: On Wed, Nov 17, 2010 at 12:27 PM, Shannon Clark shannon.cl...@gmail.com wrote: Will companies that license the data be allowed to, in turn, sell services on top of that data - i.e. will this spark a new generation of products such as Scout Labs (now Lithium) or other analytics tools which are built by companies who have negotiated for full or partial firehose access but which are then used by clients of those companies each of whom will configure different queries and searches to monitor? Companies can definitely build and sell products based on the analysis of the data. A major market for this move is the Social Media Monitoring (SMM) market and we expect that to grow. As I've already noted, I don't see the economic / business sense in paying a monopoly middleman for downsampled Firehose when the full Firehose is directly available via negotiation with Twitter. IMHO, if you've got the brains and infrastructure to create social media monitoring business value from 10% or 50% of the Firehose, it's easy to scale that up to 100% of the Firehose. If you don't, well, you're one of the 95 percent of businesses that fail because *you* made a wrong decision. While I haven't paid much attention to the social media monitoring market recently, what I've seen for much of 2010 is consolidation - big companies like IBM buying smaller ones with *solid* business models. What I *haven't* seen in social media monitoring / analytics is small nimble startups becoming successful with minimum viable products. Social media monitoring is a difficult business to be in, *especially* at the data rates Twitter delivers and the unnatural aspects of Twitter linguistics. The sales cycle for social media monitoring tools is long and arduous, and, IMHO, Facebook, Flickr and YouTube data are immensely richer and easier for marketers to explore and exploit than Twitter data. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Twitter + Gnip Partnership
Quoting John Kalucki j...@twitter.com: Every search engine, social network, blogging platform, content aggregator, and to a certain extent, every used book store and used record store... Except that digital content producers can block search engines if it's in their economic interests to do so. I'm not sure how that's working out in Murdoch vs. Google, but at least it's been examined. ;-) For that matter, some news organizations have imposed strict rules on how and when they may use Twitter. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] URGENT: Advice on building the correct API stream
Quoting Adam Green 140...@gmail.com: In general, if you are planning on capturing *all* tweets for a set of words or users, and *never* losing any, you are setting an impossible goal. Aiming for a very high level of accuracy is all you are going to achieve. With the right coding 99% or better is possible. Perhaps Gnip will be able to supply 99.9% or 99.99%. They've certainly got the infrastructure, according to Pete Warden's writeup in RWW (http://www.readwriteweb.com/hack/2010/11/why-is-twitter-partnering-with-gnip.php) I wouldn't bet on five nines, though. ;-) -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Failed to validate oauth signature and token
The server administrators can and should sync server clocks automatically to the world time clocks using Network Time Protocol (NTP). If your IT department isn't doing this, find out why not. Most likely they don't know it's possible. It's pretty easy on Linux and Windows, but you do need an Internet connection to the outside world, so the firewall folks need to be involved and you have to make sure your server-side NTP software is kept up to date on security patches. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting computerzworld meat2...@gmail.com: Thanks for your reply. Is there anyway to sync server clock programatically? Or any other way by which we can make the stuff working? Because I don't have access to server hardware. On Nov 12, 12:28 am, Abraham Williams 4bra...@gmail.com wrote: Your servers clock needs to be properly synced using NTP. http://en.wikipedia.org/wiki/Network_Time_Protocol Abraham - Abraham Williams | Hacker Advocate | abrah.am @abraham https://twitter.com/abraham | github.com/abraham | blog.abrah.am This email is: [ ] shareable [x] ask first [ ] private. On Thu, Nov 11, 2010 at 05:36, computerzworld meat2...@gmail.com wrote: Hello, I am using Twitter Oauth library for signing in to Twitter getting access token for posting tweets programatically. But when I am trying to run the application on my server it is giving me error like Failed to validate oauth signature and token I tried to move the application on another server it is working. So what should be the problem behind this? Is there any configuration required for the server in order to make this work? Please help me. Thanks in advance. -- Twitter developer documentation and resources:http://dev.twitter.com/doc API updates via Twitter:http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Help needed - using data to create a spreadsheet with user characteristics
Do you have a budget to get this done? This looks like fairly simple custom code using the REST API from any number of scripting languages. My Social Media Analytics Research Toolkit has some Perl scripts that will dump a list of a Twitter user's contacts (followers + followings) and a Twitter user's most recent 3200 tweets in CSV format. Given the small number of users you're tracking about, it wouldn't be that difficult to make a driver script to automate your reports. My scripts are on Github at https://github.com/znmeb/SUSE-Studio-Appliances/tree/master/SMART-at-znmeb/Desktop/Demos/ -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting rogerdodger rl_wh...@hotmail.com: Hi folks - I'm a user rather than a developer so not even sure I should be here. If I need to head off somewhere else let me know where but my attempts to find what I need on the bit of the Twitter site dealing with APIs has foundered on jargon (theirs) and ignorance (mine). What I'd like to do is download data to an Excel spreadsheet about a sub-set of Twitter users on a regular (probably monthly) basis. For each of the set of users (about 250 at present, maximum of 500/660 as more of them - they're a finite number of public organisations - start tweeting) I would like to export on a set day each period the four counts shown on the user profile i.e. No. Tweets No. following No. followers No. listed. Once I've got those four data items into a spreadsheet I intend to produce tabular and graphical summaries of activity for individual users and for the whole set of users, showing trends over time. I could obviously visit each user's profile and cut and paste the data but life is short. Is there something that will allow me to do this automatically without becoming the technical expert I will never be. My thanks for any help received. Roger -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter + Gnip Partnership
Quoting Ryan Sarver rsar...@twitter.com: Many of you may wonder what this means for elevated access and whitelisting requests. Our default levels like Spritzer, Follow and Track will not be changing, and will remain free and available directly from Twitter. Companies and developers are encouraged to begin development with these free APIs, available at http://dev.twitter.com/pages/streaming_api. Is Spritzer still 1% of the Firehose? Since the status IDs are no longer sequential, the previous obvious sampling algorithm - status ID mod 100 == 0 - no longer will work. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter + Gnip Partnership
Quoting Ryan Sarver rsar...@twitter.com: Spritzer is currently at 1% of the Firehose, but as the docs say it's subject to change without notice Given the Snowflake algorithm, how can a program consuming Spritzer determine whether a Spritzer rate change has happened because a. People are tweeting at a different rate, exclusive-or b. Twitter has changed the proportion of Firehose being sent to Spritzer? -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] historic trend data 10 days old
I've seen a few hints of the analytics product and know a fair number of people who do that sort of thing for a living. I think they're *not* obsessed with the past at all - their wet dream is very much like what Wieden and Kennedy and a whole host of partners did this summer in real time with Old Spice. That's the future of Twitter / social media / advertising: teams of creative, legal, copy writers, production and analytics people huddled around control panels, analytics dashboards, video studios, phone banks, etc. It's a bit like mission control for a shuttle launch - only if something goes wrong do people look at the past. And mobile / iPad / places is going to make it even more real-time. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Adam Green 140...@gmail.com: Yes, but advertisers and sales people are obsessed with the past, and they provide the dollars that will make Twitter grow. We'll see where this leads Twitter. I bet they follow the money. Google did, and it worked out OK. :) On Mon, Nov 22, 2010 at 9:41 AM, Taylor Singletary taylorsinglet...@twitter.com wrote: I can't really speak much on the topic of the analytics tool. I can say that you'll find most everything in Twitter is focused on real-time -- whether it's search results, the tweets available for a given user timeline, or the general structure and emphasis presented by our UI. There's not much on Twitter that allows one to dwell on the past. Taylor On Mon, Nov 22, 2010 at 6:26 AM, Adam Green 140...@gmail.com wrote: Taylor, there has been much talk lately about the new Twitter Analytics tool that would deliver historical data. Am I correct in assuming that this is built on an internal API, and that this API will be surfaced eventually for use by us developers? On Mon, Nov 22, 2010 at 9:20 AM, Taylor Singletary taylorsinglet...@twitter.com wrote: Hi James, You'll find that, in most cases, the data available for a trend is limited by the amount of data provided by the Search API. While this goes back around 10 days currently, there have been times when less was available. Some day we hope to provide more historical data. Taylor On Sat, Nov 20, 2010 at 1:24 PM, James Chivers jchiv...@gmail.com wrote: I'm trying to dig out some hourly trend data from the Twitter API using the trends/daily call with the associated date that I'm looking for, but I'm not able to go back in time more than ~10 days. Is there any way that I'm able to grab the hourly trend data given a date 10 days from the API? Thanks in advance, James -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Adam Green Twitter API Consultant and Trainer http://140dev.com @140dev -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Date format changed on DMs?
There's a third date format for tweets returned by the Search API. Time for me to check my parsers again. There's a Perl module that will literally parse any imaginable date format, but it's hopelessly slow for the kind of volume Twitter delivers. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Rich rhyl...@gmail.com: It appears on normal timelines the created_at field is Wed Mar 25 22:04:55 + 2009 On DMs it's now formatted Tue Nov 23 16:47:09 UTC 2010 which causes a number of parsers to fail if they are looking for offsets rather than timezone codes. On Nov 23, 4:41 pm, Rich rhyl...@gmail.com wrote: Has the default date response format changed on DMs, they aren't parsing the same now? Some notification might be nice? -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Trying to get rid of twitter spammers
Hmmm ... Twitter has a user quality filter that's supposed to weed out spammers from Search and Streaming. At about 450,000 new user IDs created every day, it might take a while for Twitter's spambot detectors to flag them all, but I'd think between algorithms and crowdsourced block / report, eventually they'd get taken out. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Adam Green 140...@gmail.com: As long as you aren't trying to capture and deliver *all* tweets, there are a couple of good ways to cut out spammers. One thing I do is save all mentions for all users in a database of tweets. When a tweet comes in from the streaming API, I collect @mentions, and store them with the screen name of the tweet's author and the screen name mentioned. Then I can rank users based on the number of different accounts that mention them. If you only use the tweets from the top N% of users, the quality improves a lot. I find that the top 80% is usually enough of a screen to get good quality. Another trick is blocking duplicates from each user. The API only blocks duplicates that repeat immediately, but if a spammer has a list of tweets, and cycles through them, all the tweets get through. I compare all new tweets with the other tweets from that user. This is very expensive if you have a big database. This can be made less intensive by limiting the comparison to just the tweets from that user in the last few days. You can also run this with a separate process that doesn't slow down you main tweet parsing loop. Most spammers are so simplistic that they just repeat the same tweet over and over. In a real spammy set of keywords, if I find more than a few duplicates from a user, I just stop saving their tweets. On Fri, Nov 26, 2010 at 11:26 AM, Furkan Kuru furkank...@gmail.com wrote: Word lol is the most common in these spam tweets. We receive 400 spam tweets per hour now tracking 100K people. We plan to delete all of the tweets containing lol word. It is also used by our users (Turkish people) writing in English though. Any better suggestions? -- Adam Green Twitter API Consultant and Trainer http://140dev.com @140dev -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Getting tweets from users following a particular user
Quoting Louis louis...@gmail.com: I'd like to stream tweets from the set of users which follow a specific user. Is there a way to do this directly, or a way to get a list of such users, so I can then specify to filter tweets from them only? It depends on how many followers the user has. Up to 5000, you can do it with the follow parameter either on the filter Streaming endpoint or on User Streams. Over 5000, you will need to get elevated access via Gnip. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Differences between trends and trends/current??
I'm starting to write some code that uses the trends portions of the API. I notice that there are two similar endpoints, 'GET trends and GET trends/current. They look pretty much alike in the documentation, except for a minor format difference in the returned JSON. However, if I actually use the Try it option, it looks like GET trends/current returns more information. Given that my application is a data collector, I'd obviously prefer more information and plan to code using GET trends/current. Is this just a documentation glitch, or is the new format from GET trends/current an undocumented feature that might disappear? -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Differences between trends and trends/current??
Thanks!! I'm also looking at the local trends API - there seems to be a world-wide endpoint there (WOEID=1) and the documentation there indicates that there's a caching frequency of five minutes. So that's probably what I'll go with. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting Taylor Singletary taylorsinglet...@twitter.com: Hi Ed, trends/current is the most appropriate and informationally dense end point and will stick around. Taylor On Mon, Nov 29, 2010 at 7:24 PM, M. Edward (Ed) Borasky zn...@borasky-research.net wrote: I'm starting to write some code that uses the trends portions of the API. I notice that there are two similar endpoints, 'GET trends and GET trends/current. They look pretty much alike in the documentation, except for a minor format difference in the returned JSON. However, if I actually use the Try it option, it looks like GET trends/current returns more information. Given that my application is a data collector, I'd obviously prefer more information and plan to code using GET trends/current. Is this just a documentation glitch, or is the new format from GET trends/current an undocumented feature that might disappear? -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] whitelist Approval refusal!!!!
This looks like something you could implement using the Streaming API, using REST and Search to fill in the missing pieces. If you're working in PHP, have a look at Adam Green's open source library at http://140dev.com/free-twitter-api-source-code-library/ and the Phirehose library. -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting moneekun minsu8...@gmail.com: Why the approval is not but I don't know ㅜㅜ continuous refusal Nothing answer back ! Did my application form go wrong? help me!! (Application Form) @fcsearch This is company of Korea operating portal website name of freechal.com We offering news, video, blog, mail, game, p2p and search engine. We are interested in your twitter service it means we prepare to use that service from December of 2010. We would like to display same keyword that result of tweets, ids, and profile images from twitter when users searching some words. This service has already provided by many websites of Korea (Naver, Daum, Nate, etc.) and they permitted white list by twitter. Also we are developing to provide that service such as other websites. It is going to be updated as often as we can also we will save data that Koreans wrote during the latest 3days. To provide near real-time services, we are using the REST API, the data is cached. ‘Oauth’ will be used for authentication, ‘twitter4J’ library is expected to be used. In this process we expect 3,000 requests per an hour the number of API calls that means it will be exceed API Limit. In that reason, we want to white list the IP address and to reduce collection cycle of tweets. We expect that will be very important part of our new service, it’s going to open December of this year. Kind Regards, The features in current use are as follows: Data for example. Features 1) Request for the all Korean users following information, Their twitts : friends_timeline(Real-time) 2) Request for the all Korean user IDs, status(image data, etc.) : statuses/friends -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] XML disabled on Streaming API
Quoting John Kalucki j...@twitter.com: As previously announced, XML has been disabled on the Streaming API. The few remaining consumers should move to JSON, and bid the year 2003 adieu. Sigh ... anyone want to buy a used but serviceable 56K modem? ;-) -- M. Edward (Ed) Borasky http://borasky-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Mulitple Trending Topic Spam
How difficult would it be to modify the Search response to a search for a Trending Topic so it returned tweets that only matched the searched-for topic? In other words, if a tweet matches more than one Trending Topic, don't show it in the search. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Chrome/Chromium vs. Firefox for Promoted Trends and Accounts
I just noticed something last night - when I browse Twitter with Firefox 3.6.12, I see the Promoted Trends and Promoted Accounts. But when I browse with Chrome 10.0.612.1 dev I don't. This may be some ad blocker setting - I haven't dug into that yet. But is there a generic reason why I wouldn't see them in Chrome? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Chrome/Chromium vs. Firefox for Promoted Trends and Accounts
On Fri, 17 Dec 2010 11:33:46 -0800, M. Edward (Ed) Borasky zn...@borasky-research.net wrote: I just noticed something last night - when I browse Twitter with Firefox 3.6.12, I see the Promoted Trends and Promoted Accounts. But when I browse with Chrome 10.0.612.1 dev I don't. This may be some ad blocker setting - I haven't dug into that yet. But is there a generic reason why I wouldn't see them in Chrome? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős OK - disabled AdBlock in Chrome and it still doesn't show Promoted Trends or Promoted Accounts. This is openSUSE Linux 11.3 on a 64-bit machine, BTW - sorry I don't have something more vanilla. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Site stream unfollow event
On Sat, 18 Dec 2010 07:25:55 -0800, John Kalucki j...@twitter.com wrote: We'd like to help developers maintain a local copy of their authorized users' followings -- the accounts that their users follow. We hope to enable a feature that will make this easier in early 2011. We're not particularly interested in helping developers maintain the set of an account's followers. There are awful scaling issues involved here, vectors for spammy behavior, and generally not much value for end-users in providing this data. Twitter is mostly about who you follow and what you are interested in. Who is following you is becoming less and less relevant. Long ago in a Chirp far away, one proposed feature of commercial accounts was that if you had a commercial account, someone who was following that account could send you a DM if they were following you, even if you were *not* following them. This assumed some kind of sales / customer service use case, I'm guessing. Now that it seems like commercial accounts, or at least an advertising sales form and analytics for paid advertisers is in place, is that I must be prepared for DMs from any of the millions of people who follow my brand feature still part of the package? Do big paying advertisers like Dell or Best Buy actually want something like that? Would it be a scalability nightmare for Twitter? Speaking of vectors for spammy behavior, Marshall Kirkpatrick of Read Write Web reports that 40% of the Amazon Mechanical Turk task requests are for spamming or spam enablement activities, like opening accounts to services that have a CAPTCHA gate and posting blog comments. (http://www.readwriteweb.com/archives/study_40_of_new_mechanical_turkers_work_requests_a.php) Heck, for all I know, those Hey, look at this! tweets with multiple Trending Topics are being posted by the same Turk folks that are opening the account in the first place instead of by bots. Perhaps it's time for someone at Twitter and someone at Amazon to have a little chat. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Storing twitter stream public timeline, conversations and hashtag search!
On Sun, 19 Dec 2010 13:19:03 -0800 (PST), imbenzene imbenz...@gmail.com wrote: Myself an 2nd year undergrad and I am running a minor research project on twitter analysis. I need to urgently* collect tweet streams for certain users and streams by searching hashtags*. I am completely neo in this development side, with no previous knowledge of scripting and Mysql, python or databases. Any suggestions with what to start from beginning will be highly appreciated, and what shall i start studying, online tutorials and all if available online. I have TWITTER API by Kevin Makice but its too confusing without prior knowledge. I have created the mysql database with phpmyadmin, and created the required 6 tables but its not reading the scripted php codes to download tweets, errors are creeping in and bugging my head. In the previous posts it was mentioned something about *certain websites doing this job and and allowing to export data as whole* I am in urgent need for one, I know one was 140kit.com which is not working these days. In the end I have to just put the collected data into data mining tools like Weka or Tableau public 6.0 and run for visualisations. Web is tooo blogging in sense what shall i start with python, JSON, scala or run a php code for it( if possible suggest tutorials for neo's), Plus will i have to run my laptop full on for week something for streaming? Please help me out as my deadline is just coming up right this week. Any help so that I can make it fast and quick without going through much of gross work, is appreciated. Is there any *online resource paid or unpaid available which can do this work of just collecting tweets for certain hash tags over a period of time and deliver collected data *in desired format with location, and time tags ? thanks a ton in advance! Reply please its very urgent. Try TwapperKeeper.com. The code is open source if you want to run it yourself, but you should be able to just create a hashtag archive for each hashtag and then download the results. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] t.co Posting Questions
On Mon, 20 Dec 2010 10:21:32 -0800, David E. Wheeler da...@kineticode.com wrote: On Dec 20, 2010, at 4:16 AM, Emil Tullstedt wrote: As for bit.ly, there is an API for bit.ly which aids you in using URL-shortening until t.co is finished.. Yeah, but it's rate-limited. I'm using http://s.coop/ for now. Dead simple. Best, David *All* services are rate-limited and *none* are free. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Help!! please. How to collect old data by Twitter API
On Fri, 24 Dec 2010 18:53:12 +0100, Tom van der Woerdt i...@tvdw.eu wrote: I'll be simple: you can't achieve this with the Twitter API. Maybe other APIs can help you, but I don't know one. Tom There are some services that have indexed tweets for more than Twitter's default of seven days. I don't recall the names, though. On 12/24/10 6:13 AM, Chris Bang wrote: I’m developing a program to collect historical data or twits from Twitter using Twitter search API and Twitter4J which means the program is based on Java. I selected Search API for my program among APIs by Twitter. However, Twitter says that there is a limitation of 7days, although the limit depends on topic. Is there any way to collect older or historical Twitter data like 12 or 24 months old or without time constraint at all? If anybody successfully retrieved old Twitter data, can you please share the source code? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Exposing IP addresses for legal threats
On Tue, 4 Jan 2011 14:49:59 +, Scott Wilcox sc...@dor.ky wrote: No, there is no API methods to access IP addresses for tweets. I'd suggest contacting local law enforcement and taking it from there. Actually, if the victim can afford it, I'd suggest seeing an attorney before contacting law enforcement. Law enforcement tends to be overworked, have pressing priorities and need evidence of an actual crime as defined in their jurisdiction before they'll take any action in most cases. Law enforcement represents the people more or less as a whole, while an attorney can and will act on behalf of an individual victim or class of victims, if the alleged offender is threatening more than one person. In any case, good luck to him or her - cyberbullying is nasty stuff. Scott. On 4 Jan 2011, at 14:39, Felipe Knorr Kuhn wrote: Hello everyone, Although this is probably not the best list to discuss this, perhaps you guys have some experience to share. A friend of mine is being threated by a Twitter user via DMs and public messages. He doesn't know the identity of the user and thought about tracking him via the IP he uses to post to Twitter. The API does not expose IP addresses, does it? He lives in Brazil and believed he could contact the ISP to track the user, since filing an international lawsuit to Twitter asking for this information and only then contact the ISP would be very time and money consuming. Thanks, FK -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk Scott Wilcox t:+44 (0) 7538 842418 +1 (646) 257 0580 e:sc...@dor.ky w:http://dor.ky -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: ~25% loss rate Streaming API vs. Search API
On Sun, 9 Jan 2011 14:29:12 -0800 (PST), Brian Maso br...@blumenfeld-maso.com wrote: What I did is opened up three separate normal browser tabs in Firefox, each using the Twitter search web interface to search for three different hashtags (#ces, ces11, and nfl -- examples of three tags that should have decent ongoing traffic). At the same time I have an application capturing tweets from the same three hashtags using the streaming API (filter.json? q=#ces,#ces11,#nfl, with appropriate URL encoding). Irregardless of the amount of time, the streaming application captured about 25% fewer tweets. Detailed analysis of the tweet IDs captured by the browsers vs. those captured by the standalone application retrieving tweets via the streaming API verified that there were tweets delivered through the browsers that did not appear through the streaming API. There were no tweets delivered through the streaming API that did not also appear in the set of tweets delivewred through the browsers. I would love it if anyone else would try a similar experiment and report back results. Maybe I'm doing something wrong, or maybe this is an anomaly, or maybe the streaming API just doesn't capture as much -- impossible for me to say. I note that the streaming API documentation doesn't claim an intent to match accuracy with the search API (nor vice versa). At this point I'm thinking to get the greatest accuracy I should be collecting tweets from *both* APIs. Brian Maso Did you just recently start running these tests? Specifically, did you run any tests / notice discrepancies *before* Twitter threw the switches for the Gnip partnership? This might be an unintended consequence of the data plumbing activities associated with Gnip. By the way, I've seen tweets returned by search that *don't* appear to match the search terms! Have you verified that all the tweets Search is giving you do in fact match? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] user streams example
On Thu, 13 Jan 2011 16:10:13 -0800 (PST), jhollingworth jamiehollingwo...@gmail.com wrote: Hi, I've been looking around but have so far been unable to find any code examples of using user streams (http://dev.twitter.com/pages/ user_streams). I might just be being a little dumb but i've had a look at a few libraries in different languages and none seem to mention them. Also do user streams need to be turned on per account? I've been messing around with some of my own code but my request is just hanging. I'm trying to work out if it's something wrong with my implementation or if I've got to be white listed? Thanks, James The Perl CPAN module AnyEvent::Twitter::Stream is what I use to access User Streams. I don't remember whether there's any sample code there or not. I'm pretty sure the Phirehose PHP library also has User Streams code but I'm not a PHP programmer. What language are you working in? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Whitelisted on Twitter
On Mon, 17 Jan 2011 10:57:07 -0800 (PST), Mike Jodon mjo...@agoragames.com wrote: Hey guys We're integrating Twitter into our project, and after looking into whitelisting, it looks like the max calls an hour is 20,000. While that MIGHT be enough for us, we're worried that we will come to close to that number during initial launch of our product. Is there a contact number out there where I can call Twitter and talk to them directly? It seems almost impossible to find something for them. I'd love to boost the 20,000 to maybe 30,000 if possible. Anyone have any thoughts? I can't help you with the business negotiations with Twitter, but is it possible your application could use the Streaming API for high-frequency access to Twitter? Between User Streams (desktops) and Site Streams (multi-user subscription servers) it's possible to do almost anything you can do with the other APIs. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Streaming Unfollow events through Site Streams
On Tue, 18 Jan 2011 12:14:41 -0800, Matt Harris thematthar...@twitter.com wrote: Hey everyone, Starting today we will be streaming unfollow events through Site Streams. These events are being streamed to allow you to keep the social graph of your users current without the need to query the REST API. We require that you only surface actions that are organically displayed on Twitter. This means, for example, executing the unfollow and delete actions but not publicly displaying them to end users. (Section II.4.B of the API Terms of Service - http://dev.twitter.com/pages/api_terms [1] ). The event will be the same format as follow except the event type will be unfollow. For example: { for_user: 123456, message: { created_at: Thu Jan 12 21:55:04 + 2011, target: { }, event: unfollow, source: { }, } } Best, @themattharrisDeveloper Advocate, Twitter http://twitter.com/themattharris [2] -- Twitter developer documentation and resources: http://dev.twitter.com/doc [3] API updates via Twitter: http://twitter.com/twitterapi [4] Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list [5] Change your membership to this group: http://groups.google.com/group/twitter-development-talk [6] Links: -- [1] http://dev.twitter.com/pages/api_terms [2] http://twitter.com/themattharris [3] http://dev.twitter.com/doc [4] http://twitter.com/twitterapi [5] http://code.google.com/p/twitter-api/issues/list [6] http://groups.google.com/group/twitter-development-talk Can this also be added to User Streams? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Location-based search is returning tweets that should not be included (again)
On Fri, 21 Jan 2011 12:37:18 -0800 (PST), @IDisposable idisposa...@gmail.com wrote: In response to this query: http://search.twitter.com/search.atom?rpp=100geocode=38.627522%2C-90.19841%2C30misince_id=28525950136229890 I get tweets like this: http://api.twitter.com/1/statuses/show/28525953676218368.json We're talking about a location search for St. Louis MO, radius of 30 miles. We're getting a guy from Jeffersonian, but timezone is Madrid. Any ideas where this wire got crossed, when we can get it uncrossed, or what the long-term viability of location based searches are? Marc Brooks http://stltweets.com I filed an issue last year and it was closed as fixed on January 8, 2011: http://code.google.com/p/twitter-api/issues/detail?id=1348 I have a Perl script that will grab tweets in a 25 mile radius of Portland, Oregon and dump them to CSV. I haven't run it in a while, though, so I don't know if the results are better now than when I filed it. If you have something to reproduce this, maybe you should re-open issue 1348. I guess given the low percentage of people who enter their actual location in the profile, as opposed to being from Botland or Earth or Hilbert Space, maybe the Search API should only return geotagged tweets when a geocode radius is specified, like the Streaming filter API does. It's that or somehow crowdsource locations, which is going to violate peoples' privacy if done without permission. To me it seems like a tradeoff between clean but very sparse data or messy but copious data that can be imputed or cleaned via crowdsourcing provided permissions can be obtained. I can't put a business case forward for either option from Twitter's perspective, but I think I'd prefer as a researcher to have Search adopt the Streaming model and only return geotagged tweets when a geocode parameter is specified. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Minor glitch in Twitter's emails
I'm now getting multiple emails from Twitter sometimes when someone follows me or sends me a direct message. This is only a minor annoyance - I'm sure you have more urgent issues to worry about. But I did want you to know it's happening. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] registering twitter application
On Tue, 25 Jan 2011 11:54:33 -0800, Taylor Singletary taylorsinglet...@twitter.com wrote: When you're just starting out, feel free to put anything you like that can be interpreted as a valid, non-twitter.com [1] URL. Perhaps to your Geocities homepage, Uh ... you must not have gotten the tweet about Geocities ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter spam checker on a distributed basis
On Mon, 31 Jan 2011 06:18:58 -0500, Dean Collins d...@cognation.net wrote: Ok I'm drowning here, I've given up trying to manually block all the people on twitter sending me spam and I don't think that TrueTwit is really the solution. What we really need is a distributed system like Spam Assassin where when enough people block or report an account as spam that it is then flagged and block from all other participating accounts. Does something like this exist already? Is the API the limit to using something like this? What can I cut down on the number of follows who are sending me spam accounts? Cheers, Dean -- Twitter developer documentation and resources: http://dev.twitter.com/doc [1] API updates via Twitter: http://twitter.com/twitterapi [2] Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list [3] Change your membership to this group: http://groups.google.com/group/twitter-development-talk [4] Links: -- [1] http://dev.twitter.com/doc [2] http://twitter.com/twitterapi [3] http://code.google.com/p/twitter-api/issues/list [4] http://groups.google.com/group/twitter-development-talk I'm guessing Twitter has to manually review all the block and report for spam reports, unless they either get thousands of such reports for an account, or the account's offensive behavior is so blatantly robotic that it triggers some other automated detector. How many new follows do you get per day now? I'm following about 9300 and followed by about 8600. I only get about 20 - 30 new followers a day, about half of which are humans that I want to follow back, or are people who have followed me back. So I have enough time to go through the list once a day and look at not only the new follower but also the list of up to six other accounts in the email and make decisions on each one - follow, unfollow, block or block and report. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Site Streams Beta Users
On Sat, 5 Feb 2011 09:34:25 -0800, John Kalucki j...@twitter.com wrote: Please refrain from large-scale restarts of Site Streams connections during the Super Bowl. Routine operations and the resulting connection churn is not a problem. Rather, starts and stops of a large number of connections is a bit stressful on our system, and we'd rather not disrupt other Site Streams clients during the event. We've made an of optimization in this area over the last week, and we hope to get that fix into production soon, but not before the game. If you can schedule stress testing and non-critical maintenance activities around the broadcast, this would be helpful. We don't expect any service interruptions, but we'd like to keep everyone's distractions to a minimum. Thank you, John Kalucki http://twitter.com/jkalucki [1] Twitter, Inc. I'm not using Streaming at the moment, but I am using Search for some testing. Are there likely to be any Search capacity issues during the game? Should I sample less frequently than normal? -- Twitter developer documentation and resources: http://dev.twitter.com/doc [2] API updates via Twitter: http://twitter.com/twitterapi [3] Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list [4] Change your membership to this group: http://groups.google.com/group/twitter-development-talk [5] Links: -- [1] http://twitter.com/jkalucki [2] http://dev.twitter.com/doc [3] http://twitter.com/twitterapi [4] http://code.google.com/p/twitter-api/issues/list [5] http://groups.google.com/group/twitter-development-talk -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Is there going to be another Chirp?
Maybe this is the wrong place to ask, but is there going to be another Chirp? If so, when and where? I'm making my conference plans for the year and pretty much know when everything is *except* Chirp! -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Is there going to be another Chirp?
On Sun, 6 Feb 2011 12:28:39 -0800, Abraham Williams 4bra...@gmail.com wrote: How about some more state of the union events too. I thought they were going to be quarterly. Given the rumored growth rate of Twitter head count, I'd say they probably have more pressing priorities, like finding new digs. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Is there going to be another Chirp?
On Sun, 6 Feb 2011 18:27:42 -0800 (PST), Orian Marx (@orian) or...@orianmarx.com wrote: Non-Twitter-employee developer headcount might be something they should still be concerned with too... That only matters for where they have Chirp ;-) On Feb 6, 3:50 pm, M. Edward (Ed) Borasky zn...@borasky- research.net wrote: On Sun, 6 Feb 2011 12:28:39 -0800, Abraham Williams 4bra...@gmail.com wrote: How about some more state of the union events too. I thought they were going to be quarterly. Given the rumored growth rate of Twitter head count, I'd say they probably have more pressing priorities, like finding new digs. ;-) -- http://twitter.com/znmebhttp://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] return count
On Mon, 7 Feb 2011 10:02:17 -0800, Taylor Singletary taylorsinglet...@twitter.com wrote: Hi there, Still not much in the way of counting methods in the Twitter Search API. There are a few services out and about that do a decent job approximating such things. For instance, Topsy: http://corp.topsy.com/developers/api/ [1] @episod [2] - Taylor Singletary - Twitter Developer Advocate On Mon, Feb 7, 2011 at 9:44 AM, new developer wrote: Has there been any updates/improvements to the API that will allow me to search on a term and request a count of the number of term mentions? Is this something I can achieve through the API? thanks! If you look at Kevin Weil's slides from Strata (http://www.slideshare.net/kevinweil/rainbird-realtime-analytics-at-twitter-strata-2011), I'd say the strategy would be 1. Develop a validated business model. 2. Wait for the Cassandra / Rainbird patches described to go open source. 3. Subscribe to Gnip's PowerTrack (http://blog.gnip.com/twitter-firehose-filtering-with-power-track/) and feed it to your Cassandra / Rainbird instance. Don't skip step 1 - at ten cents a kilotweet it will take you longer than it will take Twitter to open source the Cassandra / Rainbird patches. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Is there going to be another Chirp?
On Mon, 07 Feb 2011 15:25:59 +0100, Tom van der Woerdt i...@tvdw.eu wrote: I'd prefer London or some other West-European city. I'm guessing it will be in SFO, given how closely the Twitter team worked with the developers last year. They can't fly a few hundred folks to NYC or London. The question is *where* in SFO - Fort Mason wasn't particularly well suited for a barcamp-style conference with breakout sessions, wifi, etc. The noise level / acoustics were unacceptable. But really, unless they're going for late May - early June, they need to get some planning done now. Google I/O sold out in 59 minutes, and actually the scuttlebutt is that it was actually sold out for all practical purposes as soon as the web site went live - invited attendees had already scooped up most of the tickets. I'm not saying I think Chirp will be *that* popular, but I'm guessing a lot of people who didn't get in last year will want to come this year. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Twitter geocoords + gmap is erratic, why?
On Wed, 9 Feb 2011 14:35:06 -0500, David Terranova da...@davidterranova.com wrote: Thanks for the tips Matt. The people using this system definitely send the tweet when they reach their final destination (they're run a food truck), and don't use wifi. They are using both iPhone and Android phones to send these tweets, so the only answer is that their devices must be sending incorrect GPS data. However... why should this happen when the iPhone Map application is tracking accurately, at the same time when sending a status message to Twitter? This is why I'm confused and wondering if actually there's a process in between the device and Twitter that gets things muddled? Especially as I get a completely different result when using Google Latitude, also erratic (mostly incorrect) but in a completely different way to Twitter's result. Thanks again, David I can't help you with iPhone - don't have one - but I can tell you that as of a few weeks ago, Twitter's native Android client was *not* correctly sensing location in real time, even though all three (WiFi, GPS and Verizon 3G) on my Verizon Droid Incredible were correctly configured and functioning, and the native Google tools like Maps function correctly. This is in the Portland, Oregon metro area. I didn't try mobile.twitter.com or any of the third-party Twitter clients. I've had spotty results with location on all Twitter clients on my Droid and have essentially given up. If I want to tweet with a correct location, I have to use my ChromeOS Cr-48 Notebook or my laptop running Linux via WiFi and often need to enter location manually. I have neither the patience nor the tools to diagnose location issues with three vendors - Twitter, Verizon and Google! My belief is that both business and engineering partnerships between the three vendors will be required for correct functioning of Twitter location on my device. I suspect similar is required for iPhone - Apple, Twitter and ATT must have a *formal* partnership arrangement for stuff to work. Meanwhile, I'd suggest that if you have the time, diagnose this as far as possible and file a bug on Twitter's site. *Maybe* it's simply a Twitter issue, but I rather doubt it, given the number of things I tried on my Droid before giving up. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Promoted Trend Rollover Time?
I live in the Pacific Time Zone, and I've noticed that Twitter's Promoted Trend rolls over to a new trend right about midnight my time. Is this a policy thing, or just a coincidence? And is it always midnight Pacific Time, or midnight in the viewer's time? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Update on Whitelisting
On Thu, 10 Feb 2011 17:26:17 -0500, Adam Green 140...@gmail.com wrote: Now the next step in opening up this marketplace is to create multiple resellers of Twitter API data, and let them compete on price. Giving Gnip a monopoly over this market makes no sense. Twitter's biggest problem is the huge volume of requests. By blocking whitelisting you are forcing some developers to cheat by creating multiple accounts and distributing their requests across them. That can never be stopped. What you have to do is make it inefficient, by letting multiple resellers complete and drive the price of Twitter data down. Then the strongest reseller will take the load off of you and offer enough value added that developers will be willing to pay for data. That will never happen when only one reseller sets the price. +1000 -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Update on Whitelisting
On Thu, 10 Feb 2011 15:11:09 -0800, Taylor Singletary taylorsinglet...@twitter.com wrote: Hi Ed, Some quick answers to a few specific points below: With authentication, whitelisting works at the junction of a user and an application. @znmeb using Twitter for iPhone has 350 requests per hour. @znmeb using YoruFukurou has 350 requests per hour. Using one user request in Twitter for iPhone does not effect the user quota for YoruFukurou. Ah ... sounds good ... except for the buy an iPhone part, anyhow ;-) A related question - how far away from production is Site Streams, and is there a plan to encourage services like HootSuite to migrate to Site Streams? It seems like it would be a big win for them (and all the other web-based Twitter platforms). Site Streams is nearing availability for general use -- there are a few more t's to cross and i's to dot. In fact, HootSuite is currently a Site Streams beta consumer. Thanks! That's great news - I'm a HootSuite user again. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Update on Whitelisting
On Thu, 10 Feb 2011 17:40:03 -0800, Matt Harris thematthar...@twitter.com wrote: Hi Ian, For trends you might like to try our trends.api.twitter.com [1] server which hosts a cached copy of the trends information and is updated whenever the trends change. It should support your use case and we would be interested in any feedback you may have about it's performance. Nice! I was just about to try building something very much like twendr, but I can either use twendr or go right to your new server. Is this on a five-minute cycle like the main Trending Topics feed? Will we ever get to see the Promoted fields populated without spending money? ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Update on Whitelisting
On Thu, 10 Feb 2011 18:46:46 -0800, Ryan Sarver rsar...@twitter.com wrote: Orian, You should definitely plan on working within 350/hr for the forseeable future. FWIW, we have watched #newtwitter usage and an average session uses between 80-120 rq/hr. Interesting - I had an incident last week where I was running out of calls in #newtwitter - that's why I asked about HootSuite. I never did figure out what happened. I'm running them both now and not running out. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: user stream api
On Fri, 11 Feb 2011 13:25:07 -0500, Adam Green 140...@gmail.com wrote: Be aware that the streaming API does not deliver everything you are tracking. In theory it delivers everything up to 1% of the total flow of tweets. In practice, I find that it delivers about 95% of the tweets that match your keywords or users. This is fine when sampling, which is what I generally use it for, but will cause much anguish if you assume you will get everything sent by people you are following. I have to admit that I have only found this issue with the streaming API, but I'm betting that the user streams are based on the same underlying code. My solution to the missing values from the streaming API is to collect everything I can from streaming, then use the REST API to backfill data I might not have received. If you run the backfill every hour, you only have to go back to the last set of good tweets, adding anything you missed. Backfill for keywords is easy - just use Search. But how do you determine what you *haven't* received from accounts that you're following? Do you need to grab the most recent 200 tweets from everyone you're following using REST, or do you do a Search with from: OR from: ... as many times as it takes? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] DM rate limit
On Sat, 12 Feb 2011 14:46:33 -0500, Dossy Shiobara do...@panoptic.com wrote: Any one Twitter account that sends 250 DM's in a 24 hour period is DOIN' IT RONG. DM spamming your followers is JUST NOT OK. Putting multiple Trending Topics on a tweet with porn links is not OK either, but that doesn't mean bots don't do it. #twittercouldfixthat. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Is there going to be another Chirp?
On Sat, 12 Feb 2011 11:29:09 -0500, Brainewave Consulting i...@brainewave.com wrote: On Feb 7, 2011, at 5:25 PM, M. Edward (Ed) Borasky wrote: On Mon, 07 Feb 2011 15:25:59 +0100, Tom van der Woerdt wrote: I'd prefer London or some other West-European city. I'm guessing it will be in SFO, given how closely the Twitter team worked with the developers last year. They can't fly a few hundred folks to NYC or London. The question is *where* in SFO - Fort Mason wasn't particularly well suited for a barcamp-style conference with breakout sessions, wifi, etc. The noise level / acoustics were unacceptable. True enough, but Twitter is a global application - the developer conference should go global too! Rio! Twitter's huge in Brasil, and Facebook is conspicuously absent there! -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: DM rate limit
On Sat, 12 Feb 2011 15:29:23 -0500, Dossy Shiobara do...@panoptic.com wrote: It's an unfortunate reality, but for every one legitimate application of DM's, there's 100 projects being posted to rent-a-coder asking for an auto DM script ... As developers that use the Twtiter API, we're all collateral damage to the scammers and spammers. Yes, it sucks, but there's no other real solution here. Yeah - Google doesn't seem to be able to do spam control without PhD-level manual intervention, so I can imagine how hard it is for Twitter. ;-) Rent-a-coder? Try Amazon Mechanical Turk - you can get things done there for pennies an hour ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: DM rate limit
On Sat, 12 Feb 2011 16:28:43 -0500, Dossy Shiobara do...@panoptic.com wrote: Indeed, if you figure someone can send a customized DM once per 15 seconds, and an hour at Turk costs you $0.05/hour, you can consume 250 DM's/day in 62.5 minutes - you're talking less than $0.10/day to have someone send DM's on Twitter for you, personalized by a human ... If a script off rent-a-coder costs you $100 ... that's 1,000 days worth of Turk-time ... so using a script only breaks even after 2.7 years of use. LOL. Yes, and you can get Twitter accounts created on MTurk as well. It's supposedly a violation of Amazon's TOS but they don't enforce it because they collect per-HIT transaction fees. Dick Costolo and Jeff Bezos need to have a long talk IMHO, backed up by attorneys and possibly the IRS and FTS. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: DM rate limit
On Sat, 12 Feb 2011 17:07:36 -0500, Trevor Dean trevord...@gmail.com wrote: I agree, don't be so quick to judge. We have an opt-in based service and out clients have thousands of customers that explicitly say yes send me direct messages. The information we send is requested by the end user and is not spam. So you can imagine that a client with a large user base could quickly go beyond the 250 dm/day limit. It's unfortunate that the spammers take advantage and ultimately ruin things for legitimate services. Trevor Dean | Director big time design communication Inc. 647 234 8198 Visit http://www.bigtimedesign.ca for more information Speaking of spam, there's a great article at the New York Times on J.C. Penney, black hat SEO and Google: http://www.nytimes.com/2011/02/13/business/13search.html Many thanks to Twitter's spam fighters for keeping it as clean as it is, under the circumstances. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter Development platform - A Rant
On Sun, 13 Feb 2011 12:18:11 -0600, Andrew W. Donoho andrew.don...@gmail.com wrote: It is clear from this thread that many developers made, perhaps unwisely, product plans based on Twitter's continued support for white listing. In my case as a client developer, the increase of my API count from 150/hour to 350/hour due to moving to OAuth totally removed my need for white listing. If user streams was supported, I could easily live with 150/hour limit. If they would stand behind their user streams API, I would switch to it immediately. (Beta status is not, frankly, good enough. If they cannot make a commitment to their new API, why should I? By my count, user streams has been in beta for almost 6 months.) User Streams is in fact in production and has been for months. The only restrictions on User Streams, other than what's documented in the technical documentation, is that it is *only* for desktop *clients*, not servers or mobile. I'm not sure where iPad fits in this spectrum, but for sure an iPhone is mobile. *Site* Streams is designed for servers and it is still in beta. Perhaps you need to be pitching your idea to Twitter and adapting your service to Site Streams if it's a server-backed app, which I'm guessing an iPhone/iPad app would be. That said, Twitter's API evolution practices, presumably approved by their CTO, Mr. Sarver, are not, in my opinion, helping their partners grow with Twitter. [snip] Another example is the closed roll-out of promoted tweets. I think every third party app developer would love to find a way to further monetize their Twitter application. Twitter did announce that they would find a way to allow their developer partners to participate with the promoted tweets program. That has not yet happened. Currently, as Twitter has made a floor price of $0.00 for iOS apps, I have to resort to Apple's iAds to capture revenue from my labors. I don't mind but it does cut my other market-making partner, Twitter, out of the revenue stream. As it reduces my revenue opportunities, I think this is sub-optimal. I win when my partner wins. The key word in this rant is partner. A *partner* is, IMHO, someone who has a *formal* partnership arrangement. Sure, there's a certain formality when you accept Twitter's TOS, but I think if you want to use Site Streams or Promoted content, you should be negotiating as a business with Twitter as a business. What's in it for Twitter? Twitter has built a powerful brand. I was there in early 2007 when the vast majority of pundits predicted that it would go nowhere - that it was just a bunch of Ruby hackers with too much time on their hands, that it would destroy flow, etc. It's now one of the top ten sites world wide according to Alexa. If you want to be a partner with Twitter, *you* are the one who needs to have something to offer *them* IMHO. [snip] Overall, everyone needs to remember that we are dealing with a company that publicly claims to not yet be trying to capture revenue from their platform. I seem to have missed that claim. As far as I know, they *are* trying to capture revenue through a combination of Promoted Accounts, Tweets and Trends with bundled analytics and data licensing. What do I want? I want a better developer experience. Both Apple and Microsoft show what a good experience can be. I want user streams, a promoted tweet API and annotations. I hope Twitter can deliver these technical features to enable new business opportunities for themselves and the Twitter app ecosystem. Myself included. I think you have User Streams, though it may not be suitable for your specific application. You may be eligible to get in the Site Streams beta, although I'm guessing that was invite-only. You can always ask - as a business negotiating a partnership with another business. We'll have to wait and see about the Promoted products. Advertising sales is a fiercely competitive business and it's not something I personally want to deal with at the moment. Annotations? That was definitely a case where Twitter's reach seems to have exceeded its grasp. The story I've heard is that there are people in Twitter hacking away on it but the priorities do get adjusted according to the demands of the marketplace. If it could be a breakthrough spam killer, I think they'd push it front and center in a big hurry. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter Development platform - A Rant
On Sun, 13 Feb 2011 14:16:30 -0500, Adam Green 140...@gmail.com wrote: Edward, I'm going to jump in on the partner issue, since that is my big point. I think you are thinking too small when you say If you want to be a partner with Twitter, *you* are the one who needs to have something to offer *them* IMHO. One dev is very small compared to Twitter. 10,000 devs is a labor force. 100,000 devs is a market that protects Twitter from *any* competitor, including Google. We are all partners, because we all make money. You look old enough to remember dBASE. That was a huge labor force that protected Ashton-Tate for years when they had a product with technical limitations. Sound familiar? Corporations and government agencies used dBASE not because it was *best*, but because they could find many qualified developers. Ashton-Tate started attacking their developers in 1988, when they were one of the top 5 software companies. They were out of business 3 years later. If Twitter wants to be embedded into the infrastructure of corporations around the world, they must have outside developers. If they want it to be a cool toy for the Kardashians and Justin Beiber to amuse their fans. They don't need us at all. It is their choice. Well, I'm old enough but I was doing something radically different from Ashton-Tate at the time. This whole thread is starting to sound eerily similar to last year, when Fred Wilson made the infamous filling holes blog post, followed by Twitter buying Tweetie, followed by Chirp. I'd be surprised if the *Twitter* ecosystem could support 10,000 independent developers - they'd self-organize into businesses with some sort of power law size distribution, where the largest such business is Twitter itself. I don't know that Twitter wants to be embedded into the infrastructure of corporations. It seems to me that Twitter is unique and not at all suited to intra-enterprise communications. Besides, there are dozens of enterprise software platforms that can do everything Twitter can do except talk to the hundreds of millions of Twitter users in real-time. ;-) Maybe I am thinking too small, but then again, people aren't coming to *me* with problems big enough to require whitelisting, or for that matter Cassandra, or MapReduce, or sending thousands of DMs a day. Even if they did, there's no way I could compete with Twitter. I really should save this for my blog - it's been a while since I wrote a post about Twitter, and that's what my search analytics tell me people read there. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter Development platform - A Rant
On Mon, 14 Feb 2011 01:21:29 -0500, Adam Green 140...@gmail.com wrote: Good points. I think the basic confusion is the definition of developer. It could mean someone who builds a web or mobile app and tries to monetize it. That would be limited. I think it also means all the consultants and in-house programmers who integrate Twitter into existing websites and businesses. As I started responding CNN ran a big button on the screen telling people to try their Twitter integration on their website. I think that was built by a developer, not Twitter HQ. My impression is that this is exactly the sort of thing @anywhere was designed to do - make it possible for a CNN or even the Original Coffee Brake to incorporate Twitter into their web site with a budget of, say, 8 hours of HTML editing time. ;-) I haven't kept up with how well @anywhere is fulfilling that promise, though. I ran it for a long time on my blog but shut it down because the trips to Twitter's servers were slowing down page loads. I should probably revisit that now that I'm starting to get traffic again. Multiply that by every TV show, radio program, newspaper, magazine, movie, real estate office, hospital, retailer, you get the point. There are way more than 10,000 programmers who work on websites and mobile apps around the world. They are all possible Twitter developers, among other tasks they did. I don't know about the rest of the world, but here in PDX, the skills that are in huge demand are HTML5/CSS3/JavaScript and user interface design. We've got a small collection of people who do stuff with Twitter, but you don't see help wanted ads for Twitter API coding - that's something people do in their spare time. Most folks use Twitter the old-fashioned way - from the web app or from a client - or license a monitoring platform that talks to Twitter and Facebook. Too big an idea? Maybe, but with the right assistance from Twitter, there would be enough developers that when a competitor comes along Twitter would have a base that would make it hard to switch. That is what we offer them. I think it would be harder for a competitor to get Twitter's millions of active subscribers than to get thousands of developers. ;-) I was just looking at the Alexa statistics - Twitter is in 9th place world-wide now. http://www.alexa.com/topsites Who's ahead of us? Twitter is just below the huge Chinese site Baidu.com. Neither Facebook nor Twitter is active in China, although I have seen accounts claiming to be from Guangzhou. Next up the ladder is Wikipedia. In short, it's been a long climb since March of 2006 to get there, and there's a lot of power above Twitter - Google/Youtube/Blogger, Yahoo, Microsoft, Facebook, Wikipedia and Baidu.com. Twitter is, as they say, running with the big dogs. And we're ahead of Aol. ;-) I have an idea. Why doesn't Twitter hire a developer relations person? Not a support person. Matt and Taylor do a good job of technical support. I appreciate what they do. I mean someone who could run a developer program. I haven't seen someone like that yet. Could some of the $200 million pay that salary? Maybe again I'm thinking small, but I have yet to run up against anything that Twitter did that seriously impacted me. Twitter's not like Microsoft, Android or Apple where you need a huge standardized SDK / MSDN-like library. The one thing I'd want as an independent developer would be some kind of keyword tools along the lines of what Google provides for webmasters. I can easily determine what people tweet about but I *can't* determine what they search for. Oh, yeah - a Streaming endpoint that delivers the overall tweets per minute every minute, so I can draw pretty graphs in real time like Carolyn Penner did on the Twitter blog. http://blog.twitter.com/2011/02/superbowl.html -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: should search and streaming apis return similar tweets for equivalent geolocation areas
On Mon, 14 Feb 2011 11:33:54 -0800 (PST), Taylor Singletary taylorsinglet...@twitter.com wrote: The Search API is greedy with those location fields on user's profiles. It's not likely this behavior will be emulated in the Streaming API with the bright side that you can be more confident in the location accuracy in matches on the Streaming API. Thanks, Taylor I wouldn't call the Search API greedy on location as much as I'd call it myopic or easily confused. ;-) Twitalyzer is now getting some of their location data from PeerIndex when the Twitter profile isn't accurate. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Jetwick Twitter Search
On Tue, 15 Feb 2011 03:20:40 -0800 (PST), Karussell tableyourt...@googlemail.com wrote: Hi there! Just a link to my open source twitter search (without noise) developed in my spare time: http://jetwick.com/ Regards, Peter. PS: Most of the features are listed here: http://www.pannous.info/products/jetwick-twitter-search/ Looks nice! I wish I knew Java to hack on it! -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Streaming API vs. Search API: no API returns 95% of intented tweets
On Tue, 15 Feb 2011 21:01:07 -0800, John Kalucki j...@twitter.com wrote: On every occasion where I've tested the Firehose and track terms from the Streaming API against the Tweet database and against each other, there is no loss -- all the sources match exactly. Unless there's some unusual operational instability, the Streaming API returns 100% of the tweets requested, or sends a limit message to let you know what has been dropped. What has been dropped, or how many have been dropped? ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Seeing many Woah there errors on oauth/authenticate
On Thu, 24 Feb 2011 09:41:34 -0800 (PST), Aaron Rankin aran...@sproutsocial.com wrote: Our users are reporting many sporadic Woah there errors on the oauth/ authenticate page, where the error says the token info was already used. We're forwarding our users to that page immediately after we get the token info. Is this a problem with our oauth logic (we're using Twitter Async / EpiTwitter) or is it an API issue? Thanks, Aaron As a user, I've seen a fair number of those from some applications too. I just saw one from PeerIndex, in fact. I ended up having to revoke access and sign out of Twitter, then sign back in. I'm guessing this isn't on Twitter's end. Could this be some kind of clock mismatch between the application and Twitter? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Streaming API access level limit
On Thu, 24 Feb 2011 17:34:52 +0800, Chen Jack S Y aquaj...@gmail.com wrote: Thanks, dude. My problem is still there though. When I try the streaming api with curl in command line, everything goes well and it tracks a few thousands of ids successfully. While using eventmachine (together with em-http-request) ruby gem, haven't found any solutions to track more 400 ids but keep receiving 413 response errors. Kind of weird. Is this the tweetstream Ruby gem? If their repository is still on Github, it hasn't been updated in over a year. In particular, they haven't added code for User Streams or oAuth. Could they be using an incorrect endpoint or something like that? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] current response issues at Twitter.com?
Is something happening? I'm seeing Loading Tweets seems to be taking a while. Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information. pretty regularly at the moment. Search, on the other hand, seems to be fine. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Apps that Site Hack
On Fri, 25 Feb 2011 11:16:54 +0100, Pascal Jürgens lists.pascal.juerg...@googlemail.com wrote: How about a competition to develop spam-detection algorithms :) Pascal I don't see VCs / angels funding that sort of thing, so there's not likely a market. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] consistency and ecosystem opportunities
On Fri, 11 Mar 2011 13:18:24 -0700, Ryan Sarver rsar...@twitter.com wrote: THE OPPORTUNITY FOR DEVELOPERS Some key areas where ecosystem developers are thriving: - PUBLISHER TOOLS. Companies such as SocialFlow [2] help publishers optimize how they use Twitter, leading to increased user engagement and the production of the right tweet at the right time. - CURATION. Mass Relevance [3] and Sulia [4] provide services for large media brands to select, display, and stream the most interesting and relevant tweets for a breaking news story, topic or event. - REALTIME DATA SIGNALS. Hundreds of companies use real-time Twitter data as an input into ranking, ad targeting, or other aspects of enhancing their own core products. Klout [5] is an example of a company which has taken this to the next level by using Twitter data to generate reputation scores for individuals. Similarly, Gnip [6] syndicates Twitter data for licensing by third parties who want to use our real-time corpus for numerous applications (everything from hedge funds to ranking scores). - SOCIAL CRM, ENTREPRISE CLIENTS, AND BRAND INSIGHTS. Companies such as HootSuite [7], CoTweet [8], Radian6 [9], Seesmic [10], and Crimson Hexagon [11] help brands, enterprises, and media companies tap into the zeitgeist about their brands on Twitter, and manage relationships with their consumers using Twitter as a medium for interaction. - VALUE-ADDED CONTENT AND VERTICAL EXPERIENCES. Emerging services like Formspring [12], Foursquare [13], Instagram [14], and Quora [15] have built into Twitter by allowing users to share unique and valuable content to their followers, while, in exchange, the services get broader reach, user acquisition, and traffic. There's a common thread in most of the businesses you've listed as thriving above. Nearly all of them interface with *multiple* networks - Twitter, yes, but also Facebook, LinkedIn, and even MySpace. HootSuite, for example, connects to Twitter, Facebook, LinkedIn, MySpace, Ping.fm, WordPress, Foursquare and mixi. There's also Google Buzz / Latitude, Tumblr, Posterous, Gowalla, Yelp, and I'm sure many others. In short, I'd say there seem to be few businesses thriving that have focused only on Twitter. Last time I looked at the Alexa site rankings world-wide, Twitter was number nine. It's a long climb to the top IMHO - Twitter needs to pass Wikipedia and Baidu just to get to the point where Google, Yahoo!, Microsoft and Facebook are in sight. Twitter is still growing, for sure, but there are clearly some challenges for developers who only develop for Twitter. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: consistency and ecosystem opportunities
On Sun, 13 Mar 2011 11:49:45 -0700 (PDT), Dewald Pretorius dpr...@gmail.com wrote: I used to be counted in the 90% until they defaced Tweetie, sorry, Twitter for iPhone with that moronic #DickBar that shoves irrelevant nonsense in your face. It's like yelling at you, I KNOW YOU DON'T WANT TO SEE THIS AND HAVE NO INTEREST IN THIS, BUT HERE, TAKE IT ANYWAY. LEARN #WHATNOTTOSAYTOAFATWOMAN AND TRY TO #FARTLIKEJUSTINBIEBER AND OH, JUST WHILE YOU'RE AT IT, HERE'S ANOTHER STUPID ONE THAT'S NOT TRENDING AT ALL, BUT SOMEONE PAID US TO SHOVE IT IN YOUR FACE!!! Are any of you guys developing a better Twitter client for iPhone, because I'll switch in a heartbeat. Oh... Wait Dewald, you have to remember that Twitter isn't the only granfalloon that one must deal with on the iPhone - there's Apple, too. If Steve Jobs didn't like the #DickBar, how long do you suppose it would last? ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: consistency and ecosystem opportunities
On Sun, 13 Mar 2011 12:21:20 -0700 (PDT), Jef Poskanzer jef.poskan...@gmail.com wrote: On my Android phone I have both the official Twitter client and Twidroid installed. If they had more or less the same functionailty and useability I would prefer to use the official client. However I only use Twidroid, because Twitter's official app is inferior. I could explain why in detail if anyone is interested, but it's not a subtle matter, it's gross and obvious. Twitter apparently believes that no one should bother making a plain old timeline-displaying client because Twitter's official ones are all you need. And yet even with Twidroid's prior example to copy from, Twitter's official Android client is still unusable. I say this one example shows that the new policy Ryan posted is at best premature. I've been holding off on the Android issue, but since you brought it up ... I have a Verizon HTC Droid Incredible. I've tried *all* the Twitter clients. I've tried the one that's built in, Peep, I've tried every release of Twitter's native client. I've tried the mobile Twitter web site in the browser. I've tried Twidroyd, Touiteur, TweetDeck, HootSuite, Seesmic and probably a few others I've forgotten. The most recent version of Twitter's native app is the *only* one of that line that I consider even marginally usable. And yet in terms of usability, it is still way behind Seesmic. Seesmic is the one I use. I'd *love* to use Twitter's native app, but until it does everything Seesmic does, it's not going to happen. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: consistency and ecosystem opportunities
On Mon, 14 Mar 2011 01:32:27 +0530, Umashankar Das umashankar...@gmail.com wrote: Relevance in microblogging. Big opportunity but very difficult to define. Last i read, even google is stumped. Cheers Umashankar Das I don't think it's relevance that stumps Google so much as privacy. It's a lot of work for users to control how much they reveal and to whom, and the Holy Grail of permission marketing - timely, relevant and personal - runs square up against that. I'm cynical enough to think that the sole consumer benefit that has come from social media, including Twitter and Facebook, is the ability to talk back to granfalloons like the State Department, United Airlines and Google. Everything else about the technologies simply reduces costs to marketers, and those cost reductions are not passed on to consumers in the form of less expensive or higher-quality products and services. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: Requesting increased access levels for Streaming API
On Wed, 16 Mar 2011 09:10:13 -0700 (PDT), Ryan Sarver (@rsarver) ryan.sar...@gmail.com wrote: Also as we stated before, you can use User Streams or Site Streams and get more data by getting more users to authorize your application. Ryan, it's not as simple as getting more users to authorize your application. You need to get *all* your users to *explicitly* authorize the application's *exact* usage of their data! Users tend not to read the fine print. I'd hate to see some data collection / analytics application make some assumptions based on the implicit openness of the tweet stream and then get nailed by a bunch of angry users. Angry users tend to write to their Congressmen and Senators. ;-) Managing a *single* user's User Streams feed is a relatively straightforward coding task - I've got a smallish Perl script that can do it for my own account. Managing multiple users' Site Streams is a much more complex endeavor, and to use that mechanism for a data collection / analytics application is ludicrous IMHO. Somehow, the notion of the right tool for the job seems to have been ignored. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] app to block all users ending with numerals
On Fri, 25 Mar 2011 15:17:25 +, hax0rsteve hax0rc...@btinternet.com wrote: I know a number of people who use twitter as a read only source of information (for instance they may follow only news outlets and celebrity tweeters) and therefore may have large follow counts with zero tweets. This may not be a use case that you are familiar with, but it is a valid use case. Also, I don't know if you are aware of the current limits on following, etc, which are described here, my apologies if you already are : http://support.twitter.com/forums/10711/entries/15364 As for the OP, well, a) if this is what you (or your users) want, just parse the follow messages looking for numerical postfixes and offer the user the user the option to block them, there is no need for an API call specifically to do this. And b) again, you are missing a use case, there are lots of genuine accounts that have numerics postfixed to them, some people use birth years, and some people - perhaps finding that the screen name they wanted is not available in a naked form - will have chosen [screen name]76 or some similar format, or picked a year with some historical connection with their chosen name. It is not safe to simply assume that ending with numerics is sufficient to indicate that the account is used only in the delivery of spam, be that tweet spam or simply follow spam. While the assumption may hold in a large number of cases - and I am not aware of any empirical data that shows what this number is, though I'd be interested to see one - it will undoubtedly include some false positives. HTH hax0rsteve On 25 Mar 2011, at 15:00, Adam Green wrote: What if Twitter just suspended anyone who followed more than 1,000 users without ever having tweeted? But then their membership would sink dramatically. How about not allowing following past 100 users without tweeting at least once. What is the point of these accounts anyway, unless they are being built up and then sold? They can't be used for spam, since they don't tweet, and generally don't have URLs in their profiles. On Fri, Mar 25, 2011 at 10:47 AM, Dean Collins d...@cognation.net wrote: Lol, someone want to write me an app that blocks all users where their username ends with two or three numbers. This is getting ridiculous. Seems like something that would be pretty easy to achieve via the API don’t you think? Cheers, Dean -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Adam Green Twitter API Consultant and Trainer http://140dev.com @140dev -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk 1. There are plenty of good spam detection and filtering algorithms. The ones listed here, however, are simple hacks unlikely to work without extensive manual intervention. The same can be said for ManageFlitter, TwitCleaner and similar services. They give you a start, but you still have to wade through hundreds or thousands of positives to weed out the keepers. 2. A first name followed by a few numbers is a common legitimate screen name - just having a name like that isn't necessarily an indication of a spammer. Here's how it works - Bobby asks Kelly if she's on Twitter. Kelly says No and signs up. She starts with the screen name Kelly, finds it's taken, so she adds her age or the year she was born. If that's taken too, she'll maybe get clever and pick something like PiercedChick, or she'll pick a few random numbers and get in as Kelly117. (Now don't go blaming me if you start getting followers with names like PiercedChick117.) 3. The User / Twitter spam reporting process could definitely be improved with a few simple steps. I don't have any data - that would have to come from inside Twitter - but the two most common types of spam I see is spambots riding Trending Topics and spambots replying to keywords. In either case, the actual spam tweets sent are usually easily found via Twitter Search. Given that, what I do when I get a spam tweet is perform the search, then go through the resulting page and manually report a page or so, depending on how much time I'm willing to spend on this. So here's what I'd propose: Twitter sets up an email address or some other mechanism to receive these search patterns. When someone gets spammed, they can send a copy of the tweet to Twitter, in addition to doing a block and report on the spammer. Twitter could then create the search pattern, run the query and suspend
Re: [twitter-dev] Twitter followers in excel
On Fri, 25 Mar 2011 14:10:36 +, Scott Wilcox sc...@dor.ky wrote: Hello there, There is no method to do this straight from the API. What 'details' of each follower are you interested in having? Can you elaborate on why you're interested in having an export to excel if possible too. Scott. On 25 Mar 2011, at 12:25, shaily wrote: Hi Tweeples, Can you please help me how to download the details of my followers, their details, picture into excel! Can I connect excel directly to twitter? Is their an easy way? Please advise. Shaily There's a service called Export.ly that will do this for you. I don't remember how many of the fields it exports, though. This is an easy coding task in any of the scripting languages with Twitter API libraries - I do it in Perl but I'm sure it can be done in Python, Ruby or PHP as well with just a few lines of code. Finally, there are some ways in Excel to import XML data - anything you can export from Twitter via Atom / RSS feeds in XML can be imported into Excel that way. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] app to block all users ending with numerals
On Fri, 25 Mar 2011 11:33:30 -0700, M. Edward (Ed) Borasky zn...@borasky-research.net wrote: [snip] One other note - a tweet that contains multiple Trending Topics is nearly always spam. I haven't gathered any data, mostly because I'm too lazy to write the API call management / rate limit logic to automate this. I'd *almost* be willing to recommend to Twitter that they stop indexing tweets for Search that match more than one Trending Topic, though. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] app to block all users ending with numerals
On Fri, 25 Mar 2011 19:58:58 +, hax0rsteve hax0rc...@btinternet.com wrote: To pointlessly prolong the discussion - it being Friday :-) ... [snip] I guess what I'm getting at here is that any automated filtering system ultimately amounts to making value judgements on behalf of your users. That this fails quite often in - for example - corporate email systems gives me no confidence that any similar approach is going to work for twitter, where the diversity of message content, users, and use cases is vastly more pronounced. But I could - of course - be wrong :-) Well, Twitter is on the one hand a smaller data set than Google, but on the other hand has different usage patterns in the real-time signal-processing sense. So yes, if Google has to mix human judgment and algorithmic judgment to optimize shareholder value, then so does Twitter. I claim, though, that the mere fact that one can buy the number one position in a Twitter Search that otherwise returns total garbage is very much different from buying clicks on Google, where organic search results at least return something that a mix of human and mechanical judgment has determined is relevant to the searchers' intent. Twitter Trending Topics is broken and infested with spam. One shouldn't need Sulia to consume Twitter, and Twitter's own Promoted Trends and Tweets should not have to compete for eyeballs and clicks with spambots. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Perl devs: new AutoCursor trait for Net::Twitter
On Sun, 27 Mar 2011 16:14:10 -0700, Marc Mims marc.m...@gmail.com wrote: If you're using Net::Twitter's friends_ids or follower_ids methods without a cursor parameter, an upcoming Twitter API change will break your code. I've added an AutoCursor trait (currently in a developer only release), to deal as transparently as possible with the change. I blogged about it here: http://post.ly/1oKFG After I get some feedback, I'll make any necessary interface changes and make a production release. -Marc I've had explicit cursor / page logic in all my Net::Twitter calls since I started using it - is there any reason to switch to AutoCursor? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] need twitter spam for a research project
On Sun, 3 Apr 2011 18:19:38 -0700 (PDT), Jeff Tucker fred.f.cho...@gmail.com wrote: I'm conducting a research project involving proactively identifying twitter spam accounts before they actually start spamming. I've observed that some spammers attempt to create tweets that look like they're a legitimate account prior to actually sending spam and my project is to be able to identify those accounts as soon as they pop up. Unfortunately (I can't believe that I'm writing this) I am having a hard time getting spammers to actually spam me. Is there any way that I can somehow get access to the tweets of several dozen spam accounts (prior to when they're shut down) so that I can see what they're posting? Is this possible somehow? Also, if anyone gets spammed regularly, are you interested in helping me out with my research? No guarantee that I'll actually publish this, but anyone interested will be credited in my paper in the acknowledgements. Thanks -Jeff Tucker Lecturer, DigiPen Institute of Technology www.digipen.edu I don't know how rapidly Twitter detects and shuts spam accounts down these days. I imagine there's a priority scheme, with accounts linking to malware and pr0n shut down more aggressively than those that are just selling stuff and being annoying about it. Here's a bit of pseudo-code that will get you one class of spammers: 1. Poll the Trending Topics periodically. IIRC if you do it every ten minutes for all the localities you won't use up all your API calls per hour. 2. Do a search for each trending topic - take the first 100 tweets for each. This doesn't cost you any API calls, since it's a search. 3. Now use a relational database to find tweets that match more than one trending topic. There's a high probability those are spam. Quite a few of the other tweets will be spam too, but those that match multiple trends are much more likely to be spam. 4. Now you have a list of accounts - pull their most recent 3200 tweets and test your algorithm. You'll probably have to manually go through them to find the boundary where the account started spamming, but then you should have a nice dataset for a classifier training. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: need twitter spam for a research project
On Sun, 3 Apr 2011 21:34:54 -0700 (PDT), John Sheehan johnshee...@gmail.com wrote: You can use my account as an example. I'm currently getting between 50 and 150 follow spams per day for the last 3 weeks. Here's a graph that demonstrates the 'attack' http://screencast.com/t/xl7zcgdYI If you have any other questions, I'm @johnsheehan and can be reached via email same user name at gmail. John Interesting - most of the followers I've been getting are real humans, not that they're all that interesting humans. ;-) There was a period when I was getting a bunch of followers that were tweeting nonsense, sometimes not even real sentences. Eventually one or two them started to tweet links. Apparently the way they work is to build a network - if one of them follows you and you don't block them, then they copy each other. I suppose it's possible to collect data via the API and do graph theory analysis on these accounts to isolate the clusters, but it hardly seems worth the effort when there are so many accounts just spamming multiple trending topics apparently with little interference from Twitter. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: need twitter spam for a research project
On Sat, Apr 9, 2011 at 2:13 AM, Jeff Tucker fred.f.cho...@gmail.com wrote: Followers tweeting nonsense or just tweeting sentences that just don't quite fit with reality is exactly what I'm hoping to identify. It's easy enough to find a known spammer and block them, but my hope is to identify a spam account before they ever actually send any links. There are certainly some categories of spammers that this approach will not work on, although they are easy enough to detect using other means. I have observed a trend of bots that attempt to appear human and those are the ones that I hope to identify. I will have something completed by about two weeks from now so I'll post with how effective it is. Interesting - I haven't seen that type of bot following me in a long time. Maybe the maker read http://borasky-research.net/2011/02/18/this-is-not-the-blog-post-about-twitter-youre-looking-for/ and put me on a do not follow because he'll send my name to Twitter list. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] #TrollWatcher API app.
Uh ... what's the definition of Troll we are supposed to use? ;-) On Sat, Apr 9, 2011 at 4:30 PM, Quinn quinnmicha...@gmail.com wrote: Hello other Twitter Developers. The other day I had an idea for a little service to monitor trolls. So some code was punched out to monitor a hash tag and the #TrollWatcher service was born. How it works is someone tags (#TrollWatcher) to a tweet and then a system check twitter and then adds any usernames in the tweets to a troll database. Then over time the big trolls on Twitter can be identified. http://twitter.com/TrollWatcher: http://j.mp/TrollWatcher Remember hashtag #TrollWatcher Thanks, and I hope you find it fun to tag trolls. Also I have a #FollowFriday helper app at: http://j.mp/bleuFF Thanks alot, and I hope you enjoy the apps... please share them with your friends too. Quinn Developer @thequinnshow -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Twitter Search API - Questions Regarding Scaling Out
I don't see an answer here, but I'll tell you how *I* would go about implementing this: 1. Switch to the Streaming API. Using Search in an application puts a strain on Twitter's servers and makes it difficult to Twitter to manage capacity. That's why it's rate-limited and why the rate limits aren't publicly disclosed. 2. If your application is a desktop application, use User Streams. If it is a server, use User Streams on a desktop or the low-frequency free access to Streaming on a server to prototype and develop. Your target for a server will be Site Streams, but that's in closed beta at the moment IIRC. 3. *Concurrently with development*, your business development / sales / marketing / planning people, or yourself, if it's a one-person shop, should be negotiating with Twitter for access to Site Streams, I'm assuming an agile development methodology - customer-in-the-loop - and one of the parties that needs to be in the loop is Twitter for Site Streams. You simply *can't* build an at-scale Twitter application without direct business discussions with Twitter! On Mon, Apr 11, 2011 at 8:14 AM, Corey Ballou ball...@gmail.com wrote: I tried speaking with Ryan Sarver directly, but he's forwarding me here to the community advocates to answer. I believe this answer will need to come top down from Twitter, as it's your rate limiting that I'm most worried about. I have a technical question for all of you in regards to the Search API as I want to maintain full compliancy. Currently, the old Search API implementation (albeit slower) provides a fuller result set and allows for more flexibility in the types and combinations of searches allowed. The manner I have developed my application would allow for a number of daemonized worker instances running on different IP addresses to make calls to the search API on behalf of the stored OAuth credentials to avoid rate limiting issues. I had a conversation with the Pluggio developer in which he stated Twitter had threatened to shutdown his application if he didn't switch to a different implementation of the Search API. The problem indicated was that he was performing searches for multiple Twitter accounts, which is exactly my use case. Site streams does not make as much sense for my application given the search queries I wish to perform and the necessity for logical AND operations on geo-location. Do you foresee any problems with my current method of using different IP addresses to stay under the rate limit? I'm trying to stay in full compliance with Twitter's TOS and would love to find the most applicable and API friendly solution. I know headway is being made with Twitter's new search implementation so I would like to stay ahead of the curve and not get myself stuck in a box. I still need a method for polling for new search results (say, every 30 minutes, dependent upon the pricing plan) for non-logged in users. Below is a scaled down representation of how I'm currently handling searches to help you decide the best plan of action: 1) Searches are performed on a rolling queue basis, say one search every thirty minutes. There can be a finite number of searches per Twitter user (say 5 searches per Twitter account). There can be any number of Twitter accounts. 2) Search results are stored locally for retrieval by a javascript AJAX long-poller every minute to check for frequent changes. 3) When a user visits the search results page and filters results, no API calls to Twitter are made, only a local query is required Due to this process, the queue is constantly searching for the next searches and mentions to perform. I foresee rate limiting concerns cropping up with searches being performed for any number of users. Can you steer me in the right direction to avoid shutdown notices or access revocation? Regards, Corey @cballou -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Site Streams beta update
On Tue, Apr 19, 2011 at 11:54 AM, Taylor Singletary taylorsinglet...@twitter.com wrote: Site Streams does not support any of the search/track features of the User Streams, so if your application requires these capabilities, Site Streams may not be the right fit. Some developers have asked for Site Streams access with the misunderstanding that it can provide a greater percentage of the firehose than the self-serve options available to them today -- this is also not the case. I haven't looked at Gnip recently - are the elevated levels of filter access available from them, or do they just sell 1/10 Firehose and 1/2 Firehose? Datasift? Seems to me like you're still going down the two throats to choke path - a user licenses part of the feed directly from Twitter and must license the rest of it from a third party adding value. In my experience that's *not* how enterprises buy stuff - the one throat to choke philosophy is how they *got* to be an enterprise. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Sitebucket: Python based, threaded Site Stream monitor
HootCourse looks nice ... you'll probably end up changing the name, though, unless you've negotiated some terms with the HootSuite folks. ;-) On Sun, Apr 24, 2011 at 1:03 PM, Thomas thomas.welf...@gmail.com wrote: Hi everyone, I've been working on a Python based, threaded site stream monitor that follows the requirements defined at http://dev.twitter.com/pages/site_streams. It's called Sitebucket and it's available on Github: https://github.com/thomasw/sitebucket If you have beta access to the site streams endpoint, you should check it out. I think you'll like it. I've been using Sitebucket in combination with some asynchronous processing magic in production for http://hootcourse.com going on about two months now. It's been working out really well, so I figured it was finally time to share. You can find Sitebucket's full documentation here: http://thomasw.github.com/sitebucket/ Admittedly, she still needs a bit of work. There's a high level to do list at http://thomasw.github.com/sitebucket/todo.html if anyone wants to dive in and help out! If you find any problems or have requests, please submit a ticket https://github.com/thomasw/sitebucket/issues. Thanks, Thomas -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] @Anywhere JavaScript API Status?
On Mon, Apr 25, 2011 at 1:18 PM, Taylor Singletary taylorsinglet...@twitter.com wrote: Hi Dusty, The Javascript API is still undocumented and unsupported -- the only production-ready elements of @Anywhere that are officially supported are the simple basics documented at http://dev.twitter.com/anywhere/begin -- there are a number of developers who can offer some experience-oriented guidance on the @Anywhere mailing list with the extended features at http://groups.google.com/group/twitter-dev-anywhere But anything beyond the features noted on dev.twitter.com are considered internals to the official @Anywhere platform and subject to change at any time. It's not really recommended at this time to pursue this avenue of development and instead to use server-side integrations for anything more complicated than what @Anywhere or Web Intents offer. The document at http://platform.twitter.com/js-api.html was meant to display a snapshot of what could be possible with a JS-centric API but was never meant to be an official platform offering. Taylor It might be time for Twitter's engineering and business development teams to have a pow-wow about API road maps. There has to be a balance struck at some point over how much unsupported and undocumented and experimental work a company as small as Twitter can get away with, given the size of some of the big dogs Twitter runs with these days. Have a look at the names that are above Twitter in the Alexa Top Sites rankings, for example. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Developer Relations and the Twitter Platform
On Tue, Apr 26, 2011 at 10:53 AM, Adam Green 140...@gmail.com wrote: Welcome, Jason. Let me be the first, but certainly not the last to remind you that many of us are not in the Bay area. Since airfares cost much less with 30 days notice, please keep this in mind when announcing developer events. For example, a flight from Boston to SFO costs half as much to fly a month from now rather than 15 days in the future. That is significant. So are lodging costs for conferences in Boston relative to PDX. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Getting users' location
On Wed, Apr 27, 2011 at 9:22 AM, Marcelo Jenisch marc...@inmeta.com.br wrote: Hello everyone, I need to display the location of someone's followers in a map, so he can see the distribution by country of his followers. I couldn't use the location, since it is just a text box where the user can enter anything and it would be pretty complicated to interpret that without some level of error. So my second idea was to use the place info in the user's last tweet, but then I realized that most tweets don't attach such info. So now I'm at a loss. Do I invest time in interpreting the location field, or are there better (easier or more accurate) ways to get such info? It doesn't even need to be down to the city level, as long as I can get a country, it's fine. There are ways you can infer someone's location, but you run the risk of running afoul of privacy laws and terms of service violations for the services you access via APIs or scraping. The correct way to acquire someone's location at any granularity is to *explicitly* ask them for it, *clearly* stating in plain language what they will receive in return. This is a very big deal - just look at all the brouhaha over the iPhone location logging that erupted last week. There's no shortcuts / tricks / games you can play here. You need lawyers and solid business planning. -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
[twitter-dev] Where is the RSS feed link on #newtwiiter?
Maybe I'm just getting old, but I can't seem to find the link for my account's RSS feed on #newtwitter. Did it go away? Is that feed deprecated? It's right where it always was on the old Twitter. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Streaming API JSON Samples
From sample you will receive delete messages. From User Streams you will receive numerous types of events, as well as tweets and DMs. I haven't looked at the documentation recently, but last time I did Twitter was still reserving the right to add message types and recommended you have a code path for message types you had never seen. On Mon, May 2, 2011 at 12:34 PM, Augusto Santos augu...@gemeos.org wrote: Hi Juliano, From filter stream we received just two types of messages: 'status' (tweets itself) and 'limit' (show how many tweets was suppressed since last reconnection). Abraços da UFRGS!! On Sun, May 1, 2011 at 3:40 PM, Juliano Bortolozzo Solanho juliano.sola...@gmail.com wrote: Hello there, Does anyone know of some sort of community maintained repository of message types sent by the Streaming API? With a sample of every known type of json message found in the site/user/filter streams. - Juliano -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- 氣 -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] At Reply Spam
Twitter is supposed to be entertaining and informative. I don't know about all of you, but I got a good belly laugh from discovering this on Louis Gray's blog last night, following the links to some NSFW tweets and then reading the ReadWriteWeb post Marshall Kirkpatrick made on the subject. ;-) Yeah, it's a bad idea IMHO but I did need a good laugh. On Thu, May 5, 2011 at 9:07 AM, TjL luo...@gmail.com wrote: On Thu, May 5, 2011 at 11:45 AM, Arnaud Meunier arn...@twitter.com wrote: Neither our TOS nor our Automation Rules Best Practices (http://support.twitter.com/articles/76915) have changed since the launch of @twittersuggests experimental feature :) I think that's pretty much what I said :) -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] Re: At Reply Spam
It's an @reply spambot, pure and simple. There is no vetting of suggested users - it didn't take either me or Marshall Kirkpatrick long to find a tweeter that was not safe for work in @twittersuggests' stream. It's a bad idea - Twitter needs to quit screwing around with stuff like this and solve problems that keep people with budgets up at night! On Fri, May 6, 2011 at 12:38 AM, Arnaud Meunier arn...@twitter.com wrote: Dewald, These rules apply to third party apps. @twittersuggests is not a third party app, but an experimental feature, developed and owned by Twitter. Now I can also understand this Do as I Say, not as I Do situation can be irritating. But I guess the best thing to do at this point is probably to share your thoughts on the experiment through his dedicated feedback form: https://spreadsheets.google.com/a/twitter.com/spreadsheet/viewform?formkey=dHJ6UnYwdFZ6aHNRRVJoTU1mYl9FMlE6MQ Arnaud / @rno On May 5, 2011, at 11:56 AM, Dewald Pretorius dpr...@gmail.com wrote: Arnaud, That's comforting to know. With that being the case, can you please enlighten us as to why Twitter is apparently violating its own rules, which, as you said, are still in force and we all still are apparently expected to adhere to? Let me help you and quote from your rules the appropriate text: If you are automatically sending @reply messages or Mentions to a bunch of users, the recipients must request or approve this action in advance. Have any of the users targeted by @twittersuggests, which is sending automated @reply messages to a bunch of users, explicitly requested or approved this action in advance? If not, then you may have de facto invalidated that section of your rules and by implication exempted all developers and applications from it. On May 5, 12:45 pm, Arnaud Meunier arn...@twitter.com wrote: Hey Dewald, Neither our TOS nor our Automation Rules Best Practices (http://support.twitter.com/articles/76915) have changed since the launch of @twittersuggests experimental feature :) Arnaud / @rno http://twitter.com/rno On Thu, May 5, 2011 at 6:00 AM, TjL luo...@gmail.com wrote: On Thu, May 5, 2011 at 8:31 AM, Dewald Pretorius dpr...@gmail.com wrote: With reference to @twittersuggests, is other unsolicited @reply spam now also officially sanctioned by Twitter? When has Twitter ever given you the idea that they were playing by the same rules as everyone else? -- Twitter developer documentation and resources:http://dev.twitter.com/doc API updates via Twitter:http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdős -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk
Re: [twitter-dev] A new permission level
-- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos Quoting Matt Harris thematthar...@twitter.com: Hey everyone, We recently updated our OAuth screens to give users greater transparency about the level of access applications have to their accounts. The valuable feedback Twitter users and developers have given us played a large part in that redesign and helped us identify where we can do more. In particular, users and developers have requested greater granularity for permission levels. In response to this feedback, we have created a new permission level for applications called “Read, Write Direct Messages”. This permission will allow an application to read or delete a user's direct messages. When we enforce this permission, applications without a “Read, Write Direct Messages” token will be unable to read or delete direct messages. To ensure users know that an application is receiving access to their direct messages, we are also restricting this permission to the OAuth /authorize web flow only. This means applications which use xAuth and want to access direct messages must send a user through the full OAuth flow. What does this mean for your application? If you do not need access to direct messages: you won’t need to make any changes to your application. When we enforce the new permission level your read or read/write token will automatically lose access to direct messages. If you do need access to direct messages: you will need to edit your application record on https://dev.twitter.com/apps and change the permission level of your application to “Read, Write and Direct Messages”. The new permission will not affect existing tokens which means existing users or your app or service will need to reauthorize. We know this will take some time so we are allowing a transition period until the end of this month. During this time there will be no change to the access Read/Write tokens have to a users account. However, at the end of the month any tokens which have not been upgrade to “Read, Write and Direct Messages” will be unable to access and delete direct messages. Affected APIs and requests On the REST API, Read and Read/Write applications will no longer be able to use these API methods: /1/direct_messages.{format} /1/direct_messages/sent.{format} /1/direct_messages/show.{format} /1/direct_messages/destroy.{format} For the Streaming API, both User Streams and Site Streams will only receive direct messages if the user has authorised an application to access direct messages. Applications that use “Sign-in with Twitter” or xAuth will only be able to receive Read or Read/Write tokens. What this means is only applications which direct a user through the OAuth web flow will be able to receive access tokens that allow access to direct messages. Any other method of authorization, including xAuth, will only be able to receive Read/Write tokens. What will happen when the permission is activated When we activate the new permission, all Read and Read/Write user_tokens issued to third-party applications will lose their ability to read direct messages. Any attempt to read direct messages will result in an HTTP 403 error being returned. For example, a GET request to https://api.twitter.com/1/direct_messages/sent.json will return an HTTP 403 Forbidden with the response body: {errors:[{code:93,message:This application is not allowed to access or delete your direct messages}]} Key Points * If you wish to access a user’s direct messages you will need to update your application and reauthorize existing tokens. * The only way to get direct message access is to request access through the OAuth /authorize web flow. You will not be permitted to access direct messages if you use xAuth. * When we enforce the permission Read/Write and Read tokens will be unable to access and delete direct messages. * Read/Write tokens will be able to send direct messages after the permission is enforced. We’ll be collating responses and adding more information on our developer resources permission model page: https://dev.twitter.com/pages/application-permission-model We have also blogged about this on the Twitter blog: http://blog.twitter.com/2011/05/mission-permission.html Best, @themattharris -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk
Re: [twitter-dev] Introducing the Follow Button
Now I'm getting curious about the road map for @anywhere and all the miscellaneous Twitter plugins, especially for WordPress. Last year, when Twitter announced @anywhere, I tried a couple of plugins before settling on one. What I got from that was hovercards, tweet boxes and follow buttons. A few months later, I discovered that the trips to Twitter servers were slowing down my blog's page loads, so I stopped using @anywhere. Since then, there have been some other JavaScript tools from Twitter, and now this Follow Button. So I've put a follow button on my blog. So far it doesn't seem to be slowing it down, but it's only been up a couple of hours. In any event, is @anywhere deprecated, in favor of the most popular single functions from the collection, like follow buttons? Or are there always going to be multiple JavaScript / HTML widgets and gizmos coming from Twitter that users need to track? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos Quoting Arnaud Meunier arn...@twitter.com: Hey developers, Today we're launching the Follow Button! Similar to the Tweet Button, it's a new widget that lets users easily follow a Twitter account from any web page. The Follow Button has a single click follow experience, simple implementation model, and is configurable to fit the needs of your website. Read our announcement on the Twitter blog, and use the resources below to set up your own Follow Button: - Create a Follow Button here: http://twitter.com/about/resources/followbutton - Detailed documentation: http://dev.twitter.com/pages/follow_button We’ve also added a Javascript layer to our Buttons and Web Intents that makes it possible for you to detect how users are interacting with these tools, and to hook them up to your own web analytics. More details on: http://dev.twitter.com/pages/intents-events We're excited to see how you guys will implement the Follow Button. Let us know what you think, or if you have any questions. Arnaud / @rno -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk
Re: [twitter-dev] Introducing the Follow Button
Thanks!! I'm all in favor of frictionless. Still, I'm struggling now to think of a use case for @anywhere, being mid-way between Web Intents and server-side REST functionality. In fact, I'm struggling to think of a use case for the server-side stuff now. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos Quoting Taylor Singletary taylorsinglet...@twitter.com: Hi Ed, @Anywhere is an effort to provide a client-side authentication authorization flow to Twitter REST API integrations: a simpler, more frictionless experience for common Twitter actions. While @Anywhere meets this criteria, there is obvious room for continued simplification, both for end-users and implementors. @Anywhere applications still require a developer to register an application and the end-user to make additional approvals for that application construct. The Twitter for Websites arm of the Twitter Platform (Tweet Button, Follow Button, and Web Intents) provides integrators with even simpler solutions that don't require API keys. By utilizing the end user's logged in state, the gulf between the user's intention to act and the action being accomplished is bridged. While the Buttons, like @anywhere, use Javascript, the building blocks they use, Web Intents, provide perhaps the most atomic form of frictionless integration: simple URLs that can be linked from any web-enabled context, with or without Javascript. Web Intents and the Tweet Follow Buttons are the best fit for a wide swath of integration points. Deeper integrations are still best serviced by server-side REST integrations or @Anywhere. @episod http://twitter.com/episod - Taylor Singletary On Tue, May 31, 2011 at 3:24 PM, M. Edward (Ed) Borasky zn...@borasky-research.net wrote: Now I'm getting curious about the road map for @anywhere and all the miscellaneous Twitter plugins, especially for WordPress. Last year, when Twitter announced @anywhere, I tried a couple of plugins before settling on one. What I got from that was hovercards, tweet boxes and follow buttons. A few months later, I discovered that the trips to Twitter servers were slowing down my blog's page loads, so I stopped using @anywhere. Since then, there have been some other JavaScript tools from Twitter, and now this Follow Button. So I've put a follow button on my blog. So far it doesn't seem to be slowing it down, but it's only been up a couple of hours. In any event, is @anywhere deprecated, in favor of the most popular single functions from the collection, like follow buttons? Or are there always going to be multiple JavaScript / HTML widgets and gizmos coming from Twitter that users need to track? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos Quoting Arnaud Meunier arn...@twitter.com: Hey developers, Today we're launching the Follow Button! Similar to the Tweet Button, it's a new widget that lets users easily follow a Twitter account from any web page. The Follow Button has a single click follow experience, simple implementation model, and is configurable to fit the needs of your website. Read our announcement on the Twitter blog, and use the resources below to set up your own Follow Button: - Create a Follow Button here: http://twitter.com/about/resources/followbutton - Detailed documentation: http://dev.twitter.com/pages/follow_button We’ve also added a Javascript layer to our Buttons and Web Intents that makes it possible for you to detect how users are interacting with these tools, and to hook them up to your own web analytics. More details on: http://dev.twitter.com/pages/intents-events We're excited to see how you guys will implement the Follow Button. Let us know what you think, or if you have any questions. Arnaud / @rno -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com
[twitter-dev] Is the sample stream still delivering 1% of all public tweets?
I'm just getting back to my code that uses the sample Streaming endpoint. Is that still delivering 1% of all public tweets? -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk
Re: [twitter-dev] trending topics order
How difficult would it be for Twitter to return the tweets per minute by location on Trending Topics? For example, if hockey is getting 100 tweets per minute in Boston, the line for Boston would read boston 100 -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos Quoting Matt Harris thematthar...@twitter.com: Hi, Yes, trending topic responses are returned in the order of most trending to least trending. In the example you give Guille Franco is trending more than Vuvuzela. Best, @themattharris https://twitter.com/intent/follow?screen_name=themattharris Developer Advocate, Twitter On Fri, Jun 17, 2011 at 7:09 PM, xkema kemal...@gmail.com wrote: Hi there Are trending topics results, ordered from most-trendy topic to last trendy? .. .. .. consider a trends node like: trends: [ { name: Guille Franco, url: http://search.twitter.com/search?q=Guille+Franco; }, { name: #honestyhour, url: http://search.twitter.com/search?q=%23honestyhour; }, ... ... ... ... { name: Vuvuzela, url: http://search.twitter.com/search?q=Vuvuzela; } ], Question again: IsGuille Franco most trending and Vuvuzela least trending. (for these ten result) -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk
Re: [twitter-dev] Re: sudden api slowdown
I haven't been doing anything with the REST API recently but I think there was some kind of event on Streaming last night. I don't have the data here but it was about 2011-06-27T05:00:00Z if I remember correctly. I was connected to the sample stream with basic auth if that matters. It looked like a giant spike in tweet rate and it sent the Perl AnyEvent::Twitter::Stream library into deep space. It recovered fairly rapidly, although my machine didn't - I ended up rebooting. ;-) -- http://twitter.com/znmeb http://borasky-research.net A mathematician is a device for turning coffee into theorems. -- Paul Erdos Quoting Nicholas Chase nch...@earthlink.net: On 6/27/2011 6:25 PM, jenny wrote: To make things more exciting, all new site stream connections started returning 401s half an hour ago(9:47utc)... -jenny Check your access tokens; that's what's been happening to me for the last several days, and it comes down to the access key and secret spontaneously changing. (Still waiting to hear on that one...) Nick -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk -- Twitter developer documentation and resources: https://dev.twitter.com/doc API updates via Twitter: https://twitter.com/twitterapi Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list Change your membership to this group: https://groups.google.com/forum/#!forum/twitter-development-talk