Re: [twitter-dev] Deprecation Notice: XML Support on Streaming APIs will be dropped on Dec 6th, 2010

2010-11-08 Thread M. Edward (Ed) Borasky

Hooray!!!

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Taylor Singletary taylorsinglet...@twitter.com:


Hi Developers,

We will end support for XML on all Streaming APIs on Dec 6th, 2010, after
encouraging developers to use JSON-based output formats for some time now.
This deprecation does not apply to the REST or Search APIs, but all clients
requesting XML from stream.twitter.com, regardless of role and method
(sample, filter, follow, etc) will be affected.

If you're currently connecting to an XML-based Twitter Streaming API
endpoint, you'll need to migrate your code to consume JSON by Monday
December 6th, 2010 (approximately four weeks from now). According to our
records, only a very small number of developers are consuming XML via
streams today.

Now would be a good time for streaming clients to verify that they are using
JSON. If you're still using XML, please migrate to JSON as soon as possible.
User/Site Streams implementations should already be JSON-only.

As a reminder, we encourage using OAuth to connect to the Streaming API --
basic authentication, while supported today on stream.twitter.com, will also
be deprecated at a future date.

Please respond with any questions or concerns.

Thanks!
Taylor Singletary
http://twitter.com/episod

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Announcing: Free Open Source Twitter Framework in PHP

2010-11-10 Thread M. Edward (Ed) Borasky
Excellent! You may have finally motivated me to learn PHP, MySQL,  
Javascript and JQuery. ;-) Seriously, though, have you given any  
thought to signing up with SUSE Studio and packaging this up as an  
appliance?


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Adam Green 140...@gmail.com:


I have just published the first version of a Twitter aggregation
database and tweet display framework called 140dev. The code is at:
http://140dev.com/free-twitter-api-source-code-library/

This is written in PHP and MySQL on the server side, and JQuery and
Javascript on the client side. The functionality is pretty basic now,
but I have plans to extend it over time. This code is very heavily
documented, and is meant as a working tutorial for Twitter API
programming.

It uses the Phirehose library to access the Twitter Streaming API and
collect tweets containing a set of keywords, stores the tweets into a
normalized MySQL database, and then returns the most recent tweets as
linkified, formatted HTML. Javascript code in the browser uses Ajax to
load older tweets, and to automatically update a count of new tweets,
as done on Twitter.com. The result is a real-time tweet stream that
can be added to any Web page with a single line of PHP code.

I'd really appreciate any comments you have on this code. It is GPLed
and has a plugin architecture, so if anyone wants to add on to it, let
me know.

- Adam Green
http://140dev.com
140...@gmail.com
@140dev

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Need Help Dumping my Tweets for Analysis

2010-11-11 Thread M. Edward (Ed) Borasky
I have a Perl routine that will dump your most recent 3200 tweets to a  
CSV file. That's the most anyone can get using the API at the moment.  
It's bundled in the Social Media Analytics Research Toolkit, but you  
can find the source in


https://github.com/znmeb/SUSE-Studio-Appliances/blob/master/SMART-at-znmeb/Desktop/Demos/Tweets/Tweets.pl

and

https://github.com/znmeb/SUSE-Studio-Appliances/blob/master/SMART-at-znmeb/Desktop/Demos/TwitterUtilities.pm

It doesn't use authentication, so it only gets 150 API calls per hour.  
It's based on Marc Mims' Net::Twitter::Lite.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Sarah K sarahannal...@gmail.com:


Hi,

First, let me start by apologizing for asking a question that I know I
could answer for myself with enough googling, or simply implement
myself by studying the API docs. I would do so... if I could. But
that's kind of difficult for me right now.

The question: can someone point me to a tool, or piece of sample code,
that can dump all my tweets into a text file? Or at least, the last
several months worth? Preferably Java or Python code.

The reason: I may have had a small, silent heart attack about mid-
September. And, strangely enough, my tweets at the time might help my
doctor and I pinpoint the approximate date of the incident, because
I sometimes tweet about my exercise habits. But I need the tweets all
in a pile I can sort through easily.

Unfortunately, given that I'm still feeling very unwell, I just don't
have the energy to figure out how to get my historical tweet data in a
form that would help me do this analysis, or to write the code myself
to do so.

Can anyone help me out with this? Somebody must have a tool to do
this, right? Something that just dumps all my tweets into a plain text
file, respects the API rate limits, etc?

Thanks for any help you can offer. If I wind up needing to make any
mods to open source code, I'll be more than happy to share any changes
I make, if appropriate.

Sarah K

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Best way to set up data analytics service. Firehose stream?

2010-11-15 Thread M. Edward (Ed) Borasky

Quoting Incredicorp mail...@gmail.com:


Goodmorning,

I am of course not talking about the business side of things-  however
I am searching for solid information regarding the following.

- We want to access as much public tweets as possible (for a 3 man
startup working on userfriendly analytics apps) - Do I understand
correctly that access to the firehose stream would provide us with the
necessary data- and is getting access to that stream feasible (for a
startup)?


The Firehose Stream will provide you the most data you can get outside  
of Twitter. It consists of all public tweets from users deemed not to  
be on Twitter's list of low quality users. It may not have  
everything necessary to satisfy your customers' needs, but it's  
literally all you can get without being Twitter or having some other  
arrangement (like a court order.) ;-)


Is getting the Firehose feasible for a startup? At one time Twitter  
had a program for that and I don't recall a public announcement that  
the program had been cancelled, so unless Twitter is ready to state  
otherwise, I'd say it's feasible. But it's a case by case basis, so  
send them a private email.


- Any best practices people would like to share? Most 'knowledge'
would be inferred using keywords.


If you *know* up front the keywords, rather than connecting to the  
Firehose and doing all the filtering yourself, you should connect to  
one of the Filter streams. If you're finding the keywords from a  
statistical sample of tweets, you may be able to get a big enough  
sample using a Spritzer or Gardenhose level sample rather than the  
full Firehose.


Another way to make your life easier would be if you have a list of  
*users* that generate a representative sample of the tweets you wish  
to analyze. The Follow, Shadow or Bird Dog filters will let you  
collect all of the tweets from a set of users. IIRC you can follow  
at least 5000 users this way.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter Psychological Personality Profiling

2010-11-16 Thread M. Edward (Ed) Borasky

Before going too far down this path, you might want to take a look at

a. The research of Dan Zarrella (@danzarrella) at HubSpot. He's done  
some extensive research in this area and most of it is publicly  
available for free (well, you *do* have to get into their email  
contact database)
b. The various Twitter ranking services, like Twitalyzer and Klout.  
They have lists and searchable databases of high ranking Twitter  
users that collect most of these statistics automatically, and have  
APIs you can subscribe to.



--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Ciarán ciaran.mac.mathgham...@gmail.com:


Hi

I hope I'm not posting this in the wrong area, as I haven't posted
here before and am not a developer. I am a lecturer and researcher at
Dublin Business School and I've tried to find what I'm looking for
elsewhere, but so far haven't found what I need. I reckon this is
fairly straightforward, but I'm not a coder, so I don't know. If you
think you can do this, please email me with a quote

I need help with a project I'm trying to get off the ground - I'm a
research psychologist with a special interest in social networking.
Basically, I want to look at the personality profile of Twitter users.
This has been done before with Facebook, but with self-reporting of
usage data.

I want an app which will, with the user's permission, produce their
overall statistics:- e.g.
number of followers, following, listed, tweets, date joined, number of
@replies, #hashtags, retweets, and links.

This will form part of an online survey which will also include
personality and other psychological measures (for more information see
http://www.ciaranmcmahon.ie/psychbook/social-network-profiling-project/).
The basic idea is to see if there is a relationship between
personality traits and actual Twitter usage.

For example, I'm interested in things like the personality differences
between the average Facebook and Twitter user, what types of people do
or don't retweet or provide links - that type of thing


Any help or advice would be greatly appreciated,



Thanks,



Ciarán

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] URGENT: Advice on building the correct API stream

2010-11-16 Thread M. Edward (Ed) Borasky

Quoting Tom van der Woerdt i...@tvdw.eu:


If the only thing you want to do is follow the tweets of some users,
your best option is the filter stream.


Yep - you now get 5000 users from 'filter' without applying for  
elevated access, and many more if you qualify for elevated access. In  
addition, 'filter' currently works with basic authentication as well  
as oAuth.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Twitter + Gnip Partnership

2010-11-17 Thread M. Edward (Ed) Borasky
Ryan, what about User Streams? I'm building something around User  
Streams but it is a non-display analytics application. Am I at risk  
for Twitter inserting another business into *my* data stream as well?  
And I'm curious how some of the other Streaming consumers are going to  
react to insertion of a monopoly middleman into their data source. I  
briefly dealt with Gnip a while back and found their API hard to use  
and their pricing exorbitant.

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Ryan Sarver rsar...@twitter.com:


Dewald,

The basic levels of all of the streaming APIs -- Spritzer, Follow,
Track -- will remain open, free and direct from us. Elevated levels
for non-display use will be served through Gnip.

Hope that answers the question.

Best, Ryan

On Wed, Nov 17, 2010 at 5:44 PM, Dewald Pretorius dpr...@gmail.com wrote:

Ryan,

The Gnip blog post states:

[QUOTE]Twitter Decahose. This volume-based product is comprised of 10%
of the full firehose. Starting today, developers who want to access
this sample rate will access it via Gnip instead of Twitter. Twitter
will also begin to transition non-display developers with existing
Twitter Gardenhose access over to Gnip.[/QUOTE]

How does this affect the basic statuses/sample method of the Streaming
API? Are you discontinuing it? If so, when?

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:  
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk




--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Twitter + Gnip Partnership

2010-11-17 Thread M. Edward (Ed) Borasky
I quite frankly don't see *any* economic value in a downsampled  
Firehose. Why should *anyone* pay Gnip for 10% or 50% of the Firehose  
when they can negotiated *directly* with Twitter for the whole Firehose?

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Dewald Pretorius dpr...@gmail.com:


The minimum Gnip charge is $500 per month, with a minimum of a year
contract, if you want to use Gnip in a production application.

And that's before the -- still unknown -- additional access charges
for the Twitter feeds.

You can't use Gnip in a production application if you are not an
incorporated business, so that excludes access for many developers,
even if they can afford the charges.

Maybe there's a secondary market here, for an incorporated business to
provide access for one-man developers to Gnip data for a fee. Meaning,
Reseller Inc subscribes to Gnip and gets the data feeds, and resells
them to one-man developers. I haven't checked Gnip's TOS to see if
that's expressly prohibited.

On Nov 17, 2:51 pm, M. Edward (Ed) Borasky zn...@borasky-
research.net wrote:

Ryan, what about User Streams? I'm building something around User  
Streams but it is a non-display analytics application. Am I at risk  
for Twitter inserting another business into *my* data stream as well?  
And I'm curious how some of the other Streaming consumers are going to  
react to insertion of a monopoly middleman into their data source. I  
briefly dealt with Gnip a while back and found their API hard to use  
and their pricing exorbitant.
--
M. Edward (Ed) Boraskyhttp://borasky-research.nethttp://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Twitter + Gnip Partnership

2010-11-17 Thread M. Edward (Ed) Borasky

Quoting Ryan Sarver rsar...@twitter.com:
On Wed, Nov 17, 2010 at 12:27 PM, Shannon Clark  
shannon.cl...@gmail.com wrote:

Will companies that license the data be allowed to, in turn, sell services
on top of that data - i.e. will this spark a new generation of products such
as Scout Labs (now Lithium) or other analytics tools which are built by
companies who have negotiated for full or partial firehose access but which
are then used by clients of those companies each of whom will configure
different queries and searches to monitor?


Companies can definitely build and sell products based on the analysis
of the data. A major market for this move is the Social Media
Monitoring (SMM) market and we expect that to grow.


As I've already noted, I don't see the economic / business sense in  
paying a monopoly middleman for downsampled Firehose when the full  
Firehose is directly available via negotiation with Twitter. IMHO, if  
you've got the brains and infrastructure to create social media  
monitoring business value from 10% or 50% of the Firehose, it's easy  
to scale that up to 100% of the Firehose. If you don't, well, you're  
one of the 95 percent of businesses that fail because *you* made a  
wrong decision.


While I haven't paid much attention to the social media monitoring  
market recently, what I've seen for much of 2010 is consolidation -  
big companies like IBM buying smaller ones with *solid* business  
models. What I *haven't* seen in social media monitoring / analytics  
is small nimble startups becoming successful with minimum viable  
products.


Social media monitoring is a difficult business to be in, *especially*  
at the data rates Twitter delivers and the unnatural aspects of  
Twitter linguistics. The sales cycle for social media monitoring tools  
is long and arduous, and, IMHO, Facebook, Flickr and YouTube data are  
immensely richer and easier for marketers to explore and exploit than  
Twitter data.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Twitter + Gnip Partnership

2010-11-17 Thread M. Edward (Ed) Borasky

Quoting John Kalucki j...@twitter.com:


Every search engine, social network, blogging platform, content aggregator,
and to a certain extent, every used book store and used record store...


Except that digital content producers can block search engines if it's  
in their economic interests to do so. I'm not sure how that's working  
out in Murdoch vs. Google, but at least it's been examined. ;-)


For that matter, some news organizations have imposed strict rules  
on how and when they may use Twitter.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos



--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] URGENT: Advice on building the correct API stream

2010-11-18 Thread M. Edward (Ed) Borasky

Quoting Adam Green 140...@gmail.com:


In general, if you are planning on capturing *all* tweets for a set of
words or users, and *never* losing any, you are setting an impossible
goal. Aiming for a very high level of accuracy is all you are going to
achieve. With the right coding 99% or better is possible.


Perhaps Gnip will be able to supply 99.9% or 99.99%. They've certainly  
got the infrastructure, according to Pete Warden's writeup in RWW  
(http://www.readwriteweb.com/hack/2010/11/why-is-twitter-partnering-with-gnip.php) I wouldn't bet on five nines, though.  
;-)


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Failed to validate oauth signature and token

2010-11-19 Thread M. Edward (Ed) Borasky
The server administrators can and should sync server clocks  
automatically to the world time clocks using Network Time Protocol  
(NTP). If your IT department isn't doing this, find out why not.  
Most likely they don't know it's possible. It's pretty easy on Linux  
and Windows, but you do need an Internet connection to the outside  
world, so the firewall folks need to be involved and you have to make  
sure your server-side NTP software is kept up to date on security  
patches.

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting computerzworld meat2...@gmail.com:


Thanks for your reply. Is there anyway to sync server clock
programatically? Or any other way by which we can make the stuff
working? Because I don't have access to server hardware.

On Nov 12, 12:28 am, Abraham Williams 4bra...@gmail.com wrote:

Your servers clock needs to be properly synced using NTP.

http://en.wikipedia.org/wiki/Network_Time_Protocol

Abraham
-
Abraham Williams | Hacker Advocate | abrah.am
@abraham https://twitter.com/abraham | github.com/abraham | blog.abrah.am
This email is: [ ] shareable [x] ask first [ ] private.

On Thu, Nov 11, 2010 at 05:36, computerzworld meat2...@gmail.com wrote:
 Hello,
            I am using Twitter Oauth library for signing in to Twitter
  getting access token for posting tweets programatically. But when I
 am trying to run the application on my server it is giving me error
 like

 Failed to validate oauth signature and token

 I tried to move the application on another server  it is working. So
 what should be the problem behind this? Is there any configuration
 required for the server in order to make this work? Please help me.

 Thanks in advance.

 --
 Twitter developer documentation and resources:http://dev.twitter.com/doc
 API updates via Twitter:http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
http://groups.google.com/group/twitter-development-talk


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Help needed - using data to create a spreadsheet with user characteristics

2010-11-20 Thread M. Edward (Ed) Borasky
Do you have a budget to get this done? This looks like fairly simple  
custom code using the REST API from any number of scripting languages.  
My Social Media Analytics Research Toolkit has some Perl scripts that  
will dump a list of a Twitter user's contacts (followers + followings)  
and a Twitter user's most recent 3200 tweets in CSV format. Given the  
small number of users you're tracking about, it wouldn't be that  
difficult to make a driver script to automate your reports.


My scripts are on Github at

https://github.com/znmeb/SUSE-Studio-Appliances/tree/master/SMART-at-znmeb/Desktop/Demos/
--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting rogerdodger rl_wh...@hotmail.com:


Hi folks - I'm a user rather than a developer so not even sure I
should be here.  If I need to head off somewhere else let me know
where but my attempts to find what I need on the bit of the Twitter
site dealing with APIs has foundered on jargon (theirs) and ignorance
(mine).

What I'd like to do is download data to an Excel spreadsheet about a
sub-set of Twitter users on a regular (probably monthly) basis.  For
each of the set of users (about 250 at present, maximum of 500/660 as
more of them - they're a finite number of public organisations - start
tweeting) I would like to export on a set day each period the four
counts shown on the user profile i.e.

No. Tweets
No. following
No. followers
No. listed.

Once I've got those four data items into a spreadsheet I intend to
produce tabular and graphical summaries of activity for individual
users and for the whole set of users, showing trends over time.

I could obviously visit each user's profile and cut and paste the data
but life is short.  Is there something that will allow me to do this
automatically without becoming the technical expert I will never be.

My thanks for any help received.

Roger

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter + Gnip Partnership

2010-11-21 Thread M. Edward (Ed) Borasky

Quoting Ryan Sarver rsar...@twitter.com:

Many of you may wonder what this means for elevated access and
whitelisting requests. Our default levels like Spritzer, Follow and
Track will not be changing, and will remain free and available
directly from Twitter. Companies and developers are encouraged to
begin development with these free APIs, available at
http://dev.twitter.com/pages/streaming_api.


Is Spritzer still 1% of the Firehose? Since the status IDs are no  
longer sequential, the previous obvious sampling algorithm - status  
ID mod 100 == 0 - no longer will work.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos



--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter + Gnip Partnership

2010-11-22 Thread M. Edward (Ed) Borasky

Quoting Ryan Sarver rsar...@twitter.com:


Spritzer is currently at 1% of the Firehose, but as the docs say it's
subject to change without notice


Given the Snowflake algorithm, how can a program consuming Spritzer  
determine whether a Spritzer rate change has happened because


a. People are tweeting at a different rate, exclusive-or
b. Twitter has changed the proportion of Firehose being sent to Spritzer?

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos



--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] historic trend data 10 days old

2010-11-22 Thread M. Edward (Ed) Borasky
I've seen a few hints of the analytics product and know a fair number  
of people who do that sort of thing for a living. I think they're  
*not* obsessed with the past at all - their wet dream is very much  
like what Wieden and Kennedy and a whole host of partners did this  
summer in real time with Old Spice.


That's the future of Twitter / social media / advertising: teams of  
creative, legal, copy writers, production and analytics people huddled  
around control panels, analytics dashboards, video studios, phone  
banks, etc. It's a bit like mission control for a shuttle launch -  
only if something goes wrong do people look at the past. And mobile /  
iPad / places is going to make it even more real-time.

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Adam Green 140...@gmail.com:


Yes, but advertisers and sales people are obsessed with the past, and
they provide the dollars that will make Twitter grow. We'll see where
this leads Twitter. I bet they follow the money. Google did, and it
worked out OK. :)

On Mon, Nov 22, 2010 at 9:41 AM, Taylor Singletary
taylorsinglet...@twitter.com wrote:

I can't really speak much on the topic of the analytics tool. I can say that
you'll find most everything in Twitter is focused on real-time -- whether
it's search results, the tweets available for a given user timeline, or the
general structure and emphasis presented by our UI. There's not much on
Twitter that allows one to dwell on the past.
Taylor

On Mon, Nov 22, 2010 at 6:26 AM, Adam Green 140...@gmail.com wrote:


Taylor, there has been much talk lately about the new Twitter
Analytics tool that would deliver historical data. Am I correct in
assuming that this is built on an internal API, and that this API will
be surfaced eventually for use by us developers?

On Mon, Nov 22, 2010 at 9:20 AM, Taylor Singletary
taylorsinglet...@twitter.com wrote:
 Hi James,
 You'll find that, in most cases, the data available for a trend is
 limited
 by the amount of data provided by the Search API. While this goes back
 around 10 days currently, there have been times when less was available.
 Some day we hope to provide more historical data.
 Taylor

 On Sat, Nov 20, 2010 at 1:24 PM, James Chivers jchiv...@gmail.com
 wrote:

 I'm trying to dig out some hourly trend data from the Twitter API
 using the trends/daily call with the associated date that I'm looking
 for, but I'm not able to go back in time more than ~10 days.

 Is there any way that I'm able to grab the hourly trend data given a
 date  10 days from the API?

 Thanks in advance,

 James

 --
 Twitter developer documentation and resources:
 http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk

 --
 Twitter developer documentation and resources:
 http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk




--
Adam Green
Twitter API Consultant and Trainer
http://140dev.com
@140dev

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk



--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Date format changed on DMs?

2010-11-23 Thread M. Edward (Ed) Borasky
There's a third date format for tweets returned by the Search API.  
Time for me to check my parsers again. There's a Perl module that will  
literally parse any imaginable date format, but it's hopelessly slow  
for the kind of volume Twitter delivers.

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Rich rhyl...@gmail.com:


It appears on normal timelines the created_at field is Wed Mar 25
22:04:55 + 2009
On DMs it's now formatted Tue Nov 23 16:47:09 UTC 2010 which causes a
number of parsers to fail if they are looking for offsets rather than
timezone codes.



On Nov 23, 4:41 pm, Rich rhyl...@gmail.com wrote:

Has the default date response format changed on DMs, they aren't
parsing the same now?

Some notification might be nice?


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-26 Thread M. Edward (Ed) Borasky
Hmmm ... Twitter has a user quality filter that's supposed to weed  
out spammers from Search and Streaming. At about 450,000 new user IDs  
created every day, it might take a while for Twitter's spambot  
detectors to flag them all, but I'd think between algorithms and  
crowdsourced block / report, eventually they'd get taken out.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Adam Green 140...@gmail.com:


As long as you aren't trying to capture and deliver *all* tweets,
there are a couple of good ways to cut out spammers. One thing I do is
save all mentions for all users in a database of tweets. When a tweet
comes in from the streaming API, I collect @mentions, and store them
with the screen name of the tweet's author and the screen name
mentioned. Then I can rank users based on the number of different
accounts that mention them. If you only use the tweets from the top N%
of users, the quality improves a lot. I find that the top 80% is
usually enough of a screen to get good quality.

Another trick is blocking duplicates from each user. The API only
blocks duplicates that repeat immediately, but if a spammer has a list
of tweets, and cycles through them, all the tweets get through. I
compare all new tweets with the other tweets from that user. This is
very expensive if you have a big database. This can be made less
intensive by limiting the comparison to just the tweets from that user
in the last few days. You can also run this with a separate process
that doesn't slow down you main tweet parsing loop. Most spammers are
so simplistic that they just repeat the same tweet over and over. In a
real spammy set of keywords, if I find more than a few duplicates from
a user, I just stop saving their tweets.


On Fri, Nov 26, 2010 at 11:26 AM, Furkan Kuru furkank...@gmail.com wrote:


Word lol is the most common in these spam tweets. We receive 400 spam
tweets per hour now tracking 100K people.

We plan to delete all of the tweets containing lol word. It is also used
by our users (Turkish people) writing in English though.

Any better suggestions?



--
Adam Green
Twitter API Consultant and Trainer
http://140dev.com
@140dev

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Getting tweets from users following a particular user

2010-11-29 Thread M. Edward (Ed) Borasky

Quoting Louis louis...@gmail.com:


I'd like to stream tweets from the set of users which follow a
specific user. Is there a way to do this directly, or a way to get a
list of such users, so I can then specify to filter tweets from them
only?


It depends on how many followers the user has. Up to 5000, you can do  
it with the follow parameter either on the filter Streaming  
endpoint or on User Streams. Over 5000, you will need to get elevated  
access via Gnip.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Differences between trends and trends/current??

2010-11-29 Thread M. Edward (Ed) Borasky
I'm starting to write some code that uses the trends portions of the  
API. I notice that there are two similar endpoints, 'GET trends and  
GET trends/current. They look pretty much alike in the  
documentation, except for a minor format difference in the returned  
JSON. However, if I actually use the Try it option, it looks like  
GET trends/current returns more information.


Given that my application is a data collector, I'd obviously prefer  
more information and plan to code using GET trends/current. Is this  
just a documentation glitch, or is the new format from GET  
trends/current an undocumented feature that might disappear?


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Differences between trends and trends/current??

2010-11-30 Thread M. Edward (Ed) Borasky
Thanks!! I'm also looking at the local trends API - there seems to be  
a world-wide endpoint there (WOEID=1) and the documentation there  
indicates that there's a caching frequency of five minutes. So that's  
probably what I'll go with.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting Taylor Singletary taylorsinglet...@twitter.com:


Hi Ed,

trends/current is the most appropriate and informationally dense end point
and will stick around.

Taylor

On Mon, Nov 29, 2010 at 7:24 PM, M. Edward (Ed) Borasky 
zn...@borasky-research.net wrote:


I'm starting to write some code that uses the trends portions of the API.
I notice that there are two similar endpoints, 'GET trends and GET
trends/current. They look pretty much alike in the documentation, except
for a minor format difference in the returned JSON. However, if I actually
use the Try it option, it looks like GET trends/current returns more
information.

Given that my application is a data collector, I'd obviously prefer more
information and plan to code using GET trends/current. Is this just a
documentation glitch, or is the new format from GET trends/current an
undocumented feature that might disappear?

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul
Erdos





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk



--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk






--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] whitelist Approval refusal!!!!

2010-12-02 Thread M. Edward (Ed) Borasky
This looks like something you could implement using the Streaming API,  
using REST and Search to fill in the missing pieces. If you're working  
in PHP, have a look at Adam Green's open source library at  
http://140dev.com/free-twitter-api-source-code-library/ and the  
Phirehose library.


--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


Quoting moneekun minsu8...@gmail.com:


Why the approval is not but I don't know ㅜㅜ
continuous  refusal
Nothing answer back !
Did my application form go wrong?
help me!!


(Application Form)
@fcsearch

This is company of Korea operating portal website name of
freechal.com
We offering news, video, blog, mail, game, p2p and search engine.

We are interested in your twitter service it means we prepare to use
that service from December of 2010.

We would like to display same keyword that result of tweets, ids, and
profile images from twitter when users searching some words.

This service has already provided by many websites of Korea (Naver,
Daum, Nate, etc.) and they permitted white list by twitter. Also we
are developing to provide that service such as other websites.

It is going to be updated as often as we can also we will save data
that Koreans wrote during the latest 3days.

To provide near real-time services, we are using the REST API, the
data is cached.
‘Oauth’ will be used for authentication, ‘twitter4J’ library is
expected to be used.
In this process we expect 3,000 requests per an hour the number of API
calls that means it will be exceed API Limit. In that reason, we want
to white list the IP address and to reduce collection cycle of
tweets.

We expect that will be very important part of our new service, it’s
going to open December of this year.
Kind Regards,

The features in current use are as follows: Data for example.

Features
1) Request for the all Korean users following information,  Their
twitts : friends_timeline(Real-time)
2) Request for the all Korean user IDs, status(image data, etc.) :
statuses/friends

--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:  
http://groups.google.com/group/twitter-development-talk





--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] XML disabled on Streaming API

2010-12-06 Thread M. Edward (Ed) Borasky

Quoting John Kalucki j...@twitter.com:


As previously announced, XML has been disabled on the Streaming API. The few
remaining consumers should move to JSON, and bid the year 2003 adieu.


Sigh ... anyone want to buy a used but serviceable 56K modem? ;-)

--
M. Edward (Ed) Borasky
http://borasky-research.net http://twitter.com/znmeb

A mathematician is a device for turning coffee into theorems. - Paul Erdos


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Mulitple Trending Topic Spam

2010-12-15 Thread M. Edward (Ed) Borasky
How difficult would it be to modify the Search response to a search for a
Trending Topic so it returned tweets that only matched the searched-for
topic? In other words, if a tweet matches more than one Trending Topic,
don't show it in the search.

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Chrome/Chromium vs. Firefox for Promoted Trends and Accounts

2010-12-17 Thread M. Edward (Ed) Borasky
I just noticed something last night - when I browse Twitter with Firefox
3.6.12, I see the Promoted Trends and Promoted Accounts. But when I browse
with Chrome 10.0.612.1 dev I don't. This may be some ad blocker setting - I
haven't dug into that yet. But is there a generic reason why I wouldn't see
them in Chrome?

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Chrome/Chromium vs. Firefox for Promoted Trends and Accounts

2010-12-17 Thread M. Edward (Ed) Borasky
On Fri, 17 Dec 2010 11:33:46 -0800, M. Edward (Ed) Borasky
zn...@borasky-research.net wrote:
 I just noticed something last night - when I browse Twitter with Firefox
 3.6.12, I see the Promoted Trends and Promoted Accounts. But when I
browse
 with Chrome 10.0.612.1 dev I don't. This may be some ad blocker setting
- I
 haven't dug into that yet. But is there a generic reason why I wouldn't
see
 them in Chrome?
 
 -- 
 http://twitter.com/znmeb http://borasky-research.net
 
 A mathematician is a device for turning coffee into theorems. -- Paul
 Erdős


OK - disabled AdBlock in Chrome and it still doesn't show Promoted Trends
or Promoted Accounts. This is openSUSE Linux 11.3 on a 64-bit machine, BTW
- sorry I don't have something more vanilla. ;-)
-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Site stream unfollow event

2010-12-18 Thread M. Edward (Ed) Borasky
On Sat, 18 Dec 2010 07:25:55 -0800, John Kalucki j...@twitter.com wrote:
 We'd like to help developers maintain a local copy of their authorized
 users' followings -- the accounts that their users follow. We hope to
 enable
 a feature that will make this easier in early 2011.
 
 We're not particularly interested in helping developers maintain the set
of
 an account's followers. There are awful scaling issues involved here,
 vectors for spammy behavior, and generally not much value for end-users
in
 providing this data. Twitter is mostly about who you follow and what you
 are
 interested in. Who is following you is becoming less and less relevant.

Long ago in a Chirp far away, one proposed feature of commercial
accounts was that if you had a commercial account, someone who was
following that account could send you a DM if they were following you, even
if you were *not* following them. This assumed some kind of sales /
customer service use case, I'm guessing. Now that it seems like commercial
accounts, or at least an advertising sales form and analytics for paid
advertisers is in place, is that I must be prepared for DMs from any of
the millions of people who follow my brand feature still part of the
package? Do big paying advertisers like Dell or Best Buy actually want
something like that? Would it be a scalability nightmare for Twitter?

Speaking of vectors for spammy behavior, Marshall Kirkpatrick of Read
Write Web reports that 40% of the Amazon Mechanical Turk task requests are
for spamming or spam enablement activities, like opening accounts to
services that have a CAPTCHA gate and posting blog comments.
(http://www.readwriteweb.com/archives/study_40_of_new_mechanical_turkers_work_requests_a.php)
Heck, for all I know, those Hey, look at this! tweets with multiple
Trending Topics are being posted by the same Turk folks that are opening
the account in the first place instead of by bots. Perhaps it's time for
someone at Twitter and someone at Amazon to have a little chat. ;-)

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Storing twitter stream public timeline, conversations and hashtag search!

2010-12-19 Thread M. Edward (Ed) Borasky
On Sun, 19 Dec 2010 13:19:03 -0800 (PST), imbenzene imbenz...@gmail.com
wrote:
 Myself an 2nd year undergrad and I am running a minor research project
on 
 twitter analysis.
 I need to urgently* collect tweet streams for certain users and streams
by 
 searching hashtags*. I am completely neo in this development side, with
no 
 previous knowledge of scripting and Mysql, python or databases. Any 
 suggestions with what to start from beginning will be highly
appreciated, 
 and what shall i start studying, online tutorials and all if available 
 online. I have TWITTER API by Kevin Makice but its too confusing without

 prior knowledge. I have created the mysql database with phpmyadmin, and 
 created the required 6 tables but its not reading the scripted php codes
 to 
 download tweets, errors are creeping in and bugging my head.
 In the previous posts it was mentioned something about *certain websites

 doing this job and and allowing to export data as whole* I am in urgent
 need 
 for one, I know one was 140kit.com which is not working these days. In
the 
 end I have to just put the collected data into data mining tools like
Weka 
 or Tableau public 6.0 and run for visualisations. Web is tooo blogging
in 
 sense what shall i start with python, JSON, scala or run a php code for
 it( 
 if possible suggest tutorials for neo's),
 Plus will i have to run my laptop full on for week something for
 streaming? 
 Please help me out as my deadline is just coming up right this week. Any

 help so that I can make it fast and quick without going through much of 
 gross work, is appreciated.
 Is there any *online resource paid or unpaid available which can do this

 work of just collecting tweets for certain hash tags over a period of
time 
 and deliver collected data *in desired format with location, and time
tags
 ? 
 thanks a ton in advance! Reply please its very urgent.

Try TwapperKeeper.com. The code is open source if you want to run it
yourself, but you should be able to just create a hashtag archive for each
hashtag and then download the results.
-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] t.co Posting Questions

2010-12-20 Thread M. Edward (Ed) Borasky
On Mon, 20 Dec 2010 10:21:32 -0800, David E. Wheeler
da...@kineticode.com wrote:
 On Dec 20, 2010, at 4:16 AM, Emil Tullstedt wrote:
 
 As for bit.ly, there is an API for bit.ly which aids you in using
 URL-shortening until t.co is finished..
 
 Yeah, but it's rate-limited. I'm using http://s.coop/ for now. Dead
simple.
 
 Best,
 
 David

*All* services are rate-limited and *none* are free. ;-)
-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Help!! please. How to collect old data by Twitter API

2010-12-24 Thread M. Edward (Ed) Borasky
On Fri, 24 Dec 2010 18:53:12 +0100, Tom van der Woerdt i...@tvdw.eu
wrote:
 I'll be simple: you can't achieve this with the Twitter API.
 
 Maybe other APIs can help you, but I don't know one.
 
 Tom

There are some services that have indexed tweets for more than Twitter's
default of seven days. I don't recall the names, though.

 
 
 On 12/24/10 6:13 AM, Chris Bang wrote:
 I’m developing a program to collect historical data or twits from
 Twitter using Twitter search API and Twitter4J which means the program
 is based on Java.
 I selected Search API for my program among APIs by Twitter. However,
 Twitter says that there is a limitation of 7days, although the limit
 depends on topic. Is there any way to collect older or historical
 Twitter data like 12 or 24 months old or without time constraint at
 all? If anybody successfully retrieved old Twitter data, can you
 please share the source code?


-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Exposing IP addresses for legal threats

2011-01-04 Thread M. Edward (Ed) Borasky
On Tue, 4 Jan 2011 14:49:59 +, Scott Wilcox sc...@dor.ky wrote:
 No, there is no API methods to access IP addresses for tweets. I'd
suggest
 contacting local law enforcement and taking it from there.

Actually, if the victim can afford it, I'd suggest seeing an attorney
before contacting law enforcement. Law enforcement tends to be overworked,
have pressing priorities and need evidence of an actual crime as defined in
their jurisdiction before they'll take any action in most cases. Law
enforcement represents the people more or less as a whole, while an
attorney can and will act on behalf of an individual victim or class of
victims, if the alleged offender is threatening more than one person. In
any case, good luck to him or her - cyberbullying is nasty stuff.

 
 Scott.
 
 On 4 Jan 2011, at 14:39, Felipe Knorr Kuhn wrote:
 
 Hello everyone,
 
 Although this is probably not the best list to discuss this, perhaps
you
 guys have some experience to share.
 
 A friend of mine is being threated by a Twitter user via DMs and public
 messages.
 
 He doesn't know the identity of the user and thought about tracking him
 via the IP he uses to post to Twitter.
 
 The API does not expose IP addresses, does it?
 
 He lives in Brazil and believed he could contact the ISP to track the
 user, since filing an international lawsuit to Twitter asking for this
 information and only then contact the ISP would be very time and money
 consuming.
 
 Thanks,
 
 FK
 
 -- 
 Twitter developer documentation and resources:
http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk
 
 
 Scott Wilcox
 
 t:+44 (0) 7538 842418 
   +1 (646) 257 0580
 e:sc...@dor.ky
 w:http://dor.ky

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: ~25% loss rate Streaming API vs. Search API

2011-01-09 Thread M. Edward (Ed) Borasky
On Sun, 9 Jan 2011 14:29:12 -0800 (PST), Brian Maso 
br...@blumenfeld-maso.com wrote:
What I did is opened up three separate normal browser tabs in 
Firefox,

each using the Twitter search web interface to search for three
different hashtags (#ces, ces11, and nfl -- examples of three
tags that should have decent ongoing traffic).

At the same time I have an application capturing tweets from the same
three hashtags using the streaming API (filter.json?
q=#ces,#ces11,#nfl, with appropriate URL encoding).

Irregardless of the amount of time, the streaming application 
captured
about 25% fewer tweets. Detailed analysis of the tweet IDs captured 
by

the browsers vs. those captured by the standalone application
retrieving tweets via the streaming API verified that there were
tweets delivered through the browsers that did not appear through the
streaming API. There were no tweets delivered through the streaming
API that did not also appear in the set of tweets delivewred through
the browsers.

I would love it if anyone else would try a similar experiment and
report back results. Maybe I'm doing something wrong, or maybe this 
is
an anomaly, or maybe the streaming API just doesn't capture as much 
--

impossible for me to say.

I note that the streaming API documentation doesn't claim an intent 
to
match accuracy with the search API (nor vice versa). At this point 
I'm

thinking to get the greatest accuracy I should be collecting tweets
from *both* APIs.

Brian Maso


Did you just recently start running these tests? Specifically, did you 
run any tests / notice discrepancies *before* Twitter threw the switches 
for the Gnip partnership? This might be an unintended consequence of the 
data plumbing activities associated with Gnip.


By the way, I've seen tweets returned by search that *don't* appear to 
match the search terms! Have you verified that all the tweets Search is 
giving you do in fact match?


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] user streams example

2011-01-13 Thread M. Edward (Ed) Borasky
On Thu, 13 Jan 2011 16:10:13 -0800 (PST), jhollingworth 
jamiehollingwo...@gmail.com wrote:

Hi,

I've been looking around but have so far been unable to find any code
examples of using user streams (http://dev.twitter.com/pages/
user_streams). I might just be being a little dumb but i've had a 
look

at a few libraries in different languages and none seem to mention
them.

Also do user streams need to be turned on per account? I've been
messing around with some of my own code but my request is just
hanging. I'm trying to work out if it's something wrong with my
implementation or if I've got to be white listed?

Thanks,
James


The Perl CPAN module AnyEvent::Twitter::Stream is what I use to access 
User Streams. I don't remember whether there's any sample code there or 
not. I'm pretty sure the Phirehose PHP library also has User Streams 
code but I'm not a PHP programmer.


What language are you working in?
--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Whitelisted on Twitter

2011-01-18 Thread M. Edward (Ed) Borasky
On Mon, 17 Jan 2011 10:57:07 -0800 (PST), Mike Jodon 
mjo...@agoragames.com wrote:

Hey guys

We're integrating Twitter into our project, and after looking into
whitelisting, it looks like the max calls an hour is 20,000.  While
that MIGHT be enough for us, we're worried that we will come to close
to that number during initial launch of our product.

Is there a contact number out there where I can call Twitter and talk
to them directly? It seems almost impossible to find something for
them.

I'd love to boost the 20,000 to maybe 30,000 if possible.  Anyone 
have

any thoughts?


I can't help you with the business negotiations with Twitter, but is it 
possible your application could use the Streaming API for high-frequency 
access to Twitter? Between User Streams (desktops) and Site Streams 
(multi-user subscription servers) it's possible to do almost anything 
you can do with the other APIs.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Streaming Unfollow events through Site Streams

2011-01-18 Thread M. Edward (Ed) Borasky
On Tue, 18 Jan 2011 12:14:41 -0800, Matt Harris 
thematthar...@twitter.com wrote:

Hey everyone,

Starting today we will be streaming unfollow events through Site
Streams. These events are being streamed to allow you to keep the
social graph of your users current without the need to query the REST
API.  

We require that you only surface actions that are organically
displayed on Twitter. This means, for example, executing the unfollow
and delete actions but not publicly displaying them to end users.
(Section II.4.B of the API Terms of Service -
http://dev.twitter.com/pages/api_terms [1] ).
The event will be the same format as follow except the event type
will be unfollow. For example:

{
    for_user: 123456,
    message: {
        created_at: Thu Jan 12 21:55:04 + 2011,
        target: {
            
        },
        event: unfollow,
        source: {
            
        },
    }
}

Best,
@themattharrisDeveloper Advocate, Twitter
http://twitter.com/themattharris [2]

 --
 Twitter developer documentation and resources:
http://dev.twitter.com/doc [3]
 API updates via Twitter: http://twitter.com/twitterapi [4]
 Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list [5]
 Change your membership to this group:
http://groups.google.com/group/twitter-development-talk [6]


Links:
--
[1] http://dev.twitter.com/pages/api_terms
[2] http://twitter.com/themattharris
[3] http://dev.twitter.com/doc
[4] http://twitter.com/twitterapi
[5] http://code.google.com/p/twitter-api/issues/list
[6] http://groups.google.com/group/twitter-development-talk


Can this also be added to User Streams?
--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Location-based search is returning tweets that should not be included (again)

2011-01-21 Thread M. Edward (Ed) Borasky
On Fri, 21 Jan 2011 12:37:18 -0800 (PST), @IDisposable 
idisposa...@gmail.com wrote:

In response to this query:

http://search.twitter.com/search.atom?rpp=100geocode=38.627522%2C-90.19841%2C30misince_id=28525950136229890
I get tweets like this:
http://api.twitter.com/1/statuses/show/28525953676218368.json

We're talking about a location search for St. Louis MO, radius of 30
miles. We're getting a guy from Jeffersonian, but timezone is
Madrid.

Any ideas where this wire got crossed, when we can get it uncrossed,
or what the long-term viability of location based searches are?

Marc Brooks
http://stltweets.com


I filed an issue last year and it was closed as fixed on January 8, 
2011:


http://code.google.com/p/twitter-api/issues/detail?id=1348

I have a Perl script that will grab tweets in a 25 mile radius of 
Portland, Oregon and dump them to CSV. I haven't run it in a while, 
though, so I don't know if the results are better now than when I filed 
it. If you have something to reproduce this, maybe you should re-open 
issue 1348.


I guess given the low percentage of people who enter their actual 
location in the profile, as opposed to being from Botland or Earth 
or Hilbert Space, maybe the Search API should only return geotagged 
tweets when a geocode radius is specified, like the Streaming filter 
API does. It's that or somehow crowdsource locations, which is going 
to violate peoples' privacy if done without permission. To me it seems 
like a tradeoff between clean but very sparse data or messy but copious 
data that can be imputed or cleaned via crowdsourcing provided 
permissions can be obtained. I can't put a business case forward for 
either option from Twitter's perspective, but I think I'd prefer as a 
researcher to have Search adopt the Streaming model and only return 
geotagged tweets when a geocode parameter is specified.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Minor glitch in Twitter's emails

2011-01-24 Thread M. Edward (Ed) Borasky
I'm now getting multiple emails from Twitter sometimes when someone 
follows me or sends me a direct message. This is only a minor annoyance 
- I'm sure you have more urgent issues to worry about. But I did want 
you to know it's happening. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] registering twitter application

2011-01-25 Thread M. Edward (Ed) Borasky
On Tue, 25 Jan 2011 11:54:33 -0800, Taylor Singletary 
taylorsinglet...@twitter.com wrote:
When you're just starting out, feel free to put anything you like 
that

can be interpreted as a valid, non-twitter.com [1] URL. Perhaps to
your Geocities homepage,


Uh ... you must not have gotten the tweet about Geocities ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter spam checker on a distributed basis

2011-01-31 Thread M. Edward (Ed) Borasky
On Mon, 31 Jan 2011 06:18:58 -0500, Dean Collins d...@cognation.net 
wrote:

Ok I'm drowning here, I've given up trying to manually block all the
people on twitter sending me spam and I don't think that TrueTwit is
really the solution.

What we really need is a distributed system like Spam Assassin where
when enough people block or report an account as spam that it is
then flagged and block from all other participating accounts. Does
something like this exist already? Is the API the limit to using
something like this? What can I cut down on the number of follows who
are sending me spam accounts?

Cheers,

Dean

 --
 Twitter developer documentation and resources:
http://dev.twitter.com/doc [1]
 API updates via Twitter: http://twitter.com/twitterapi [2]
 Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list [3]
 Change your membership to this group:
http://groups.google.com/group/twitter-development-talk [4]


Links:
--
[1] http://dev.twitter.com/doc
[2] http://twitter.com/twitterapi
[3] http://code.google.com/p/twitter-api/issues/list
[4] http://groups.google.com/group/twitter-development-talk


I'm guessing Twitter has to manually review all the block and report 
for spam reports, unless they either get thousands of such reports for 
an account, or the account's offensive behavior is so blatantly robotic 
that it triggers some other automated detector.


How many new follows do you get per day now? I'm following about 9300 
and followed by about 8600. I only get about 20 - 30 new followers a 
day, about half of which are humans that I want to follow back, or are 
people who have followed me back. So I have enough time to go through 
the list once a day and look at not only the new follower but also the 
list of up to six other accounts in the email and make decisions on each 
one - follow, unfollow, block or block and report.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Site Streams Beta Users

2011-02-05 Thread M. Edward (Ed) Borasky
On Sat, 5 Feb 2011 09:34:25 -0800, John Kalucki j...@twitter.com 
wrote:

Please refrain from large-scale restarts of Site Streams connections
during the Super Bowl. Routine operations and the resulting 
connection

churn is not a problem. Rather, starts and stops of a large number of
connections is a bit stressful on our system, and we'd rather not
disrupt other Site Streams clients during the event. We've made an of
optimization in this area over the last week, and we hope to get that
fix into production soon, but not before the game.

If you can schedule stress testing and non-critical maintenance
activities around the broadcast, this would be helpful. We don't
expect any service interruptions, but we'd like to keep everyone's
distractions to a minimum.

Thank you,
John Kalucki
http://twitter.com/jkalucki [1]
Twitter, Inc.


I'm not using Streaming at the moment, but I am using Search for some 
testing. Are there likely to be any Search capacity issues during the 
game? Should I sample less frequently than normal?





 --
 Twitter developer documentation and resources:
http://dev.twitter.com/doc [2]
 API updates via Twitter: http://twitter.com/twitterapi [3]
 Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list [4]
 Change your membership to this group:
http://groups.google.com/group/twitter-development-talk [5]


Links:
--
[1] http://twitter.com/jkalucki
[2] http://dev.twitter.com/doc
[3] http://twitter.com/twitterapi
[4] http://code.google.com/p/twitter-api/issues/list
[5] http://groups.google.com/group/twitter-development-talk


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Is there going to be another Chirp?

2011-02-06 Thread M. Edward (Ed) Borasky
Maybe this is the wrong place to ask, but is there going to be another 
Chirp? If so, when and where? I'm making my conference plans for the 
year and pretty much know when everything is *except* Chirp!


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Is there going to be another Chirp?

2011-02-06 Thread M. Edward (Ed) Borasky
On Sun, 6 Feb 2011 12:28:39 -0800, Abraham Williams 4bra...@gmail.com 
wrote:
How about some more state of the union events too. I thought they 
were

going to be quarterly.


Given the rumored growth rate of Twitter head count, I'd say they 
probably have more pressing priorities, like finding new digs. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Is there going to be another Chirp?

2011-02-06 Thread M. Edward (Ed) Borasky
On Sun, 6 Feb 2011 18:27:42 -0800 (PST), Orian Marx (@orian) 
or...@orianmarx.com wrote:

Non-Twitter-employee developer headcount might be something they
should still be concerned with too...


That only matters for where they have Chirp ;-)




On Feb 6, 3:50 pm, M. Edward (Ed) Borasky zn...@borasky-
research.net wrote:
 On Sun, 6 Feb 2011 12:28:39 -0800, Abraham Williams 
4bra...@gmail.com


 wrote:
 How about some more state of the union events too. I thought they
 were
 going to be quarterly.

 Given the rumored growth rate of Twitter head count, I'd say they
 probably have more pressing priorities, like finding new digs. ;-)

--
 http://twitter.com/znmebhttp://borasky-research.net

 A mathematician is a device for turning coffee into theorems. -- 
Paul

 Erdős


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] return count

2011-02-07 Thread M. Edward (Ed) Borasky
On Mon, 7 Feb 2011 10:02:17 -0800, Taylor Singletary 
taylorsinglet...@twitter.com wrote:

Hi there,

Still not much in the way of counting methods in the Twitter Search
API. There are a few services out and about that do a decent job
approximating such things. For instance,
Topsy: http://corp.topsy.com/developers/api/ [1]

@episod [2] - Taylor Singletary - Twitter Developer Advocate

On Mon, Feb 7, 2011 at 9:44 AM, new developer  wrote:
 Has there been any updates/improvements to the API that will allow
me
 to search on a term and request a count of the number of term
 mentions? Is this something I can achieve through the API?

 thanks!


If you look at Kevin Weil's slides from Strata 
(http://www.slideshare.net/kevinweil/rainbird-realtime-analytics-at-twitter-strata-2011), 
I'd say the strategy would be


1. Develop a validated business model.
2. Wait for the Cassandra / Rainbird patches described to go open 
source.
3. Subscribe to Gnip's PowerTrack 
(http://blog.gnip.com/twitter-firehose-filtering-with-power-track/) and 
feed it to your Cassandra / Rainbird instance.


Don't skip step 1 - at ten cents a kilotweet it will take you longer 
than it will take Twitter to open source the Cassandra / Rainbird 
patches. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Is there going to be another Chirp?

2011-02-07 Thread M. Edward (Ed) Borasky
On Mon, 07 Feb 2011 15:25:59 +0100, Tom van der Woerdt i...@tvdw.eu 
wrote:

I'd prefer London or some other West-European city.


I'm guessing it will be in SFO, given how closely the Twitter team 
worked with the developers last year. They can't fly a few hundred folks 
to NYC or London. The question is *where* in SFO - Fort Mason wasn't 
particularly well suited for a barcamp-style conference with breakout 
sessions, wifi, etc. The noise level / acoustics were unacceptable.


But really, unless they're going for late May - early June, they need 
to get some planning done now. Google I/O sold out in 59 minutes, and 
actually the scuttlebutt is that it was actually sold out for all 
practical purposes as soon as the web site went live - invited 
attendees had already scooped up most of the tickets. I'm not saying I 
think Chirp will be *that* popular, but I'm guessing a lot of people who 
didn't get in last year will want to come this year.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Twitter geocoords + gmap is erratic, why?

2011-02-09 Thread M. Edward (Ed) Borasky
On Wed, 9 Feb 2011 14:35:06 -0500, David Terranova 
da...@davidterranova.com wrote:

Thanks for the tips Matt.

The people using this system definitely send the tweet when they
reach their final destination (they're run a food truck), and don't
use wifi. They are using both iPhone and Android phones to send these
tweets, so the only answer is that their devices must be sending
incorrect GPS data.

However... why should this happen when the iPhone Map application is
tracking accurately, at the same time when sending a status message 
to

Twitter? This is why I'm confused and wondering if actually there's a
process in between the device and Twitter that gets things muddled?

Especially as I get a completely different result when using Google
Latitude, also erratic (mostly incorrect) but in a completely
different way to Twitter's result.

Thanks again,
David


I can't help you with iPhone - don't have one - but I can tell you that 
as of a few weeks ago, Twitter's native Android client was *not* 
correctly sensing location in real time, even though all three (WiFi, 
GPS and Verizon 3G) on my Verizon Droid Incredible were correctly 
configured and functioning, and the native Google tools like Maps 
function correctly. This is in the Portland, Oregon metro area. I didn't 
try mobile.twitter.com or any of the third-party Twitter clients.


I've had spotty results with location on all Twitter clients on my 
Droid and have essentially given up. If I want to tweet with a correct 
location, I have to use my ChromeOS Cr-48 Notebook or my laptop running 
Linux via WiFi and often need to enter location manually.


I have neither the patience nor the tools to diagnose location issues 
with three vendors - Twitter, Verizon and Google! My belief is that both 
business and engineering partnerships between the three vendors will be 
required for correct functioning of Twitter location on my device. I 
suspect similar is required for iPhone - Apple, Twitter and ATT must 
have a *formal* partnership arrangement for stuff to work. Meanwhile, 
I'd suggest that if you have the time, diagnose this as far as possible 
and file a bug on Twitter's site. *Maybe* it's simply a Twitter issue, 
but I rather doubt it, given the number of things I tried on my Droid 
before giving up.


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Promoted Trend Rollover Time?

2011-02-09 Thread M. Edward (Ed) Borasky
I live in the Pacific Time Zone, and I've noticed that Twitter's 
Promoted Trend rolls over to a new trend right about midnight my time. 
Is this a policy thing, or just a coincidence? And is it always midnight 
Pacific Time, or midnight in the viewer's time?


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Update on Whitelisting

2011-02-10 Thread M. Edward (Ed) Borasky
On Thu, 10 Feb 2011 17:26:17 -0500, Adam Green 140...@gmail.com 
wrote:
Now the next step in opening up this marketplace is to create 
multiple

resellers of Twitter API data, and let them compete on price. Giving
Gnip a monopoly over this market makes no sense. Twitter's biggest
problem is the huge volume of requests. By blocking whitelisting you
are forcing some developers to cheat by creating multiple accounts 
and

distributing their requests across them. That can never be stopped.
What you have to do is make it inefficient, by letting multiple
resellers complete and drive the price of Twitter data down. Then the
strongest reseller will take the load off of you and offer enough
value added that developers will be willing to pay for data. That 
will

never happen when only one reseller sets the price.


+1000

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Update on Whitelisting

2011-02-10 Thread M. Edward (Ed) Borasky
On Thu, 10 Feb 2011 15:11:09 -0800, Taylor Singletary 
taylorsinglet...@twitter.com wrote:

Hi Ed,

Some quick answers to a few specific points below:

With authentication, whitelisting works at the junction of a user and
an application. @znmeb using Twitter for iPhone has 350 requests per
hour. @znmeb using YoruFukurou has 350 requests per hour. Using one
user request in Twitter for iPhone does not effect the user quota for
YoruFukurou.


Ah ... sounds good ... except for the buy an iPhone part, anyhow ;-)


A related question - how far away from production is Site Streams,
and is there a plan to encourage services like HootSuite to migrate
to Site Streams? It seems like it would be a big win for them (and 
all

the other web-based Twitter platforms).

Site Streams is nearing availability for general use -- there are a
few more t's to cross and i's to dot. In fact, HootSuite is currently
a Site Streams beta consumer. 


Thanks! That's great news - I'm a HootSuite user again.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Update on Whitelisting

2011-02-10 Thread M. Edward (Ed) Borasky
On Thu, 10 Feb 2011 17:40:03 -0800, Matt Harris 
thematthar...@twitter.com wrote:

Hi Ian,

For trends you might like to try our trends.api.twitter.com [1]
server which hosts a cached copy of the trends information and is
updated whenever the trends change. It should support your use case
and we would be interested in any feedback you may have about it's
performance.


Nice! I was just about to try building something very much like twendr, 
but I can either use twendr or go right to your new server. Is this on a 
five-minute cycle like the main Trending Topics feed? Will we ever get 
to see the Promoted fields populated without spending money? ;-)



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Update on Whitelisting

2011-02-10 Thread M. Edward (Ed) Borasky
On Thu, 10 Feb 2011 18:46:46 -0800, Ryan Sarver rsar...@twitter.com 
wrote:

Orian,

You should definitely plan on working within 350/hr for the
forseeable future. FWIW, we have watched #newtwitter usage and an
average session uses between 80-120 rq/hr.


Interesting - I had an incident last week where I was running out of 
calls in #newtwitter - that's why I asked about HootSuite. I never did 
figure out what happened. I'm running them both now and not running out.



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: user stream api

2011-02-11 Thread M. Edward (Ed) Borasky
On Fri, 11 Feb 2011 13:25:07 -0500, Adam Green 140...@gmail.com 
wrote:

Be aware that the streaming API does not deliver everything you are
tracking. In theory it delivers everything up to 1% of the total flow
of tweets. In practice, I find that it delivers about 95% of the
tweets that match your keywords or users. This is fine when sampling,
which is what I generally use it for, but will cause much anguish if
you assume you will get everything sent by people you are following. 
I

have to admit that I have only found this issue with the streaming
API, but I'm betting that the user streams are based on the same
underlying code.

My solution to the missing values from the streaming API is to 
collect

everything I can from streaming, then use the REST API to backfill
data I might not have received. If you run the backfill every hour,
you only have to go back to the last set of good tweets, adding
anything you missed.


Backfill for keywords is easy - just use Search. But how do you 
determine what you *haven't* received from accounts that you're 
following? Do you need to grab the most recent 200 tweets from everyone 
you're following using REST, or do you do a Search with from: OR 
from: ... as many times as it takes?


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] DM rate limit

2011-02-12 Thread M. Edward (Ed) Borasky
On Sat, 12 Feb 2011 14:46:33 -0500, Dossy Shiobara do...@panoptic.com 
wrote:

Any one Twitter account that sends 250 DM's in a 24 hour period is
DOIN' IT RONG.

DM spamming your followers is JUST NOT OK.


Putting multiple Trending Topics on a tweet with porn links is not OK 
either, but that doesn't mean bots don't do it. #twittercouldfixthat. 
;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Is there going to be another Chirp?

2011-02-12 Thread M. Edward (Ed) Borasky
On Sat, 12 Feb 2011 11:29:09 -0500, Brainewave Consulting 
i...@brainewave.com wrote:

On Feb 7, 2011, at 5:25 PM, M. Edward (Ed) Borasky wrote:

On Mon, 07 Feb 2011 15:25:59 +0100, Tom van der Woerdt  wrote:
I'd prefer London or some other West-European city.

I'm guessing it will be in SFO, given how closely the Twitter team
worked with the developers last year. They can't fly a few hundred
folks to NYC or London. The question is *where* in SFO - Fort Mason
wasn't particularly well suited for a barcamp-style conference with
breakout sessions, wifi, etc. The noise level / acoustics were
unacceptable.

True enough, but Twitter is a global application - the developer
conference should go global too!


Rio! Twitter's huge in Brasil, and Facebook is conspicuously absent 
there!



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: DM rate limit

2011-02-12 Thread M. Edward (Ed) Borasky
On Sat, 12 Feb 2011 15:29:23 -0500, Dossy Shiobara do...@panoptic.com 
wrote:
It's an unfortunate reality, but for every one legitimate application 
of

DM's, there's 100 projects being posted to rent-a-coder asking for an
auto DM script ...

As developers that use the Twtiter API, we're all collateral damage 
to

the scammers and spammers.  Yes, it sucks, but there's no other real
solution here.


Yeah - Google doesn't seem to be able to do spam control without 
PhD-level manual intervention, so I can imagine how hard it is for 
Twitter. ;-)


Rent-a-coder? Try Amazon Mechanical Turk - you can get things done 
there for pennies an hour ;-)

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: DM rate limit

2011-02-12 Thread M. Edward (Ed) Borasky
On Sat, 12 Feb 2011 16:28:43 -0500, Dossy Shiobara do...@panoptic.com 
wrote:

Indeed, if you figure someone can send a customized DM once per 15
seconds, and an hour at Turk costs you $0.05/hour, you can consume 
250

DM's/day in 62.5 minutes - you're talking less than $0.10/day to have
someone send DM's on Twitter for you, personalized by a human ...

If a script off rent-a-coder costs you $100 ... that's 1,000 days 
worth
of Turk-time ... so using a script only breaks even after 2.7 years 
of use.


LOL.


Yes, and you can get Twitter accounts created on MTurk as well. It's 
supposedly a violation of Amazon's TOS but they don't enforce it because 
they collect per-HIT transaction fees. Dick Costolo and Jeff Bezos need 
to have a long talk IMHO, backed up by attorneys and possibly the IRS 
and FTS. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: DM rate limit

2011-02-12 Thread M. Edward (Ed) Borasky
On Sat, 12 Feb 2011 17:07:36 -0500, Trevor Dean trevord...@gmail.com 
wrote:

I agree, don't be so quick to judge.  We have an opt-in based service
and out clients have thousands of customers that explicitly say yes
send me direct messages.  The information we send is requested by 
the

end user and is not spam.  So you can imagine that a client with a
large user base could quickly go beyond the 250 dm/day limit.  It's
unfortunate that the spammers take advantage and ultimately ruin
things for legitimate services.

Trevor Dean | Director
big time design  communication Inc.
647 234 8198

Visit http://www.bigtimedesign.ca for more information


Speaking of spam, there's a great article at the New York Times on J.C. 
Penney, black hat SEO and Google:


http://www.nytimes.com/2011/02/13/business/13search.html

Many thanks to Twitter's spam fighters for keeping it as clean as it 
is, under the circumstances.


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter Development platform - A Rant

2011-02-13 Thread M. Edward (Ed) Borasky
On Sun, 13 Feb 2011 12:18:11 -0600, Andrew W. Donoho 
andrew.don...@gmail.com wrote:

It is clear from this thread that many developers made, perhaps
unwisely, product plans based on Twitter's continued support for 
white

listing. In my case as a client developer, the increase of my API
count from 150/hour to 350/hour due to moving to OAuth totally 
removed

my need for white listing. If user streams was supported, I could
easily live with 150/hour limit. If they would stand behind their 
user

streams API, I would switch to it immediately. (Beta status is not,
frankly, good enough. If they cannot make a commitment to their new
API, why should I? By my count, user streams has been in beta for
almost 6 months.)


User Streams is in fact in production and has been for months. The only 
restrictions on User Streams, other than what's documented in the 
technical documentation, is that it is *only* for desktop *clients*, not 
servers or mobile. I'm not sure where iPad fits in this spectrum, but 
for sure an iPhone is mobile.


*Site* Streams is designed for servers and it is still in beta. Perhaps 
you need to be pitching your idea to Twitter and adapting your service 
to Site Streams if it's a server-backed app, which I'm guessing an 
iPhone/iPad app would be.



That said, Twitter's API evolution
practices, presumably approved by their CTO, Mr. Sarver, are not, in
my opinion, helping their partners grow with Twitter.


[snip]


Another example is the closed roll-out of promoted tweets. I think
every third party app developer would love to find a way to further
monetize their Twitter application. Twitter did announce that they
would find a way to allow their developer partners to participate 
with

the promoted tweets program. That has not yet happened. Currently, as
Twitter has made a floor price of $0.00 for iOS apps, I have to 
resort
to Apple's iAds to capture revenue from my labors. I don't mind but 
it

does cut my other market-making partner, Twitter, out of the revenue
stream. As it reduces my revenue opportunities, I think this is
sub-optimal. I win when my partner wins.


The key word in this rant is partner. A *partner* is, IMHO, someone 
who has a *formal* partnership arrangement. Sure, there's a certain 
formality when you accept Twitter's TOS, but I think if you want to use 
Site Streams or Promoted content, you should be negotiating as a 
business with Twitter as a business. What's in it for Twitter?


Twitter has built a powerful brand. I was there in early 2007 when the 
vast majority of pundits predicted that it would go nowhere - that it 
was just a bunch of Ruby hackers with too much time on their hands, that 
it would destroy flow, etc. It's now one of the top ten sites world wide 
according to Alexa. If you want to be a partner with Twitter, *you* 
are the one who needs to have something to offer *them* IMHO.


[snip]


Overall, everyone needs to remember that we are dealing with a
company that publicly claims to not yet be trying to capture revenue
from their platform.


I seem to have missed that claim. As far as I know, they *are* trying 
to capture revenue through a combination of Promoted Accounts, Tweets 
and Trends with bundled analytics and data licensing.



What do I want? I want a better developer experience. Both Apple and
Microsoft show what a good experience can be. I want user streams, a
promoted tweet API and annotations. I hope Twitter can deliver these
technical features to enable new business opportunities for 
themselves

and the Twitter app ecosystem. Myself included.


I think you have User Streams, though it may not be suitable for your 
specific application. You may be eligible to get in the Site Streams 
beta, although I'm guessing that was invite-only. You can always ask - 
as a business negotiating a partnership with another business.


We'll have to wait and see about the Promoted products. Advertising 
sales is a fiercely competitive business and it's not something I 
personally want to deal with at the moment.


Annotations? That was definitely a case where Twitter's reach seems to 
have exceeded its grasp. The story I've heard is that there are people 
in Twitter hacking away on it but the priorities do get adjusted 
according to the demands of the marketplace. If it could be a 
breakthrough spam killer, I think they'd push it front and center in a 
big hurry. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter Development platform - A Rant

2011-02-13 Thread M. Edward (Ed) Borasky
On Sun, 13 Feb 2011 14:16:30 -0500, Adam Green 140...@gmail.com 
wrote:

Edward, I'm going to jump in on the partner issue, since that is my
big point. I think you are thinking too small when you say  If you
want to be a partner with Twitter, *you* are the one who needs to
have something to offer *them* IMHO. One dev is very small compared
to Twitter. 10,000 devs is a labor force. 100,000 devs is a market
that protects Twitter from *any* competitor, including Google. We are
all partners, because we all make money. You look old enough to
remember dBASE. That was a huge labor force that protected 
Ashton-Tate

for years when they had a product with technical limitations. Sound
familiar? Corporations and government agencies used dBASE not because
it was *best*, but because they could find many qualified developers.
Ashton-Tate started attacking their developers in 1988, when they 
were
one of the top 5 software companies. They were out of business 3 
years

later.

If Twitter wants to be embedded into the infrastructure of
corporations around the world, they must have outside developers. If
they want it to be a cool toy for the Kardashians and Justin Beiber 
to

amuse their fans. They don't need us at all. It is their choice.


Well, I'm old enough but I was doing something radically different from 
Ashton-Tate at the time. This whole thread is starting to sound eerily 
similar to last year, when Fred Wilson made the infamous filling holes 
blog post, followed by Twitter buying Tweetie, followed by Chirp. I'd be 
surprised if the *Twitter* ecosystem could support 10,000 independent 
developers - they'd self-organize into businesses with some sort of 
power law size distribution, where the largest such business is Twitter 
itself.


I don't know that Twitter wants to be embedded into the infrastructure 
of corporations. It seems to me that Twitter is unique and not at all 
suited to intra-enterprise communications. Besides, there are dozens of 
enterprise software platforms that can do everything Twitter can do 
except talk to the hundreds of millions of Twitter users in real-time. 
;-)


Maybe I am thinking too small, but then again, people aren't coming to 
*me* with problems big enough to require whitelisting, or for that 
matter Cassandra, or MapReduce, or sending thousands of DMs a day. Even 
if they did, there's no way I could compete with Twitter. I really 
should save this for my blog - it's been a while since I wrote a post 
about Twitter, and that's what my search analytics tell me people read 
there. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter Development platform - A Rant

2011-02-13 Thread M. Edward (Ed) Borasky
On Mon, 14 Feb 2011 01:21:29 -0500, Adam Green 140...@gmail.com 
wrote:

Good points. I think the basic confusion is the definition of
developer. It could mean someone who builds a web or mobile app and
tries to monetize it. That would be limited. I think it also means 
all

the consultants and in-house programmers who integrate Twitter into
existing websites and businesses. As I started responding CNN ran a
big button on the screen telling people to try their Twitter
integration on their website. I think that was built by a developer,
not Twitter HQ.


My impression is that this is exactly the sort of thing @anywhere was 
designed to do - make it possible for a CNN or even the Original Coffee 
Brake to incorporate Twitter into their web site with a budget of, say, 
8 hours of HTML editing time. ;-) I haven't kept up with how well 
@anywhere is fulfilling that promise, though. I ran it for a long time 
on my blog but shut it down because the trips to Twitter's servers were 
slowing down page loads. I should probably revisit that now that I'm 
starting to get traffic again.




Multiply that by every TV show, radio program,
newspaper, magazine, movie, real estate office, hospital, retailer,
you get the point. There are way more than 10,000 programmers who 
work

on websites and mobile apps around the world. They are all possible
Twitter developers, among other tasks they did.


I don't know about the rest of the world, but here in PDX, the skills 
that are in huge demand are HTML5/CSS3/JavaScript and user interface 
design. We've got a small collection of people who do stuff with 
Twitter, but you don't see help wanted ads for Twitter API coding - 
that's something people do in their spare time. Most folks use Twitter 
the old-fashioned way - from the web app or from a client - or license a 
monitoring platform that talks to Twitter and Facebook.



Too big an idea?
Maybe, but with the right assistance from Twitter, there would be
enough developers that when a competitor comes along Twitter would
have a base that would make it hard to switch. That is what we offer
them.


I think it would be harder for a competitor to get Twitter's millions 
of active subscribers than to get thousands of developers. ;-) I was 
just looking at the Alexa statistics - Twitter is in 9th place 
world-wide now.


http://www.alexa.com/topsites

Who's ahead of us? Twitter is just below the huge Chinese site 
Baidu.com. Neither Facebook nor Twitter is active in China, although I 
have seen accounts claiming to be from Guangzhou. Next up the ladder is 
Wikipedia. In short, it's been a long climb since March of 2006 to get 
there, and there's a lot of power above Twitter - 
Google/Youtube/Blogger, Yahoo, Microsoft, Facebook, Wikipedia and 
Baidu.com. Twitter is, as they say, running with the big dogs. And we're 
ahead of Aol. ;-)


I have an idea. Why doesn't Twitter hire a developer relations 
person?

Not a support person. Matt and Taylor do a good job of technical
support. I appreciate what they do. I mean someone who could run a
developer program. I haven't seen someone like that yet. Could some 
of

the $200 million pay that salary?


Maybe again I'm thinking small, but I have yet to run up against 
anything that Twitter did that seriously impacted me. Twitter's not like 
Microsoft, Android or Apple where you need a huge standardized SDK / 
MSDN-like library. The one thing I'd want as an independent developer 
would be some kind of keyword tools along the lines of what Google 
provides for webmasters. I can easily determine what people tweet about 
but I *can't* determine what they search for. Oh, yeah - a Streaming 
endpoint that delivers the overall tweets per minute every minute, so I 
can draw pretty graphs in real time like Carolyn Penner did on the 
Twitter blog.


http://blog.twitter.com/2011/02/superbowl.html

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: should search and streaming apis return similar tweets for equivalent geolocation areas

2011-02-14 Thread M. Edward (Ed) Borasky
On Mon, 14 Feb 2011 11:33:54 -0800 (PST), Taylor Singletary 
taylorsinglet...@twitter.com wrote:

The Search API is greedy with those location fields on user's
profiles. It's not likely this behavior will be emulated in the
Streaming API with the bright side that you can be more confident in
the location accuracy in matches on the Streaming API.

Thanks,
Taylor


I wouldn't call the Search API greedy on location as much as I'd call 
it myopic or easily confused. ;-) Twitalyzer is now getting some of 
their location data from PeerIndex when the Twitter profile isn't 
accurate.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Jetwick Twitter Search

2011-02-15 Thread M. Edward (Ed) Borasky
On Tue, 15 Feb 2011 03:20:40 -0800 (PST), Karussell 
tableyourt...@googlemail.com wrote:

Hi there!

Just a link to my open source twitter search (without noise) 
developed

in my spare time:

http://jetwick.com/

Regards,
Peter.

PS: Most of the features are listed here:
http://www.pannous.info/products/jetwick-twitter-search/


Looks nice! I wish I knew Java to hack on it!
--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Streaming API vs. Search API: no API returns 95% of intented tweets

2011-02-15 Thread M. Edward (Ed) Borasky
On Tue, 15 Feb 2011 21:01:07 -0800, John Kalucki j...@twitter.com 
wrote:

On every occasion where I've tested the Firehose and track terms from
the Streaming API against the Tweet database and against each other,
there is no loss -- all the sources match exactly. Unless there's 
some
unusual operational instability, the Streaming API returns 100% of 
the

tweets requested, or sends a limit message to let you know what has
been dropped.


What has been dropped, or how many have been dropped? ;-)

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Seeing many Woah there errors on oauth/authenticate

2011-02-24 Thread M. Edward (Ed) Borasky
On Thu, 24 Feb 2011 09:41:34 -0800 (PST), Aaron Rankin 
aran...@sproutsocial.com wrote:
Our users are reporting many sporadic Woah there errors on the 
oauth/

authenticate page, where the error says the token info was already
used. We're forwarding our users to that page immediately after we 
get

the token info. Is this a problem with our oauth logic (we're using
Twitter Async / EpiTwitter) or is it an API issue?


Thanks,
Aaron


As a user, I've seen a fair number of those from some applications too. 
I just saw one from PeerIndex, in fact. I ended up having to revoke 
access and sign out of Twitter, then sign back in. I'm guessing this 
isn't on Twitter's end. Could this be some kind of clock mismatch 
between the application and Twitter?

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Streaming API access level limit

2011-02-24 Thread M. Edward (Ed) Borasky
On Thu, 24 Feb 2011 17:34:52 +0800, Chen Jack S Y aquaj...@gmail.com 
wrote:

Thanks, dude. My problem is still there though.

When I try the streaming api with curl in command line, everything
goes well and it tracks a few thousands of ids successfully.

While using eventmachine (together with em-http-request) ruby gem,
haven't found any solutions to track more 400 ids but keep receiving
413 response errors. Kind of weird.


Is this the tweetstream Ruby gem? If their repository is still on 
Github, it hasn't been updated in over a year. In particular, they 
haven't added code for User Streams or oAuth. Could they be using an 
incorrect endpoint or something like that?


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] current response issues at Twitter.com?

2011-02-24 Thread M. Edward (Ed) Borasky

Is something happening? I'm seeing

Loading Tweets seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try 
again or visit Twitter Status for more information.


pretty regularly at the moment.

Search, on the other hand, seems to be fine.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Apps that Site Hack

2011-02-25 Thread M. Edward (Ed) Borasky
On Fri, 25 Feb 2011 11:16:54 +0100, Pascal Jürgens 
lists.pascal.juerg...@googlemail.com wrote:

How about a competition to develop spam-detection algorithms :)

Pascal


I don't see VCs / angels funding that sort of thing, so there's not 
likely a market.


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] consistency and ecosystem opportunities

2011-03-11 Thread M. Edward (Ed) Borasky
On Fri, 11 Mar 2011 13:18:24 -0700, Ryan Sarver rsar...@twitter.com 
wrote:

THE OPPORTUNITY FOR DEVELOPERS



Some key areas where ecosystem developers are thriving:
 - PUBLISHER TOOLS.  Companies such as SocialFlow [2] help
publishers optimize how they use Twitter, leading to increased user
engagement and the production of the right tweet at the right time. 
 - CURATION.  Mass Relevance [3] and Sulia [4] provide services for
large media brands to select, display, and stream the most 
interesting

and relevant tweets for a breaking news story, topic or event.  
 - REALTIME DATA SIGNALS.  Hundreds of companies use real-time
Twitter data as an input into ranking, ad targeting, or other aspects
of enhancing their own core products.  Klout [5] is an example of a
company which has taken this to the next level by using Twitter data
to generate reputation scores for individuals.  Similarly, Gnip [6]
syndicates Twitter data for licensing by third parties who want to 
use

our real-time corpus for numerous applications (everything from hedge
funds to ranking scores).  
 - SOCIAL CRM, ENTREPRISE CLIENTS, AND BRAND INSIGHTS.  Companies
such as HootSuite [7], CoTweet [8], Radian6 [9], Seesmic [10], and
Crimson Hexagon [11] help brands, enterprises, and media companies 
tap

into the zeitgeist about their brands on Twitter, and manage
relationships with their consumers using Twitter as a medium for
interaction.
 - VALUE-ADDED CONTENT AND VERTICAL EXPERIENCES.  Emerging services
like Formspring [12], Foursquare [13], Instagram [14], and Quora [15]
have built into Twitter by allowing users to share unique and 
valuable

content to their followers, while, in exchange, the services get
broader reach, user acquisition, and traffic.  


There's a common thread in most of the businesses you've listed as 
thriving above. Nearly all of them interface with *multiple* networks 
- Twitter, yes, but also Facebook, LinkedIn, and even MySpace. 
HootSuite, for example, connects to Twitter, Facebook, LinkedIn, 
MySpace, Ping.fm, WordPress, Foursquare and mixi. There's also Google 
Buzz / Latitude, Tumblr, Posterous, Gowalla, Yelp, and I'm sure many 
others. In short, I'd say there seem to be few businesses thriving 
that have focused only on Twitter.


Last time I looked at the Alexa site rankings world-wide, Twitter was 
number nine. It's a long climb to the top IMHO - Twitter needs to pass 
Wikipedia and Baidu just to get to the point where Google, Yahoo!, 
Microsoft and Facebook are in sight. Twitter is still growing, for sure, 
but there are clearly some challenges for developers who only develop 
for Twitter.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: consistency and ecosystem opportunities

2011-03-13 Thread M. Edward (Ed) Borasky
On Sun, 13 Mar 2011 11:49:45 -0700 (PDT), Dewald Pretorius 
dpr...@gmail.com wrote:

I used to be counted in the 90% until they defaced Tweetie, sorry,
Twitter for iPhone with that moronic #DickBar that shoves irrelevant
nonsense in your face. It's like yelling at you, I KNOW YOU DON'T
WANT TO SEE THIS AND HAVE NO INTEREST IN THIS, BUT HERE, TAKE IT
ANYWAY. LEARN #WHATNOTTOSAYTOAFATWOMAN AND TRY TO
#FARTLIKEJUSTINBIEBER AND OH, JUST WHILE YOU'RE AT IT, HERE'S ANOTHER
STUPID ONE THAT'S NOT TRENDING AT ALL, BUT SOMEONE PAID US TO SHOVE 
IT

IN YOUR FACE!!!

Are any of you guys developing a better Twitter client for iPhone,
because I'll switch in a heartbeat.

Oh...

Wait


Dewald, you have to remember that Twitter isn't the only granfalloon 
that one must deal with on the iPhone - there's Apple, too. If Steve 
Jobs didn't like the #DickBar, how long do you suppose it would last? 
;-)



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: consistency and ecosystem opportunities

2011-03-13 Thread M. Edward (Ed) Borasky
On Sun, 13 Mar 2011 12:21:20 -0700 (PDT), Jef Poskanzer 
jef.poskan...@gmail.com wrote:

On my Android phone I have both the official Twitter client and
Twidroid installed.  If they had more or less the same functionailty
and useability I would prefer to use the official client.  However I
only use Twidroid, because Twitter's official app is inferior.  I
could explain why in detail if anyone is interested, but it's not a
subtle matter, it's gross and obvious.

Twitter apparently believes that no one should bother making a plain
old timeline-displaying client because Twitter's official ones are 
all

you need.  And yet even with Twidroid's prior example to copy from,
Twitter's official Android client is still unusable.  I say this one
example shows that the new policy Ryan posted is at best premature.


I've been holding off on the Android issue, but since you brought it up 
...


I have a Verizon HTC Droid Incredible. I've tried *all* the Twitter 
clients. I've tried the one that's built in, Peep, I've tried every 
release of Twitter's native client. I've tried the mobile Twitter web 
site in the browser. I've tried Twidroyd, Touiteur, TweetDeck, 
HootSuite, Seesmic and probably a few others I've forgotten.


The most recent version of Twitter's native app is the *only* one of 
that line that I consider even marginally usable. And yet in terms of 
usability, it is still way behind Seesmic. Seesmic is the one I use. I'd 
*love* to use Twitter's native app, but until it does everything Seesmic 
does, it's not going to happen.

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: consistency and ecosystem opportunities

2011-03-13 Thread M. Edward (Ed) Borasky
On Mon, 14 Mar 2011 01:32:27 +0530, Umashankar Das 
umashankar...@gmail.com wrote:

Relevance in  microblogging. Big opportunity but very difficult to
define. Last i read, even google is stumped.

Cheers
Umashankar Das


I don't think it's relevance that stumps Google so much as privacy. 
It's a lot of work for users to control how much they reveal and to 
whom, and the Holy Grail of permission marketing - timely, relevant 
and personal - runs square up against that. I'm cynical enough to think 
that the sole consumer benefit that has come from social media, 
including Twitter and Facebook, is the ability to talk back to 
granfalloons like the State Department, United Airlines and Google. 
Everything else about the technologies simply reduces costs to 
marketers, and those cost reductions are not passed on to consumers in 
the form of less expensive or higher-quality products and services. ;-)

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: Requesting increased access levels for Streaming API

2011-03-16 Thread M. Edward (Ed) Borasky
On Wed, 16 Mar 2011 09:10:13 -0700 (PDT), Ryan Sarver (@rsarver) 
ryan.sar...@gmail.com wrote:


Also as we stated before, you can use User Streams or Site Streams 
and

get more data by getting more users to authorize your application.


Ryan, it's not as simple as getting more users to authorize your 
application. You need to get *all* your users to *explicitly* authorize 
the application's *exact* usage of their data! Users tend not to read 
the fine print. I'd hate to see some data collection / analytics 
application make some assumptions based on the implicit openness of the 
tweet stream and then get nailed by a bunch of angry users. Angry users 
tend to write to their Congressmen and Senators. ;-)


Managing a *single* user's User Streams feed is a relatively 
straightforward coding task - I've got a smallish Perl script that can 
do it for my own account. Managing multiple users' Site Streams is a 
much more complex endeavor, and to use that mechanism for a data 
collection / analytics application is ludicrous IMHO. Somehow, the 
notion of the right tool for the job seems to have been ignored. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] app to block all users ending with numerals

2011-03-25 Thread M. Edward (Ed) Borasky
On Fri, 25 Mar 2011 15:17:25 +, hax0rsteve 
hax0rc...@btinternet.com wrote:

I know a number of people who use twitter as a read only source of
information (for instance they may follow only news outlets and 
celebrity
tweeters) and therefore may have large follow counts with zero 
tweets.


This may not be a use case that you are familiar with, but it is a 
valid

use case.

Also, I don't know if you are aware of the current limits on 
following,

etc, which are described here, my apologies if you already are :

http://support.twitter.com/forums/10711/entries/15364


As for the OP, well, a) if this is what you (or your users) want, 
just parse
the follow messages looking for numerical postfixes and offer the 
user

the user the option to block them, there is no need for an API call
specifically to do this.

And b) again, you are missing a use case, there are lots of genuine 
accounts
that have numerics postfixed to them, some people use birth years, 
and some
people - perhaps finding that the screen name they wanted is not 
available
in a naked form - will have chosen [screen name]76 or some similar 
format,
or picked a year with some historical connection with their chosen 
name.


It is not safe to simply assume that ending with numerics is 
sufficient to
indicate that the account is used only in the delivery of spam, be 
that tweet

spam or simply follow spam.

While the assumption may hold in a large number of cases - and I am 
not aware

of any empirical data that shows what this number is, though I'd be
interested
to see one - it will undoubtedly include some false positives.

HTH

hax0rsteve

On 25 Mar 2011, at 15:00, Adam Green wrote:


What if Twitter just suspended anyone who followed more than 1,000
users without ever having tweeted? But then their membership would
sink dramatically. How about not allowing following past 100 users
without tweeting at least once. What is the point of these accounts
anyway, unless they are being built up and then sold? They can't be
used for spam, since they don't tweet, and generally don't have URLs
in their profiles.

On Fri, Mar 25, 2011 at 10:47 AM, Dean Collins d...@cognation.net 
wrote:
Lol, someone want to write me an app that blocks all users where 
their

username ends with two or three numbers.



This is getting ridiculous.



Seems like something that would be pretty easy to achieve via the 
API don’t

you think?





Cheers,

Dean







--
Twitter developer documentation and resources: 
http://dev.twitter.com/doc

API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker:
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
http://groups.google.com/group/twitter-development-talk





--
Adam Green
Twitter API Consultant and Trainer
http://140dev.com
@140dev

--
Twitter developer documentation and resources: 
http://dev.twitter.com/doc

API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: 
http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


1. There are plenty of good spam detection and filtering algorithms. 
The ones listed here, however, are simple hacks unlikely to work without 
extensive manual intervention. The same can be said for ManageFlitter, 
TwitCleaner and similar services. They give you a start, but you still 
have to wade through hundreds or thousands of positives to weed out the 
keepers.


2. A first name followed by a few numbers is a common legitimate screen 
name - just having a name like that isn't necessarily an indication of a 
spammer. Here's how it works - Bobby asks Kelly if she's on Twitter. 
Kelly says No and signs up. She starts with the screen name Kelly, 
finds it's taken, so she adds her age or the year she was born. If 
that's taken too, she'll maybe get clever and pick something like 
PiercedChick, or she'll pick a few random numbers and get in as 
Kelly117. (Now don't go blaming me if you start getting followers with 
names like PiercedChick117.)


3. The User / Twitter spam reporting process could definitely be 
improved with a few simple steps. I don't have any data - that would 
have to come from inside Twitter - but the two most common types of spam 
I see is spambots riding Trending Topics and spambots replying to 
keywords. In either case, the actual spam tweets sent are usually easily 
found via Twitter Search. Given that, what I do when I get a spam tweet 
is perform the search, then go through the resulting page and manually 
report a page or so, depending on how much time I'm willing to spend on 
this.


So here's what I'd propose: Twitter sets up an email address or some 
other mechanism to receive these search patterns. When someone gets 
spammed, they can send a copy of the tweet to Twitter, in addition to 
doing a block and report on the spammer. Twitter could then create the 
search pattern, run the query and suspend 

Re: [twitter-dev] Twitter followers in excel

2011-03-25 Thread M. Edward (Ed) Borasky

On Fri, 25 Mar 2011 14:10:36 +, Scott Wilcox sc...@dor.ky wrote:

Hello there,

There is no method to do this straight from the API.

What 'details' of each follower are you interested in having?

Can you elaborate on why you're interested in having an export to
excel if possible too.

Scott.


On 25 Mar 2011, at 12:25, shaily wrote:


Hi Tweeples,

Can you please help me how to download the details of my followers,
their details, picture into excel! Can I connect excel directly to
twitter? Is their an easy way?

Please advise.
Shaily


There's a service called Export.ly that will do this for you. I don't 
remember how many of the fields it exports, though.


This is an easy coding task in any of the scripting languages with 
Twitter API libraries - I do it in Perl but I'm sure it can be done in 
Python, Ruby or PHP as well with just a few lines of code.


Finally, there are some ways in Excel to import XML data - anything you 
can export from Twitter via Atom / RSS feeds in XML can be imported into 
Excel that way.


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] app to block all users ending with numerals

2011-03-25 Thread M. Edward (Ed) Borasky
On Fri, 25 Mar 2011 11:33:30 -0700, M. Edward (Ed) Borasky 
zn...@borasky-research.net wrote:


[snip]

One other note - a tweet that contains multiple Trending Topics is 
nearly always spam. I haven't gathered any data, mostly because I'm too 
lazy to write the API call management / rate limit logic to automate 
this. I'd *almost* be willing to recommend to Twitter that they stop 
indexing tweets for Search that match more than one Trending Topic, 
though. ;-)

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] app to block all users ending with numerals

2011-03-25 Thread M. Edward (Ed) Borasky
On Fri, 25 Mar 2011 19:58:58 +, hax0rsteve 
hax0rc...@btinternet.com wrote:



To pointlessly prolong the discussion - it being Friday :-) ...


[snip]


I guess what I'm getting at here is that any automated filtering
system ultimately
amounts to making value judgements on behalf of your users.  That 
this fails
quite often in - for example - corporate email systems gives me no 
confidence

that any similar approach is going to work for twitter, where the
diversity of
message content, users, and use cases is vastly more pronounced.

But I could - of course - be wrong :-)


Well, Twitter is on the one hand a smaller data set than Google, but on 
the other hand has different usage patterns in the real-time 
signal-processing sense. So yes, if Google has to mix human judgment and 
algorithmic judgment to optimize shareholder value, then so does 
Twitter. I claim, though, that the mere fact that one can buy the number 
one position in a Twitter Search that otherwise returns total garbage is 
very much different from buying clicks on Google, where organic search 
results at least return something that a mix of human and mechanical 
judgment has determined is relevant to the searchers' intent.


Twitter Trending Topics is broken and infested with spam. One shouldn't 
need Sulia to consume Twitter, and Twitter's own Promoted Trends and 
Tweets should not have to compete for eyeballs and clicks with spambots.


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Perl devs: new AutoCursor trait for Net::Twitter

2011-03-27 Thread M. Edward (Ed) Borasky
On Sun, 27 Mar 2011 16:14:10 -0700, Marc Mims marc.m...@gmail.com 
wrote:

If you're using Net::Twitter's friends_ids or follower_ids methods
without a cursor parameter, an upcoming Twitter API change will break
your code.

I've added an AutoCursor trait (currently in a developer only 
release),

to deal as transparently as possible with the change.

I blogged about it here: http://post.ly/1oKFG

After I get some feedback, I'll make any necessary interface changes 
and

make a production release.

-Marc


I've had explicit cursor / page logic in all my Net::Twitter calls 
since I started using it - is there any reason to switch to AutoCursor?

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] need twitter spam for a research project

2011-04-03 Thread M. Edward (Ed) Borasky
On Sun, 3 Apr 2011 18:19:38 -0700 (PDT), Jeff Tucker 
fred.f.cho...@gmail.com wrote:

I'm conducting a research project involving proactively identifying
twitter spam accounts before they actually start spamming.  I've
observed that some spammers attempt to create tweets that look like
they're a legitimate account prior to actually sending spam and my
project is to be able to identify those accounts as soon as they pop
up.

Unfortunately (I can't believe that I'm writing this) I am having a
hard time getting spammers to actually spam me.  Is there any way 
that

I can somehow get access to the tweets of several dozen spam accounts
(prior to when they're shut down) so that I can see what they're
posting?  Is this possible somehow?

Also, if anyone gets spammed regularly, are you interested in helping
me out with my research?  No guarantee that I'll actually publish
this, but anyone interested will be credited in my paper in the
acknowledgements.  Thanks
-Jeff Tucker
Lecturer, DigiPen Institute of Technology
www.digipen.edu


I don't know how rapidly Twitter detects and shuts spam accounts down 
these days. I imagine there's a priority scheme, with accounts linking 
to malware and pr0n shut down more aggressively than those that are just 
selling stuff and being annoying about it. Here's a bit of pseudo-code 
that will get you one class of spammers:


1. Poll the Trending Topics periodically. IIRC if you do it every ten 
minutes for all the localities you won't use up all your API calls per 
hour.


2. Do a search for each trending topic - take the first 100 tweets for 
each. This doesn't cost you any API calls, since it's a search.


3. Now use a relational database to find tweets that match more than 
one trending topic. There's a high probability those are spam. Quite a 
few of the other tweets will be spam too, but those that match multiple 
trends are much more likely to be spam.


4. Now you have a list of accounts - pull their most recent 3200 tweets 
and test your algorithm. You'll probably have to manually go through 
them to find the boundary where the account started spamming, but then 
you should have a nice dataset for a classifier training.



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: need twitter spam for a research project

2011-04-03 Thread M. Edward (Ed) Borasky
On Sun, 3 Apr 2011 21:34:54 -0700 (PDT), John Sheehan 
johnshee...@gmail.com wrote:
You can use my account as an example. I'm currently getting between 
50
and 150 follow spams per day for the last 3 weeks. Here's a graph 
that

demonstrates the 'attack' http://screencast.com/t/xl7zcgdYI

If you have any other questions, I'm @johnsheehan and can be reached
via email same user name at gmail.

John


Interesting - most of the followers I've been getting are real humans, 
not that they're all that interesting humans. ;-) There was a period 
when I was getting a bunch of followers that were tweeting nonsense, 
sometimes not even real sentences. Eventually one or two them started to 
tweet links. Apparently the way they work is to build a network - if one 
of them follows you and you don't block them, then they copy each other. 
I suppose it's possible to collect data via the API and do graph theory 
analysis on these accounts to isolate the clusters, but it hardly seems 
worth the effort when there are so many accounts just spamming multiple 
trending topics apparently with little interference from Twitter.



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul 
Erdős


--
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: need twitter spam for a research project

2011-04-09 Thread M. Edward (Ed) Borasky
On Sat, Apr 9, 2011 at 2:13 AM, Jeff Tucker fred.f.cho...@gmail.com wrote:

 Followers tweeting nonsense or just tweeting sentences that just don't
 quite fit with reality is exactly what I'm hoping to identify.  It's
 easy enough to find a known spammer and block them, but my hope is to
 identify a spam account before they ever actually send any links.
 There are certainly some categories of spammers that this approach
 will not work on, although they are easy enough to detect using other
 means.  I have observed a trend of bots that attempt to appear human
 and those are the ones that I hope to identify.  I will have something
 completed by about two weeks from now so I'll post with how effective
 it is.


Interesting - I haven't seen that type of bot following me in a long time.
Maybe the maker read
http://borasky-research.net/2011/02/18/this-is-not-the-blog-post-about-twitter-youre-looking-for/
and
put me on a do not follow because he'll send my name to Twitter list. ;-)

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] #TrollWatcher API app.

2011-04-09 Thread M. Edward (Ed) Borasky
Uh ... what's the definition of Troll we are supposed to use? ;-)

On Sat, Apr 9, 2011 at 4:30 PM, Quinn quinnmicha...@gmail.com wrote:

 Hello other Twitter Developers.

 The other day I had an idea for a little service to monitor trolls.
 So some code was punched out to monitor a hash tag and the
 #TrollWatcher service was born.

 How it works is someone tags (#TrollWatcher) to a tweet and then a
 system check twitter and then adds any usernames in the tweets to a
 troll database.  Then over time the big trolls on Twitter can be
 identified.

 http://twitter.com/TrollWatcher:
 http://j.mp/TrollWatcher

 Remember hashtag #TrollWatcher

 Thanks, and I hope you find it fun to tag trolls.

 Also I have a #FollowFriday helper app at:
 http://j.mp/bleuFF

 Thanks alot, and I hope you enjoy the apps... please share them with
 your friends too.

 Quinn
 Developer
 @thequinnshow

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk




-- 
-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Twitter Search API - Questions Regarding Scaling Out

2011-04-11 Thread M. Edward (Ed) Borasky
I don't see an answer here, but I'll tell you how *I* would go about
implementing this:

1. Switch to the Streaming API. Using Search in an application puts a strain
on Twitter's servers and makes it difficult to Twitter to manage capacity.
That's why it's rate-limited and why the rate limits aren't publicly
disclosed.

2. If your application is a desktop application, use User Streams. If it is
a server, use User Streams on a desktop or the low-frequency free access to
Streaming on a server to prototype and develop. Your target for a server
will be Site Streams, but that's in closed beta at the moment IIRC.

3. *Concurrently with development*, your business development / sales /
marketing / planning people, or yourself, if it's a one-person shop, should
be negotiating with Twitter for access to Site Streams, I'm assuming an
agile development methodology - customer-in-the-loop - and one of the
parties that needs to be in the loop is Twitter for Site Streams. You simply
*can't* build an at-scale Twitter application without direct business
discussions with Twitter!

On Mon, Apr 11, 2011 at 8:14 AM, Corey Ballou ball...@gmail.com wrote:

 I tried speaking with Ryan Sarver directly, but he's forwarding me
 here to the community advocates to answer. I believe this answer will
 need to come top down from Twitter, as it's your rate limiting that
 I'm most worried about.

 I have a technical question for all of you in regards to the Search
 API as I want to maintain full compliancy. Currently, the old Search
 API implementation (albeit slower) provides a fuller result set and
 allows for more flexibility in the types and combinations of searches
 allowed. The manner I have developed my application would allow for a
 number of daemonized worker instances running on different IP
 addresses to make calls to the search API on behalf of the stored
 OAuth credentials to avoid rate limiting issues.

 I had a conversation with the Pluggio developer in which he stated
 Twitter had threatened to shutdown his application if he didn't switch
 to a different implementation of the Search API. The problem indicated
 was that he was performing searches for multiple Twitter accounts,
 which is exactly my use case. Site streams does not make as much sense
 for my application given the search queries I wish to perform and the
 necessity for logical AND operations on geo-location.

 Do you foresee any problems with my current method of using different
 IP addresses to stay under the rate limit? I'm trying to stay in full
 compliance with Twitter's TOS and would love to find the most
 applicable and API friendly solution. I know headway is being made
 with Twitter's new search implementation so I would like to stay ahead
 of the curve and not get myself stuck in a box.

 I still need a method for polling for new search results (say, every
 30 minutes, dependent upon the pricing plan) for non-logged in users.

 Below is a scaled down representation of how I'm currently handling
 searches to help you decide the best plan of action:

 1) Searches are performed on a rolling queue basis, say one search
 every thirty minutes. There can be a finite number of searches per
 Twitter user (say 5 searches per Twitter account). There can be any
 number of Twitter accounts.
 2) Search results are stored locally for retrieval by a javascript
 AJAX long-poller every minute to check for frequent changes.
 3) When a user visits the search results page and filters results, no
 API calls to Twitter are made, only a local query is required

 Due to this process, the queue is constantly searching for the next
 searches and mentions to perform. I foresee rate limiting concerns
 cropping up with searches being performed for any number of users.

 Can you steer me in the right direction to avoid shutdown notices or
 access revocation?

 Regards,

 Corey
 @cballou

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk




-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Site Streams beta update

2011-04-19 Thread M. Edward (Ed) Borasky
On Tue, Apr 19, 2011 at 11:54 AM, Taylor Singletary
taylorsinglet...@twitter.com wrote:

 Site Streams does not support any of the
 search/track features of the User Streams, so if your application requires
 these capabilities, Site Streams may not be the right fit. Some developers
 have asked for Site Streams access with the misunderstanding that it can
 provide a greater percentage of the firehose than the self-serve options
 available to them today -- this is also not the case.

I haven't looked at Gnip recently - are the elevated levels of
filter access available from them, or do they just sell 1/10
Firehose and 1/2 Firehose? Datasift? Seems to me like you're still
going down the two throats to choke path - a user licenses part of
the feed directly from Twitter and must license the rest of it from a
third party adding value. In my experience that's *not* how
enterprises buy stuff - the one throat to choke philosophy is how
they *got* to be an enterprise. ;-)

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Sitebucket: Python based, threaded Site Stream monitor

2011-04-25 Thread M. Edward (Ed) Borasky
HootCourse looks nice ... you'll probably end up changing the name,
though, unless you've negotiated some terms with the HootSuite folks.
;-)

On Sun, Apr 24, 2011 at 1:03 PM, Thomas thomas.welf...@gmail.com wrote:
 Hi everyone,

 I've been working on a Python based, threaded site stream monitor that
 follows the requirements defined at http://dev.twitter.com/pages/site_streams.
 It's called Sitebucket and it's available on Github:
 https://github.com/thomasw/sitebucket If you have beta access to the
 site streams endpoint, you should check it out. I think you'll like
 it.

 I've been using Sitebucket in combination with some asynchronous
 processing magic in production for http://hootcourse.com going on
 about two months now. It's been working out really well, so I figured
 it was finally time to share. You can find Sitebucket's full
 documentation here: http://thomasw.github.com/sitebucket/

 Admittedly, she still needs a bit of work. There's a high level to do
 list at http://thomasw.github.com/sitebucket/todo.html if anyone wants
 to dive in and help out!

 If you find any problems or have requests, please submit a ticket
 https://github.com/thomasw/sitebucket/issues.

 Thanks,
 Thomas

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group: 
 http://groups.google.com/group/twitter-development-talk




-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] @Anywhere JavaScript API Status?

2011-04-25 Thread M. Edward (Ed) Borasky
On Mon, Apr 25, 2011 at 1:18 PM, Taylor Singletary
taylorsinglet...@twitter.com wrote:
 Hi Dusty,
 The Javascript API is still undocumented and unsupported -- the only
 production-ready elements of @Anywhere that are officially supported are the
 simple basics documented at http://dev.twitter.com/anywhere/begin -- there
 are a number of developers who can offer some experience-oriented guidance
 on the @Anywhere mailing list with the extended features at
 http://groups.google.com/group/twitter-dev-anywhere
 But anything beyond the features noted on dev.twitter.com are considered
 internals to the official @Anywhere platform and subject to change at any
 time. It's not really recommended at this time to pursue this avenue of
 development and instead to use server-side integrations for anything more
 complicated than what @Anywhere or Web Intents offer. The document
 at http://platform.twitter.com/js-api.html was meant to display a snapshot
 of what could be possible with a JS-centric API but was never meant to be an
 official platform offering.
 Taylor

It might be time for Twitter's engineering and business development
teams to have a pow-wow about API road maps. There has to be a balance
struck at some point over how much unsupported and undocumented
and experimental work a company as small as Twitter can get away
with, given the size of some of the big dogs Twitter runs with these
days. Have a look at the names that are above Twitter in the Alexa Top
Sites rankings, for example. ;-)

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Developer Relations and the Twitter Platform

2011-04-26 Thread M. Edward (Ed) Borasky
On Tue, Apr 26, 2011 at 10:53 AM, Adam Green 140...@gmail.com wrote:
 Welcome, Jason. Let me be the first, but certainly not the last to remind
 you that many of us are not in the Bay area. Since airfares cost much less
 with 30 days notice, please keep this in mind when announcing developer
 events. For example, a flight from Boston to SFO costs half as much to fly a
 month from now rather than 15 days in the future. That is significant.

So are lodging costs for conferences in Boston relative to PDX. ;-)
-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Getting users' location

2011-04-27 Thread M. Edward (Ed) Borasky
On Wed, Apr 27, 2011 at 9:22 AM, Marcelo Jenisch marc...@inmeta.com.br wrote:
 Hello everyone,

 I need to display the location of someone's followers in a map, so he
 can see the distribution by country of his followers.

 I couldn't use the location, since it is just a text box where the
 user can enter anything and it would be pretty complicated to
 interpret that without some level of error. So my second idea was to
 use the place info in the user's last tweet, but then I realized that
 most tweets don't attach such info.

 So now I'm at a loss. Do I invest time in interpreting the location
 field, or are there better (easier or more accurate) ways to get such
 info? It doesn't even need to be down to the city level, as long as I
 can get a country, it's fine.

There are ways you can infer someone's location, but you run the
risk of running afoul of privacy laws and terms of service violations
for the services you access via APIs or scraping. The correct way to
acquire someone's location at any granularity is to *explicitly* ask
them for it, *clearly* stating in plain language what they will
receive in return.

This is a very big deal - just look at all the brouhaha over the
iPhone location logging that erupted last week. There's no shortcuts /
tricks / games you can play here. You need lawyers and solid business
planning.

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


[twitter-dev] Where is the RSS feed link on #newtwiiter?

2011-04-28 Thread M. Edward (Ed) Borasky
Maybe I'm just getting old, but I can't seem to find the link for my
account's RSS feed on #newtwitter. Did it go away? Is that feed
deprecated? It's right where it always was on the old Twitter. ;-)

-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Streaming API JSON Samples

2011-05-02 Thread M. Edward (Ed) Borasky
From sample you will receive delete messages. From User Streams
you will receive numerous types of events, as well as tweets and DMs.
I haven't looked at the documentation recently, but last time I did
Twitter was still reserving the right to add message types and
recommended you have a code path for message types you had never seen.

On Mon, May 2, 2011 at 12:34 PM, Augusto Santos augu...@gemeos.org wrote:
 Hi Juliano,

 From filter stream we received just two types of messages: 'status' (tweets
 itself) and 'limit' (show how many tweets was suppressed since last
 reconnection).

 Abraços da UFRGS!!

 On Sun, May 1, 2011 at 3:40 PM, Juliano Bortolozzo Solanho
 juliano.sola...@gmail.com wrote:

 Hello there,
 Does anyone know of some sort of community maintained repository of
 message types sent by the Streaming API?
 With a sample of every known type of json message found in the
 site/user/filter streams.
 -
 Juliano

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk



 --
 氣

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk




-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] At Reply Spam

2011-05-05 Thread M. Edward (Ed) Borasky
Twitter is supposed to be entertaining and informative. I don't know
about all of you, but I got a good belly laugh from discovering this
on Louis Gray's blog last night, following the links to some NSFW
tweets and then reading the ReadWriteWeb post Marshall Kirkpatrick
made on the subject. ;-)

Yeah, it's a bad idea IMHO but I did need a good laugh.

On Thu, May 5, 2011 at 9:07 AM, TjL luo...@gmail.com wrote:
 On Thu, May 5, 2011 at 11:45 AM, Arnaud Meunier arn...@twitter.com wrote:
 Neither our TOS nor our Automation Rules  Best Practices
 (http://support.twitter.com/articles/76915) have changed since the launch
 of @twittersuggests experimental feature :)

 I think that's pretty much what I said :)

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group: 
 http://groups.google.com/group/twitter-development-talk




-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] Re: At Reply Spam

2011-05-06 Thread M. Edward (Ed) Borasky
It's an @reply spambot, pure and simple. There is no vetting of
suggested users - it didn't take either me or Marshall Kirkpatrick
long to find a tweeter that was not safe for work in @twittersuggests'
stream.

It's a bad idea - Twitter needs to quit screwing around with stuff
like this and solve problems that keep people with budgets up at
night!

On Fri, May 6, 2011 at 12:38 AM, Arnaud Meunier arn...@twitter.com wrote:
 Dewald,

 These rules apply to third party apps. @twittersuggests is not a third
 party app, but an experimental feature, developed and owned by
 Twitter.

 Now I can also understand this Do as I Say, not as I Do situation
 can be irritating. But I guess the best thing to do at this point is
 probably to share your thoughts on the experiment through his
 dedicated feedback form:
 https://spreadsheets.google.com/a/twitter.com/spreadsheet/viewform?formkey=dHJ6UnYwdFZ6aHNRRVJoTU1mYl9FMlE6MQ

 Arnaud / @rno


 On May 5, 2011, at 11:56 AM, Dewald Pretorius dpr...@gmail.com wrote:

 Arnaud,

 That's comforting to know. With that being the case, can you please
 enlighten us as to why Twitter is apparently violating its own rules,
 which, as you said, are still in force and we all still are apparently
 expected to adhere to?

 Let me help you and quote from your rules the appropriate text: If
 you are automatically sending @reply messages or Mentions to a bunch
 of users, the recipients must request or approve this action in
 advance.

 Have any of the users targeted by @twittersuggests, which is sending
 automated @reply messages to a bunch of users, explicitly requested
 or approved this action in advance?

 If not, then you may have de facto invalidated that section of your
 rules and by implication exempted all developers and applications from
 it.

 On May 5, 12:45 pm, Arnaud Meunier arn...@twitter.com wrote:
 Hey Dewald,

 Neither our TOS nor our Automation Rules  Best Practices 
 (http://support.twitter.com/articles/76915) have changed since the launch
 of @twittersuggests experimental feature :)

 Arnaud / @rno http://twitter.com/rno







 On Thu, May 5, 2011 at 6:00 AM, TjL luo...@gmail.com wrote:
 On Thu, May 5, 2011 at 8:31 AM, Dewald Pretorius dpr...@gmail.com wrote:
 With reference to @twittersuggests, is other unsolicited @reply spam
 now also officially sanctioned by Twitter?

 When has Twitter ever given you the idea that they were playing by the
 same rules as everyone else?

 --
 Twitter developer documentation and resources:http://dev.twitter.com/doc
 API updates via Twitter:http://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 http://groups.google.com/group/twitter-development-talk

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group: 
 http://groups.google.com/group/twitter-development-talk

 --
 Twitter developer documentation and resources: http://dev.twitter.com/doc
 API updates via Twitter: http://twitter.com/twitterapi
 Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
 Change your membership to this group: 
 http://groups.google.com/group/twitter-development-talk




-- 
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul Erdős

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk


Re: [twitter-dev] A new permission level

2011-05-18 Thread M. Edward (Ed) Borasky


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos


Quoting Matt Harris thematthar...@twitter.com:


Hey everyone,

We recently updated our OAuth screens to give users greater transparency
about the level of access applications have to their accounts. The valuable
feedback Twitter users and developers have given us played a large part in
that redesign and helped us identify where we can do more.

In particular, users and developers have requested greater granularity for
permission levels.

In response to this feedback, we have created a new permission level for
applications called “Read, Write  Direct Messages”. This permission will
allow an application to read or delete a user's direct messages. When we
enforce this permission, applications without a “Read, Write  Direct
Messages” token will be unable to read or delete direct messages. To ensure
users know that an application is receiving access to their direct messages,
we are also restricting this permission to the OAuth /authorize web flow
only. This means applications which use xAuth and want to access direct
messages must send a user through the full OAuth flow.


What does this mean for your application?
If you do not need access to direct messages: you won’t need to make any
changes to your application. When we enforce the new permission level your
read or read/write token will automatically lose access to direct messages.

If you do need access to direct messages: you will need to edit your
application record on https://dev.twitter.com/apps and change the permission
level of your application to “Read, Write and Direct Messages”. The new
permission will not affect existing tokens which means existing users or
your app or service will need to reauthorize.

We know this will take some time so we are allowing a transition period
until the end of this month. During this time there will be no change to the
access Read/Write tokens have to a users account. However, at the end of the
month any tokens which have not been upgrade to “Read, Write and Direct
Messages” will be unable to access and delete direct messages.


Affected APIs and requests
On the REST API, Read and Read/Write applications will no longer be able to
use these API methods:
/1/direct_messages.{format}
/1/direct_messages/sent.{format}
/1/direct_messages/show.{format}
/1/direct_messages/destroy.{format}

For the Streaming API, both User Streams and Site Streams will only receive
direct messages if the user has authorised an application to access direct
messages.

Applications that use “Sign-in with Twitter” or xAuth will only be able to
receive Read or Read/Write tokens.

What this means is only applications which direct a user through the OAuth
web flow will be able to receive access tokens that allow access to direct
messages. Any other method of authorization, including xAuth, will only be
able to receive Read/Write tokens.


What will happen when the permission is activated
When we activate the new permission, all Read and Read/Write user_tokens
issued to third-party applications will lose their ability to read direct
messages. Any attempt to read direct messages will result in an HTTP 403
error being returned.

For example, a GET request to
https://api.twitter.com/1/direct_messages/sent.json will return an HTTP 403
Forbidden with the response body:

{errors:[{code:93,message:This application is not allowed to access
or delete your direct messages}]}


Key Points
* If you wish to access a user’s direct messages you will need to update
your application and reauthorize existing tokens.
* The only way to get direct message access is to request access through the
OAuth /authorize web flow. You will not be permitted to access direct
messages if you use xAuth.
* When we enforce the permission Read/Write and Read tokens will be unable
to access and delete direct messages.
* Read/Write tokens will be able to send direct messages after the
permission is enforced.

We’ll be collating responses and adding more information on our developer
resources permission model page:
https://dev.twitter.com/pages/application-permission-model

We have also blogged about this on the Twitter blog:
http://blog.twitter.com/2011/05/mission-permission.html

Best,
@themattharris

--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker:   
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:   
https://groups.google.com/forum/#!forum/twitter-development-talk




--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] Introducing the Follow Button

2011-05-31 Thread M. Edward (Ed) Borasky
Now I'm getting curious about the road map for @anywhere and all the  
miscellaneous Twitter plugins, especially for WordPress. Last year,  
when Twitter announced @anywhere, I tried a couple of plugins before  
settling on one. What I got from that was hovercards, tweet boxes and  
follow buttons.


A few months later, I discovered that the trips to Twitter servers  
were slowing down my blog's page loads, so I stopped using @anywhere.  
Since then, there have been some other JavaScript tools from Twitter,  
and now this Follow Button.


So I've put a follow button on my blog. So far it doesn't seem to be  
slowing it down, but it's only been up a couple of hours. In any  
event, is @anywhere deprecated, in favor of the most popular single  
functions from the collection, like follow buttons? Or are there  
always going to be multiple JavaScript / HTML widgets and gizmos  
coming from Twitter that users need to track?



--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos


Quoting Arnaud Meunier arn...@twitter.com:


Hey developers,

Today we're launching the Follow Button!  Similar to the Tweet Button,
it's a new widget that lets users easily follow a Twitter account from
any web page. The Follow Button has a single click follow experience,
simple implementation model, and is configurable to fit the needs of
your website.

Read our announcement on the Twitter blog, and use the resources below
to set up your own Follow Button:

- Create a Follow Button here:   
http://twitter.com/about/resources/followbutton

- Detailed documentation: http://dev.twitter.com/pages/follow_button

We’ve also added a Javascript layer to our Buttons and Web Intents
that makes it possible for you to detect how users are interacting
with these tools, and to hook them up to your own web analytics. More
details on: http://dev.twitter.com/pages/intents-events

We're excited to see how you guys will implement the Follow Button.
Let us know what you think, or if you have any questions.

Arnaud / @rno

--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker:   
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:   
https://groups.google.com/forum/#!forum/twitter-development-talk




--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] Introducing the Follow Button

2011-05-31 Thread M. Edward (Ed) Borasky
Thanks!! I'm all in favor of frictionless. Still, I'm struggling now  
to think of a use case for @anywhere, being mid-way between Web  
Intents and server-side REST functionality. In fact, I'm struggling to  
think of a use case for the server-side stuff now. ;-)


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos


Quoting Taylor Singletary taylorsinglet...@twitter.com:


Hi Ed,

@Anywhere is an effort to provide a client-side authentication 
authorization flow to Twitter REST API integrations: a simpler, more
frictionless experience for common Twitter actions. While @Anywhere meets
this criteria, there is obvious room for continued simplification, both for
end-users and implementors. @Anywhere applications still require a developer
to register an application and the end-user to make additional approvals for
that application construct.

The Twitter for Websites arm of the Twitter Platform (Tweet Button, Follow
Button, and Web Intents) provides integrators with even simpler solutions
that don't require API keys. By utilizing the end user's logged in state,
the gulf between the user's intention to act and the action being
accomplished is bridged. While the Buttons, like @anywhere, use Javascript,
the building blocks they use, Web Intents, provide perhaps the most atomic
form of frictionless integration: simple URLs that can be linked from any
web-enabled context, with or without Javascript.

Web Intents and the Tweet  Follow Buttons are the best fit for a wide swath
of integration points. Deeper integrations are still best serviced by
server-side REST integrations or @Anywhere.

@episod http://twitter.com/episod - Taylor Singletary


On Tue, May 31, 2011 at 3:24 PM, M. Edward (Ed) Borasky 
zn...@borasky-research.net wrote:


Now I'm getting curious about the road map for @anywhere and all the
miscellaneous Twitter plugins, especially for WordPress. Last year, when
Twitter announced @anywhere, I tried a couple of plugins before settling on
one. What I got from that was hovercards, tweet boxes and follow buttons.

A few months later, I discovered that the trips to Twitter servers were
slowing down my blog's page loads, so I stopped using @anywhere. Since then,
there have been some other JavaScript tools from Twitter, and now this
Follow Button.

So I've put a follow button on my blog. So far it doesn't seem to be
slowing it down, but it's only been up a couple of hours. In any event, is
@anywhere deprecated, in favor of the most popular single functions from
the collection, like follow buttons? Or are there always going to be
multiple JavaScript / HTML widgets and gizmos coming from Twitter that
users need to track?


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos



Quoting Arnaud Meunier arn...@twitter.com:

 Hey developers,


Today we're launching the Follow Button!  Similar to the Tweet Button,
it's a new widget that lets users easily follow a Twitter account from
any web page. The Follow Button has a single click follow experience,
simple implementation model, and is configurable to fit the needs of
your website.

Read our announcement on the Twitter blog, and use the resources below
to set up your own Follow Button:

- Create a Follow Button here:
http://twitter.com/about/resources/followbutton
- Detailed documentation: http://dev.twitter.com/pages/follow_button

We’ve also added a Javascript layer to our Buttons and Web Intents
that makes it possible for you to detect how users are interacting
with these tools, and to hook them up to your own web analytics. More
details on: http://dev.twitter.com/pages/intents-events

We're excited to see how you guys will implement the Follow Button.
Let us know what you think, or if you have any questions.

Arnaud / @rno

--
Twitter developer documentation and resources:
https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi

Issues/Enhancements Tracker:
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
https://groups.google.com/forum/#!forum/twitter-development-talk



--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi

Issues/Enhancements Tracker:
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
https://groups.google.com/forum/#!forum/twitter-development-talk



--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker:   
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:   
https://groups.google.com/forum/#!forum/twitter-development-talk




--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com

[twitter-dev] Is the sample stream still delivering 1% of all public tweets?

2011-06-02 Thread M. Edward (Ed) Borasky
I'm just getting back to my code that uses the sample Streaming  
endpoint. Is that still delivering 1% of all public tweets?


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos



--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] trending topics order

2011-06-25 Thread M. Edward (Ed) Borasky
How difficult would it be for Twitter to return the tweets per minute  
by location on Trending Topics? For example, if hockey is getting  
100 tweets per minute in Boston, the line for Boston would read


boston 100


--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos


Quoting Matt Harris thematthar...@twitter.com:


Hi,

Yes, trending topic responses are returned in the order of most trending to
least trending. In the example you give Guille Franco is trending more than
Vuvuzela.

Best,
@themattharris https://twitter.com/intent/follow?screen_name=themattharris
Developer Advocate, Twitter



On Fri, Jun 17, 2011 at 7:09 PM, xkema kemal...@gmail.com wrote:


Hi there

Are trending topics results, ordered from most-trendy topic to last
trendy?
..
..
..
consider a trends node like:

trends: [
   {
 name: Guille Franco,
 url: http://search.twitter.com/search?q=Guille+Franco;
   },
   {
 name: #honestyhour,
 url: http://search.twitter.com/search?q=%23honestyhour;
   },
   ...
   ...
   ...
   ...
   {
 name: Vuvuzela,
 url: http://search.twitter.com/search?q=Vuvuzela;
   }
 ],

Question again: IsGuille Franco most trending and Vuvuzela least
trending. (for these ten result)

--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker:
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:
https://groups.google.com/forum/#!forum/twitter-development-talk



--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker:   
https://code.google.com/p/twitter-api/issues/list
Change your membership to this group:   
https://groups.google.com/forum/#!forum/twitter-development-talk




--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] Re: sudden api slowdown

2011-06-27 Thread M. Edward (Ed) Borasky
I haven't been doing anything with the REST API recently but I think  
there was some kind of event on Streaming last night. I don't have  
the data here but it was about 2011-06-27T05:00:00Z if I remember  
correctly. I was connected to the sample stream with basic auth if  
that matters. It looked like a giant spike in tweet rate and it sent  
the Perl AnyEvent::Twitter::Stream library into deep space. It  
recovered fairly rapidly, although my machine didn't - I ended up  
rebooting. ;-)

--
http://twitter.com/znmeb http://borasky-research.net

A mathematician is a device for turning coffee into theorems. -- Paul
Erdos


Quoting Nicholas Chase nch...@earthlink.net:




On 6/27/2011 6:25 PM, jenny wrote:

To make things more exciting, all new site stream connections started
returning 401s half an hour ago(9:47utc)...
-jenny


Check your access tokens; that's what's been happening to me for the
last several days, and it comes down to the access key and secret
spontaneously changing.  (Still waiting to hear on that one...)

  Nick

--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker:   
https://code.google.com/p/twitter-api/issues/list

Change your membership to this group:
https://groups.google.com/forum/#!forum/twitter-development-talk


--
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


<    1   2   3   4   5