Re: [twitter-dev] Trying to get rid of twitter spammers

2010-12-11 Thread Furkan Kuru
Unfortunately we do not have any time to implement a spam filter/ranking algorithm. Besides I think this issue should be resolved on the twitter side. Some people are sending tweets in reply to *all* twitter users. I think the spammer twitter accounts and their tweets should be analyzed. The

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Furkan Kuru
The text in these spam tweets are not easy to recognize. They do not repeat. They are mixed of different words and they contain a link. They seem to be sent via web. The ranking and discarding some mentions will not completely resolve the problem. Because our mention data and trending words data

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Adam Green
All of your sample spam tweets are from suspended accounts, yet the tweets were only sent yesterday. That means that the spammers behavior was so aggressive that they were suspended quickly by a Twitter algorithm. I doubt that a human at Twitter read your email and went through each tweet

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Edward Hotchkiss
empty url? resolve if the user clicks i'm sure there is backend code running, the only purpose of even returning a 200 On Nov 27, 2010, at 8:33 AM, Adam Green wrote: All of your sample spam tweets are from suspended accounts, yet the tweets were only sent yesterday. That means that the

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Furkan Kuru
Most of the tweets here are spams: http://twitturk.com/tweet/search?q=lol On Sat, Nov 27, 2010 at 3:33 PM, Adam Green 140...@gmail.com wrote: All of your sample spam tweets are from suspended accounts, yet the tweets were only sent yesterday. That means that the spammers behavior was so

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Adam Green
The URLs again return a code of 200 and nothing in the content. What happens when you try getting one of the URLs with cURL? I'm curious if it behaves differently for an IP in Turkey. On Sat, Nov 27, 2010 at 8:56 AM, Furkan Kuru furkank...@gmail.com wrote: Most of the tweets here are spams:

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Furkan Kuru
It returns a redirection to amazon.com product page Example: http://www.amazon.com/gp/product/B0041E16RC?ie=UTF8tag=iphone403d-20linkCode=as2camp=1789creative=9325creativeASIN=B0041E16RC On Sat, Nov 27, 2010 at 4:04 PM, Adam Green 140...@gmail.com wrote: The URLs again return a code of 200

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Adam Green
Now you know that it does resolve differently in different countries. You could set up an account with a webhost in the US, and have a script there that you can call with URLs in tweets from new users. If the URL resolves to a blank page, blacklist that user. There are plenty of good hosts that

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Furkan Kuru
Another hosting will be problematic to maintain. I have looked at a few more short urls. They redirect to very wide range of sites not just amazon. I think twitter may change the priority level of Report for spam for new opened accounts. And the number of tweets per hour. Here I write again the

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Edward Hotchkiss
the followers are probably bots, create an account and within about 5 minutes or less you will generally have 2-3 followers that appear [real]. they iterate over ids. someone is running a dating/hookup bot net with those user accounts. On Nov 27, 2010, at 4:18 PM, Furkan Kuru wrote: Another

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-27 Thread Adam Green
My final suggestion is to rank users by something (age of account, number of mentions/mentioners/followers/following) and cut out the bottom N%. On Sat, Nov 27, 2010 at 4:18 PM, Furkan Kuru furkank...@gmail.com wrote: Another hosting will be problematic to maintain. I have looked at a few more

RE: [twitter-dev] Trying to get rid of twitter spammers

2010-11-26 Thread Dean Collins
What I don't understand is that apart from possibly generating clicks why are people doing this? Are enough clicks converting into some kind of ROI interaction that makes them money? I keep expecting SPAM to take some kind of evolutionary leap (customized to your location/interests/cookies

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-26 Thread Furkan Kuru
Word lol is the most common in these spam tweets. We receive 400 spam tweets per hour now tracking 100K people. We plan to delete all of the tweets containing lol word. It is also used by our users (Turkish people) writing in English though. Any better suggestions? On Fri, Nov 26, 2010 at 5:15

RE: [twitter-dev] Trying to get rid of twitter spammers

2010-11-26 Thread Dean Collins
November 2010 11:27 AM To: twitter-development-talk@googlegroups.com Subject: Re: [twitter-dev] Trying to get rid of twitter spammers Word lol is the most common in these spam tweets. We receive 400 spam tweets per hour now tracking 100K people. We plan to delete all of the tweets containing lol

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-26 Thread Adam Green
As long as you aren't trying to capture and deliver *all* tweets, there are a couple of good ways to cut out spammers. One thing I do is save all mentions for all users in a database of tweets. When a tweet comes in from the streaming API, I collect @mentions, and store them with the screen name

Re: [twitter-dev] Trying to get rid of twitter spammers

2010-11-26 Thread M. Edward (Ed) Borasky
Hmmm ... Twitter has a user quality filter that's supposed to weed out spammers from Search and Streaming. At about 450,000 new user IDs created every day, it might take a while for Twitter's spambot detectors to flag them all, but I'd think between algorithms and crowdsourced block /