Reposting. I should have fixed the horrendous spelling my phone dished
out. Sorry for the double post, but this one should be clearer…
Thanks. I have a feeling I'm going to go over the 20,000 a hour hit
rate limit. Are those hard limits or does Twitter make concessions to
busy sites?
I
I dint think this is a function of a workaround. This is a function of
Twitter having a good policy in place to prevent abuse.
You can do what you want by incrementally querrying the API. The API
limits will make it take too long. Even with multiple accounts it will
be months before you
Hi Mark, I am just not there yet, 80% into the dev. If I can take
this off list, I would be more than happy to explain to you what it is
all about.
Thanks for the reply and working with me on this.
I plan on being public and getting a normal API key soon, as soon as I
manage to come up
I heard the other day that in the wake of the MJ stuff, a few high
profile celebs accounts where hacked. Is this media hacking and
there were just weak passwords, or their email accounts were
compromised, or were these real live hacks where someone brute forced,
or did otherwise
actually taking advantage of a security flaw in our system was the
Mikeyy
worm that was going around for a weekend several months ago. We've
done a
lot of security work since then, and there's more in progress.
On Mon, Jun 29, 2009 at 15:40, Scott Haneda talkli...@newgeo.com
wrote:
I heard
Found a site today that gives you your first tweet. Looking over the
API, I can not figure out how to do this. Would doing a date search,
and going way back in time, to get the first tweet work? I thought
the search API only afforded you 7 days.
If I use REST, then I am not sure how I
Looking at the timeline API calls, all seem to return much redundant
data. Everything in the user section is repeated. If I return 200
items, I will get 200 copies of the user data.
Is this correct? Seems like a lot of extra data to send across the
wire. I was looking at the search
Is RT an official Twitter funtion or a community invented convention?
If I have a timeline loaded what is the best way to determine the
number of retweets? There seem to be many formats in which RT is done.
--
Scott
Iphone says hello.
Has Twitter ever shared their logic for locating @usernames and hash
tags?
@([A-Za-z0-9_]+)
The above regex seems logical but I can see faults. It will pick up
the trailing domain in an email address.
I could look for a whitespace in front, or nothing in front and do
better.
Then there
I will look it over when I have a larger screen than a phone. I am
guessing English is not your native language?
I would start with getting someone to help you with the grammer on the
first page and a few other pages.
If you would like help in that area, more than happy to lend a hand.
I am finding near all apps I use with twitter in some way or another
fail at threading a conversation. Anyone have pointers for how to do
this, based on the current twitter API, and whatever bugs have been
uncovered, perhaps with workarounds?
Each tweet has a 'in_reply_to_status_id', if
Thank you, makes sense.
On Jun 30, 2009, at 7:35 AM, Abraham Williams wrote:
The bandwidth is cheaper for Twitter then the cycles to drop duplicate
user objects.
Abraham
On Tue, Jun 30, 2009 at 02:25, Scott Hanedatalkli...@newgeo.com
wrote:
Looking at the timeline API calls, all seem to
Been pondering this today. There seem to be 7 day limits, or around
3000 tweet limits to the API. At first, my gut told me that was for
load reasons, and it made sense.
I started thinking about paging results in development projects I have
worked on.
Looking at this from a database
[1]. A cleaver regex should help you parse if a tweet
is a
retweet.
http://www.google.com/webhp?
complete=1hl=en#complete=1hl=enq=retweet
+formataq=foq=aqi=fp=LH9toxtiWpk
Thanks,
Doug
On Tue, Jun 30, 2009 at 9:56 AM, Scott Haneda talkli...@newgeo.com
wrote:
Is RT an official Twitter
Awesome, thanks. I found I had to use a B, so this works form me:
\B@([A-Za-z0-9_]+)
Word boundary is indeed very handy, works perfect, and the hash tag
one works close enough.
I know there are limits on length, what are they for both hash tags
and @usersnames?
On Jun 30, 2009, at
Hope this is not out of line, but this list has been pretty busy
lately in traffic, and I am looking for a little hand holding on tweet
threading... so bump :)
On Jun 30, 2009, at 3:53 PM, Scott Haneda wrote:
I am finding near all apps I use with twitter in some way or another
fail
What is the getMentions method? I did not see that in the twitter
API. I suspect this is a framework you are referring to?
Or are you talking about this:
http://apiwiki.twitter.com/Twitter-REST-API-Method%3A-statuses-mentions?SearchFor=mentionssp=1
That seems inaccurate though, would it
On Jul 8, 2009, at 4:22 PM, Doug Williams wrote:
It is not possible to view a user's email address. Additionally, it
is not possible to perform a user lookup based on an email address.
This is not entirely true, though can not be done through the API. I
had friends find me on twitter,
You are correct, you have to do 15 requests. However, you can cache
the results in your end, so when you come back, you are only getting
the new stuff.
Twitter has pretty good date handling, so you specify your last date,
and pull forward from there. You may even be able to get the
You are correct, you have to do 15 requests. However,
you can cache the results in your end, so when you come
back, you are only getting the new stuff.
Thanks Scott. I'm storing the results in a database on my server but
that doesn't stop the search from retrieving the same results
From what I understand, it is UTC time. The +/- is the offset
depending on what zone you are in.
This allows for a time value that is the same across the world, but
can be offset for any particular locale.
I think http://en.m.wikipedia.org/wiki/Coordinated_Universal_Time will
explain
I think that you should look at tr.im. They make it rather clear that
they have no intention of ever doing something like this. Their API
is really nice to work with.
I had one issue that I exceeded their limits on a non API key account,
and my IP was blocked. It took them way too
Can you tell me more about this auto topic discovery feature? I am
not seeing anything of that nature on the twitter Web site at all.
On Aug 5, 2009, at 2:29 AM, AJ Chen wrote:
After playing around with auto-discovery of topics in twitter
conversations for a while, it seems to me that
I agree. I also think it is very important to recognize Twitter made a
strong move with such an open API. As a result, it is just as
important to recognize, Twitter very well may not be where it is today
were it not for third party apps.
I may go as far as to say the API should be a higher
Can someone point me to the details on the attack? I am a little out
of the loop. I've heard Twitter only uses around 200Mbit/s of data.
From a net ops perspective, why is this challenging to detect and
block?
I'm not trying to degrade the efforts of the engineers, this is a
genuine
In all honesty, I think you are stuck. The responsible thing to do is
follow this list and wait until the API is reported 100% functional.
Writing a new app is bound to have testing issues, currently you have
zero way of knowing if it is your app, the API, routing blocks, or
even
It may get even harder and open the door to an already hot topic with
T.W.I.T. (The Week In Tech) which is a show by Leo Laporte.
I believe this show pre-dates the use of twit, and nay pre-date
Twitter. I seem to recall at some point Leo Laporte would not even use
Twitter as a result of
I don't know how we get to the point of meaningful auto following.
That seems hard to define.
If I post a tweet mentioning photography I get 5-10 new followers in
a few minutes. Use the word cock or pussy and the auto follow rate
is higher. Hash tags are vulnerable here as well.
In
The second you can play drinking games based on how many times a
company is mentioned on local news; I think that companies ability to
be clear and unambiguous becomes as hard as not getting hammered in
5 minutes of watching the news.
--
Scott
Iphone says hello.
On Aug 12, 2009, at 6:04
I was always under the impression trademarks came down to a reasonable
expectation that users could be confused as to which was the original
name.
In the example of the Edge iPhone game, he was called out against
using Edge as a name since there was a shady software development
house
I am not a lawyer, but everything I have read about this makes the
below impossible. If you have a trademark on a name, you MUST protect
it. Failure to protect it, results in loss of the mark.
The quote below, clearly states that Twitter is not going to protect
this mark. That being
Others use your following and follower list as a way to bridge new
connections to interesting people.
If I am interested in Person X, I can look at who is following him,
and know that others are probably of like minds. I can dig into their
list of followers and following, and build
This is a little OT, and while somewhat tongue in cheek, I thought it
amusing, just for the utter inaccuracy of it, as well as how some
peoples minds works:
Suffer through the ad, and go to 20:00 in the video
http://www.hulu.com/watch/89201/late-night-with-jimmy-fallon-tue-aug-11-2009
I used to ass well, this does not work well when number grow.
On Aug 12, 2009, at 11:54 AM, JDG wrote:
sure they do. it's called blocking. every time a pain in the ass
porn bot or social media expert following 100x more people than
follow them follows me, i block them. then they can't
.
These are pretty rough generalizations, but I certainly do not agree
with the no harm statement. It just depends on your use and how you
define harm, which to me is defined as inconvenience.
On Aug 12, 3:28 pm, Scott Haneda talkli...@newgeo.com wrote:
If I go to someone's account and they have 500
Good point. There are a lot more broken things that have higher
priority. Top of the list, notify all third party clients that do not
attach a message ID to a reply.
Threading of tweets is so fundamentally broken it should be way up on
the list. Sure, not twitters fault, but the third
On Aug 17, 2009, at 11:40 AM, Brian Smith br...@briansmith.org
wrote:
Paul Kinlan wrote:
Favorites are open to be read, it is just that not many
people use it and I can't actually find who favorited my
tweets - (probably no one in my case ;) - if I had that
information I could do a lot of
On Aug 17, 2009, at 1:38 PM, iphone.noob wrote:
Will wrote:
My mindset was that why hold back a feature that solves one problem
just because it doesn't solve two. What I didn't take into
consideration is that it creates another problem - disparate methods
of retweeting because people will
Hello. The Twitter API has a mobile version. I have never seen it work.
http://apiwiki.twitter.com/Getting-Started
As you can see, if you are detected as mobile all API doc pages 404. I
click the desktop version link at the bottom and everything works as
advertised.
I thought I would
Good point. Why not just send them an email, and offer to let them
follow you? This puts it as a opt in on their part. You can then
follow them back if you desire, which I assume you do.
Probably not a good idea to do anything of this nature when you are
talking about 400K.
On Aug 19,
Playng with the http://apiwiki.twitter.com/Twitter-REST-API-Method%3A-statuses%C2%A0update
part of the API today. I can post easily with curl:
curl -u user:password -d status=foo bar baz
The Tweet says it is from API. How do I set the user agent as I
have seen other developers do? It
My only statements regarding ethics or morality is that with a list of
400K people, there will be many ways in which those 400K people
interpret what you are doing.
So you were able to do 1700 emails so far, can you figure out what the
limit is? At that point, I would probably use a
From the google docs on importing:
• You can import 3,000 contacts at a time.
• Non-ASCII or non-Latin characters may not be accepted.
• Any information formatted as a group or distribution
list won't transfer into your Gmail Contacts list.
• Importing
Ha ha. Php does have a regex parser. This should not matter if coded
correctly. Twitter did announce they would be messing around last week.
--
Scott
Iphone says hello.
On Aug 22, 2009, at 3:07 AM, Andrew Badera and...@badera.us wrote:
Crazily enough, not everyone writes in PHP.
∞ Andy
Building my ever growing exclusion list for Twitter to get more signal
and less noise...
#php -lance -phpge3k -stackalert -RT -imoracle -#freelance -phplinks -
web2feed -freelance -webtechman -tuvinh -freelancer -job -jobs
That works.
#php -lance -phpge3k -stackalert -RT -imoracle
If you don't want a public community API, and want to write it in your
own, then you are sort stuck.
The docs show you sample curl commands or you can http request in a
browser to test simulate.
You have sample curl examples, if you are objectionable to libraries,
then warp your php
I agree with your disagreement. The other day I was playing with a
service that made a background. When I clicked done, I thought it
would prompt me to save the image and I would be on my own to upload
it into my account.
That is not what happened. It auto replaced my background. I also
Hello, what is the best way to get tweets that are from me OR to me OR
mentioning me?
I have been playing with with search API:
feed://search.twitter.com/search.atom?q=from:some_user+...@some_user
I believe that does what I want, but was not sure if the search API is
the best place to be
Thanks. These users will be mobile, largely, and asking them to log
in to see what will amount to comments is asking too much. This is
more a add on feature that some may find value in.
Looks like search it is.
On Aug 26, 2009, at 9:41 PM, Raffi Krikorian wrote:
if you were to allow
I hope you find out. I long ago gave up. If I really needed the
feature, I would scrape that one out of the html, which I know is
frowned upon, however, as your data shows, this is pretty all over the
map.
On Sep 2, 2009, at 2:44 PM, Jason Tan wrote:
Anyways, to get back to my
Yes.
On Sep 3, 2009, at 9:41 AM, ka...@sbcglobal.net wrote:
Is twitter a fad or worth development efforts?
--
Scott * If you contact me off list replace talklists@ with scott@ *
I have not looked at this so this is mostly curiosity.
Why use md5 on a moving target? Who knows when someone may resave an
image to compress it more.
I bet 1% compression savings translates to thousands of dollars over
short time.
Isn't the path relatively static?
/images/default...
Then maybe mark it in the docs as highly experimental, this way,
people do not build their business plans around something. Make it
clear, this feature could go away at any time.
On Sep 15, 2009, at 11:04 AM, Alex Payne wrote:
Please understand that the denormalized lists are currently
Probably too late for this, but perhaps moving forward, it could be
done...
Twitter.com should move to using their own API. The tools they use to
power their own site should be the same tools we use and rely on.
In all reality, this seems a simpler approach, rather than pushing out
code
I think the important part here is in some places. The problem is,
twitter.com probably has 75% or more of the exposure. The lowly app
developer hits a bug in the API, and people say wtf, works on
twitter.com, this app sucks.
Good to know that facebook and the mobile site are using the
Can someone explain this issue to me in more detail?
How do I know my php can handle it? I'm running on an older PPC
machine, which is 64 bit, but I have no idea if I built it as 64, I
just supplied standard configure arguments.
If php sees a 64 bit integer come in as JSON what happens on
If you are on 32 bit, what php.ini changes are you referring to that
would be beneficial?
--
Scott
Iphone says hello.
On Sep 25, 2009, at 10:35 AM, jmathai jmat...@gmail.com wrote:
I like Abraham's idea:
Twitter could add: next_cursor_string:1314614526448841129
Or a general
Ok, I'll bite :)
I though you meant phishing at first.
Do you have programmin experience? If so, what languages are you
familiar with?
If not, do you have access to a programer and are just looking for
confirmation that your idea could be realized?
This mailing list is primarily for
I tend to agree, a MacMini, around 600.00, would build php out as 64
bit no issue. If you are a baby startup, that should really cover you
and be able to handle a lot more load than you would think. You may
have to pop your database on something more robust, but it works quite
well as
I would not change either. But there are those here that are stating
they need new hardware to work around this issue, and that they can
not afford that. I was trying to be that voice of reason if that is
the road/excuse they are choosing to go.
There seem to be acceptable workarounds,
it a string
people could convert it to 64bit int if they still want to.
On Sep 25, 10:16 pm, Scott Haneda talkli...@newgeo.com wrote:
I would not change either. But there are those here that are
stating
they need new hardware to work around this issue, and that they can
not afford that. I was trying
I think it would be more appropriate to create a GUI interface in
Visual Basic, see if I can track an IP address. :)
--
Scott * If you contact me off list replace talklists@ with scott@ *
On Sep 25, 2009, at 6:05 PM, Dewald Pretorius wrote:
I am going to remotely install a
VB program on
I'm not sure this is possible, I'm trying to avoid a local data store
to make it possible.
I would like to get a small bit of data from a tweet, but only the
first tweet, ignoring that user from that point forward.
I can of course grab their username and disregard, but my list will
tweet.
Cheers
Peter
On Sat, Oct 10, 2009 at 1:19 PM, Scott Haneda talkli...@newgeo.com
wrote:
I'm not sure this is possible, I'm trying to avoid a local data
store to
make it possible.
I would like to get a small bit of data from a tweet, but only the
first
tweet, ignoring that user from
Thank you. I think I just got booted from hitting the public timeline
too much. I requested whitelisting via the whitelist form. Since I
am not authenticating, and am just curl'ing the json resource for the
public timeline, is there a way for me to tell what is really happening?
I
One last question I think. Is there a way to control how many items
come back in a request to the public timeline? I currently can not
tell how many there are in the result set, I will have to wait an hour.
However, if I could get a larger batch, I could query it much less
often.
--
It appears Twitter returns the 'source' field which has a user agent
in it.
Most of the time this is an HTML HREF string. I have found one case
where that is not true. web will exist as only that string.
Is web the only non HTML string I can expect at this time? I'm
logging the event
Isn't part of the point of oauth to teach the user they are entering
in credentials for another website into that other website?
By rebranding the twitter oauth page it gets to a point where you may
as well just ask their user/pass on your own site, and never have them
leave your
Well holy smokes, add another one to the kitchen sink list of php
functions I was not aware of. Thanks!
I worry about ' a hreffoo/a, which a browser happily takes, but I
get this feeling strip_tags is going to only chop off the /a closing
tag.
Have you had this in use and confirmed
Agreed, just for data savings alone, there is no reason why *we* need
to presentation data that Twitter uses. If they want to use
rel=nofollow, they they can, but that has no bearing on how I may or
may not want to use the data.
If there was just url and agent, that alone should shave
I brought this up on this list before, let's look at this:
http://help.twitter.com/home
1) Where do I go to open a ticket?
I read the entire page, to find a little link, that says ask us.
That takes me to:
http://twitter.zendesk.com/requests/new
That redirects me around a few times, and takes
I just ran your exact code, and was able to pull an xml string just
fine, so I do not believe it is your code. The only thing I can think
is you may want to curl_close() the connection, perhaps there is some
caching or other similar thing in effect, though that is a big long
shot.
On Oct 14, 2009, at 8:38 AM, Kyle B wrote:
I am creating a mathematical model based on some results from
Twitter's API, but I am missing one critical number in the model. I
need to estimate the number of total tweets in the USA each day. The
better an estimate I get and the less assumptions I
And you don't think the streaming API will answer that for you?
--
Scott * If you contact me off list replace talklists@ with scott@ *
On Oct 14, 2009, at 3:27 PM, Kyle B wrote:
Thanks for the info. It helps a lot. Figuring out an accurate number
is essential to my model, so much so that I
I have a pretty simple function I made to curl a url against twitter.
I am whitelisted. I call a url once every 15 seconds, about once an
hour, I get 'http_response' of 0, the rest I get 200 OK.
When I do not see a 200, I log the 'http_response', is there anything
else I can log or
the connection failed. should
probably
just retry.
On Thu, Oct 15, 2009 at 14:44, Scott Haneda talkli...@newgeo.com
wrote:
I have a pretty simple function I made to curl a url against
twitter. I am
whitelisted. I call a url once every 15 seconds, about once an
hour, I get
I had a glitch, and was denied, and had whitelisting completed, from
start to finish, in about 30 hours.
--
Scott * If you contact me off list replace talklists@ with scott@ *
On Oct 15, 2009, at 4:56 PM, Atul Kulkarni wrote:
Hi All,
What is the approximate expected time for white
Correct, error 0 means no data was returned, and that the timeout in
curl was hit, which I have set to 10 seconds. I am seeing about 5 of
these per Admin block 24 hours, out of around 300 calls per 24 hours.
I see a lot more of them when I see more of the 502 errors, which
seems to tell
Specifically, what are you referring to?
--
Scott * If you contact me off list replace talklists@ with scott@ *
On Oct 17, 2009, at 10:25 AM, Jonathan Timar wrote:
Now Twitter is only offering complex, overly stylized widgets that I
cannot integrate cleanly with my website. Why would you
What constitutes sketchy behavior?
--
Scott * If you contact me off list replace talklists@ with scott@ *
On Oct 17, 2009, at 7:28 PM, John Kalucki wrote:
Your user should begin to flow into search again. But, if there is any
further sketchy behavior on this account, it will be permanently
I am not sure I understand the confusion, the API is 140 characters
exactly in the query string. You can run this, don't run it often, or
put a sleep 1; in the loop if you do.
#!/bin/bash
# This script assumes you pre url encode your data.
# Request url
this against the Advanced Search Tool, it wasn't clear
what was being included. And the tools seems to be somewhat buggy.
Leon
From: Scott Haneda talkli...@newgeo.com
To: twitter-development-talk@googlegroups.com
Sent: Sat, October 17, 2009 9:22:44 PM
Subject
Yes, it seems a bit of a mess, but rely on the API, and the responses
it gives you. The web based advanced search is a nice way to do a
quick visual test, but as you have seen, can spit out some bizarre
things.
I think the bash script will help you definitively answer anything you
need
I brought that up the other day, twitter eating their own dog food,
to which I was told they do, but only in some parts. It would be nice,
so that when the API is down, twitter is down, and we as developers
did not look like our apps suck, but that may not be a goal for
twitter, or it
Not sure I understand, you mean like this one:
http://twitter.com/widgets/html_widget
Either way, text only widget, you being on a developer mailing list, I
am sure in all honestly, a few lines, maybe 10 lines or so, and you
could have a widget to your liking.
Whatever old widget your
I am calling the public timeline once every 60 seconds. Today has
been a bad day, 26 total 502 errors since 12:21 PST to now. http
public timeline is fine on the website. Any ideas when this is going
to be resolved, or if it is even something that Twitter is aware of?
If not, heads
I do not really understand their motivation, 99% of the groups out
there are not going to be susceptible to spam. Most groups are tech,
or at least, highly niche, and the people on it are going to know it
is spam. Most groups are filtered into a folder, there are just so
many red
:
I've been seeing fail whales on the site as well.. Something must be
going
on...
On 10/19/09 3:03 PM, Scott Haneda talkli...@newgeo.com wrote:
I am calling the public timeline once every 60 seconds. Today has
been a bad day, 26 total 502 errors since 12:21 PST to now. http
public timeline
statuses, you should be using the Streaming API.
-John Kalucki
http://twitter.com/jkalucki
Services, Twitter Inc.
On Oct 20, 12:44 am, Scott Haneda talkli...@newgeo.com wrote:
This is getting out of hand, I am getting 10 a minute. I guess it is
time to write that back off code that I figured would
The Twitter Dev/API list is the one list that there is a very often
posted thread of this nature. I call it the Twitter Think Tank
BandWagon™ :)
Twitter hits the news, the news reports that application x, y, and z
are all getting millions of users, millions of users translates to
some
On Oct 27, 2009, at 4:05 AM, Dwi Sasongko Supriyadi wrote:
Twitter is not a point and click API, none are; a Twitter
programmer could
build any web app they want. With that in mind, I would look to
forums and
mailing lists for beginner introductions to programming. A good
programmer
Whether you like or dislike DNS Bl's they are part of email severs in
wide use today. I had both twitter.com and facebook.com whitelisted,
so I was ok, however,
http://www.spamcop.net/w3m?action=checkblockip=128.121.146.141
http://www.spamcop.net/w3m?action=checkblockip=69.63.178.175
Apparently you have issues pasting image urls as well :)
I would try to see what the errors are, there are a few ways you can
do this, depending on how centOS is set up.
http://php.net/manual/en/function.error-reporting.php
You can add the error handling enabler to your script, this works
My G/F is getting the same thing. She has DM's set to go via SMS, but
she also gets tweets as SMS on a daly basis, at some pretty unruly
hours. These are just normal tweets, by people she is following.
Some, if not most, are not following her back.
I do not have this problem, and follow
Am I the only one who thinks this is somewhat disingenous, or at least
lacking in details?
http://blog.twitter.com/2009/12/update-on-last-nights-dns-disruption.html
I dontv even know what happened. I'm guessing, somehow, Twitter.com
had their DNS records pointed to some arbitrary host. I
On Dec 20, 2009, at 5:53 AM, shiplu shiplu@gmail.com wrote:
Why is this?
$ curl -iv http://twitter.com/shiplu
* About to connect() to twitter.com port 80 (#0)
* Trying 168.143.162.36... Connection timed out
* couldn't connect to host
* Closing connection #0
curl: (7) couldn't connect to
96 matches
Mail list logo
