[twitter-dev] Re: tweets history

[calyps]

Thanks David,

This definately helps.

If i have just get the count of the tweet, can I use the Twitter count
API for a tweet? WIll that capture the re-tweets both the old and new
ones?

Thanks,



On Sep 16, 8:36 am, David  wrote:
> HI calyps,
>
> Good questions. Yes, the search API only returns results from the last
> 6 or 7 days. To be exact, I believe it returns results since a certain
> id, so the time window will continue to decrease as the number of
> tweets per day grows.
>
> To get your own tweets, you'll want to hit the "statuses/
> user_timeline" endpoint of the REST API. 
> Seehttp://dev.twitter.com/doc/get/statuses/user_timeline
> This should allow you to grab your most recent 3200 tweets.
>
> You are correct in thinking that you'll probably want to store those,
> then going forward, you'll either want to periodically hit that
> endpoint to grab newer tweets, or more efficiently, use the "statuses/
> filter" endpoint of the streaming API and follow your own username to
> suck down and store all your future tweets.
>
> With regards to getting all retweets of your tweets, take a look at
> "statuses/retweets_of_me" endpoint (for new style 
> retweets).http://dev.twitter.com/doc/get/statuses/retweets_of_me. For 
> old-style
> retweets, you'll need to use the streaming api, grab mentions, and do
> a little bit of work to figure out which ones are retweets.
>
> Hope that helps,
> David
>
> On Sep 15, 2:26 pm, calyps  wrote:
>
>
>
> > Hello,
>
> > I need to somehow get my tweet history and including all the Re
> > tweets. I am trying to use the search API but i believe the search API
> > is restricted for only last certain days. Hence, i believe the only
> > possibility is to store it somewhere but i have the following
> > questions:
>
> > 1) If the search API is restricted for last certain days, can i still
> > collect how many retweets were made (using the new twitter.com
> > method)?
>
> > 2) can you recommend when i should try storing the tweets to ensure I
> > dont store duplicate tweets or What is the limit of search API so i
> > know every time i execute it, i will get new set of searches. This may
> > be how the tweetmeme.com holds the count of tweet? right?
>
> > Thanks,
>
> > Ali- Hide quoted text -
>
> - Show quoted text -

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk?hl=en

[twitter-dev] Re: tweets history

[David]

HI calyps,

Good questions. Yes, the search API only returns results from the last
6 or 7 days. To be exact, I believe it returns results since a certain
id, so the time window will continue to decrease as the number of
tweets per day grows.

To get your own tweets, you'll want to hit the "statuses/
user_timeline" endpoint of the REST API. See
http://dev.twitter.com/doc/get/statuses/user_timeline
This should allow you to grab your most recent 3200 tweets.

You are correct in thinking that you'll probably want to store those,
then going forward, you'll either want to periodically hit that
endpoint to grab newer tweets, or more efficiently, use the "statuses/
filter" endpoint of the streaming API and follow your own username to
suck down and store all your future tweets.

With regards to getting all retweets of your tweets, take a look at
"statuses/retweets_of_me" endpoint (for new style retweets).
http://dev.twitter.com/doc/get/statuses/retweets_of_me. For old-style
retweets, you'll need to use the streaming api, grab mentions, and do
a little bit of work to figure out which ones are retweets.

Hope that helps,
David

On Sep 15, 2:26 pm, calyps  wrote:
> Hello,
>
> I need to somehow get my tweet history and including all the Re
> tweets. I am trying to use the search API but i believe the search API
> is restricted for only last certain days. Hence, i believe the only
> possibility is to store it somewhere but i have the following
> questions:
>
> 1) If the search API is restricted for last certain days, can i still
> collect how many retweets were made (using the new twitter.com
> method)?
>
> 2) can you recommend when i should try storing the tweets to ensure I
> dont store duplicate tweets or What is the limit of search API so i
> know every time i execute it, i will get new set of searches. This may
> be how the tweetmeme.com holds the count of tweet? right?
>
> Thanks,
>
> Ali

-- 
Twitter developer documentation and resources: http://dev.twitter.com/doc
API updates via Twitter: http://twitter.com/twitterapi
Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
http://groups.google.com/group/twitter-development-talk?hl=en

[twitter-dev] Re: Tweets with !, ', and other characters refused..

[Rejeev]

I was also facing the same issue beforeit was sorted now by
properly encoding the tweet message we send. Please see the code below
done in Flex.


public function getSignedURI( method:String, url:String,
postData:String = "" ):String
{

if( method.toUpperCase() != "GET" && 
method.toUpperCase() !=
"POST" )
{
throw new ArgumentError("Invalid method passed. 
Only GET and POST
supported");
}
if( url.length == 0 )
{
throw new ArgumentError("Empty url passed");
}
if( consumerKey.length == 0 )
{
throw new ArgumentError("consumerKey property 
not set");
}
if( _consumerSecret.length == 0 )
{
throw new ArgumentError("consumerSecret 
property not set");
}
var timeStamp:String = Math.round( new Date().getTime() 
/
1000 ).toString();
var nonce:String = Math.round(Math.random() * 9 
).toString();

 var args:Array = [];
 if( _usePinWorkflow )
{
 args.push({name: "oauth_callback", value: "oob"});
}
 args.push({name: "oauth_consumer_key", value:
consumerKey});
 args.push({name: "oauth_nonce", value: nonce});
 args.push({name: "oauth_signature_method", value: "HMAC-
SHA1"});
 args.push({name: "oauth_timestamp", value: timeStamp});
 args.push({name: "oauth_version", value: "1.0"});

if( _accessToken.length )
{
  args.push({name: "oauth_token", value: 
_accessToken});
}
else if( _authorizationToken.length )
{
  args.push({name: "oauth_token", value:
_authorizationToken});
}
if( _accessPin )
{
args.push({name: "oauth_verifier", value: 
_accessPin.toString
()});
}
if(method.toUpperCase() == "POST" && postData.length)
{

args.push({name: "status", value:  
encode(postData)});
}
args.sortOn("name");
var n:int = args.length;
var vars:String = "";
for (var i:int = 0; i < n; i++)
{
if (args[i]["name"] != "_method")
{
vars += args[i]["name"]+"="+args[i]["value"];
if (i != n-1)
vars += "&";
}
}
var signString:String = method.toUpperCase() +"&" +
encodeURIComponent(url) + "&" + encodeURIComponent(vars);
var hmac:HMAC =  Crypto.getHMAC("sha1");
var key:ByteArray = Hex.toArray( Hex.fromString
(encodeURIComponent(_consumerSecret) + "&" + encodeURIComponent
(_accessTokenSecret)));
var data:ByteArray = Hex.toArray( Hex.fromString
( signString ) );
var sha:String = Base64.encodeByteArray( hmac.compute
( key, data ) );
vars += "&oauth_signature="+encodeURIComponent(sha);
trace ("Returned "+vars )
return vars;
}

[twitter-dev] Re: Tweets with !, ', and other characters refused..

[Duane Roelands]

I'm seeing this in a library that previously was not having this
issue.

On Jan 14, 9:48 am, Xavier Grosjean  wrote:
> There must be an issue in the OAuth signature computing, which is why you
> are requested to provide your login again...
>
> 2010/1/14 thetwitmaniac 
>
>
>
> > We are using UTF-8 and still have this issue!  Really can't understand
> > why, all help would be greatly appreciated!
>
> > On Dec 23 2009, 6:04 pm, Abraham Williams <4bra...@gmail.com> wrote:
> > > Make sure you are properly encoding the characters before you send them
> > to
> > > Twitter.
>
> > > Abraham
>
> > > On Tue, Dec 22, 2009 at 23:49, thetwitmaniac 
> > wrote:
> > > > Hi,
>
> > > > I'm building a desktop twitter client and for some reason whenever I
> > > > try to post a tweet with an exclamation mark or apostrophe, the tweet
> > > > is rejected and I am presented with a request to provide login
> > > > credential for the Twitter API.
>
> > > > Has anyone run into this issue or have any idea why this would occur?
>
> > > > Thanks!
>
> > > --
> > > Abraham Williams | Awesome Lists |http://awesomeli.st
> > > Project | Intersect |http://intersect.labs.poseurtech.com
> > > Hacker |http://abrah.am|http://twitter.com/abraham
> > > This email is: [ ] shareable [x] ask first [ ] private.

Re: [twitter-dev] Re: Tweets with !, ', and other characters refused..

[Xavier Grosjean]

There must be an issue in the OAuth signature computing, which is why you
are requested to provide your login again...

2010/1/14 thetwitmaniac 

> We are using UTF-8 and still have this issue!  Really can't understand
> why, all help would be greatly appreciated!
>
> On Dec 23 2009, 6:04 pm, Abraham Williams <4bra...@gmail.com> wrote:
> > Make sure you are properly encoding the characters before you send them
> to
> > Twitter.
> >
> > Abraham
> >
> > On Tue, Dec 22, 2009 at 23:49, thetwitmaniac 
> wrote:
> > > Hi,
> >
> > > I'm building a desktop twitter client and for some reason whenever I
> > > try to post a tweet with an exclamation mark or apostrophe, the tweet
> > > is rejected and I am presented with a request to provide login
> > > credential for the Twitter API.
> >
> > > Has anyone run into this issue or have any idea why this would occur?
> >
> > > Thanks!
> >
> > --
> > Abraham Williams | Awesome Lists |http://awesomeli.st
> > Project | Intersect |http://intersect.labs.poseurtech.com
> > Hacker |http://abrah.am|http://twitter.com/abraham
> > This email is: [ ] shareable [x] ask first [ ] private.
>

[twitter-dev] Re: Tweets with !, ', and other characters refused..

[thetwitmaniac]

We are using UTF-8 and still have this issue!  Really can't understand
why, all help would be greatly appreciated!

On Dec 23 2009, 6:04 pm, Abraham Williams <4bra...@gmail.com> wrote:
> Make sure you are properly encoding the characters before you send them to
> Twitter.
>
> Abraham
>
> On Tue, Dec 22, 2009 at 23:49, thetwitmaniac  wrote:
> > Hi,
>
> > I'm building a desktop twitter client and for some reason whenever I
> > try to post a tweet with an exclamation mark or apostrophe, the tweet
> > is rejected and I am presented with a request to provide login
> > credential for the Twitter API.
>
> > Has anyone run into this issue or have any idea why this would occur?
>
> > Thanks!
>
> --
> Abraham Williams | Awesome Lists |http://awesomeli.st
> Project | Intersect |http://intersect.labs.poseurtech.com
> Hacker |http://abrah.am|http://twitter.com/abraham
> This email is: [ ] shareable [x] ask first [ ] private.

Re: [twitter-dev] Re: Tweets with !, ', and other characters refused..

[anand manocha]

hi duane,
what language are u talking about ?
anand
anand

On 12/23/09, Duane Roelands  wrote:
>
> What language are you working in?  Also, are you using an existing
> library or writing your own?
>
> On Dec 23, 12:49 am, thetwitmaniac  wrote:
> > Hi,
> >
> > I'm building a desktop twitter client and for some reason whenever I
> > try to post a tweet with an exclamation mark or apostrophe, the tweet
> > is rejected and I am presented with a request to provide login
> > credential for the Twitter API.
> >
> > Has anyone run into this issue or have any idea why this would occur?
> >
> > Thanks!
>

[twitter-dev] Re: Tweets with !, ', and other characters refused..

[Duane Roelands]

What language are you working in?  Also, are you using an existing
library or writing your own?

On Dec 23, 12:49 am, thetwitmaniac  wrote:
> Hi,
>
> I'm building a desktop twitter client and for some reason whenever I
> try to post a tweet with an exclamation mark or apostrophe, the tweet
> is rejected and I am presented with a request to provide login
> credential for the Twitter API.
>
> Has anyone run into this issue or have any idea why this would occur?
>
> Thanks!

[twitter-dev] Re: Tweets Dataset for academia?

[Thomas Woolway]

Hi Atul,

There is a fairly significant corpus of tweets available, although it is
fairly old - see here:
http://www.mail-archive.com/twitter-development-talk@googlegroups.com/msg05715.html.
I believe that the second part has expired, but you should be unable to use
the first part - it is several million tweets worth.

All the best,

Tom

On Wed, Oct 14, 2009 at 5:55 PM, Atul Kulkarni wrote:

> Thanks, John. I am not only looking at hash tags, but also other things
> that go along with tweets. I will keep in mind. I was actually curious about
> Twitter's policy on this. What is there take on releasing a certain dataset
> of say some random X number of users. Is it violation of any of their policy
> or their agreement with the users.
>
> Regards,
> Atul.
>
>
>
> On Wed, Oct 14, 2009 at 11:43 AM, JOHN OBRIEN wrote:
>
>> Many people in academia / research have used TwapperKeeper service to
>> capture tweets of interest (that are tagged) and export for analysis.
>> Let me know if you have any questions.
>>
>> v/r,
>> John
>> http://TwapperKeeper.com
>> jobr...@ob3solutions.com
>> @jobrieniii
>>
>>
>>
>> On Oct 14, 2009, at  12:39 PM, Atul Kulkarni wrote:
>>
>> Hi All,
>>
>> I am curious if there is any Twitter data set already available for
>> research or academia? If it is already not there then can one crawl through
>> the users and build one and release it to the research community without any
>> charge? What would be Twitter's official policy on this?
>>
>> I am sure there will be a lot of interest in academia from the Linguistics
>> perspective and Machine Learning perspective. These questions are just out
>> of curiosity and feasibility study types.
>>
>> --
>> Regards,
>> Atul Kulkarni
>> www.d.umn.edu/~kulka053 
>>
>>
>>
>
>
> --
> Regards,
> Atul Kulkarni
> www.d.umn.edu/~kulka053 
>

[twitter-dev] Re: Tweets Dataset for academia?

[Kyle B]

Atul,

I am in the same boat as you.  I am currently using the APIs that
Twitter offers to gather data.  However, the more data I have access
to, the fewer assumptions I have to make and the better my results.
Twitter is very popular though and access to their data from 3rd
parties consumes a lot of computing power on their part.  Just keep
that in mind!  Feel free to contact me if you have any specific
questions.

-Kyle


On Oct 14, 12:39 pm, Atul Kulkarni  wrote:
> Hi All,
>
> I am curious if there is any Twitter data set already available for research
> or academia? If it is already not there then can one crawl through the users
> and build one and release it to the research community without any charge?
> What would be Twitter's official policy on this?
>
> I am sure there will be a lot of interest in academia from the Linguistics
> perspective and Machine Learning perspective. These questions are just out
> of curiosity and feasibility study types.
>
> --
> Regards,
> Atul Kulkarniwww.d.umn.edu/~kulka053

[twitter-dev] Re: Tweets Dataset for academia?

[Atul Kulkarni]

Thanks, John. I am not only looking at hash tags, but also other things that
go along with tweets. I will keep in mind. I was actually curious about
Twitter's policy on this. What is there take on releasing a certain dataset
of say some random X number of users. Is it violation of any of their policy
or their agreement with the users.

Regards,
Atul.


On Wed, Oct 14, 2009 at 11:43 AM, JOHN OBRIEN wrote:

> Many people in academia / research have used TwapperKeeper service to
> capture tweets of interest (that are tagged) and export for analysis.
> Let me know if you have any questions.
>
> v/r,
> John
> http://TwapperKeeper.com
> jobr...@ob3solutions.com
> @jobrieniii
>
>
>
> On Oct 14, 2009, at  12:39 PM, Atul Kulkarni wrote:
>
> Hi All,
>
> I am curious if there is any Twitter data set already available for
> research or academia? If it is already not there then can one crawl through
> the users and build one and release it to the research community without any
> charge? What would be Twitter's official policy on this?
>
> I am sure there will be a lot of interest in academia from the Linguistics
> perspective and Machine Learning perspective. These questions are just out
> of curiosity and feasibility study types.
>
> --
> Regards,
> Atul Kulkarni
> www.d.umn.edu/~kulka053 
>
>
>


-- 
Regards,
Atul Kulkarni
www.d.umn.edu/~kulka053

[twitter-dev] Re: Tweets Dataset for academia?

[JOHN OBRIEN]

Many people in academia / research have used TwapperKeeper service to  
capture tweets of interest (that are tagged) and export for analysis.


Let me know if you have any questions.

v/r,
John
http://TwapperKeeper.com
jobr...@ob3solutions.com
@jobrieniii



On Oct 14, 2009, at  12:39 PM, Atul Kulkarni wrote:


Hi All,

I am curious if there is any Twitter data set already available for  
research or academia? If it is already not there then can one crawl  
through the users and build one and release it to the research  
community without any charge? What would be Twitter's official  
policy on this?


I am sure there will be a lot of interest in academia from the  
Linguistics perspective and Machine Learning perspective. These  
questions are just out of curiosity and feasibility study types.


--
Regards,
Atul Kulkarni
www.d.umn.edu/~kulka053

[twitter-dev] Re: Tweets ignored in search.twitter.com

[Abraham Williams]

That may or may not be why I said "generally".
Abraham

On Thu, Oct 8, 2009 at 22:56, Dewald Pretorius  wrote:

>
> Abraham,
>
> Reality is more nuanced than that. There is some flagging system in
> Twitter that prevents tweets from some accounts, which are otherwise
> normal in appearance, from being indexed by Twitter Search.
>
> I know because it happened to my personal account a few months ago.
> The reason given was because most of my tweets were @replies, which is
> simply indicative of how I utilized my account at that time. But, the
> Twitter staff member who helped me was also just guessing as to the
> reason.
>
> Dewald
>
> On Oct 9, 12:10 am, Abraham Williams <4bra...@gmail.com> wrote:
> > Generally any public Tweet that is not from a suspended/spam account will
> be
> > searchable.
> > Abraham
>



-- 
Abraham Williams | Community Evangelist | http://web608.org
Hacker | http://abrah.am | http://twitter.com/abraham
Project | http://fireeagle.labs.poseurtech.com
This email is: [ ] blogable [x] ask first [ ] private.

[twitter-dev] Re: Tweets ignored in search.twitter.com

[Dewald Pretorius]

Abraham,

Reality is more nuanced than that. There is some flagging system in
Twitter that prevents tweets from some accounts, which are otherwise
normal in appearance, from being indexed by Twitter Search.

I know because it happened to my personal account a few months ago.
The reason given was because most of my tweets were @replies, which is
simply indicative of how I utilized my account at that time. But, the
Twitter staff member who helped me was also just guessing as to the
reason.

Dewald

On Oct 9, 12:10 am, Abraham Williams <4bra...@gmail.com> wrote:
> Generally any public Tweet that is not from a suspended/spam account will be
> searchable.
> Abraham

[twitter-dev] Re: Tweets ignored in search.twitter.com

[Abraham Williams]

Generally any public Tweet that is not from a suspended/spam account will be
searchable.
Abraham

On Thu, Oct 8, 2009 at 12:38, Emídio Cunha  wrote:

>
> If an application publishes a tweet about 3 times a minute, will it be
> ignored in search.twitter.com ? what are the rules for this? If so, it
> renders any realtime update a large content site might have.
>
> Thanks
> Emidio
>



-- 
Abraham Williams | Community Evangelist | http://web608.org
Hacker | http://abrah.am | http://twitter.com/abraham
http://web608.org/geeks/abraham/blogs/2009/10/03/win-google-wave-invite
This email is: [ ] blogable [x] ask first [ ] private.
Sent from Madison, WI, United States

[twitter-dev] Re: tweets

[dizid]

Dick,

Better ask questiosn in English here ;)

> Als ik een tweet zend kom ik deze naderhand niet tegen bij degene die ik volg.
Klopt, diegene aan wie jij een tweet stuurt moet jou volgen (i.p.v.
wat jij boven beschrijft, nl. dat jij diegene volgt)

> Als er een tweet gestuurd woord door de gene die ik volg komt hij wel op mijn 
> site maar niet andersom.
Dat lijkt ook te kloppen: jij volgt diegene, dus je krijgt z'n tweets
te zien (via API of web, maakt niet uit)
> heb ik iets verkeerd ingesteld soms?
Lijkt mij verwachtte gedrag vh systeem

Marc

[twitter-dev] Re: tweets

[Duane Roelands]

Google's "Jaiku" application works this way.  I think it would be neat
if Twitter implemented something like this as well.

On Aug 17, 7:13 am, Jack Sampson  wrote:
> I think it would be better if you could comment on someone's tweet as
> opposed to having to make your own one as it is hard to keep tweeting
> in that way

[twitter-dev] Re: Tweets Publishing Issue?

[Dewald Pretorius]

And just for clarity, I'm excluding duplicate tweet filtering from my
question. I'm referring to unique tweets that one would expect to be
published.

[twitter-dev] Re: Tweets not getting to search.twitter.com

[Doug Williams]

Randy,
Please see the help article on this very subject [1].

If this is for a developer or API related project please contact us off list
so we can discuss [2].

1. http://help.twitter.com/forums/10713/entries/42646
2. http://apiwiki.twitter.com/Support

Thanks,
Doug




On Mon, Jul 13, 2009 at 5:10 PM, RandyC  wrote:

>
> I have a client whose account recently changed names after they fought
> for successful control of their name from another Twitter user who
> parked on it.  However, Tweets on this account name are not
> searchable.  The account is not protected.  Has anyone ever had this
> happen?  How do you get Tweets back into the search stream?  It's like
> they somehow inherited some bad juju from the old account owner.  My
> client put in support tickets that have not been addressed.  One was
> summarily closed with no explanation.
>
> Thanks,
> Randy C
>

[twitter-dev] Re: Tweets are not showing up in search results, have not been since Thursday

[Chad Etzel]

Hi Ron,

I left a comment on your blog explaining the answer to your question,
but maybe it didn't go through.

A while ago it was decided to remove "trending bots/accounts" from
search results because they really did clutter the results.  One of my
bots/accounts was removed as well, and you're correct, the traffic
does drop off tremendously because of it.

After the first "silencing of the bots" another group of trend bots
popped up and have since been silenced as well.  I guess thumbfight
was a victim of the last go 'round.

There was a lengthy thread about this topic earlier in this group here:
http://groups.google.com/group/twitter-development-talk/browse_thread/thread/459e5151ddaaa2b

Hope that answers your question!

-Chad
On Sun, Jun 14, 2009 at 12:54 PM, Ron Evans wrote:
>
> I have noticed that tweets from my twitter account @thumbfight
> suddenly stopped appearing in the Twitter search results starting on
> Thursday. Anyone else have this problem?
>
> I submitted a Twitter support request, which was closed by an
> automated program they have regarding new Twitter accounts. This
> account is not new, and up until Wednesday evening all was working
> well.
>
> Anyone else experiencing, or have experienced in the past, this kind of 
> problem?
>
> Ron Evans
> @deadprogram
>

[twitter-dev] Re: Tweets are not showing up in search results, have not been since Thursday

[Chris Thomson]

A common reason that an account wouldn't show up in search is because it is
being investigated for spam. See [1] for more details.

-Chris Thomson

1 - http://help.twitter.com/forums/10713/entries/16817

On Sun, Jun 14, 2009 at 12:54 PM, Ron Evans  wrote:

>
> I have noticed that tweets from my twitter account @thumbfight
> suddenly stopped appearing in the Twitter search results starting on
> Thursday. Anyone else have this problem?
>
> I submitted a Twitter support request, which was closed by an
> automated program they have regarding new Twitter accounts. This
> account is not new, and up until Wednesday evening all was working
> well.
>
> Anyone else experiencing, or have experienced in the past, this kind of
> problem?
>
> Ron Evans
> @deadprogram
>

[twitter-dev] Re: Tweets not showing up in realtime search results

[Brooks Bennett]

I have seen this happen to random, human user accounts as well. It
leads to headaches for those of us that use the Search API - we have
to explain why certain peoples tweets are not showing up in our apps
and there is no great answer...


On Jun 10, 10:21 am, Rod  wrote:
> I'm thinking that because techwatching and techwatching_cl post
> similar content (with different links) that may be why they've been
> blacklisted - taken together, do they look like a spam attack?
>
> One part of the answer may be to shutter one of them, and just have a
> single account.

[twitter-dev] Re: Tweets not showing up in realtime search results

[Rod]

I'm thinking that because techwatching and techwatching_cl post
similar content (with different links) that may be why they've been
blacklisted - taken together, do they look like a spam attack?

One part of the answer may be to shutter one of them, and just have a
single account.