Re: [CODE4LIB] twarc and 30-day limitation

2020-05-05 Thread Edward Summers
Hi Eric, Like Francis and Darnelle said, Twitter's primary free search API is limited to the last 7 days of activity. The so called "Standard" search API is what twarc uses to gather data when you `twarc search …` However a couple years ago Twitter added the Premium Search API [1] which is a

Re: [CODE4LIB] file sharing/transfer

2020-01-15 Thread Edward Summers
Depending on the context, OnionShare might be worth looking at: https://onionshare.org/ The publisher of the data runs OnionShare on their laptop/workstation to share the data. They send the generated unguessable .onion URL to the recipient who can download the data by opening the URL in

Re: [CODE4LIB] Preserving content from a closed Facebook group?

2019-11-04 Thread Edward Summers
Hi Carol, As far as I know there's no way to download an official copy of Facebook groups, even if you are the owner. This is something that the Society of American Archivists wrote a letter to Facebook about in 2015 [1], and I don't think they ever received a response. If you have access to

Re: [CODE4LIB] COinS

2019-03-19 Thread Edward Summers
I think that Zotero still looks for COinS, but understands a lot more? If you drop your COinS markup you may want to make sure that you have some other metadata in there for Zotero (and tools like it) to use? > On Mar 19, 2019, at 11:45 AM, Kyle Banerjee wrote: > > If you have to ask, you

[CODE4LIB] Call For Proposals: Forum on Ethics and Archiving the Web

2017-10-25 Thread Edward Summers
Forum on Ethics and Archiving the Web New Museum, New York City, March 22-24 Proposals due by November 14 (funding available) http://rhizome.org/editorial/2017/oct/24/open-call-national-forum-on-ethics-and-archiving-the-web/ The dramatic rise in the public’s use of the web and social media to

Re: [CODE4LIB] Persistent Identifiers for organizations/institutions.

2017-10-14 Thread Edward Summers
> On Oct 14, 2017, at 7:09 AM, Stuart A. Yeates wrote: > > archive.org web harvests include at least some DNS details for the content > they harvest. I'm not sure how comprehensive it is and I'm pretty such that > there isn't a tool for easily exploring it. I was thinking

Re: [CODE4LIB] Persistent Identifiers for organizations/institutions.

2017-10-13 Thread Edward Summers
What if we created an identifier system that organizations would pay an annual feel to belong to? This identifier would be guaranteed to be globally unique as long as the organization cared to maintain it. You could use this identifier with your web browser to find information about the

Re: [CODE4LIB] internet archive api

2017-09-18 Thread Edward Summers
The internetarchive [1] python library that folks have already mentioned is pretty nice for working with IA collections. For a small project I needed to download the metadata for a collection created by the National Agriculture Library, and write it out to the filesystem as JSON in a pairtree