Scraping Twitter using Outwit Hub

Students in my graduate unit Philosophies of Communication Technologies and Change (part of our Graduate Certificate in Social Media and Public Engagement) are producing simple lists of tweets.

Some students are using Outwit Hub to generate these lists as this is what I have used since 2012. I have created a guide “Scraping Twitter using Outwit Hub worksheet” for my students but others may also find it useful.

Scraping the results from a Twitter ‘advanced search’ allows you create an archive of tweets without the limitations of the API. It is only useful for relatively small sets that have less than 3,200 tweets per day as you can query Twitter for all tweets for a given hashtag per day.

The lists of tweets shall be used for the purpose of carrying out sophisticated analyses of the ‘circulation of discourse’:

Writing to a public helps to make a world, insofar as the object of address is brought into being partly by postulating and characterizing it. This performative ability depends, however, on that object’s being not entirely fictitious–not postulated merely, but recognized as a real path for the circulation of discourse. That path is then treated as a social entity. (Warner 2002: 64)

The character of this discourse will depend on the stakeholder publics they (or their organisations) wish to engage with and so on.