Hi Martin,
On 16/06/15 10:14, MartinW wrote:
Thank you very much, Offray, that looks very interesting.
Thanks. I think that is important to keep politicians and public accountable for what they say and do and social networks could help in doing that in a more dynamic way (of course is not enough).
When was the last time, you used the scraping plugin? It does run and scrolls down the twitter pages, but there is no result at all to be found in the console. Can it be that Twitter changed the format lately?
The last time was April, but if the scroll works, you should be able to inspect the DOM from the browser and export it following the instructions at the blog post. The browser knows about the DOM of the page that is being showed currently and if you are capable of seeing it in the browser, you should be able to inspect and save. We will test the script again and improve the code next week in a week long workshop on data visualization using Pharo/Roassal, so I will keep you posted about what's happening with this approach.
I will try to find a way to harvest tweets first, and then I will try your visualization engine.
Ok. Let me know what happens. Cheers, Offray
