wikimill
This site contains various Wikipedia “List of” pages and categories that serve as good raw material for data visualization: sortable tables, decades of history, and a built-in audience of people who already care about the topics.
You’ll find instructions for scraping and cleaning a few of those tables with both R and Python, then visualizes them with R and ggplot2. It covers two themes: topics that shaped the millennial generation (recessions, wage stagnation, platforms that came and went) and Y2K-era internet nostalgia (early browsers, worms, instant messengers).
- Table sources: Wikipedia pages scraped directly with
rvest::html_table()orpandas.read_html(). - List sources: Wikipedia bulleted lists and categories, scraped through the MediaWiki API.
- Each topic has a ‘scraping’ page and a ‘cleaning’ page with R and Python tabs. The visualization page only uses R and
ggplot2. - Examples include Recessions, Minimum wage, Dating services, Malls, and Social platforms: the
ggplot2visualizations built on the cleaned data.