dtomlinson/geography-anki
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

chore: add initial scrapy code

Browse Source
This commit is contained in:
Daniel Tomlinson
2022-06-22 20:39:31 +01:00
parent 5d0c7b19fa
commit e49fa7a346
11 changed files with 1612 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
01_scrapy/wikipedia_country_scraper/download_countries.sh Executable file
View File

@@ -0,0 +1,2 @@
source .venv/bin/activate
scrapy crawl CountrydownloaderSpider -O ../../data/scrapy/raw_country_data/countries.json