Slightly updated my web scraping methods for randomantagning.se. Chromedriver-autoinstaller finally let me run the scraper script without having to download a new driver for Chrome every time. I am now saving to JSON files and importing them with webpack instead of writing to a text file and copy the contents into a massive array in my Javascript (which webpack now does for me). The scraper can now be run with command line arguments of which semesters to download.
I have also switched hosting from Neocities to Netlify (same as this site) because it’s free, even though supporting neocities was nice.
Next step is importing the JSON data more dynamically/lazily to avoid the slow page load.
| Backlinks |
|---|