helseveileder_webscraper/README.md

Webscraper needed for Helseveileder

Part of Bachelor-project V2024

📝 Info

This webscraper will retrieve questions and answers, as well as the category assigned to the question, from Studenterspør.no. This will be used in our Bachelor project.

📋 Prerequisites

• Python 3.x
• httpx ~ HTTP client
• HTMLParser (from selectolax.parser) ~ a fast HTML5 parser with CSS selectors
• re ~ regular expression matching operations

🛠️ How to run locally

1. Create Python environment: python -m venv venv
2. Activate environment: source venv/bin/activate
3. Install requirements: pip install -r requirements.txt
4. Run main.py to get a csv.file: python main.py