scripts for loading courses into alma
Setting Python virtual env and install dependencies
python3 -m venv .
python3 -m pip install beautifulsoup4 lxml
source ./bin/activate
https://w2prod.sis.yorku.ca/Apps/WebObjects/cdm.woa/wo/JcV46Qa7mX7zJyLcyB9Mcw/0.3.4.37.0
Click on the start new session if expired.
Click on the "View Active Course Timetables" on the left navigation.
On the "View Active Course Timetables by Faculty" page, there is a listing of faculties and sessions.
Use DownThemAll extension and highlight the links to download all at once.
$ python3 courses.py ./download/
Processing: FW2026AP.html...
Found 10150 <tr>
Processing: FW2026ED.html...
Found 1334 <tr>
Processing: FW2026EU.html...
Found 625 <tr>
Processing: FW2026FA.html...
Found 3493 <tr>
Processing: FW2026GL.html...
Found 2385 <tr>
Processing: FW2026GS.html...
Found 4588 <tr>
Processing: FW2026HH.html...
Found 4515 <tr>
Processing: FW2026LE.html...
Found 4139 <tr>
Processing: FW2026LW.html...
Found 3 <tr>
Processing: FW2026SB.html...
Found 2846 <tr>
Processing: FW2026SC.html...
Found 4731 <tr>
Processing: SU2025GS.html...
Found 1172 <tr>
Processing: SU2025LW.html...
Found 3 <tr>
Processing: SU2025SB.html...
Found 556 <tr>
Processing: SU2025UG.html...
Found 4507 <tr>
Successfully processed 15 files. Total rows written: 16943 to courses.csv