Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Connectum based scraper #1000

Merged
merged 11 commits into from
May 5, 2024
Merged

Connectum based scraper #1000

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
d25651f
converted the scraper to use connectum instead
CommanderStorm Feb 29, 2024
83bba9b
integrated the new rooms into the current codebase
CommanderStorm Mar 1, 2024
83e33ba
Update data/external/scrapers/tumonline.py
CommanderStorm Mar 1, 2024
8d75413
fixed the adress zip_code being an integer
CommanderStorm Mar 1, 2024
caecd36
adjustment to new meta
CommanderStorm May 4, 2024
f1f81e7
simplified the scraper further
CommanderStorm May 4, 2024
b06edf1
fixed compilation errors
CommanderStorm May 5, 2024
179d696
revert unintended update
CommanderStorm May 5, 2024
57fce18
fixed an ID-Difference
CommanderStorm May 5, 2024
124b00c
fixed more ID-Differences
CommanderStorm May 5, 2024
c36ff36
less diff
CommanderStorm May 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
309 changes: 0 additions & 309 deletions data/data_format_geo-entry.yaml
View file
Open in desktop

This file was deleted.

2 changes: 1 addition & 1 deletion data/external/models/common.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@

class PydanticConfiguration(BaseModel):
model_config = pydantic.ConfigDict(
frozen=True,
frozen=False,
str_strip_whitespace=True,
extra="forbid",
populate_by_name=True,
Expand Down
1 change: 1 addition & 0 deletions data/external/models/test_models.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
from typing import Literal

import pytest

from external.models import nat, public_transport, roomfinder, tumonline


Expand Down
Loading
Loading