Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Version 1.0.0beta1 #2

Merged
merged 50 commits into from
Sep 18, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
9f1fdf5
Prepare initial structure and generate a client
theorm Mar 28, 2024
7f5fe47
Add API client test notebook
theorm Mar 28, 2024
5c1d225
connect method
theorm Mar 28, 2024
5b523ff
Replaced api client generator with the one that better supports types.
theorm Mar 29, 2024
d20ae84
regenerated code with literals
theorm Mar 29, 2024
f2f4bf9
Refactor search resource to use literal values for group_by, order_by…
theorm Mar 29, 2024
b0e2a0f
Add pandas dependency and support for converting data to DataFrame
theorm Mar 29, 2024
fc9ea59
basic library use and fixes
theorm Apr 3, 2024
5be8a10
Refactor get_enum_from_literal function to handle Unset values in py.py
theorm Apr 3, 2024
590649e
added article resource
theorm Apr 4, 2024
c8cf079
clean output in basic.ipynb
theorm Apr 4, 2024
e859a4c
optional persisted token
theorm Apr 4, 2024
007a60b
regenerated api client
theorm May 2, 2024
fefd426
rebuilt api client and models
theorm Jul 12, 2024
fd8927b
protobuf filers. code regenerated. various fixes.
theorm Jul 20, 2024
2006e0b
WIP on fliters
theorm Jul 25, 2024
9beb33a
complex filters
theorm Jul 26, 2024
124e9ad
added search facet method
theorm Jul 26, 2024
b8aba88
added text reuse search
theorm Aug 2, 2024
4408763
added newspapers and TR passages
theorm Aug 6, 2024
2b217e8
added collections resource
theorm Aug 7, 2024
123dd07
generated entity service and models
theorm Aug 7, 2024
0d0c5a6
added entities resource
theorm Aug 7, 2024
685b4d4
regenerated code and added collections methods
theorm Aug 15, 2024
7844597
filter by wikidata ID
theorm Aug 16, 2024
ce02659
updated entities notebook
theorm Aug 16, 2024
8fa6d04
updated config loading code and added documentation to the `basic` no…
theorm Aug 17, 2024
954f45a
Partially updated documentation
theorm Aug 17, 2024
400e541
updated client to log errors and all notebooks
theorm Aug 21, 2024
7459526
raise error when an unexpected response status is returned
theorm Aug 21, 2024
c78064d
added url to search response container
theorm Aug 21, 2024
ef7479e
added notebook friendly result container representation
theorm Aug 21, 2024
ac237f0
added urls to all resources
theorm Aug 25, 2024
5e31722
render facets as a graph
theorm Aug 25, 2024
7a6d89d
updated resource repr and sample notebooks
theorm Aug 27, 2024
437447c
Fixed newspapers URL
theorm Aug 29, 2024
c40156e
order facets by value by default
theorm Aug 29, 2024
e0c8077
added NER tool
theorm Sep 4, 2024
ba6f55d
updated facets app links
theorm Sep 6, 2024
e28a4ec
updated dependency for python
theorm Sep 6, 2024
57508c2
updated dependencies
theorm Sep 6, 2024
240f491
version update second go
theorm Sep 6, 2024
d40ab84
added search entities by ids and expand wikidata
theorm Sep 6, 2024
705a139
use getpass to get token
theorm Sep 6, 2024
8f61853
added precision and modifiers
theorm Sep 14, 2024
b23d004
exact precision for strings by default
theorm Sep 14, 2024
1c75931
updated token url
theorm Sep 14, 2024
6be9b07
updated api client and re-ran notebooks to confirm they still work
theorm Sep 18, 2024
2385226
made mypy and linter happy
theorm Sep 18, 2024
fb22f76
removed unused imports
theorm Sep 18, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .apigen.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
project_name_override: impresso
package_name_override: api_client
3 changes: 3 additions & 0 deletions .flake8
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[flake8]
max-line-length = 120
exclude = impresso/api_client, impresso/protobuf
38 changes: 38 additions & 0 deletions .github/workflows/qa.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
#file: noinspection YAMLSchemaValidation
name: Run QA (test, lint, type check)

on:
pull_request:
types: [opened, synchronize, reopened]

jobs:
qa:
env:
commitmsg: ${{ github.event.head_commit.message }}
strategy:
fail-fast: false
matrix:
python-version: ["3.11"]
poetry-version: ["1.5"]
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v3
- uses: actions/setup-python@v4
with:
python-version: ${{ matrix.python-version }}
- uses: abatilo/actions-poetry@v2
with:
poetry-version: ${{ matrix.poetry-version }}
- name: Install dependencies
run: |
poetry install
- name: Unit tests
run: |
poetry run pytest
- name: Linting
run: |
poetry run flake8 impresso tests
- name: Type checking
run: |
poetry run mypy -p impresso -p tests
17 changes: 17 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,19 @@
# Pycharm
.idea/
__pycache__/
/.pytest_cache/

# jupyter
.ipynb_checkpoints/

.mypy_cache/

.DS_Store
.venv
.env
.env.*
!.env.example

impresso.egg-info/*
tmp/
dist/
1 change: 0 additions & 1 deletion .python-version

This file was deleted.

9 changes: 9 additions & 0 deletions .vscode/extensions.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
{
// See http://go.microsoft.com/fwlink/?LinkId=827846
// for the documentation about the extensions.json format
"recommendations": [
"ms-python.python",
"ms-python.black-formatter",
"ms-python.mypy-type-checker"
]
}
17 changes: 17 additions & 0 deletions .vscode/launch.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
{
"version": "0.2.0",
"configurations": [
{
"name": "Python: Debug Tests",
"type": "python",
"request": "launch",
"program": "${file}",
"purpose": ["debug-test"],
"console": "integratedTerminal",
"justMyCode": false,
"presentation": {
"hidden": true // keep original launch order in 'run and debug' tab
}
}
]
}
14 changes: 14 additions & 0 deletions .vscode/settings.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
{
"python.testing.pytestEnabled": true,
"python.testing.unittestEnabled": false,
"python.defaultInterpreterPath": ".venv/bin/python",
"[python]": {
"editor.formatOnSave": true,
"editor.formatOnPaste": false,
"editor.formatOnSaveMode": "file",
"editor.defaultFormatter": "ms-python.black-formatter"
},
"python.testing.pytestArgs": ["-vv"],
"editor.formatOnSave": true,
"pylint.args": ["--generate-members"]
}
Loading
Loading