Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

updates metadata model #64

Merged
merged 1 commit into from
Jul 26, 2024
Merged

updates metadata model #64

merged 1 commit into from
Jul 26, 2024

Conversation

BielStela
Copy link
Collaborator

No description provided.

Copy link

vercel bot commented Jul 26, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
amazonia-360 ⬜️ Ignored (Inspect) Jul 26, 2024 5:33pm

@BielStela BielStela merged commit 1b23640 into develop Jul 26, 2024
5 checks passed
@BielStela BielStela deleted the update-meta-model branch July 26, 2024 17:34
mbarrenechea added a commit that referenced this pull request Nov 5, 2024
* sin up dev instance

* point to dev host in cd

* Grid prototype (#54)

* Add router for h3 tiler

* Add router to main app and fix dependencies

* WIP script for converting raster to tiles

* script for base case

* remove progress context manager

* WIP compute overviews

* WIP compute overviews

* small refactor and clenup

* Adds low memory filtering

* Set loggin levl to INFO

* Rename script and wip combinator for merging multiple tile sources to single folder

* some improvements, still not there

* Add metadata to tiled dataset creation and format to 100 columns

* Improves dataset combination

* Fix dtype conversion

* Add tests for grid enpoint and fixes bad index handling

* Fix test env vars in docker

* Add metadata model and endpoint for it

* add testito for meta endpoint and fix deprecation in model config

* Testing (#55)

* Header: tests

* Card: loader and no data

* Testing: Formats

* Testing: husky

* Testing: population

* Images

* Testing: utils

* Fix auth in grid  and update metadata model (#56)

* Wopsie

* Adds one for all test to check unauthorized accesses

* adds tests and removes dead code

* Make use of fastapi tools for auth (#57)

* Makes use of fastapis tooling to check tokens instead of our own

* Handle token errors in house

* Add comment

* Compact

* Table endpoint (#59)

* WIP table endpoint with filters

* set to use polars instead of duckdb. it is faster

* query builder and model for table filters json.

* add a couple of tests for the query builder

* add missing __init__ 🤦

* model tidy up models

* fix tests to new model

* add more test cases for the all the ops and changes order by to use '-' as desc indicator in column name

* tidy up names and tests

* remove duckdb from requirements

* add test

* set tests settings env vars in conftest

* Add column filter to tile endpoint (#60)

* query builder and model for table filters json.

* add a couple of tests for the query builder

* add missing __init__ 🤦

* fix tests to new model

* add more test cases for the all the ops and changes order by to use '-' as desc indicator in column name

* tidy up names and tests

* remove duckdb from requirements

* Adds columns query param to grid tile endpoint

* fix column param default and tests

* tidyup api documentation

* set correct status code for incorrect columns in filters

* amazonia360+ rewording

* updates metamodel (#64)

* add missing env var to compose setup

* add env vars for testing flow

* remove env vars from service for tests

* Remove zoom limit

* Search improvements

* Search: fix reset

* Fullstory

* Fullstory

* Filter cells by region and use hex representation of h3 cell id (#66)

* update dataset to use hexadecimal representation of cell id

* Add enpoint to get tiles filtered by geojson

* Speedup request by caching geojson filling result and improve queries

* removes all outputs from notebooks

* Adds nbstrip to pre-commit

* update deps and filter table by geojson

* Adds test for table results with geojson filter

* Tidy up the table response model

* Improve response documentation in OpenAPI

* Update compose call to use the compose subcommand in the ci runner

* small comment

* improve benchmark by using multiple geojson so we can check caching

* Fix polars arrow string compatibility to use large string instead of string view so js implementation can parse it (#67)

* Set h3 index type to `string` in IPC table (#69)

* Notebook to convert grid csv to arrow files

* Cast IPC table to string

* Fix python docker image no longer ships with libexpat a requirement for fiona and gdal

* remove test router

* Add (again) the restart policy for docker compose. Upsidoo!

* platform renamed to AmazoniaForever360+

---------

Co-authored-by: alexeh <[email protected]>
Co-authored-by: Biel Stela <[email protected]>
Co-authored-by: Miguel Barrenechea Sánchez <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant