[core] Index tags

[tdraier]

fixes: https://github.com/dust-tt/tasks/issues/2047
fixes: https://github.com/dust-tt/tasks/issues/2046

Description

Update schema for tags in ES. Adds a new tags field with keyword, text/standard and text/edge_analyzer .
Update tags when upserting table or document.
Add a backfill for existing docs/tables.
Adds endpoint to query tags

Tests

run simple query to list tags values :

curl -u${ELASTICSEARCH_USERNAME}:${ELASTICSEARCH_PASSWORD} -H "Content-type: application/json" -XGET "http://localhost:9200/core.data_sources_nodes_3/_search?pretty" -d '{
    "query": {
        "bool": {
            "must": [
                {
                    "prefix": {
                        "tags.edge": "t"
                    }
                },
                {
                    "term": {
                        "data_source_id": "748f425e08b7c01c39dbd627b32a73bf7fa5f83b2499bb997b05f2551a7991e6"
                    }
                }
            ]
        }
    },
    "aggs": {
        "unique_tags": {
            "terms": {
                "field": "tags.keyword",
                "size": 10
            }
        }
    },
    "size": 0
}'

For the same query with core endpoint :

curl -XPOST http://localhost:3001/tags/search --header 'content-type: application/json' -d '{
  "query": "t",
  "query_type": "prefix",
  "data_sources": ["748f425e08b7c01c39dbd627b32a73bf7fa5f83b2499bb997b05f2551a7991e6"]
}'

Risk

Deploy Plan

run migration :

./admin/elasticsearch_run_command_from_file.sh src/search_stores/migrations/20250131_add_tags.http

deploy core

run backfills

cargo run --bin elasticsearch_backfill_document_tags_index -- --index-version 3 --query-type document
cargo run --bin elasticsearch_backfill_document_tags_index -- --index-version 3 --query-type table