Code

Adding AstraDB as a DocumentStore#144

Code

Merged

julian-risch merged 80 commits intodeepset-ai:maindeepset-ai/haystack-core-integrations:mainfrom Anant:mainAnant/haystack-core-integrations:mainCopy head branch name to clipboardJan 11, 2024

+2,220-1

Commits

Commits on Jan 11, 2024

• astra haystack integration

  

  BenAichaRihab

  authored and

  mounaTay

  committed
  3614505

• add delete

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  0af8817

• test

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  d907c63

• update init for AstraClient and AstraDocumentStore

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  cb8a1ff

• Added method fetch_documents_by_id and fetch_document_by_id

  

  jsbilgi

  authored and

  mounaTay

  committed
  3652e92

• Added count_document

  

  jsbilgi

  authored and

  mounaTay

  committed
  139ac07

• Removed _index from init

  

  jsbilgi

  authored and

  mounaTay

  committed
  1c96047

• Included batching and minor improvements in test module

  

  jsbilgi

  authored and

  mounaTay

  committed
  4477202

• bug fix:AstraClient.find_index not checking for status code and status key before getting collection from response

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  cbc2af9

• add update_document(), insert(), and find_document() to AstraClient, refactor upsert()

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  19a9e82

• implement write_documents

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  85246f1

• Add precommit hook and git actions

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  7150813

• Minor changes to documentation and add requirements file

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  84e8c6c

• Refactor json calls to AstraClient

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  c0013bf

• rename folder

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  b58689f

• Add example script

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  2b28264

• add convert_filters function

  

  david-polo

  authored and

  mounaTay

  committed
  aca0242

• fix write_documents failng with DuplicatePolicy.FAIL when there are no duplicates.

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  cd3eec2

• log additional info for insert and update in AstraDataStore.write_documents()

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  f43906c

• fix: fixing document parsing and filter documents bugs

  

  BenAichaRihab

  authored and

  mounaTay

  committed
  77ac4e1

• Add to search and delete to example

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  aeff7ac

• Adding reqs and remove mistaken pop content

  

  anomnaco

  authored and

  mounaTay

  committed
  5d2b960

• adding logger back to astra client

  

  BenAichaRihab

  authored and

  mounaTay

  committed
  6e37f79

• haystack version matching Document schema

  

  anomnaco

  authored and

  mounaTay

  committed
  9a8a77d

• set duplicates policy on datastore init, set default duplicate policy for write_documents to None

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  be8eeec

• Prepare for ci cd

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  e4713b2

• Add tests to git actions

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  2ea219a

• Modifying haystack rag pipeline example

  

  anomnaco

  authored and

  mounaTay

  committed
  3c18eda

• Update return type from queryResponse to Document

  

  anomnaco

  authored and

  mounaTay

  committed
  1633701

• Update single retriever parent references

  

  anomnaco

  authored and

  mounaTay

  committed
  7301fba

• Add rag example and readme

  

  anomnaco

  authored and

  mounaTay

  committed
  7279a40

• Update examples with DuplicatePolicy

  

  anomnaco

  authored and

  mounaTay

  committed
  c85a1ac

• Update Readme with DuplicatePolicy

  

  anomnaco

  authored and

  mounaTay

  committed
  78b3e15

• fix cicd pipeline

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  c02f54e

• remove describe index stats

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  7694610

• Update requirements.txt and pyproject.toml with haystack versions

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  e1e6fca

• select haystack 1.22.1

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  474262a

• pop id_hash_keys from metadata in Response object

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  cfbc6a4

• fix requirements for pipeline_example

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  0795587

• fix haystack version typo in pyproject.toml

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  c06b382

• fix id_hash_key can't be set at haystack Document init

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  7e956d6

• comment out currently unused indexing pipeline in examples/example.py

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  9afde47

• refoctor find

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  67036ad

• Add unit tests

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  febd779

• Skip tests with unsupported filter

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  59e2ab0

• more fixes

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  7d7f97c

• fixing unit test link

  

  BenAichaRihab

  authored and

  mounaTay

  committed
  d47621f

• more fixes

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  97946e3

• Add model_name to astra_store on initializing in test_document_store.py

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  44b4361

• all tests passing

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  35830b3

• Convert document[id] to document[_id] in write_documents

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  389236e

• Change id to _id in filter_documents

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  342c89b

• fix lint isssue for python3.9

  

  david-polo

  authored and

  mounaTay

  committed
  29be6d3

• fixing similarity score flag

  

  BenAichaRihab

  authored and

  mounaTay

  committed
  fb9e3d3

• pipeline example fix

  

  anomnaco

  authored and

  mounaTay

  committed
  b926c3f

• examples document type fix

  

  anomnaco

  authored and

  mounaTay

  committed
  1f14bb2

• Black Linting fixes

  

  anomnaco

  authored and

  mounaTay

  committed
  2ea583f

• change to pyproject.toml to use haystack 2.0, update test_document_store.py imports and

  Show description for c8a48ce
  

  ElenaKusevska

  authored and

  mounaTay

  committed
  c8a48ce

• use new Document dataclass

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  0eabdbf

• skip tests

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  7f617de

• update write_documents for haystack 2.0

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  6d43fbd

• remove -m "unit" option in Actions to not deselect tests

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  72f6c2c

• remove model_name from test_document_store.py

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  d69d3a4

• Fix setting default duplicates policy

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  3e7ad8e

• test if datastore empty before deleting

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  d1db400

• Raise exception if Document _id not string when writing documents

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  09a339f

• Implement batch size for delete limited to 20

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  9602777

• filters mapping

  

  Mouna Tayahi

  authored and

  mounaTay

  committed
  69040b6

• add test for default write documents behavior

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  5545867

• add to_dict and from_dict

  

  mouna

  authored and

  mounaTay

  committed
  6f7057a

• update examples

  mounaTay

  committed
  1644caa

• update retriever for haystack 2.0. Fix integration tests for updated

  Show description for 759f7c6
  

  ElenaKusevska

  authored and

  mounaTay

  committed
  759f7c6

• fix linting errors

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  c3f05e9

• remove preprocessor.py in examples/

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  4a91b77

• Pipeline examples document fix

  

  anomnaco

  authored and

  mounaTay

  committed
  d51dbc8

• pipeline examples lint fix

  

  anomnaco

  authored and

  mounaTay

  committed
  b5b89e2

• prepare for directory structure in haystack integrations repo

  

  ElenaKusevska

  authored and

  mounaTay

  committed
  e718180

• Add Ci + Add PR fixes

  mounaTay

  committed
  9cb8eac

• Linter fixes

  mounaTay

  committed
  33405cd

• Update integrations/astra/tests/test_document_store.py

  Show description for 5ca2d52
  

  mounaTay

  and

  julian-risch

  committed
  5ca2d52