Code

Add an S3 processor agent#755

Code

Closed

cdbartholomew wants to merge 28 commits intoLangStream:mainLangStream/langstream:mainfrom vectorize-io:mainvectorize-io/langstream:mainCopy head branch name to clipboard

+3,621-1,497

Commits

Commits on Jan 13, 2024

• S3 processor agent (#1)

  Show description for 012e520
  cdbartholomew

  authored
  012e520

Commits on Jan 21, 2024

• Updating OpenAI embedding example to use gateways to work better with… (#2)

  Show description for 7d32049
  cdbartholomew

  authored
  7d32049

Commits on Jan 27, 2024

• Add Enrico's fix for docker run missing class paths (#3)

  cdbartholomew

  authored
  dd2f41a

• Collection name from record (#4)

  cdbartholomew

  authored
  b2ab54b

Commits on Jan 29, 2024

• Allow proxy to any any agent, not just service type (#5)

  cdbartholomew

  authored
  058c918

• Bump openai python version

  cdbartholomew

  committed
  e5e229a

• Update S3 processor to emit errors

  cdbartholomew

  committed
  32a8ac5

Commits on Mar 18, 2024

• Make Pulsar connections work on non-default public/default tenant and namespace (#13)

  Show description for c15c8c4
  cdbartholomew

  authored
  c15c8c4

• Bumping the Kafka version since the old version is no longer available

  cdbartholomew

  committed
  799ab3f

Commits on Mar 20, 2024

• Add support for Pulsar in docker run

  cdbartholomew

  committed
  e692602

• Fix for duplicate tenant/namespace in topic

  cdbartholomew

  committed
  2d693d3

Commits on Mar 21, 2024

• Allow resource size and parallelism to be specified as variables; fixes for unit tests

  cdbartholomew

  committed
  9a85746

Commits on Mar 26, 2024

• Update to latest Pinecone SDK that works with servless indexes

  cdbartholomew

  committed
  1ada050

• Add similarity score to Pinecone query output

  cdbartholomew

  committed
  b72bf70

• Add fn:sha256 function

  cdbartholomew

  committed
  e1ecbd9

Commits on Mar 27, 2024

• Reduce the receiver queue size on Pulsar clients to limit the number of messages is flight and better constrain the memory usage of agents

  cdbartholomew

  committed
  1b1f1df

• Trying an even small receiver queue size

  cdbartholomew

  committed
  8ed2ee7

• Log an error message on a exception from OpenAI with non-streaming chat completions

  cdbartholomew

  committed
  b233806

Commits on Mar 28, 2024

• Update GitHub actions to run unit tests on a push to main and push tagged images to ECR

  cdbartholomew

  committed
  6d31d37

Commits on Apr 1, 2024

• Adding retry logic to Pulsar producer creation to avoid null pointer dereference issue

  cdbartholomew

  committed
  a8f038c

• Updating poetry.lock file

  cdbartholomew

  committed
  45d808a

• Adding lock around the creation of producer in Pulsar write

  cdbartholomew

  committed
  8b7b710

• Make Pulsar producer and schema volatile

  cdbartholomew

  committed
  5badc7e

Commits on Apr 2, 2024

• Additional logging around intermittently failing API gateway test

  cdbartholomew

  committed
  45ae49e

Commits on Apr 3, 2024

• Add support for Voyage AI embeddings

  cdbartholomew

  committed
  f88630b

• Update intermittently failing test to not depend on order of messages received, which makes sense since the clients are async

  cdbartholomew

  committed
  78948b7

• Separating the lazy initialization of the schema from the initialization of the producer

  cdbartholomew

  committed
  8ccd7b2

• Switch Voyage HTTP client to 1.1

  cdbartholomew

  committed
  c194ba1