Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: prepare embedder for Production #9517

Merged
merged 44 commits into from
Mar 29, 2024
Merged

feat: prepare embedder for Production #9517

Changes from 1 commit
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
d86eb2d
feat: support ad-hoc metadata inserts
mattkrick Mar 7, 2024
8628e3e
feat: triggers from metadata to queue
mattkrick Mar 8, 2024
285f69b
feat: move job queue to pg
mattkrick Mar 8, 2024
0b024dd
begin retry
mattkrick Mar 13, 2024
ae6126f
feat: support retries after queue goes dry
mattkrick Mar 13, 2024
9fb9c4f
chore: separate abstract models into their own files
mattkrick Mar 13, 2024
20f5d96
feat: support recursive text splitting for chunks
mattkrick Mar 14, 2024
eff8eb9
validate discussions to only include ended meetings
mattkrick Mar 18, 2024
7ec3d6a
support historical info
mattkrick Mar 18, 2024
49c3eae
Merge branch 'master' into feat/embedder1
mattkrick Mar 18, 2024
46dafac
feat: support listening to jobs from app
mattkrick Mar 19, 2024
47e83d9
feat: support calls from app
mattkrick Mar 19, 2024
7cee59e
merge master
mattkrick Mar 19, 2024
5c96c41
fix migration conflict
mattkrick Mar 19, 2024
49b349b
fix: import history
mattkrick Mar 19, 2024
bf9a379
fix: dataloader mem leak
mattkrick Mar 19, 2024
f7ccdc6
feat: handle stalled jobs
mattkrick Mar 19, 2024
b573083
self-review
mattkrick Mar 19, 2024
ba906e0
remove redlock for non-historical jobs
mattkrick Mar 19, 2024
10953b5
feat: clean comments
mattkrick Mar 19, 2024
7953939
remove pubsub
mattkrick Mar 19, 2024
c2b6753
fix lint errors
mattkrick Mar 19, 2024
8852ac2
fix lint
mattkrick Mar 19, 2024
2ba07c1
cast to any for CI
mattkrick Mar 19, 2024
7bcd083
build embeddings table in CI for the typings
mattkrick Mar 19, 2024
368b34c
codecheck after server starts
mattkrick Mar 19, 2024
1158523
use pgvector in CI
mattkrick Mar 19, 2024
ddfc151
POSTGRES_USE_PGVECTOR='true'
mattkrick Mar 19, 2024
07e0d12
lazy Kysely Codegen
mattkrick Mar 20, 2024
8360b95
fix: release-please and CI pgvector image bump
mattkrick Mar 20, 2024
e74754d
chore: rename files for clarity
mattkrick Mar 20, 2024
e7991d3
rename yaml to yml
mattkrick Mar 21, 2024
ef1d8c4
feat: support priority
mattkrick Mar 26, 2024
59b0647
feat: custom text splitter
mattkrick Mar 27, 2024
3faa442
feat: add language to metadata table
mattkrick Mar 27, 2024
2ab9f61
feat: support multiple workers
mattkrick Mar 27, 2024
7fc4136
feat: set workers via env var
mattkrick Mar 27, 2024
ea32be7
fix: handle shutdown and stalled jobs
mattkrick Mar 27, 2024
bc1cf74
update readme for parabol-ubi
mattkrick Mar 28, 2024
7d82b28
remove unused trigger logic
mattkrick Mar 28, 2024
b609f3e
turn on dev servers
mattkrick Mar 28, 2024
8679d2c
Merge branch 'master' into feat/embedder1
mattkrick Mar 28, 2024
0c80dd6
fix: rename migration
mattkrick Mar 28, 2024
826a044
Merge branch 'master' into feat/embedder1
mattkrick Mar 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' into feat/embedder1
  • Loading branch information
@mattkrick
mattkrick committed Mar 18, 2024
commit 49c3eae2b054c53e9cc5c3da47752740e72132ec
7 changes: 3 additions & 4 deletions yarn.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11300,7 +11300,6 @@ draft-js-utils@^1.4.0:

"draft-js@https://github.com/mattkrick/draft-js/tarball/559a21968370c4944511657817d601a6c4ade0f6":
version "0.10.5"
uid "025fddba56f21aaf3383aee778e0b17025c9a7bc"
resolved "https://github.com/mattkrick/draft-js/tarball/559a21968370c4944511657817d601a6c4ade0f6#025fddba56f21aaf3383aee778e0b17025c9a7bc"
dependencies:
fbjs "^0.8.15"
Expand Down Expand Up @@ -12039,9 +12038,9 @@ fast-json-stable-stringify@2.x, fast-json-stable-stringify@^2.0.0, fast-json-sta
integrity sha512-lhd/wF+Lk98HZoTCtlVraHtfh5XYijIjalXck7saUtuanSDyLMxnHhSXEDJqHxD7msR8D0uCmqlkwjCV8xvwHw==

fast-json-stringify@^5.7.0:
version "5.13.0"
resolved "https://registry.yarnpkg.com/fast-json-stringify/-/fast-json-stringify-5.13.0.tgz#3eafc02168713ef934d75000a8cf749492729fe8"
integrity sha512-XjTDWKHP3GoMQUOfnjYUbqeHeEt+PvYgvBdG2fRSmYaORILbSr8xTJvZX+w1YSAP5pw2NwKrGRmQleYueZEoxw==
version "5.12.0"
resolved "https://registry.yarnpkg.com/fast-json-stringify/-/fast-json-stringify-5.12.0.tgz#e9f77dc0b4face74351320c3618f1d869de5cb18"
integrity sha512-7Nnm9UPa7SfHRbHVA1kJQrGXCRzB7LMlAAqHXQFkEQqueJm1V8owm0FsE/2Do55/4CcdhwiLQERaKomOnKQkyA==
dependencies:
"@fastify/merge-json-schemas" "^0.1.0"
ajv "^8.10.0"
Expand Down
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.