Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update release process for go lib #203

Merged
merged 50 commits into from
Aug 5, 2024
Merged

Conversation

davi17g
Copy link
Collaborator

@davi17g davi17g commented Aug 4, 2024

No description provided.

@davi17g davi17g requested a review from reugn August 4, 2024 15:01
@codecov-commenter
Copy link

codecov-commenter commented Aug 4, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 86.13%. Comparing base (ef9064e) to head (a98cf5c).
Report is 81 commits behind head on useGoBackupLib.

Additional details and impacted files
@@                Coverage Diff                 @@
##           useGoBackupLib     #203      +/-   ##
==================================================
+ Coverage           85.98%   86.13%   +0.15%     
==================================================
  Files                  12       11       -1     
  Lines                 578      541      -37     
==================================================
- Hits                  497      466      -31     
+ Misses                 63       59       -4     
+ Partials               18       16       -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@reugn reugn changed the title Golib release proccess Update release process for go lib Aug 4, 2024
@davi17g davi17g merged commit 15e4b9f into useGoBackupLib Aug 5, 2024
4 checks passed
@davi17g davi17g deleted the golib-release-proccess branch August 5, 2024 07:00
korotkov-aerospike added a commit that referenced this pull request Aug 14, 2024
* Added backup-go submodule in modules directory

* Added backup-go submodule in modules directory

* Added backup-go dependency

* use go lib to backup

* userestore go

* delete old module

* Removed submodule

* delete old module

* use NewRestoreCOnfig

* use decoder in s3

* use timestamps

* remove log capture

* add restore flags

* add total records flag

* add set list and max records

* set mod before/after

* set bandwidth and policy

* set bandwidth

* update dependencies.

* update dependencies.

* update after lib's refactoring

* fixes for batch reads

* add more logs

* close aerospike client

* remove log parser

* use aws-s3

* add storage type to test

* constructor injection for restore service

* fix linter warnings

* try set GOPRIVATE

* APPS-1208 Fix s3 backups (#189)

* truncate slash in path

* clean go mod

* delete unused isRunningInDockerContainer

* add explanation

* add git config

* use BatchWrites = true

* use DisableBatchWrites property

* use new writers model

* parallel 8 by default; use encryption

* parallel 8 by default; use encryption

* use latest go lib

* use latest go lib

* close client

* pass FileLimit

* convert file limit to megabytes

* useGoBackupLib-fixed-encryption (#193)

- updated backup-go lib with fixed encrytpion

* useGoBackupLib
- update backup-go library

* useGoBackupLib
- fixed imports

* rename statistics fields

* use records per second

* update dependencies

* update dependencies

* update dependencies

* Add backup estimates endpoint (#195)

* backup function return handler

* store handlers for full backup

* only pass interval

* stats as int

* add current backup

* calculat estimates

* update API

* add total / done records

* separate incr and full backups

* code cleanup

* regen openssh

* regen openssh

* regen openssh

* rename handlers

* use map type alias

* fix estimated calculation

* protection from divison by zero

* add comments

* add comments

* pass context

* add comments

* update go.mod

* add restore_namespace.go

* use timebounds

* Revert "use timebounds"

This reverts commit 6b49d93.

* APPS-1225 Delete CreateFolder method (#196)

* delete CreateFolder

* update vulenrabilities

* go.sum

* APPS-1227 Use timebounds instead of shared.opts (#197)

* use timebounds

* revert error message

* Pass context object from the top level (#198)

* pass context from the top

* merge

* add validation for negative numbers

* create folder in DiskAccessor

* APPS-1228 Don't create multiple clients on every backup/restore (#199)

* don't create client for cluster configuration requests

* reuse client on restore

* linter warnings

* merge

* create client in goroutine

* use defer to close client

* extract init client method

* use total and socket timeouts

* set timeout on restore

* fix restore_memory_test

* add linter

* fix linter warnings

* add linters

* useGoBackupLib_handlers

* FMWK-387 Update refactored encoders lib (#201)

FMWK-387
- updated backup-go library

* return if could not connect

* release backup in progress lock in defer

* better clear incrementals

* try small connection pool

* try big connection pool

* add cinnection size

* remove whitespace

* use latest lib

* Update release process for go lib (#203)

Add golib release process

* add  MaxConnsPerHost and MinPartSize

* add  MaxConnsPerHost and MinPartSize

* use no bins flag

* APPS-1237 Add secret agent support (#200)

* APPS-1237-backup-service-secret-agent
- added support of secret agent configuration

* APPS-1237-backup-service-secret-agent
- updated swagger doc

* APPS-1237-backup-service-secret-agent
- updated lib

* APPS-1237-backup-service-secret-agent
- fix config mappings

* APPS-1237-backup-service-secret-agent
- branch update

* use no bins flag

* APPS-1243 Improve list backups performance (#202)

* use jrestoreobID

* use latest lib

* extract findlast backups

* extract retrieve config backups

* use lsDirAfter

* use lsDirAfter

* use lsDirAfter

* add lsFiles test

* codereview comments

* extract BackupNotFoundError

* use %w

* use custom error

* separate noBackup/noBackend errors

---------

Co-authored-by: yrizhkov <[email protected]>

* Update image-release.yaml

* APPS-1248 Add estimate time to restore (#205)

* use max async connections

* async restore

* store handlers in job_holder

* add estimates file

* update DTOs

* set start time

* set total records time

* extract current job stats

* update rest

* update estimates

* update dto's

* set Done records

* add comments

* add error

* use latest lib

* codereview comments

* APPS-1259 Remove shared package leftovers

* APPS-1256 Organize project build files (#206)

* Organize project build files

* Remove Project variable in Dockerfile (#208)

* APPS-1258 Refactor the service package (#209)

* add backup/restore service to covignore

* APPS-1241 Use client manager to create clients (#210)

* use client manager to create clients

* update lib

* unit tests

* add commetns

* put defenition on top

* extract Client factory

* add client manager test

* update logs

* codereview comments

* regenerate api

* APPS-1257 Refactor api handlers (#207)

* APPS-1257-refactored-handlers
- refactored http server
- refactored http handlers

* APPS-1257-refactored-handlers
- WIP logging on api handlers

* APPS-1257-refactored-handlers
- logging
- swagger update
- small fixes

* APPS-1257-refactored-handlers
- wip tests

* APPS-1257-refactored-handlers
- wip tests and dtos

* APPS-1257-refactored-handlers-DTOS
- trying to refactor DTOS

* APPS-1257-refactored-handlers
- tests

* APPS-1257-refactored-handlers
- resolved conflicts

* APPS-1257-refactored-handlers
- tests fix

* APPS-1257-refactored-handlers
- removed broken tests

* APPS-1257-refactored-handlers
- config

* APPS-1257-refactored-handlers
- resolving conflicts

* update .covignore

* fix-swagger
- fixed swagger route for static contetnt

* Update the release workflow (#212)

* Update the release workflow

* APPS-1270 Fetch namespaces on backup (#213)

if no NSs provided, fetch them on backup operation

* APPS-1252 Optimize validation for S3 (#214)

* add storage path validation

* add storage path validation

* s3 context tests

* logs

* add todo

* update documentation for restore policy

* Improve restore policy validation (#215)

* update connection queue size

* don't limit queue size

* connections queue size

---------

Co-authored-by: Dmitrii Neeman <[email protected]>
Co-authored-by: Dmitrii Neeman <[email protected]>
Co-authored-by: David Gerchikov <[email protected]>
Co-authored-by: yrizhkov <[email protected]>
Co-authored-by: David Gerchikov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants