Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Garbage collection and disappearing ports issue #3214

Merged
merged 60 commits into from
Aug 8, 2024
Merged
Changes from 1 commit
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
2aaebb7
Add integration test confirming the deletion bug
Donnype Jun 28, 2024
966e842
Add source_method field with optional boefje id
Donnype Jul 9, 2024
7ec36e0
Assert that the fix works in the integration test
Donnype Jul 9, 2024
43d1d58
Enhance origin API
Donnype Jul 9, 2024
2f9e0d1
Add release notes for upgrading
Donnype Jul 9, 2024
421c6f2
Remove 1.16 from release notes for now again
Donnype Jul 9, 2024
f25363a
Merge branch 'main' into fix/disappearing-ports
underdarknl Jul 9, 2024
921d2e4
Fix Rocky integration test
Donnype Jul 11, 2024
4b09bf2
Merge branch 'main' into fix/disappearing-ports
Donnype Jul 11, 2024
c1419c3
Fix style
Donnype Jul 11, 2024
032a24e
Recalculate bits twice for some delay to fix the CI pipeline
Donnype Jul 11, 2024
106aa01
Merge branch 'main' into fix/disappearing-ports
underdarknl Jul 11, 2024
5d85d65
Fix nmap-udp image
Donnype Jul 11, 2024
6760670
Bugfix
Donnype Jul 16, 2024
9daba3c
initialize benchmark setup in boefjes CI
Donnype Jul 18, 2024
d324309
Seed a lot more of a smaller set of types
Donnype Jul 18, 2024
c3d63bf
Create octopoes dump without source_method for the migration test usi…
Donnype Jul 23, 2024
18914bc
First migration test setup with some asserts
Donnype Jul 23, 2024
6e165db
Improve recalculate_bits endpoint logging
Donnype Jul 25, 2024
8f5832a
Fixes for the ci test
Donnype Jul 25, 2024
8a4edc7
Remove breakpoint
Donnype Jul 25, 2024
a202ebb
Final test fix
Donnype Jul 25, 2024
41a84e8
WIP selective multi-normalizer queries through method parameter
Donnype Jul 25, 2024
ea77b09
fix test setup
Donnype Jul 29, 2024
b5228ef
Remove normalizer filter
Donnype Jul 29, 2024
f19757b
Add octopoes xtdb cache to speed up benchmarking
Donnype Jul 29, 2024
2045c2a
Merge branch 'fix/disappearing-ports' into fix/disappearing-ports-ori…
Donnype Jul 29, 2024
287bc66
Fix test
Donnype Jul 29, 2024
c379c2f
Merge branch 'fix/disappearing-ports' into fix/disappearing-ports-ori…
Donnype Jul 29, 2024
5a5ca93
Use real normalizer id
Donnype Jul 29, 2024
e029a1b
Merge branch 'fix/disappearing-ports' into fix/disappearing-ports-ori…
Donnype Jul 29, 2024
f444ec3
Fix test setup: create metas after seeding octopoes
Donnype Jul 29, 2024
ed87203
Merge branch 'fix/disappearing-ports' into fix/disappearing-ports-ori…
Donnype Jul 29, 2024
f415e63
Fix upgrade filters
Donnype Jul 29, 2024
89e26d5
Update seed logic: now only 30% origins to be updated though Bytes
Donnype Jul 29, 2024
43d27ef
Fix the bytes data as well
Donnype Jul 29, 2024
eb762e7
Merge branch 'fix/disappearing-ports-original' into fix/disappearing-…
Donnype Jul 29, 2024
4907d90
Fix test assertion on total_processed
Donnype Jul 29, 2024
3b6349a
Create bulk API enabling a fast migration
Donnype Jul 30, 2024
a01f516
Add check that we did not lose any objects
Donnype Jul 30, 2024
9276d5f
Remove duplicate recalculate_bits call
Donnype Jul 30, 2024
d251d2c
Merge branch 'main' into fix/disappearing-ports
Donnype Jul 30, 2024
e3582fb
Get new findings list with current datetime
Donnype Jul 30, 2024
534ee68
Style
Donnype Jul 30, 2024
9e745bc
Fix valid time management in disappearing ports integration test
Donnype Jul 30, 2024
1835ba7
Change valid time variable names
Donnype Jul 30, 2024
a5c62d1
Test CI timing
Donnype Jul 30, 2024
3490dc4
Remove several sleeps
Donnype Jul 30, 2024
9429b73
remove more sleeps
Donnype Jul 30, 2024
a8a85a2
move around sleeps
Donnype Jul 30, 2024
86ed67a
Remove one sleep
Donnype Jul 30, 2024
e49153c
Add some sleeps again around the recalculate bits method
Donnype Jul 30, 2024
9c076a5
Merge branch 'main' into fix/disappearing-ports
Donnype Jul 31, 2024
e15cb9b
Merge branch 'main' into fix/disappearing-ports
Donnype Aug 1, 2024
a6fb676
Merge branch 'main' into fix/disappearing-ports
underdarknl Aug 2, 2024
a53eda2
Update boefjes/tools/upgrade_v1_16_0.py
Donnype Aug 5, 2024
3dabb52
Merge branch 'main' into fix/disappearing-ports
Donnype Aug 5, 2024
37cb2d3
Part of PR comments
Donnype Aug 6, 2024
0863afa
Merge branch 'main' into fix/disappearing-ports
Donnype Aug 6, 2024
7bdf3de
Merge branch 'main' into fix/disappearing-ports
Donnype Aug 6, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into fix/disappearing-ports
  • Loading branch information
underdarknl authored Aug 2, 2024
commit a6fb676fe8ce5a34928b4de301b06331ca77889c

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.