Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(sync): Sync refactor #495

Open
wants to merge 33 commits into
base: main
Choose a base branch
from
Open

feat(sync): Sync refactor #495

Show file tree
Hide file tree
Changes from 30 commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
68b2aa7
fix(db): fix number of files in db, startup hang, ram issues and flus…
cchudant Nov 6, 2024
45703c8
p2p: start
cchudant Nov 27, 2024
aa3b9aa
feat: make kad work
cchudant Dec 9, 2024
4f39098
p2p: pathfinder can now sync from us
cchudant Dec 13, 2024
b950296
sync2 refactor
cchudant Jan 6, 2025
b3a5be0
pipeline controller, debugging now
cchudant Jan 13, 2025
eeeb54c
fix: can now sync txs and headers
cchudant Jan 13, 2025
837273b
p2p: added response stream mapping for events, classes, state diffs -…
cchudant Jan 14, 2025
e09dcd5
feat(sync/p2p): added the other sync pipelines :)
cchudant Jan 15, 2025
ec97bf2
fix: legacy classes, hashes
cchudant Jan 18, 2025
e7e540b
feat(sync): probe, sync abstraction and gateway sync
cchudant Jan 21, 2025
825589b
feat: hook up gateway pipelines, now working
cchudant Jan 21, 2025
edbfae2
fix(p2p-sync): can now sync from madara 🥳
cchudant Jan 30, 2025
bfd284d
Merge remote-tracking branch 'origin/main' into p2p_4
cchudant Jan 31, 2025
11bf16f
cleaning up
cchudant Jan 31, 2025
5fa623c
fix: save chain tip to db
cchudant Feb 1, 2025
65a4667
fix: typo
cchudant Feb 1, 2025
b0e2b6e
fix: classes should be saved sequentially
cchudant Feb 1, 2025
c0a7b29
fix: pipeline polling order
cchudant Feb 2, 2025
8a0c70f
nicer log messages
cchudant Feb 2, 2025
23bc787
re-add sync metrics
cchudant Feb 2, 2025
43fbf87
re-add pending blocks, tidy probe, re-add unsafe-starting-block
cchudant Feb 3, 2025
647475d
re-add flush every n blocks, backup every n blocks
cchudant Feb 4, 2025
5c9de35
fix: rpc and gateway should not be able to see incomplete blocks in db
cchudant Feb 4, 2025
6a4f902
wrap updates
cchudant Feb 5, 2025
ddd9ab1
warp updates fixed
cchudant Feb 5, 2025
144b9fc
fix tests
cchudant Feb 14, 2025
41eae28
Remove p2p and prepare for upstreaming
cchudant Feb 14, 2025
85b6581
Adding some tests
cchudant Feb 17, 2025
70c6d21
fix tests
cchudant Feb 18, 2025
2dc9e7a
add changelog
cchudant Feb 18, 2025
729a766
fix mainnet
cchudant Feb 21, 2025
c4c1fcd
address review comments
cchudant Feb 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
127 changes: 42 additions & 85 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

14 changes: 6 additions & 8 deletions Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ members = [
"crates/madara/client/telemetry",
"crates/madara/client/devnet",
"crates/madara/client/mempool",
"crates/madara/client/block_import",
"crates/madara/client/block_production",
"crates/madara/node",
"crates/madara/primitives/block",
"crates/madara/primitives/convert",
Expand All @@ -26,24 +26,22 @@ members = [
"crates/madara/proc-macros",
"crates/madara/tests",
"crates/madara/cairo-test-contracts",
"crates/madara/client/block_production",
]
resolver = "2"
# Everything except test-related packages, so that they are not compiled when doing `cargo build`.
default-members = [
# madara
"crates/madara/client/db",
"crates/madara/client/exec",
"crates/madara/client/sync",
"crates/madara/client/eth",
"crates/madara/client/rpc",
"crates/madara/client/gateway/client",
"crates/madara/client/gateway/server",
"crates/madara/client/rpc",
"crates/madara/client/analytics",
"crates/madara/client/telemetry",
"crates/madara/client/devnet",
"crates/madara/client/mempool",
"crates/madara/client/block_import",
"crates/madara/client/analytics",
"crates/madara/client/block_production",
"crates/madara/node",
"crates/madara/primitives/block",
"crates/madara/primitives/convert",
Expand Down Expand Up @@ -132,7 +130,6 @@ mc-sync = { path = "crates/madara/client/sync" }
mc-eth = { path = "crates/madara/client/eth" }
mc-mempool = { path = "crates/madara/client/mempool" }
mc-block-production = { path = "crates/madara/client/block_production" }
mc-block-import = { path = "crates/madara/client/block_import" }
mc-devnet = { path = "crates/madara/client/devnet" }

# Madara misc
Expand Down Expand Up @@ -184,6 +181,7 @@ tracing-subscriber = { version = "0.3.18", features = [
] }
tracing-test = "0.2.5"
tracing-opentelemetry = "0.26.0"
tokio-stream = "0.1"

# Networking
jsonrpsee = { version = "0.22", default-features = false, features = [
Expand Down Expand Up @@ -273,4 +271,4 @@ librocksdb-sys = { git = "https://github.com/madara-alliance/rust-rocksdb", bran
starknet-types-core = { git = "https://github.com/kasarlabs/types-rs.git", branch = "feat-deserialize-v0.1.7" }
starknet-types-rpc = { git = "https://github.com/jbcaron/types-rs.git", branch = "fork" }

starknet-core = { git = "https://github.com/kasarlabs/starknet-rs.git", branch = "fork" }
# starknet-core = { git = "https://github.com/kasarlabs/starknet-rs.git", branch = "fork" }
Loading