Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Lazy share writers #637

Merged
merged 73 commits into from
Apr 25, 2022
Merged

Conversation

evan-forbes
Copy link
Member

@evan-forbes evan-forbes commented Feb 24, 2022

Description

Refactors share merging to be lazy. This is needed to efficiently fill the data square.

Closes: #636

Github shows previous commits as part of this PR even though they do not contribute to the changes of this PR.

The changes introduced in this PR: https://github.com/celestiaorg/celestia-core/pull/637/files/68e4e18c3d6abde34dc160fef08124b4f6afcdca..4aa56e021309e70f7267e258eecab11d2bf30cf3

@evan-forbes evan-forbes self-assigned this Feb 24, 2022
@evan-forbes evan-forbes requested review from liamsi, Wondertan, adlerjohn and rach-id and removed request for tac0turtle February 24, 2022 06:47
types/shares_test.go Show resolved Hide resolved
types/shares_test.go Outdated Show resolved Hide resolved
@evan-forbes
Copy link
Member Author

blocked by #631, so converting to a draft

@evan-forbes evan-forbes marked this pull request as draft February 27, 2022 02:47
Copy link
Member

@adlerjohn adlerjohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would like @Wondertan to take a look too

types/block.go Show resolved Hide resolved
types/block.go Show resolved Hide resolved
Copy link
Member

@liamsi liamsi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments. But looks pretty good 👏🏼

types/block.go Outdated Show resolved Hide resolved
types/block.go Show resolved Hide resolved
types/block.go Show resolved Hide resolved
types/block.go Outdated Show resolved Hide resolved
types/block.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/share_splitting.go Show resolved Hide resolved
types/shares_test.go Outdated Show resolved Hide resolved
types/block.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/share_splitting.go Outdated Show resolved Hide resolved
types/block.go Outdated Show resolved Hide resolved
Copy link
Member

@Wondertan Wondertan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

evan-forbes and others added 8 commits April 23, 2022 13:54
Co-authored-by: Ismail Khoffi <[email protected]>
Co-authored-by: Ismail Khoffi <[email protected]>
Co-authored-by: Ismail Khoffi <[email protected]>
Co-authored-by: Ismail Khoffi <[email protected]>
Co-authored-by: Ismail Khoffi <[email protected]>
Co-authored-by: Ismail Khoffi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C:erasure-coding Component: Erasure coding T:enhancement Type: Enhancement T:optimization Type: Optimization
Projects
No open projects
Archived in project
Development

Successfully merging this pull request may close these issues.

Add lazy share merging
7 participants