Implement post-state-root

[robin-near]

Update post-state-root was cancelled, cleanup PR: #10184

See the doc for more context.

Tasks

Preview Give feedback

1. feat: implement post-state-root chunk production #9537
   A-chain +1
2. post-state-root: implement block production #9618
   A-chain Near Core +2
   
3. post-state-root: process block/chunks #9619
   A-chain Near Core +2
4. post-state-root: protocol changes #9620
   A-chain Near Core +2
5. post-state-root: integration testing #9621
   A-chain Near Core +2
6. post-state-root: NEP #9622
   Near Core +1

[pugachAG]

Implementation challenges

Block fields needed when applying the chunk

Currently some block-level data is required to apply the chunk. This includes the following:

• gas_price is calculated when the block is produced: code.
• block_timestamp: provided by the runtime: code.
• block_hash: used in generate_data_id.
• random_value: used as part of random_seed

[pugachAG]

Progress update:

• Merged some groundwork PRs: introduce new block/chunk structs for post-state-root, refactor existing structs, introduce a protocol feature
• 50% progress on implementing post-state-root chunk production: feat: implement post-state-root chunk production #9537
• Collecting issues to be addressed later: comment

[walnut-the-cat]

September goal for post state root was:

• Prototype
• Come up with detailed implementation plan
• Partial implementation to unblock other part of stateless validation project

We expect the 2nd and 3rd ones to be completed by end of this week, while the first one will take little longer due to newly discovered complexity.

[pugachAG]

Plan for October:

• Implement post-state-root MVP (excluding optimisations such as making chunk parts retrieval async):
  • produce chunk (almost finished, but will be merged early next week)
  • produce block
  • process block/chunks
• End-to-end testing with rust integration tests.
• Come up with a proposal to handle protocol changes resulting from post-state-root (for example VRF and this comment)
• Make NEP-507 ready for review

@Longarithm @robin-near let me know if I forgot something or if you have any concerns