Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add canonical OC to test README template #3336

Merged
merged 9 commits into from
Nov 12, 2024
Merged

Conversation

dplore
Copy link
Member

@dplore dplore commented Jul 27, 2024

Thoughts on this?

The goal is to have an easy to read, reference/golden/canonical configuration that covers the test topic. It should be a snippet including the paths that are to be tested.

The format could be JSON or YAML, but I think YAML is considerably easier to read and somewhat easier to write.

The YAML could be validated by converting to JSON and then parsed by ygot or gnmic.

@dplore dplore requested a review from a team as a code owner July 27, 2024 01:04
@dplore dplore requested a review from a team as a code owner July 27, 2024 01:04
@OpenConfigBot
Copy link

OpenConfigBot commented Jul 27, 2024

Pull Request Functional Test Report for #3336 / 8a1db63

No tests identified for validation.

Help

@coveralls
Copy link

coveralls commented Jul 27, 2024

Pull Request Test Coverage Report for Build 11804359535

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 55.268%

Totals Coverage Status
Change from base Build 11794420856: 0.0%
Covered Lines: 1983
Relevant Lines: 3588

💛 - Coveralls

@rcdomigan
Copy link
Contributor

Whether it's JSON or YAML, as someone trying to produce openconfig for a device I would like to have a concrete stanza to model my configuration on.

sachendras added a commit that referenced this pull request Aug 30, 2024
Changing the config to the approach suggested in #3336
sachendras added a commit that referenced this pull request Sep 4, 2024
* Update to the MTU test readme to cover for Tunnel interfaces.

- Separate the test to 2 sub tests
- While the original test covered MTU configuration on physical/Bundle  interfaces only, added subtest covers for Tunnel interface MTU configuration and corresponding emphasis on zero fragmentation plus packet drops.

Updated write-up also covers for missed config and state paths.

* Update README.md

Added additional clarity on the tunnel interface MTU config  that it isn't mandatory for the NOS to allow for MTU config on tunnel interfaces. Expectation is for the tunnel interface to respect the MTU configured on the underlying physical or bundle interface acting as an egress point.

* Update README.md

updated the following bullet for MTU-1.3.2

Ensure MTU configured on this tunnel interface is in context to the MTU on the egress physical/bundle interface. It is acceptable if the implementation doesn't support explicit MTU config on tunnel interfaces. Idea is for the tunnel interface to respect the egress physical/bundle interface MTU config.

* Update README.md

* Update README.md

Corrected Yaml error

* Update README.md

* Update README.md

* Update README.md

Updated paths that were incorrectly defined.

* Update README.md

Corrected the OC path   /interfaces/interface/tunnel/config/dst: 

It was originally   /interfaces/interface/tunnel/config/dest:

* Adding canonical OC to config path

Changing the config to the approach suggested in #3336

* Update README.md

Trying to correct the error

Run go install ./tools/validate_readme_spec
########## READMEs in changed directories to be validated (including ones to be exempted):
feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md
########## Validating READMEs in changed directories:
I0830 17:54:13.842665    4350 validate_readme_spec.go:149] Validating "feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md"
E0830 17:54:13.843301    4350 validate_readme_spec.go:156] file feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md: mdocspec: error parsing YAML: yaml: unmarshal errors:
  line 4: cannot unmarshal !!seq into map[string]interface {}
F0830 17:54:13.843594    4350 validate_readme_spec.go:178] The following files have errors:
feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md
Error: Process completed with exit code 1.

* Update README.md

* Update README.md

Moved the canonical config to the Test procedure area. Also, restored the section under ## OpenConfig Path and RPC Coverage to how it was before.
frasieroh pushed a commit to aristanetworks/openconfig-featureprofiles that referenced this pull request Sep 5, 2024
…nfig#3401)

* Update to the MTU test readme to cover for Tunnel interfaces.

- Separate the test to 2 sub tests
- While the original test covered MTU configuration on physical/Bundle  interfaces only, added subtest covers for Tunnel interface MTU configuration and corresponding emphasis on zero fragmentation plus packet drops.

Updated write-up also covers for missed config and state paths.

* Update README.md

Added additional clarity on the tunnel interface MTU config  that it isn't mandatory for the NOS to allow for MTU config on tunnel interfaces. Expectation is for the tunnel interface to respect the MTU configured on the underlying physical or bundle interface acting as an egress point.

* Update README.md

updated the following bullet for MTU-1.3.2

Ensure MTU configured on this tunnel interface is in context to the MTU on the egress physical/bundle interface. It is acceptable if the implementation doesn't support explicit MTU config on tunnel interfaces. Idea is for the tunnel interface to respect the egress physical/bundle interface MTU config.

* Update README.md

* Update README.md

Corrected Yaml error

* Update README.md

* Update README.md

* Update README.md

Updated paths that were incorrectly defined.

* Update README.md

Corrected the OC path   /interfaces/interface/tunnel/config/dst:

It was originally   /interfaces/interface/tunnel/config/dest:

* Adding canonical OC to config path

Changing the config to the approach suggested in openconfig#3336

* Update README.md

Trying to correct the error

Run go install ./tools/validate_readme_spec
########## READMEs in changed directories to be validated (including ones to be exempted):
feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md
########## Validating READMEs in changed directories:
I0830 17:54:13.842665    4350 validate_readme_spec.go:149] Validating "feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md"
E0830 17:54:13.843301    4350 validate_readme_spec.go:156] file feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md: mdocspec: error parsing YAML: yaml: unmarshal errors:
  line 4: cannot unmarshal !!seq into map[string]interface {}
F0830 17:54:13.843594    4350 validate_readme_spec.go:178] The following files have errors:
feature/mtu/largeippacket/otg_tests/large_ip_packet_transmission/README.md
Error: Process completed with exit code 1.

* Update README.md

* Update README.md

Moved the canonical config to the Test procedure area. Also, restored the section under ## OpenConfig Path and RPC Coverage to how it was before.
xw-g
xw-g previously requested changes Sep 30, 2024
Copy link
Collaborator

@xw-g xw-g left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Having internal discussion. (So far it doesn't seems like we want YAML)

@dplore
Copy link
Member Author

dplore commented Oct 15, 2024

@xw-g @robshakir ready for re-review.

@self-maurya @rohit-rp, please feel free to provide any suggestions.

self-maurya
self-maurya previously approved these changes Oct 17, 2024
Co-authored-by: Rob Shakir <[email protected]>
@dplore dplore requested a review from robshakir October 25, 2024 00:11
Copy link
Contributor

@robshakir robshakir left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the changes, LGTM.

@robshakir robshakir assigned dplore and unassigned robshakir Nov 12, 2024
@dplore dplore dismissed xw-g’s stale review November 12, 2024 19:30

Addressed comment, removed yaml and added json

@dplore dplore merged commit f1ea980 into main Nov 12, 2024
15 checks passed
@dplore dplore deleted the dplore/readme-template-oc-config branch November 12, 2024 20:06
mastarkey pushed a commit to b4firex/featureprofiles that referenced this pull request Nov 18, 2024
* Update test-requirements-template.md to require Canonical OC section, written in JSON format
ANISH-GOTTAPU pushed a commit to open-traffic-generator/featureprofiles that referenced this pull request Nov 28, 2024
* Update test-requirements-template.md to require Canonical OC section, written in JSON format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants