refine(v3.7.x): refactor proxy_info.yaml and ecu_info.yaml config files parsing

[Bodong-Yang]

Description

This PR refactors the implementation of proxy_info.yaml and ecu_info.yaml config files parsing. Now these two configs files are parsed and validated by pyyaml and pydantic. The implementation now also aligns with the documentation, see ecu_info.yaml specification and proxy_info.yaml specification for more details.

Also, now the logic of parsing these two config files are separated from otaclient.app package and implemented at otaclient.config package. For the otaclient package level config package, see otaclient package scope configs infra for more details.

Check list

• test file(s) that covers the change(s) is implemented.
• local test is passed.
• VM tests passed.

Changes

Behavior changes

Does this PR introduce behavior change(s)?

• No.

Breaking change

Does this PR introduce breaking change?

• No.

Related links & tickets

[Bodong-Yang]

Note: BootloaderType.UNSPECIFIC is renamed to AUTO_DETECT for better understanding. But AUTO_DETECT is deprecated and should not be used in the future.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
otaclient/app
__init__.py	0	0	100%
__main__.py	3	3	0%	16–19
common.py	375	32	91%	63, 193, 208, 283–285, 295, 304–306, 412, 424, 543–547, 635, 637, 669–671, 673, 699–702, 707, 711–715, 741–742
configs.py	76	0	100%
downloader.py	271	44	84%	68, 81–82, 297, 302, 306, 324–325, 375–379, 398–408, 429–447, 456, 531–533, 549, 569–587
errors.py	113	0	100%
interface.py	17	4	76%	32, 43, 47, 51
log_setting.py	55	7	87%	39–40, 52, 54, 65–67
main.py	29	2	93%	43–44
ota_client.py	398	149	63%	55–56, 76, 182–206, 243–246, 258–274, 284–287, 292–330, 372–375, 380–387, 400–423, 429–432, 461–485, 499–506, 513, 516–522, 569–572, 580, 616, 621–643, 703–719, 730–746, 757, 776, 787–788, 805, 824, 828–829, 844
ota_client_call.py	38	6	84%	42–44, 80–82
ota_client_service.py	27	3	89%	55–57
ota_client_stub.py	393	108	73%	76–81, 89–97, 101–123, 128–137, 140–147, 155–160, 197–199, 204, 240, 265, 268, 271, 375, 401, 403, 429, 479, 541, 611–612, 651, 670–681, 685–699, 703–706, 759, 846–855, 885–932, 935
ota_metadata.py	315	31	90%	145, 150, 186–187, 197–201, 213, 271, 304–306, 323–326, 406, 409, 417–419, 432, 441–446, 719–730
ota_status.py	14	2	86%	34, 42
update_stats.py	105	2	98%	160, 170
otaclient/app/boot_control
__init__.py	4	0	100%
_cboot.py	289	142	51%	81–89, 98–111, 117–120, 124, 131, 135, 139, 143–147, 151–155, 162–174, 177–220, 226, 229, 232, 235, 238, 241, 244, 247–248, 251–252, 255–259, 262–263, 278, 281, 315, 332–335, 348–351, 361–364, 372, 411, 428–431, 440–443, 448–450, 459–465, 468, 475, 505–508, 547–550, 555–566, 571–577
_common.py	369	143	61%	63–72, 81–82, 86–87, 95–96, 107–108, 113–118, 123–128, 137, 146, 150, 154, 158, 172–175, 185–189, 194, 198, 208–212, 220–232, 243–247, 251–255, 267–269, 281–283, 294–308, 318–339, 358–374, 391–402, 410–416, 511–521, 580–581, 635, 639–640, 643, 651–654, 710–711, 714, 728–736, 751–752, 826–829, 850–853, 866–867, 876
_errors.py	47	19	60%	43–69, 89–90
_grub.py	404	114	72%	216, 264–267, 273–277, 314–315, 322–346, 355–361, 370–376, 455–461, 513, 519, 545, 567–572, 587–589, 618–628, 683–689, 708–711, 736–739, 762–765, 807, 813, 833–836, 848, 851, 854, 857, 861–863, 881–884, 912–915, 920–928, 933–941
_rpi_boot.py	267	125	53%	84–86, 92–147, 171–173, 179–181, 194–196, 202–204, 217–242, 247, 251, 255, 259, 293, 323, 326–328, 336, 345–348, 358–361, 365–372, 412–414, 456–460, 479–482, 487, 490, 511–514, 519–527, 532–540, 554–557, 563–565, 568
configs.py	42	0	100%
firmware.py	31	5	84%	60, 62, 73–75
protocol.py	28	5	82%	53, 57, 61, 65, 73
selecter.py	39	26	33%	44–69, 77–94
otaclient/app/create_standby
__init__.py	12	5	58%	28–34
common.py	216	45	79%	72, 75–76, 80–93, 139, 187–195, 198–201, 205, 216, 290–298, 310, 354–359, 375–376, 390–394, 419–420
interface.py	19	3	84%	55, 59, 63
rebuild_mode.py	89	1	99%	104
otaclient/app/proto
__init__.py	31	3	90%	37, 44–45
_common.py	419	49	88%	85, 163, 170, 182–184, 203, 208, 219, 256, 262, 267, 298, 302, 306, 363, 380, 403, 464, 471, 474, 494, 501, 503, 529, 535, 538, 540, 565, 571, 574, 576, 605, 609, 611, 625, 642, 670, 673, 677, 680, 708, 714, 761–766, 797
_ota_metafiles_wrapper.py	84	13	85%	37, 40–42, 112–116, 122–125
_otaclient_v2_pb2_wrapper.py	276	37	87%	87, 90–93, 132, 175, 183, 197, 207, 210–213, 258, 261, 264–265, 285, 305, 385, 452, 505, 513–515, 519–522, 525–530, 551, 559, 573, 581, 595
streamer.py	43	8	81%	32, 47, 65–66, 71, 80–81, 99
wrapper.py	4	0	100%
otaclient/ota_proxy
__init__.py	46	3	93%	86, 90, 94
__main__.py	22	22	0%	16–79
_consts.py	15	0	100%
cache_control.py	68	4	94%	71, 91, 113, 121
config.py	18	0	100%
db.py	146	15	90%	75, 81, 103, 113–116, 145–147, 166, 199, 208–209, 229, 258, 300
errors.py	10	0	100%
orm.py	115	11	90%	37, 91, 96, 101, 107, 113, 140–141, 154, 231, 235
ota_cache.py	404	75	81%	95–96, 215, 226, 253–255, 275, 291–294, 317–330, 359–363, 379, 440–441, 483–484, 554, 567–570, 620, 639–640, 672–673, 684, 721–728, 735–736, 741–743, 747, 756, 803, 811–813, 892–895, 899–903, 917–934, 965, 971, 998, 1027–1029
server_app.py	138	39	72%	75, 78, 84, 100, 102, 161–170, 212–243, 256–266, 292–298, 312–314, 320–322
utils.py	23	1	96%	31
TOTAL	5947	1306	78%

[Bodong-Yang]

Note: after we directly parse the logging_server setting from proxy_info.yaml, we don't need to read the environmental vars and the special treatment code can be removed.