PMM-12460 PMM Dump integration (#2493)

* PMM-12460 PMM Dump API

* PMM-12460 Add created_at to the dump API model

* PMM-12460 Add dump model, implement ListDumps method

* PMM-12460 Fix

* PMM-12460 Allow batch dupm deletes

* PMM-12460 Dupm integration draft

* PMM-12460 Draft

* PMM-12460 Fix bad merge

* PMM-12460 Fix dump

* PMM-12460 Use API tokens for pmm-dump authorization

* PMM-12460 Linter fixes

* PMM-12460 Fix dump logs processing

* PMM-12460 Use API keys expiration

* PMM-12460 Update dupm statuses, fix dates hadnling

* PMM-12460 Try to fix pmm-dump build

* PMM-12460 Debug

* PMM-12460 Debug

* PMM-12460 Different fixes

* PMM-12460 Use service names instead of node ids

* PMM-12460 Handle service names

* PMM-12460 Implement dump deletion

* PMM-12460 Fix

* PMM-12460 Add dump upload API

* PMM-12460 Refactoring

* PMM-12460 Refactorinb

* PMM-12460 Implement FTP upload

* PMM-12460 Fix pmm-dump authentication

* PMM-12460 Fix migrations

* PMM-12460 Fixes and improvements

* PMM-12460 Revert API key creation changes

* PMM-12460 Fix

* PMM-12460 Fixed

* PMM-12460 Revert debug info

* PMM-12460 Fix tests

* PMM-12460 Fixes

* PMM-12460 Fix tests

* PMM-12460 Fix linter

* PMM-12460 Use SFTP instead FTP

* PMM-12460 Remove dedug code

* PMM-12460 Lint fixes

* PMM-12460 Log error

* PMM-12460 Add dump metrics

* PMM-12460 Fix

* PMM-12460 Add pmm dumps telemetry

* PMM-12460 Expose directory with pmm-dupm artifacts via nginx

* PMM-12460 Fix dumps telemetry

* PMM-12460 Fix comments

* PMM-12460 Tune nginx config

* PMM-12460 Make start and end time optional (nullable)

* PMM-12460 Polishing

* PMM-12460 Don't return filepath for dupms that are not in success state

* PMM-12460 Remove redundant field

* PMM-12460 Remove dump metrics

* PMM-12460 Refactoring

* PMM-12460 Fix

* PMM-12460 Add API validation rules

* PMM-12460 Configure ssh key exchange algos

* PMM-12460 Update pmm-dump

---------

Co-authored-by: michael.okoko <[email protected]>
Co-authored-by: Yash Sartanpara <[email protected]>

Makefile.include

@@ -47,7 +47,7 @@ gen-api:            ## Generate PMM API
 
 	bin/buf generate -v api
 
-	for API in api/agentlocalpb api/serverpb api/inventorypb api/managementpb api/managementpb/dbaas api/managementpb/ia api/managementpb/alerting api/managementpb/backup api/managementpb/azure api/managementpb/role api/qanpb api/managementpb/agent api/managementpb/node api/managementpb/service api/platformpb api/userpb; do \
+	for API in api/agentlocalpb api/serverpb api/inventorypb api/managementpb api/managementpb/dbaas api/managementpb/ia api/managementpb/alerting api/managementpb/backup api/managementpb/dump api/managementpb/azure api/managementpb/role api/qanpb api/managementpb/agent api/managementpb/node api/managementpb/service api/platformpb api/userpb; do \
 		set -x ; \
 		bin/swagger mixin $$API/json/header.json $$API/*.swagger.json --output=$$API/json/$$(basename $$API).json --keep-spec-order; \
 		bin/swagger flatten --with-flatten=expand --with-flatten=remove-unused $$API/json/$$(basename $$API).json --output=$$API/json/$$(basename $$API).json ; \
@@ -91,6 +91,7 @@ gen-api:            ## Generate PMM API
 		api/managementpb/ia/json/ia.json \
 		api/managementpb/alerting/json/alerting.json \
 		api/managementpb/backup/json/backup.json \
+		api/managementpb/dump/json/dump.json \
 		api/managementpb/azure/json/azure.json \
 		api/managementpb/role/json/role.json \
 		api/managementpb/agent/json/agent.json \
@@ -127,7 +128,7 @@ clean: clean_swagger  ## Remove generated files
 	find api -name '*.pb.gw.go' -print -delete
 	find api -name '*.validate.go' -print -delete
 
-	for API in api/agentlocalpb api/serverpb api/inventorypb api/managementpb api/managementpb/dbaas api/managementpb/ia api/managementpb/alerting api/managementpb/backup api/managementpb/role api/managementpb/agent api/managementpb/node api/managementpb/service api/qanpb api/platformpb ; do \
+	for API in api/agentlocalpb api/serverpb api/inventorypb api/managementpb api/managementpb/dbaas api/managementpb/ia api/managementpb/alerting api/managementpb/backup api/management/dump api/managementpb/role api/managementpb/agent api/managementpb/node api/managementpb/service api/qanpb api/platformpb ; do \
 		rm -fr $$API/json/client $$API/json/models $$API/json/$$(basename $$API).json ; \
 	done
 	rm -f api/swagger/swagger.json api/swagger/swagger-dev.json