metricbeat: collect total thread count per process

[AndersonQ]

Collect the total by thread count per process upgrading elastic-agent-system-metrics to v0.7.0

Proposed commit message

metricbeat: collect total thread count per process

Upgrades elastic-agent-system-metrics to v0.5.0 in order to collect the total thread count per process.

Checklist

• My code follows the style guidelines of this project
• [ ] I have commented my code, particularly in hard-to-understand areas
• [ ] I have made corresponding changes to the documentation
• [ ] I have made corresponding change to the default configuration files
• [ ] I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Related issues

• Depends on process.GetInfoForPid collects the total thread count elastic-agent-system-metrics#100
• Closes Metricbeat system module - collect total thread count #34461

Logs

❯ go test -v -run TestFetch  ./metricbeat/module/system/process
=== RUN   TestFetch

// debug logs omitted
 
    process_test.go:51: fetched 5 events, showing events[0]:
    process_test.go:52: system/process event: {
          "process": {
            "args": [
              "/tmp/go-build658655655/b001/process.test",
              "-test.testlogfile=/tmp/go-build658655655/b001/testlog.txt",
              "-test.paniconexit0",
              "-test.timeout=10m0s",
              "-test.v=true",
              "-test.run=TestFetch"
            ],
            "command_line": "/tmp/go-build658655655/b001/process.test -test.testlogfile=/tmp/go-build658655655/b001/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true -test.run=TestFetch",
            "cpu": {
              "pct": 0.0171,
              "start_time": "2023-09-13T11:52:45.000Z"
            },
            "executable": "/tmp/go-build658655655/b001/process.test",
            "memory": {
              "pct": 0.0004
            },
            "name": "process.test",
            "parent": {
              "pid": 196866
            },
            "pgid": 196866,
            "pid": 197122,
            "state": "sleeping",
            "working_directory": "/home/ainsoph/devel/github.com/elastic/beats/metricbeat/module/system/process"
          },
          "service": {
            "type": "system"
          },
          "system": {
            "process": {
              "cgroup": {
                "cgroups_version": 2,
                "cpu": {
                  "id": "vte-spawn-fa31675c-a919-4c0a-9447-9fdc56de8544.scope",
                  "path": "/user.slice/user-1000.slice/[email protected]/app.slice/vte-spawn-fa31675c-a919-4c0a-9447-9fdc56de8544.scope",
                  "pressure": {
                    "full": {
                      "10": {
                        "pct": 0
                      },
                      "300": {
                        "pct": 0
                      },
                      "60": {
                        "pct": 0
                      },
                      "total": 4383214
                    },
                    "some": {
                      "10": {
                        "pct": 0
                      },
                      "300": {
                        "pct": 0
                      },
                      "60": {
                        "pct": 0
                      },
                      "total": 4588411
                    }
                  },
                  "stats": {
                    "system": {
                      "norm": {
                        "pct": 0
                      },
                      "ns": 30786963,
                      "pct": 0.0002
                    },
                    "usage": {
                      "norm": {
                        "pct": 0
                      },
                      "ns": 54487651,
                      "pct": 0.0003
                    },
                    "user": {
                      "norm": {
                        "pct": 0
                      },
                      "ns": 23700688,
                      "pct": 0.0001
                    }
                  }
                },
                "id": "vte-spawn-fa31675c-a919-4c0a-9447-9fdc56de8544.scope",
                "memory": {
                  "id": "vte-spawn-fa31675c-a919-4c0a-9447-9fdc56de8544.scope",
                  "mem": {
                    "events": {
                      "high": 0,
                      "low": 0,
                      "max": 0,
                      "oom": 0,
                      "oom_kill": 0
                    },
                    "low": {
                      "bytes": 0
                    },
                    "usage": {
                      "bytes": 551112704
                    }
                  },
                  "memsw": {
                    "events": {
                      "fail": 0,
                      "high": 0,
                      "max": 0
                    },
                    "low": {
                      "bytes": 0
                    },
                    "usage": {
                      "bytes": 0
                    }
                  },
                  "path": "/user.slice/user-1000.slice/[email protected]/app.slice/vte-spawn-fa31675c-a919-4c0a-9447-9fdc56de8544.scope",
                  "stats": {
                    "active_anon": {
                      "bytes": 74604544
                    },
                    "active_file": {
                      "bytes": 161099776
                    },
                    "anon": {
                      "bytes": 64045056
                    },
                    "anon_thp": {
                      "bytes": 14680064
                    },
                    "file": {
                      "bytes": 400678912
                    },
                    "file_dirty": {
                      "bytes": 34336768
                    },
                    "file_mapped": {
                      "bytes": 38699008
                    },
                    "file_thp": {
                      "bytes": 0
                    },
                    "file_writeback": {
                      "bytes": 0
                    },
                    "htp_collapse_alloc": 0,
                    "inactive_anon": {
                      "bytes": 24576
                    },
                    "inactive_file": {
                      "bytes": 239509504
                    },
                    "kernel_stack": {
                      "bytes": 1376256
                    },
                    "major_page_faults": 1666,
                    "page_activate": 0,
                    "page_deactivate": 0,
                    "page_faults": 987725,
                    "page_lazy_free": 0,
                    "page_lazy_freed": 0,
                    "page_refill": 0,
                    "page_scan": 0,
                    "page_steal": 0,
                    "page_tables": {
                      "bytes": 835584
                    },
                    "per_cpu": {
                      "bytes": 1728
                    },
                    "shmem": {
                      "bytes": 0
                    },
                    "shmem_thp": {
                      "bytes": 0
                    },
                    "slab": {
                      "bytes": 71222912
                    },
                    "slab_reclaimable": {
                      "bytes": 69878216
                    },
                    "slab_unreclaimable": {
                      "bytes": 1344696
                    },
                    "sock": {
                      "bytes": 0
                    },
                    "swap_cached": {
                      "bytes": 0
                    },
                    "thp_fault_alloc": 876,
                    "unevictable": {
                      "bytes": 0
                    },
                    "workingset_activate_anon": 0,
                    "workingset_activate_file": 0,
                    "workingset_node_reclaim": 0,
                    "workingset_refault_anon": 0,
                    "workingset_refault_file": 0,
                    "workingset_restore_anon": 0,
                    "workingset_restore_file": 0
                  }
                },
                "path": "/user.slice/user-1000.slice/[email protected]/app.slice/vte-spawn-fa31675c-a919-4c0a-9447-9fdc56de8544.scope"
              },
              "cmdline": "/tmp/go-build658655655/b001/process.test -test.testlogfile=/tmp/go-build658655655/b001/testlog.txt -test.paniconexit0 -test.timeout=10m0s -test.v=true -test.run=TestFetch",
              "cpu": {
                "start_time": "2023-09-13T11:52:45.000Z",
                "system": {
                  "ticks": 930
                },
                "total": {
                  "norm": {
                    "pct": 0.0171
                  },
                  "pct": 0.2743,
                  "ticks": 1420,
                  "value": 1420
                },
                "user": {
                  "ticks": 490
                }
              },
              "fd": {
                "limit": {
                  "hard": 1048576,
                  "soft": 1048576
                },
                "open": 9
              },
              "memory": {
                "rss": {
                  "bytes": 29417472,
                  "pct": 0.0004
                },
                "share": 16908288,
                "size": 2642882560
              },
              "num_threads": 19,
              "state": "sleeping"
            }
          },
          "user": {
            "name": "ainsoph"
          }
        }
--- PASS: TestFetch (3.26s)
PASS
ok  	github.com/elastic/beats/v7/metricbeat/module/system/process	3.569s

[AndersonQ]

As soon as elastic/elastic-agent-system-metrics#96 gets merged and elastic-agent-system-metrics v0.5.0 released, I'll remove the replace and properly upgrade elastic-agent-system-metrics to v0.5.0.

[elasticmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Start Time: 2023-10-02T21:40:52.406+0000

• Duration: 117 min 29 sec

Test stats 🧪

Test	Results
Failed	0
Passed	27832
Skipped	1880
Total	29712

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

• /test : Re-trigger the build.

• /package : Generate the packages and run the E2E tests.

• /beats-tester : Run the installation tests with beats-tester.

• run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

[belimawr]

Debug comments?

Suggested change

	# print("===================================================================================================")
	# print("doc_list:", doc_list)
	# print("===================================================================================================")

[belimawr]

Debug comments?

Suggested change

	print( "=================================================================================================")
	print("path:", path)
	print( "=================================================================================================")

[AndersonQ]

/test

Alex reviewed it instead

[jlind23]

Already approved by @fearful-symmetry