add dinky support

[JiaLiangC]

Description of PR

Bigtop Project Setup Guide

0. Clone the Bigtop Project

Clone the project locally using the following command:

git clone [email protected]:DataLinkDC/bigtop.git

1. Pull Bigtop Rocky Linux 8 Build Image

Pull the Bigtop compilation image for Rocky Linux 8:

docker pull bigtop/slaves:trunk-rockylinux-8

2. Enter the Cloned Bigtop Project Directory

Navigate to the cloned Bigtop project directory:

cd /home/jialiang/dev/bigtop

3. Start the Image

Start the Docker image with the following command:

docker run -d -it --network host -v `pwd`:/ws -v /data/sdv1/repository:/root/.m2/repository --workdir /ws --name bigtopr bigtop/slaves:trunk-rockylinux-8

Note: Replace /data/sdv1/repository with your local Maven repository path.

4. Enter the Image

Enter the Docker image with the following command:

docker exec -it bigtop /bin/bash

5. Modify Maven Settings Inside the Image

Edit the Maven settings file inside the image:

vi /usr/local/maven/conf/settings.xml

Replace the contents with the following configuration:

<settings xmlns="http://maven.apache.org/SETTINGS/1.0.0"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0
                      http://maven.apache.org/xsd/settings-1.0.0.xsd">
  <!-- other settings -->
  <mirrors>
    <mirror>
      <id>aliyunmaven</id>
      <mirrorOf>central</mirrorOf>
      <name>阿里云公共仓库</name>
      <url>https://maven.aliyun.com/repository/central</url>
    </mirror>
    <mirror>
      <id>repo1</id>
      <mirrorOf>central</mirrorOf>
      <name>central repo</name>
      <url>http://repo1.maven.org/maven2/</url>
    </mirror>
    <mirror>
      <id>aliyunmaven</id>
      <mirrorOf>apache snapshots</mirrorOf>
      <name>阿里云阿帕奇仓库</name>
      <url>https://maven.aliyun.com/repository/apache-snapshots</url>
    </mirror>
  </mirrors>
  <!-- other settings -->
</settings>

6. Compile Big Data Components

Enter the started Docker image:

docker exec -it bigtop /bin/bash

Compile the components:

. /etc/profile.d/bigtop.sh;./gradlew dinky-clean dinky-pkg -PparentDir=/usr/bigtop -PpkgSuffix

Explanation of Compilation Parameters

To compile big data components used by Ambari 2.8 Bigtop stack, use the following parameters:

• -PparentDir=/usr/bigtop: Changes the default installation path of the package, making it comply with Ambari's installation standards.
• -PpkgSuffix: Appends the Bigtop version number to the package, e.g., hadoop_3_2_0, to comply with the Ambari Bigtop service standards. Packages will be installed in the /usr/bigtop/3.2.0 directory.

For creating packages for use with HDP, use:

• -PparentDir=/usr/hdp -PpkgSuffix.
• Modify the bigtop.bom file's version number to match your HDP stack version.

For example, if the HDP stack is 3.1.0 and all components are in the /usr/hdp/3.1.0 directory, the parameters would be -PparentDir=/usr/hdp -PpkgSuffix. Also, update the bigtop.bom file as follows:

bigtop {
  // Base Configuration of the mirror and archives
  version = 3.1.0
  // ... rest of the configuration ...
}

Wait for the compilation to complete. The resulting RPM packages will be located in the output directory.

How was this patch tested?

For code changes:

• Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
• Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/