1
1
title: Installing the OSDF Origin by RPM
2
2
3
- Installing the OSDF Origin
4
- ==========================
3
+ Installing the OSDF Origin by RPM
4
+ =================================
5
5
6
- This document describes how to install a Pelican-based Open Science Data Federation (OSDF) Origin service via RPMs.
7
- This service allows an organization to export its data to the Data Federation.
6
+ !!! warning "OSG 24"
7
+ This installation guide requires OSG 24
8
+
9
+ This document describes how to install an Open Science Data Federation (OSDF) Origin service via RPM.
10
+ This service, based on the [ Pelican Platform] ( https://docs.pelicanplatform.org/federating-your-data ) , allows an
11
+ administrator to serve data from a POSIX filesystem or S3 endpoint through the global OSDF infrastructure.
8
12
9
13
!!! note
10
14
The origin must be registered with the OSG prior to joining the data federation.
11
15
You may start the registration process prior to finishing the installation by [ using this link] ( #registering-the-origin )
12
16
along with information like:
13
17
14
18
* Resource name and hostname
15
- * VO associated with this origin server (which will be used to determine the origin's namespace prefix)
16
19
* Administrative and security contact(s)
17
- * Who (or what) will be allowed to access the VO's data
18
- * Which caches will be allowed to cache the VO data
19
20
20
21
21
22
Before Starting
22
23
---------------
23
24
24
25
Before starting the installation process, consider the following requirements:
25
26
26
- * __ Operating system:__ A RHEL 8 or RHEL 9 or compatible operating systems .
27
+ * __ Operating system:__ A RHEL 8 or RHEL 9 or [ compatible operating system ] ( ../../release/supported_platforms.md ) .
27
28
* __ User IDs:__ If they do not exist already, the installation will create the Linux user ID ` xrootd ` for running daemons.
28
29
* __ Host certificate:__ Required for authentication. See note below.
29
30
* __ Network ports:__ The origin service requires the following ports open:
30
31
* Inbound TCP port 8443 for file access via the HTTP(S) and XRoot protocols.
31
32
* (Optional) Inbound TCP port 8444 for access to the web interface for monitoring and configuration;
32
- if enabled, this should be restricted to the LAN or management network.
33
+ if enabled, consider restricting access from your LAN
33
34
* __ Hardware requirements:__ We recommend that an origin has at least 1Gbps connectivity and 12GB of RAM.
34
35
We suggest that several gigabytes of local disk space be available for log files,
35
36
although some logging verbosity can be reduced.
36
37
37
38
As with all OSG software installations, there are some one-time steps to prepare in advance:
38
39
39
40
* Obtain root access to the host
40
- * Prepare [ the required Yum repositories] ( ../../common/yum.md )
41
-
42
-
43
- !!! note "OSG 23"
44
- In OSG 23, the Pelican-based OSDF RPMs are only available in the "osg-upcoming" repositories.
41
+ * Prepare [ the required Yum repositories] ( ../../common/yum.md ) ,
42
+ including the [ OSG 24 repositories] ( ../../common/yum.md#install-the-osg-repositories )
45
43
46
44
!!! note "Host certificates"
47
45
Origins should use a CA that is accepted by major browsers and operating systems,
@@ -54,6 +52,38 @@ As with all OSG software installations, there are some one-time steps to prepare
54
52
* ** Host Certificate Chain** : ` /etc/pki/tls/certs/pelican.crt `
55
53
* ** Host Key** : ` /etc/pki/tls/private/pelican.key `
56
54
55
+ Upgrading a Non-Pelican Origin
56
+ ------------------------------
57
+
58
+ If you are running a non-Pelican origin, e.g. one that was installed before OSG 24, there are special consideratiosn for
59
+ the upgrade to ensure minimal downtime for your users.
60
+
61
+ 1 . Verify that you are not already running a Pelican-based origin, run the following on your origin host:
62
+
63
+ :::console
64
+ root@host # systemctl status osdf-origin
65
+ Unit osdf-origin.service could not be found.
66
+
67
+ If you see the following, then you are not running a Pelican-based origin and should proceed with the rest of the
68
+ instructions in this section
69
+
70
+ 1 . Install the origin
71
+
72
+ 1 . Configure the origin
73
+
74
+ 1 . Directly verify the origin
75
+
76
+ 1 . Register the origin in the Director and Topology
77
+
78
+ !!! danger ""
79
+
80
+ 1 . Verify the origin through the OSDF director
81
+
82
+ 1 . Uninstall the old service:
83
+
84
+ :::console
85
+ root@host # yum remove stash-origin
86
+
57
87
58
88
Installing the Origin
59
89
---------------------
@@ -80,7 +110,7 @@ XRootD:
80
110
81
111
In addition, you must tell Pelican the data to export to the federation.
82
112
An origin may export one or more directory trees, or one or more S3 buckets -- follow one of the sections below.
83
- (An single origin cannot export both a bucket and a directory tree.)
113
+ A single origin cannot export both a bucket and a directory tree.
84
114
85
115
86
116
@@ -98,36 +128,15 @@ Origin:
98
128
Capabilities: # Add or remove as desired
99
129
- Reads # Enable authenticated reading of objects from under the directory tree through a cache
100
130
- PublicReads # Enable unauthenticated reading of objects from under the directory tree through a cache
101
- - DirectReads # Enable reading objects from under the directory tree
102
- # without going through a cache
131
+ - DirectReads # Enable reading objects from under the directory tree without going through a cache
103
132
- Listings # Enable directory listings
104
133
- Writes # Enable writing to files in the directory tree
105
134
```
106
135
107
136
### Configuring S3 export
108
137
109
- Set these options to export one or more S3 buckets to the federation
110
-
111
- ```
112
- Origin:
113
- StorageType: "s3"
114
- S3Region: "<S3 REGION IF APPLICABLE>"
115
- S3ServiceUrl: "<URL OF S3 SERVER>"
116
- S3UrlStyle: "path"
117
- Exports:
118
- # You may have one or more of the following block:
119
- - FederationPrefix: "<EXTERNAL OSDF NAMESPACE>"
120
- S3Bucket: "<NAME OF S3 BUCKET>"
121
- S3AccessKeyfile: "<PATH TO S3 BUCKET ACCESS KEY>"
122
- S3SecretKeyfile: "<PATH TO S3 BUCKET SECRET KEY>"
123
- Capabilities: # Add or remove as desired
124
- - Reads # Enable authenticated reading of objects from the bucket through a cache
125
- - PublicReads # Enable unauthenticated reading of objects from the bucket through a cache
126
- - DirectReads # Enable reading objects from the bucket
127
- # without going through a cache
128
- - Listings # Enable listing bucket items
129
- - Writes # Enable writing to objects in the bucket
130
- ```
138
+ To configure your origin to serve objects from an S3 endpoint, see the
139
+ [ upstream documentation] ( https://docs.pelicanplatform.org/federating-your-data/s3-backend ) .
131
140
132
141
133
142
Preparing for Initial Startup
0 commit comments