Skip to content

Commit 3ad02ab

Browse files
Merge pull request #2 from brianhlin/pr/pelican-osdf-origin.SOFTWARE-5962
Various improvements + WIP upgrade outline
2 parents ee75e30 + 80e5097 commit 3ad02ab

File tree

1 file changed

+48
-39
lines changed

1 file changed

+48
-39
lines changed

docs/data/osdf/install-origin-rpm.md

+48-39
Original file line numberDiff line numberDiff line change
@@ -1,47 +1,45 @@
11
title: Installing the OSDF Origin by RPM
22

3-
Installing the OSDF Origin
4-
==========================
3+
Installing the OSDF Origin by RPM
4+
=================================
55

6-
This document describes how to install a Pelican-based Open Science Data Federation (OSDF) Origin service via RPMs.
7-
This service allows an organization to export its data to the Data Federation.
6+
!!! warning "OSG 24"
7+
This installation guide requires OSG 24
8+
9+
This document describes how to install an Open Science Data Federation (OSDF) Origin service via RPM.
10+
This service, based on the [Pelican Platform](https://docs.pelicanplatform.org/federating-your-data), allows an
11+
administrator to serve data from a POSIX filesystem or S3 endpoint through the global OSDF infrastructure.
812

913
!!! note
1014
The origin must be registered with the OSG prior to joining the data federation.
1115
You may start the registration process prior to finishing the installation by [using this link](#registering-the-origin)
1216
along with information like:
1317

1418
* Resource name and hostname
15-
* VO associated with this origin server (which will be used to determine the origin's namespace prefix)
1619
* Administrative and security contact(s)
17-
* Who (or what) will be allowed to access the VO's data
18-
* Which caches will be allowed to cache the VO data
1920

2021

2122
Before Starting
2223
---------------
2324

2425
Before starting the installation process, consider the following requirements:
2526

26-
* __Operating system:__ A RHEL 8 or RHEL 9 or compatible operating systems.
27+
* __Operating system:__ A RHEL 8 or RHEL 9 or [compatible operating system](../../release/supported_platforms.md).
2728
* __User IDs:__ If they do not exist already, the installation will create the Linux user ID `xrootd` for running daemons.
2829
* __Host certificate:__ Required for authentication. See note below.
2930
* __Network ports:__ The origin service requires the following ports open:
3031
* Inbound TCP port 8443 for file access via the HTTP(S) and XRoot protocols.
3132
* (Optional) Inbound TCP port 8444 for access to the web interface for monitoring and configuration;
32-
if enabled, this should be restricted to the LAN or management network.
33+
if enabled, consider restricting access from your LAN
3334
* __Hardware requirements:__ We recommend that an origin has at least 1Gbps connectivity and 12GB of RAM.
3435
We suggest that several gigabytes of local disk space be available for log files,
3536
although some logging verbosity can be reduced.
3637

3738
As with all OSG software installations, there are some one-time steps to prepare in advance:
3839

3940
* Obtain root access to the host
40-
* Prepare [the required Yum repositories](../../common/yum.md)
41-
42-
43-
!!! note "OSG 23"
44-
In OSG 23, the Pelican-based OSDF RPMs are only available in the "osg-upcoming" repositories.
41+
* Prepare [the required Yum repositories](../../common/yum.md),
42+
including the [OSG 24 repositories](../../common/yum.md#install-the-osg-repositories)
4543

4644
!!! note "Host certificates"
4745
Origins should use a CA that is accepted by major browsers and operating systems,
@@ -54,6 +52,38 @@ As with all OSG software installations, there are some one-time steps to prepare
5452
* **Host Certificate Chain**: `/etc/pki/tls/certs/pelican.crt`
5553
* **Host Key**: `/etc/pki/tls/private/pelican.key`
5654

55+
Upgrading a Non-Pelican Origin
56+
------------------------------
57+
58+
If you are running a non-Pelican origin, e.g. one that was installed before OSG 24, there are special consideratiosn for
59+
the upgrade to ensure minimal downtime for your users.
60+
61+
1. Verify that you are not already running a Pelican-based origin, run the following on your origin host:
62+
63+
:::console
64+
root@host # systemctl status osdf-origin
65+
Unit osdf-origin.service could not be found.
66+
67+
If you see the following, then you are not running a Pelican-based origin and should proceed with the rest of the
68+
instructions in this section
69+
70+
1. Install the origin
71+
72+
1. Configure the origin
73+
74+
1. Directly verify the origin
75+
76+
1. Register the origin in the Director and Topology
77+
78+
!!! danger ""
79+
80+
1. Verify the origin through the OSDF director
81+
82+
1. Uninstall the old service:
83+
84+
:::console
85+
root@host # yum remove stash-origin
86+
5787

5888
Installing the Origin
5989
---------------------
@@ -80,7 +110,7 @@ XRootD:
80110

81111
In addition, you must tell Pelican the data to export to the federation.
82112
An origin may export one or more directory trees, or one or more S3 buckets -- follow one of the sections below.
83-
(An single origin cannot export both a bucket and a directory tree.)
113+
A single origin cannot export both a bucket and a directory tree.
84114

85115

86116

@@ -98,36 +128,15 @@ Origin:
98128
Capabilities: # Add or remove as desired
99129
- Reads # Enable authenticated reading of objects from under the directory tree through a cache
100130
- PublicReads # Enable unauthenticated reading of objects from under the directory tree through a cache
101-
- DirectReads # Enable reading objects from under the directory tree
102-
# without going through a cache
131+
- DirectReads # Enable reading objects from under the directory tree without going through a cache
103132
- Listings # Enable directory listings
104133
- Writes # Enable writing to files in the directory tree
105134
```
106135

107136
### Configuring S3 export
108137

109-
Set these options to export one or more S3 buckets to the federation
110-
111-
```
112-
Origin:
113-
StorageType: "s3"
114-
S3Region: "<S3 REGION IF APPLICABLE>"
115-
S3ServiceUrl: "<URL OF S3 SERVER>"
116-
S3UrlStyle: "path"
117-
Exports:
118-
# You may have one or more of the following block:
119-
- FederationPrefix: "<EXTERNAL OSDF NAMESPACE>"
120-
S3Bucket: "<NAME OF S3 BUCKET>"
121-
S3AccessKeyfile: "<PATH TO S3 BUCKET ACCESS KEY>"
122-
S3SecretKeyfile: "<PATH TO S3 BUCKET SECRET KEY>"
123-
Capabilities: # Add or remove as desired
124-
- Reads # Enable authenticated reading of objects from the bucket through a cache
125-
- PublicReads # Enable unauthenticated reading of objects from the bucket through a cache
126-
- DirectReads # Enable reading objects from the bucket
127-
# without going through a cache
128-
- Listings # Enable listing bucket items
129-
- Writes # Enable writing to objects in the bucket
130-
```
138+
To configure your origin to serve objects from an S3 endpoint, see the
139+
[upstream documentation](https://docs.pelicanplatform.org/federating-your-data/s3-backend).
131140

132141

133142
Preparing for Initial Startup

0 commit comments

Comments
 (0)