From ebb37613378979a24ffdadeaec6404f629a3a9c7 Mon Sep 17 00:00:00 2001
From: Ilona Brand <theilonabrand@gmail.com>
Date: Fri, 8 Sep 2023 13:02:39 -0500
Subject: [PATCH] Create robots.txt

De-index entire archval site from google. robots.txt is the softest way to block the indexing and still might not work in some cases -- to fully get rid of the indexing you'd want to use: <meta name="robots" content="noindex"> Explained here: https://stackoverflow.com/a/47083230
---
 robots.txt | 2 ++
 1 file changed, 2 insertions(+)
 create mode 100644 robots.txt

diff --git a/robots.txt b/robots.txt
new file mode 100644
index 00000000..1f53798b
--- /dev/null
+++ b/robots.txt
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /