made some changes

RobinNagpal · Feb 10, 2025 · b83cc22 · b83cc22
1 parent 2c84955
commit b83cc22
Show file tree

Hide file tree

Showing 2 changed files with 9 additions and 17 deletions.
diff --git a/insights-ui/public/robots.txt b/insights-ui/public/robots.txt
@@ -0,0 +1,9 @@
+# *
+User-agent: *
+Allow: /
+
+# Host
+Host: https://agentic-insights.dodao.io/
+
+# Sitemaps
+Sitemap: https://agentic-insights.dodao.io/sitemap.xml
diff --git a/insights-ui/src/app/robots.txt/route.ts b/insights-ui/src/app/robots.txt/route.ts