Move R users of jupyter.utoronto.ca to r.datatools.utoronto.ca

[yuvipanda]

We moved UToronto to have multiple hubs as part of 2i2c-org/features#14, and set up r.datatools.utoronto.ca with a rocker based image. As part of #2583, we want to simplify the images we maintain. We had already communicated to UToronto users that R is going to go away from jupyter.utoronto.ca, and we should use this opportunity to do that now.

Based on in-person conversations with @ntaback, the following schedule should work:

1. UToronto announces to all users (via their own mechanisms) that R will go away on August 15. This should be sent out by first week of July so they have time. Auguest 14 is last day of class for summer of Utoronto, and september 7 is first day of fall classes (source).
2. We merge Simplify image vastly, get rid of R utoronto-image#54, getting rid of R and simplifying everything else, on August 15.
3. If there are missing R packages, we sort them out over the next few weeks as requests come in. @ntaback should be able to corral them to us as needed.

[yuvipanda]

https://2i2c.freshdesk.com/a/tickets/952 is the linked ticket. There is a plan outlined there on how to do this + timelines.

[yuvipanda]

I tried to find a list of users who have ever used rstudio, and found that this way:

1. deployer exec-homes-shell utoronto prod. This spins up a pod with the utoronto homes be mounted under /home
2. Run this command to find all user home directories with a .rstudio directory created in them. I think this happens only if the user has ever used rstudio: k -n prod exec utoronto-prod-shell -- /bin/bash -c "cd /home; find . -name '.rstudio' -maxdepth 2 -mindepth 2" > rstudio-homedirs-utoronto. This must be run in a different tab, while (1) is still running. It'll output to a file locally named rstudio-homedirs-utoronto.
3. The home directories are escaped, unescape them by first making this following script and calling it doirstudio.py:

   import sys
   from escapism import unescape
   
   for l in sys.stdin:
       print(unescape(l.split('/')[1], '-'))

4. Run it with: cat rstudio-homedirs-utoronto| python doirstudio.py > users-with-rstudio.txt
5. This produces a list of usernames, which may be either emails or LDAP oids (that would need to be mapped). There may be some duplicates as well.

I saw about 40122 home directories and 12658 of them had .rstudio in them. I'll pass on this list to them.

[damianavila]

I have assigned @yuvipanda to this one since he has been working on this piece for some time. Additionally, I am adding @GeorgianaElena as a secondee to help @yuvipanda to get everything in place before the break.

[yuvipanda]

Yep, most important part of this is really to finish 2i2c-org/utoronto-image#54 and roll it out to staging. Nothing else needed from our side.

[damianavila]

There is a recent ticket that I think is relevant for this transition: https://2i2c.freshdesk.com/a/tickets/1185.

[yuvipanda]

Plan for tomorrow!

• Make sure that datatools.utoronto.ca is up and running (this is managed by the UToronto team, will await confirmation from them)
• Merge [Don't merge until Jan 9] Promote UToronto staging images to prod #3582 to bring in new images to prod
• Merge [Don't merge until Jan 9]Redirect all UToronto home pages to unified homepage #3583 to fixup the home page
• Merge [Merge Jan 9] utoronto: Enable automatic login on utoronto hubs #3531 to allow automatic login
• Watch for issues.

[yuvipanda]

Soooo #3531 nullifies #3583, because the home page is never shown! So there's no redirect to their unified homepage, instead we just get shunted to the login page. This is important for nbgitpuller links to work for logged out users. We can work around this with some JS in their unified landing page, but I'd prefer to not. Let's communicate this to them and see what their desire is.

[yuvipanda]

JupyterLab was failing to launch, fixed with #3598. It's an upstream bug in Jupyter Server, fixed with jupyter-server/jupyter_server#1384

[yuvipanda]

The daily active user count for the R hub overtook the daily user count for the python hub today, reflecting real usage levels I think.

This has been completed!