Fix the new release workflow

[sandhose]

Filling in problems we had that needs fixing

Tasks

Preview Give feedback

1. Git tags don't seem to be signed
2. Committing on the main branch doesn't work
3. Localazy branches are weird, should we use tags instead?
4. gh pr create failed
5. had to disable npm publishing
6. we could auto-merge the PRs we create
7. we can't sanely fix conflicts on the PR merging back to main, because that would merge main back into the release branch