vscode+devcontainers w/Macos arm64 not working

[orlyprofili]

Is this actually a rate limiting issue?

I've tried several ways, but it simply won't complete the building of rsdk and breaks with same message, consistently.

Aside (for zsh or other non-bash users, it may be useful to document that they should set:
"terminal.integrated.defaultProfile.linux": "bash",
In devcontainers.json. The rsdk script uses bash specific commands like shopt)

Using colima instead of docker desktop to run the daemon fairs worse, so I'm continuing with docker desktop.

I've cleaned out all docker builds, caches, etc and started fresh. This consistently happened. Is this a github rate limiting issue or another problem? I tried with a GITHUB PAT and the result is the same.

Here is the error message, and then trying again with a PAT. (all tokens/keys have been redacted):

direnv: loading /workspaces/rsdk/.envrc
direnv: loading https://raw.githubusercontent.com/cachix/devenv/d1f7b48e35e6dee421cfd0f51481d17f77586997/direnvrc (sha256-XXXX)
direnv: using devenv
direnv: .envrc changed, reloading
error:
… while fetching the input 'git+file:///workspaces/rsdk'

   error:
   error: opening Git repository '"/workspaces/rsdk"': repository path '/workspaces/rsdk/' is not owned by current user

✖ Command produced the following output:

Error: × Command /nix/store/as63rjja0x63d1kw7d8xagb9s7glvwkl-nix-devenv-2.21.0pre20240412_b24a931/bin/nix --show-trace --extra-experimental- │ features nix-command --extra-experimental-features flakes --option warn-dirty false --keep-going --max-jobs 6 --option eval-cache false │ print-dev-env --profile /workspaces/rsdk/.devenv/gc/shell failed with with exit code 1

direnv: loading the environment failed
direnv: error exit status 1
vscode ➜ /workspaces/rsdk $ mkdir -p ~/.config/nix/ && echo 'access-tokens = github.com=XXXXXX' >> ~/.config/ni
x/nix.conf && src/bin/rsdk setup
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy main restricted
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy-updates main restricted
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy universe
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy-updates universe
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy multiverse
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy-updates multiverse
deb [arch-=arm64,riscv64] http://archive.ubuntu.com/ubuntu/ jammy-backports main restricted universe multiverse
deb [arch-=arm64,riscv64] http://security.ubuntu.com/ubuntu/ jammy-security main restricted
deb [arch-=arm64,riscv64] http://security.ubuntu.com/ubuntu/ jammy-security universe
deb [arch-=arm64,riscv64] http://security.ubuntu.com/ubuntu/ jammy-security multiverse
deb [arch=arm64,riscv64] http://ports.ubuntu.com/ubuntu-ports/ jammy main restricted universe multiverse
deb [arch=arm64,riscv64] http://ports.ubuntu.com/ubuntu-ports/ jammy-updates main restricted universe multiverse
deb [arch=arm64,riscv64] http://ports.ubuntu.com/ubuntu-ports/ jammy-backports main restricted universe multiverse
deb [arch=arm64,riscv64] http://ports.ubuntu.com/ubuntu-ports/ jammy-security main restricted universe multiverse
Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease
Hit:3 http://ports.ubuntu.com/ubuntu-ports jammy InRelease
Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:5 http://ports.ubuntu.com/ubuntu-ports jammy-updates InRelease
Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease
Hit:7 http://ports.ubuntu.com/ubuntu-ports jammy-backports InRelease
Hit:8 http://ports.ubuntu.com/ubuntu-ports jammy-security InRelease
Reading package lists... Done
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
bash-completion is already the newest version (1:2.11-5ubuntu1).
binfmt-support is already the newest version (2.2.1-2).
libfakeroot is already the newest version (1.28-1ubuntu1).
libfakeroot:riscv64 is already the newest version (1.28-1ubuntu1).
bdebstrap is already the newest version (0.4.0-1).
debian-archive-keyring is already the newest version (2021.1.1ubuntu2).
debian-ports-archive-keyring is already the newest version (2022.02.15).
libfakechroot is already the newest version (2.20.1+ds-2).
libfakechroot:riscv64 is already the newest version (2.20.1+ds-2).
qemu-user-static is already the newest version (1:6.2+dfsg-2ubuntu6.21).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Name: cachix
Store paths: /nix/store/l5bymdl1wy7m6ih5p0fziczdrg3jfxvg-cachix-1.7.4-bin
Locked flake URL: github:cachix/devenv/6e318854efa95c5e67a1152547f838754e8f0306?narHash=sha256-XXXX
Configured https://devenv.cachix.org binary cache in /home/vscode/.config/nix/nix.conf
warning: 'flake:devenv#packages.aarch64-linux.default' is already installed
• Building shell ...
error:
… while fetching the input 'git+file:///workspaces/rsdk'

   error:
   error: opening Git repository '"/workspaces/rsdk"': repository path '/workspaces/rsdk/' is not owned by current user

✖ Command produced the following output:

✔ Building shell in 0.1s.
Error: × Command /nix/store/as63rjja0x63d1kw7d8xagb9s7glvwkl-nix-devenv-2.21.0pre20240412_b24a931/bin/nix --show-trace --extra-experimental- │ features nix-command --extra-experimental-features flakes --option warn-dirty false --keep-going --max-jobs 6 --option eval-cache false │ print-dev-env --profile /workspaces/rsdk/.devenv/gc/shell failed with with exit code 1

You might be rate limited by GitHub.
Please request a PAT from GitHub website, and add it to your Dev Container:
mkdir -p ~/.config/nix/ && echo 'access-tokens = github.com=YOUR_GITHUB_PAT' >> ~/.config/nix/nix.conf && src/bin/rsdk setup
You can run above command in a new terminal once you complete this one.
Press Enter to continue...
direnv: loading /workspaces/rsdk/.envrc
direnv: loading https://raw.githubusercontent.com/cachix/devenv/d1f7b48e35e6dee421cfd0f51481d17f77586997/direnvrc (sha256-XXXX)
direnv: using devenv
direnv: .envrc changed, reloading
error:
… while fetching the input 'git+file:///workspaces/rsdk'

   error:
   error: opening Git repository '"/workspaces/rsdk"': repository path '/workspaces/rsdk/' is not owned by current user

✖ Command produced the following output:

Error: × Command /nix/store/as63rjja0x63d1kw7d8xagb9s7glvwkl-nix-devenv-2.21.0pre20240412_b24a931/bin/nix --show-trace --extra-experimental- │ features nix-command --extra-experimental-features flakes --option warn-dirty false --keep-going --max-jobs 6 --option eval-cache false │ print-dev-env --profile /workspaces/rsdk/.devenv/gc/shell failed with with exit code 1

direnv: loading the environment failed
direnv: error exit status 1
vscode ➜ /workspaces/rsdk $

[RadxaYuntian]

error: opening Git repository '"/workspaces/rsdk"': repository path '/workspaces/rsdk/' is not owned by current user

This should be your real cause. Might want to check your file permissions and UID stuff.

[orlyprofili]

@RadxaYuntian yes, that's indeed it.

I added "remoteUser": "root" to devcontainer.json and that got me further, but not all the way, see below. Looks like nix package libguestfs-appliance-1.46.0 isn't available aarch64.

I'm currently looking into workarounds, not successful yet.

• Trusting devenv.cachix.org on first use with the public key devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/Hm9XgU50cw=
error:
… while calling the 'derivationStrict' builtin
at <nix/derivation-internal.nix>:9:12:
8|
9| strict = derivationStrict drvAttrs;
| ^
10|

   … while evaluating derivation 'devenv-shell'
     whose name attribute is located at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/make-derivation.nix:331:7

   … while evaluating attribute 'DEVENV_PROFILE' of derivation 'devenv-shell'

   … while evaluating derivation 'devenv-profile'
     whose name attribute is located at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/make-derivation.nix:331:7

   … while evaluating attribute 'passAsFile' of derivation 'devenv-profile'
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/build-support/trivial-builders/default.nix:69:9:
       68|         inherit buildCommand name;
       69|         passAsFile = [ "buildCommand" ]
         |         ^
       70|           ++ (derivationArgs.passAsFile or [ ]);

   … while evaluating derivation 'guestfs-tools-1.52.0'
     whose name attribute is located at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/make-derivation.nix:331:7

   … while evaluating attribute 'buildInputs' of derivation 'guestfs-tools-1.52.0'
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/make-derivation.nix:378:7:
      377|       depsHostHost                = elemAt (elemAt dependencies 1) 0;
      378|       buildInputs                 = elemAt (elemAt dependencies 1) 1;
         |       ^
      379|       depsTargetTarget            = elemAt (elemAt dependencies 2) 0;

   … while evaluating derivation 'libguestfs-1.50.1'
     whose name attribute is located at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/make-derivation.nix:331:7

   … while evaluating attribute 'postFixup' of derivation 'libguestfs-1.50.1'
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/development/libraries/libguestfs/default.nix:133:3:
      132|
      133|   postFixup = lib.optionalString (appliance != null) ''
         |   ^
      134|     mkdir -p $out/{lib,lib64}

   … from call site
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/development/libraries/libguestfs/default.nix:133:15:
      132|
      133|   postFixup = lib.optionalString (appliance != null) ''
         |               ^
      134|     mkdir -p $out/{lib,lib64}

   … while calling 'optionalString'
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/lib/strings.nix:268:5:
      267|     # String to return if condition is true
      268|     string: if cond then string else "";
         |     ^
      269|

   … from call site
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/check-meta.nix:511:13:
      510|           else if valid == "no" then (
      511|             handleEvalIssue { inherit meta attrs; } { inherit (validity) reason errormsg; }
         |             ^
      512|           )

   … while calling 'handleEvalIssue'
     at «github:NixOS/nixpkgs/1e3deb3d8a86a870d925760db1a5adecc64d329d»/pkgs/stdenv/generic/check-meta.nix:269:38:
      268|
      269|   handleEvalIssue = { meta, attrs }: { reason , errormsg ? "" }:
         |                                      ^
      270|     let

   error:
   error: Package ‘libguestfs-appliance-1.46.0’ in /nix/store/virtual0000000000000000000000007-source/pkgs/development/libraries/libguestfs/appliance.nix:25 is not available on the requested hostPlatform:
     hostPlatform.config = "aarch64-unknown-linux-gnu"
     package.meta.platforms = [
       "i686-linux"
       "x86_64-linux"
     ]
     package.meta.badPlatforms = [ ]
   , refusing to evaluate.

   a) To temporarily allow packages that are unsupported for this system, you can use an environment variable
      for a single invocation of the nix tools.

        $ export NIXPKGS_ALLOW_UNSUPPORTED_SYSTEM=1

      Note: When using `nix shell`, `nix build`, `nix develop`, etc with a flake,
            then pass `--impure` in order to allow use of environment variables.

   b) For `nixos-rebuild` you can set
     { nixpkgs.config.allowUnsupportedSystem = true; }
   in configuration.nix to override this.

   c) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
     { allowUnsupportedSystem = true; }
   to ~/.config/nixpkgs/config.nix.

✖ Command produced the following output:

✔ Building shell in 9.1s.
Error: x Command /nix/store/as63rjja0x63d1kw7d8xagb9s7glvwkl-nix-devenv-2.21.0pre20240412_b24a931/bin/nix --show-trace --extra- | experimental-features nix-command --extra-experimental-features flakes --option warn-dirty false --keep-going --max- | jobs 6 --option eval-cache false print-dev-env --profile /workspaces/rsdk/.devenv/gc/shell --option extra-substituters | https://devenv.cachix.org --option extra-trusted-public-keys devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/ | Hm9XgU50cw= failed with with exit code 1

You might be rate limited by GitHub.
Please request a PAT from GitHub website, and add it to your Dev Container:
mkdir -p ~/.config/nix/ && echo 'access-tokens = github.com=YOUR_GITHUB_PAT' >> ~/.config/nix/nix.conf && src/bin/rsdk setup
You can run above command in a new terminal once you complete this one.
Press Enter to continue...

[RadxaYuntian]

Can you run devenv update and try again. This package is now available in aarch64, but the lock file was pinned to previous release.

[orlyprofili]

root ➜ /workspaces/rsdk (main) $ devenv update
• Updating devenv.lock ...
✔ Updating devenv.lock in 7.5s.
root ➜ /workspaces/rsdk (main) $ devenv build
• Using Cachix: devenv
error:
error: flake 'git+file:///workspaces/rsdk' does not provide attribute 'packages.aarch64-linux.default' or 'defaultPackage.aarch64-linux'

✖ Command produced the following output:

Error: × Command /nix/store/as63rjja0x63d1kw7d8xagb9s7glvwkl-nix-devenv-2.21.0pre20240412_b24a931/bin/nix --show-trace --extra-experimental-features │ nix-command --extra-experimental-features flakes --option warn-dirty false --keep-going --max-jobs 6 --option eval-cache false build --option │ extra-substituters https://devenv.cachix.org --option extra-trusted-public-keys devenv.cachix.org-1:w1cLUi8dv3hnoSPGAuibQv+f9TZLr6cv/ │ Hm9XgU50cw= failed with with exit code 1

[RadxaYuntian]

We don't use devenv build as we do not define any package. You can run devenv shell or rsdk shell.

[orlyprofili]

I tried this as well, the result was same for devenv shell. At this point in the build, rsdk is not found, as the paths didn't get set. If I apply the path export from devenv.nix such that rsdk is found, the result is same as above. After running devenv update, it's still pointing to libguestfs-appliance-1.46.0, and I believe we're looking for >1.50 for aarch64 support.

[RadxaYuntian]

After running devenv update, it's still pointing to libguestfs-appliance-1.46.0, and I believe we're looking for >1.50 for aarch64 support.

I have updated the lock file and I now have 1.50 for libguestfs:

vscode ➜ /workspaces/rsdk (main) $ which guestfish 
/nix/store/f24d8qbffr3j86w820hlvz5q3zci4rij-libguestfs-1.50.1/bin/guestfish

At this point in the build, rsdk is not found, as the paths didn't get set.

TBH I don't know how you can install binfmt support on MacOS with devcontainer. I know docker runs in VM on MacOS but I'm not sure how you are going to modify the base Linux system there. You might want to create a VM explicitly and follow this guide.