[Feature] Discrete SAC compatibility with compile

[vmoens]

Stack from ghstack (oldest at bottom):

• [Feature] GAIL compatibility with compile #2573
• [Feature] DQN compatibility with compile #2571
• -> [Feature] Discrete SAC compatibility with compile #2569
• [Feature] DT compatibility with compile #2556
• [Feature] DDPG compatibility with compile #2555
• [Feature] CROSSQ compatibility with compile #2554
• [Feature] CQL compatibility with compile #2553

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2569

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 15 New Failures, 2 Unrelated Failures

As of commit 5859a61 with merge base c8676f4 ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  FAILED ../../../../../../tmp/test_objectives_benchmarks.py::test_sac_speed[reduce-overhead-None] - torch._dynamo.exc.UserError: Dynamic control flow is not supported at the moment. Please use functorch.experimental.control_flow.cond to explicitly capture the control flow. For more information about this error, see: https://pytorch.org/docs/main/generated/exportdb/index.html#cond-operands
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  FAILED ../../../../tmp/test_objectives_benchmarks.py::test_sac_speed[reduce-overhead-None] - torch._dynamo.exc.UserError: Dynamic control flow is not supported at the moment. Please use functorch.experimental.control_flow.cond to explicitly capture the control flow. For more information about this error, see: https://pytorch.org/docs/main/generated/exportdb/index.html#cond-operands
• Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job (gh)
  test/test_libs.py::TestGym::test_gym_gymnasium_parallel
• Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job (gh)
  test/test_libs.py::TestOpenML::test_env[batch_size2-magic]
• Lint / python-source-and-configs / linux-job (gh)
  RuntimeError: Command docker exec -t e89c051ebd4d4d3415f5d1ee4c8309aa75f70101ee528310d017fe268fd2de2e /exec failed with exit code 1
• SOTA Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  AttributeError: 'TransformedEnv' object has no attribute 'single_action_spec'
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[SamplingStrategy.RANDOM-False-True-pendulum]
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[3-False-True-pendulum]
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[3-False-True-pendulum]
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[SamplingStrategy.RANDOM-False-True-pendulum]
• Unit-tests on Linux / tests-cpu-oldget (3.12) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[3-False-True-pendulum]
• Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[3-False-True-pendulum]
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  RuntimeError: Command docker exec -t 80a3d56fe30599bc7f1edb8be49f04ab0fcc0333d7e7448dedccb609536e38c6 /exec failed with exit code 1
• Unit-tests on Linux / tests-optdeps (3.11, 12.1) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_compose
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh)
  test/test_transforms.py::TestActionDiscretizer::test_transform_env[SamplingStrategy.RANDOM-False-True-pendulum]

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh) (trunk failure)
  AttributeError: _ARRAY_API not found
• Unit-tests on Windows / unittests-cpu / windows-job (gh) (trunk failure)
  ##[error]Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.