TST: Redesign test_all

[crusaderky]

#288 introduced __dir__, which completely neutered test_all.
Instead of reverting the change, this PR attempts to reinvent the test to be more useful.

CC @jorenham @ev-br

[Copilot]

Pull Request Overview

This PR overhauls the testing of exported names by replacing the old test_all function with new, more focused tests and by standardizing the dir implementations across multiple array_api_compat modules. Key changes include:

• Replacing the test_all function with new tests (test_dir and test_builtins_collision) that better validate module exports.
• Removing redundant _all_ignore variables and cleaning up all definitions and dir implementations in various modules.
• Consolidating all settings in numpy, torch, dask, cupy, and common modules for more consistent behavior.

Reviewed Changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
tests/test_all.py	New tests using NAMES/XFAILS and updated parameterizations replacing test_all.
array_api_compat/torch/linalg.py	Removed _all_ignore and cleaned up all and dir definitions.
array_api_compat/torch/fft.py	Removed _all_ignore; standardized dir definition.
array_api_compat/torch/_aliases.py	Removed _all_ignore to simplify export handling.
array_api_compat/numpy/linalg.py	Revised all composition and removed redundant concatenation of all.
array_api_compat/numpy/fft.py	Modified all concatenation and removed extra deletion lines for cleanup.
array_api_compat/numpy/_typing.py	Removed _all_ignore.
array_api_compat/numpy/_aliases.py	Updated all assembly and removed _all_ignore for consistency.
array_api_compat/dask/array/linalg.py	Removed _all_ignore and added a dir function returning all.
array_api_compat/dask/array/fft.py	Removed _all_ignore and standardized dir implementation.
array_api_compat/dask/array/_aliases.py	Removed _all_ignore.
array_api_compat/cupy/_typing.py	Removed _all_ignore.
array_api_compat/cupy/_aliases.py	Removed _all_ignore.
array_api_compat/common/_linalg.py	Removed _all_ignore.
array_api_compat/common/_helpers.py	Removed _all_ignore.
array_api_compat/common/_aliases.py	Removed _all_ignore.

[crusaderky]

Maybe a better version of this test could automatically scrape data-apis/array-api/?

[ev-br]

cf https://github.com/data-apis/array-api-tests/blob/2db6c7b807a609a1539e312e01af093a45d34764/array_api_tests/test_has_names.py#L25
(however, data-apis/array-api-tests#224)

[crusaderky]

Are you suggesting that array-api-compat should add array-api as a git submodule, for testing only?
If so, do you agree that such a change is best left to a follow-up?

[ev-br]

Are you suggesting that array-api-compat should add array-api as a git submodule, for testing only?

Definitely not.

If so, do you agree that such a change is best left to a follow-up?

Absolutely yes.

[ev-br]

IIUC, the purpose of test_all --- with all its considerable sins! --- was three-fold:

• make sure that the user-visible dir/all lists contain everything they should
• make sure that unwanted names do not bleed into the user-visible dir/all lists
• make sure that internal implementation modules __all__ lists are sensible

This PR seems to work for the first item; the second one seems to still allow some strange things:

In [11]: import array_api_compat.numpy as anp

In [12]: "Final" in dir(anp)
Out[12]: True

In [13]: import numpy as np

In [14]: "Final" in dir(np)
Out[14]: False

For the third item, maybe we should somehow check that __all__ lists do not contain duplicate items? This would be useful for development (for one recent example, I'm not entirely sure if #317 does it right with __all__ lists; would be nice to have a test support for this)

[crusaderky]

I've heavily reworked the PR and fixed many issues where array-api-compat was hiding objects declared in the wrapped module.
Output of the new test vs. the old array_api_compat is as follows:

FAILED tests/test_all.py::test_array_api_names[numpy-] - AssertionError: Missing exports: {'__array_api_version__', '__array_namespace_info__'}
FAILED tests/test_all.py::test_array_api_names[cupy-] - AssertionError: Missing exports: {'__array_api_version__', '__array_namespace_info__'}
FAILED tests/test_all.py::test_array_api_names[torch-] - AssertionError: Missing exports: {'__array_api_version__', '__array_namespace_info__'}
FAILED tests/test_all.py::test_array_api_names[dask.array-] - AssertionError: Missing exports: {'__array_api_version__', '__array_namespace_info__'}
FAILED tests/test_all.py::test_compat_doesnt_hide_names[numpy-] - AssertionError: Non-Array API names have been hidden: {'test', 'kernel_version', 'numarray', 'polynomial', 'compat', 'typing', 'testing', 'version', 'dtypes', 'l...
FAILED tests/test_all.py::test_compat_doesnt_hide_names[numpy-fft] - AssertionError: Non-Array API names have been hidden: {'test', 'helper'}
FAILED tests/test_all.py::test_compat_doesnt_hide_names[numpy-linalg] - AssertionError: Non-Array API names have been hidden: {'test', 'linalg'}
FAILED tests/test_all.py::test_compat_doesnt_hide_names[torch-] - AssertionError: Non-Array API names have been hidden: {'cpu', 'cuda'}
FAILED tests/test_all.py::test_compat_doesnt_hide_names[torch-fft] - AssertionError: Non-Array API names have been hidden: {'ihfftn', 'common_args', 'hfft2', 'factory_common_args', 'ihfft2', 'sys', 'hfftn'}
FAILED tests/test_all.py::test_compat_doesnt_hide_names[dask.array-] - AssertionError: Non-Array API names have been hidden: {'einsumfuncs', 'annotations', 'utils', 'optimization', 'chunk_types', 'warnings', 'wrap', 'reductions', 'r...
FAILED tests/test_all.py::test_compat_doesnt_add_names[numpy-] - AssertionError: array-api-compat is adding non-Array API names: {'is_pydata_sparse_namespace', 'is_numpy_array', 'is_ndonnx_namespace', 'is_cupy_namespace', 'is_...
FAILED tests/test_all.py::test_compat_doesnt_add_names[torch-fft] - AssertionError: array-api-compat is adding non-Array API names: {'annotations', 'Sequence', 'Union', 'Literal', 'Array'}
FAILED tests/test_all.py::test_compat_doesnt_add_names[dask.array-] - AssertionError: array-api-compat is adding non-Array API names: {'Final'}
FAILED tests/test_all.py::test_compat_doesnt_add_names[dask.array-fft] - AssertionError: array-api-compat is adding non-Array API names: {'get_xp', 'fft_all', 'da'}
FAILED tests/test_all.py::test_compat_doesnt_add_names[dask.array-linalg] - AssertionError: array-api-compat is adding non-Array API names: {'Literal', 'linalg_all', 'get_xp', 'da'}