how to use an index url with username and password with pants 1.30.0

[godfatherofdevil]

Hi,

I am using pants build in CI and everything works as expected. Thanks for a great build tool
However, since i started to integrate few in-house pypi libraries, i am not able to hide the credential in an env variable or CI variable while using indexes.add option in python-repos config option

This works if i hard-code the credential in the url itself but i would like to do something like this:

[python-repos]
indexes.add = ["https://${CI_USER}:${CI_JOB_TOKEN}@<index_url>"]

Is there any way to achieve this ?

This is my global config:

[GLOBAL]
pants_version = "1.30.0"
v1 = false
v2 = true
dynamic_ui = false
colors = true
backend_packages = []
backend_packages2 = ["pants.backend.python"]
process_execution_local_parallelism = 4
pantsd = false

[jsirois]

See here for an alternate way to specify any option via environment variable: https://www.pantsbuild.org/v1.30/docs/options#environment-variables

While it's not substitution, I'm guessing this should work for you if you can export one more environment variable in your CI environment like so:

export PANTS_PYTHON_REPOS_INDEXES="https://${CI_USER}:${CI_JOB_TOKEN}@<index_url>"

[jsirois]

I'll note that the v2 pants docs linked above do not explain the implicit single element add form I've used here. The old v1docs do though: https://v1.pantsbuild.org/options.html I'll get the docs corrected pending a discussion in pantsbuild slack #general.

[benjyw]

Thanks for bringing this up. I have to assume this is oversight. The single element form is too useful not to document... Indeed with env vars it's the only practical syntax.

[godfatherofdevil]

Yes, with env variable PANTS_PYTHON_REPOS_INDEXES i was able to achieve this. Thank you

[petercm]

Since I landed here first via searching I wanted to add that this seems a little cleaner these days via config file env var interpolation (or a not checked-in .pants.rc file)

https://www.pantsbuild.org/2.18/docs/python/overview/third-party-dependencies#authenticating-to-custom-repos

[benjyw]

Thanks for posting!