Possibility to passs runtime parameters to compiled pipeline

[andrewrussell-sky]

Hello,

Im am just enquiring to find out if the is an option to configure runtime parameters for the compiled vertex pipeline? I have a requirement to set seperate run names at runtime of my vertex pipeline.

I can't quite figure out from the documentation if this is possible using the plugin. Thanks for your help

[Neuron1c]

Unfortunatly you cannot with compile alone. Depending on how you intend to run your jobs you might try use the vertexai client library. You can specify the name of the job when starting the run

from kfp.v2.google.client import AIPlatformClient

client = AIPlatformClient(project_id={GCP_PROJECT}, region={GCP_REGION})

client.create_run_from_job_spec(
    service_account={GCP_SERVICE_ACCOUNT}, # or use default
    job_spec_path="pipeline.json",
    job_id={YOUR_RUN_NAME},
    pipeline_root=f"gs://{GCP_BUCKET}",
    )

Make your run name whatever you need it to be from there when submitting the job. If you want to schedule the job using the scheduler and have it change the name (say add datetime to the end of your run name) then you are on your own. I found the tool lacking greatly. But if you do find a solution that works for you do share