Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Boto3 create_algorithm does not support FastFile #4469

Open
fcdl94 opened this issue Mar 11, 2025 · 1 comment
Open

Boto3 create_algorithm does not support FastFile #4469

fcdl94 opened this issue Mar 11, 2025 · 1 comment
Assignees
Labels
bug This issue is a confirmed bug. documentation This is a problem with documentation. p3 This is a minor priority issue response-requested Waiting on additional information or feedback.

Comments

@fcdl94
Copy link

fcdl94 commented Mar 11, 2025

Describe the issue

While in the documentation is written that TrainingChannels accepts "SupportedInputModes": ["File", "Pipe", "FastFile"] it throws a validation error if you try to use "FastFile"

For example try:

    result = client.create_algorithm(
        AlgorithmName=algorithm_name,
        AlgorithmDescription="Training_Algorithm",
        TrainingSpecification={
            "TrainingImage": train_image,
            "SupportedHyperParameters": hyperparameters,
            "SupportedTrainingInstanceTypes": supported_instances,
            "SupportsDistributedTraining": False,
            "MetricDefinitions": [],
            "TrainingChannels": [
                {
                    "Name": "dataset",
                    "Description": "full dataset channel",
                    "IsRequired": False,
                    "SupportedContentTypes": [],
                    "SupportedCompressionTypes": ["None"],
                    "SupportedInputModes": ["FastFile"],
                },
            ],
        },
    )

Links

Docs: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/sagemaker/client/create_algorithm.html

@fcdl94 fcdl94 added documentation This is a problem with documentation. needs-triage This issue or PR still needs to be triaged. labels Mar 11, 2025
@RyanFitzSimmonsAK RyanFitzSimmonsAK self-assigned this Mar 11, 2025
@RyanFitzSimmonsAK RyanFitzSimmonsAK added bug This issue is a confirmed bug. investigating This issue is being investigated and/or work is in progress to resolve the issue. p3 This is a minor priority issue and removed needs-triage This issue or PR still needs to be triaged. labels Mar 11, 2025
@RyanFitzSimmonsAK
Copy link
Contributor

Hi @fcdl94, thanks for reaching out. FastFile is included in the request syntax because it's a valid option for at least one Sagemaker operation that uses TrainingChannels. However, it is not supported for this operation. This is specified in the documentation for SupportedInputModes,

SupportedInputModes (list) – [REQUIRED]

The allowed input mode, either FILE or PIPE.

In FILE mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode.

In PIPE mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.

Please let me know if you have any follow-up questions.

@RyanFitzSimmonsAK RyanFitzSimmonsAK added response-requested Waiting on additional information or feedback. and removed investigating This issue is being investigated and/or work is in progress to resolve the issue. labels Mar 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug This issue is a confirmed bug. documentation This is a problem with documentation. p3 This is a minor priority issue response-requested Waiting on additional information or feedback.
Projects
None yet
Development

No branches or pull requests

2 participants