You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Whisper has two options prompt and prefix defined in DecodingOptions (source code). These two options will be inserted as part of the initial_tokens (source code). It would be good to support them in Transformers.js
Motivation
You can find a detailed description of these two options here: openai/whisper#117 (comment). In short, they can improve the transaction quality for long speak (i.e. larger than 30 seconds).
Your contribution
The Python library transformers has prompt_ids for this feature (source code). Maybe we should just implement it in transformers.js too.
The text was updated successfully, but these errors were encountered:
Feature request
Whisper has two options
prompt
andprefix
defined inDecodingOptions
(source code). These two options will be inserted as part of theinitial_tokens
(source code). It would be good to support them in Transformers.jsMotivation
You can find a detailed description of these two options here: openai/whisper#117 (comment). In short, they can improve the transaction quality for long speak (i.e. larger than 30 seconds).
Your contribution
The Python library
transformers
hasprompt_ids
for this feature (source code). Maybe we should just implement it intransformers.js
too.The text was updated successfully, but these errors were encountered: