You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This safety precaution may apply to multiple labels, for example "Danger of Misuse" or "Reinforces Existing Bias"
For example, if you're building a chatbot adding a process after the LLM to check if certain keywords are in the output of the LLM and ensuring such responses are not shared if they are, e.g. racist, telling people to commit suicide, or otherwise inappropriate.
Sometimes these kinds of fixes are a bit annoying as they paper over deeper issues in using data science/AI (and it's also possible in this example that they are weak to prompt injections), but I also think that it is one type of precaution to be aware of.
For example, in the phenotype predictor, perhaps it would have been useful to have a curated list of phenotypes that are sensible to predict on. This could really have ensured that the thing I was making was less open to misuse.
The text was updated successfully, but these errors were encountered:
This safety precaution may apply to multiple labels, for example "Danger of Misuse" or "Reinforces Existing Bias"
For example, if you're building a chatbot adding a process after the LLM to check if certain keywords are in the output of the LLM and ensuring such responses are not shared if they are, e.g. racist, telling people to commit suicide, or otherwise inappropriate.
Sometimes these kinds of fixes are a bit annoying as they paper over deeper issues in using data science/AI (and it's also possible in this example that they are weak to prompt injections), but I also think that it is one type of precaution to be aware of.
For example, in the phenotype predictor, perhaps it would have been useful to have a curated list of phenotypes that are sensible to predict on. This could really have ensured that the thing I was making was less open to misuse.
The text was updated successfully, but these errors were encountered: