Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DEVREL-504] Update metadata AI API info in AI Developer Zone #678

Merged
merged 12 commits into from
Feb 12, 2025
Merged
12 changes: 4 additions & 8 deletions content/guides/box-ai/ai-agents/ai-agent-overrides.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,6 @@ related_guides:

# Override AI model configuration

<Message type="notice">
Endpoints related to metadata extraction are currently a beta feature offered subject to Box’s Main Beta Agreement, and the available capabilities may change. Box AI API is available to all Enterprise Plus customers.
</Message>

The `ai_agent` configuration allows you to override the default AI model configuration. It is available for the following endpoints:

* [`POST ai/ask`][ask]
Expand Down Expand Up @@ -52,7 +48,7 @@ A complete configuration for `ai/ask` is as follows:
"temperature": 0,
"top_p": 1
},
"model": "azure__openai__gpt_3_5_turbo_16k",
"model": "azure__openai__gpt_4o_mini",
"num_tokens_for_completion": 8400,
"prompt_template": "It is `{current_date}`, consider these travel options `{content}` and answer the `{user_question}`.",
"system_message": "You are a helpful travel assistant specialized in budget travel"
Expand All @@ -66,7 +62,7 @@ A complete configuration for `ai/ask` is as follows:
"temperature": 0,
"top_p": 1
},
"model": "azure__openai__gpt_3_5_turbo_16k",
"model": "azure__openai__gpt_4o_mini",
"num_tokens_for_completion": 8400,
"prompt_template": "It is `{current_date}`, consider these travel options `{content}` and answer the `{user_question}`.",
"system_message": "You are a helpful travel assistant specialized in budget travel"
Expand All @@ -87,7 +83,7 @@ A complete configuration for `ai/ask` is as follows:
"temperature": 0,
"top_p": 1
},
"model": "azure__openai__gpt_3_5_turbo_16k",
"model": "azure__openai__gpt_4o_mini",
"num_tokens_for_completion": 8400,
"prompt_template": "It is `{current_date}`, consider these travel options `{content}` and answer the `{user_question}`.",
"system_message": "You are a helpful travel assistant specialized in budget travel"
Expand All @@ -108,7 +104,7 @@ A complete configuration for `ai/ask` is as follows:
"temperature": 0,
"top_p": 1
},
"model": "azure__openai__gpt_3_5_turbo_16k",
"model": "azure__openai__gpt_4o_mini",
"num_tokens_for_completion": 8400,
"prompt_template": "It is `{current_date}`, consider these travel options `{content}` and answer the `{user_question}`.",
"system_message": "You are a helpful travel assistant specialized in budget travel"
Expand Down
2 changes: 1 addition & 1 deletion content/guides/box-ai/ai-agents/ai-agent-versioning.md
Original file line number Diff line number Diff line change
Expand Up @@ -147,7 +147,7 @@ To make sure your configurations are not affected in a negative way, you can use
"textGen": {
"type": "ai_agent_text_gen",
"basicGen": {
"model": "azure__openai__gpt_3_5_turbo_16k",
"model": "azure__openai__gpt_4o_mini",
"systemMessage": "\nIf you need to know today's date to respond, it is {current_date}.\nThe user is working in a collaborative document creation editor called Box Notes.\nAssume that you are helping a business user create documents or to help the user revise existing text.\nYou can help the user in creating templates to be reused or update existing documents, you can respond with text that the user can use to place in the document that the user is editing.\nIf the user simply asks to \"improve\" the text, then simplify the language and remove jargon, unless the user specifies otherwise.\nDo not open with a preamble to the response, just respond.\n",
"promptTemplate": "{user_question}",
"numTokensForCompletion": 12000,
Expand Down
8 changes: 2 additions & 6 deletions content/guides/box-ai/ai-agents/get-agent-default-config.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,6 @@ related_guides:

# Get default AI agent configuration

<Message type="notice">
Endpoints related to metadata extraction are currently a beta feature offered subject to Box’s Main Beta Agreement, and the available capabilities may change. Box AI API is available to all Enterprise Plus customers.
</Message>

The `GET /2.0/ai_agent_default` endpoint allows you to fetch the default configuration for AI services.
Once you get the configuration details you can override them using the [`ai_agent`][ai-agent-config] parameter.

Expand All @@ -40,7 +36,7 @@ To make a call, you must pass the following parameters. Mandatory parameters are
|--------|--------|-------|
|`language`| The language code the agent configuration is returned for. If the language is not supported, the default configuration is returned. | `ja-JP`|
|**`mode`**|The mode used to filter the agent configuration. The value can be `ask`, `text_gen`, `extract`, or `extract_structured` depending on the result you want to achieve. |`ask`|
|`model`|The model you want to get the configuration for. To make sure your chosen model is supported, see the [list of models][models].| `azure__openai__gpt_3_5_turbo_16k`|
|`model`|The model you want to get the configuration for. To make sure your chosen model is supported, see the [list of models][models].| `azure__openai__gpt_4o_mini`|

## Responses

Expand Down Expand Up @@ -140,7 +136,7 @@ When you set the `mode` parameter to `text_gen` the response will be as follows:
{
"type": "ai_agent_text_gen",
"basic_gen": {
"model": "azure__openai__gpt_3_5_turbo_16k",
"model": "azure__openai__gpt_4o_mini",
"system_message": "\nIf you need to know today's date to respond, it is {current_date}.\nThe user is working in a collaborative document creation editor called Box Notes.\nAssume that you are helping a business user create documents or to help the user revise existing text.\nYou can help the user in creating templates to be reused or update existing documents, you can respond with text that the user can use to place in the document that the user is editing.\nIf the user simply asks to \"improve\" the text, then simplify the language and remove jargon, unless the user specifies otherwise.\nDo not open with a preamble to the response, just respond.\n",
"prompt_template": "{user_question}",
"num_tokens_for_completion": 12000,
Expand Down
4 changes: 0 additions & 4 deletions content/guides/box-ai/ai-agents/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,6 @@ related_guides:

# AI model overrides

<Message type="notice">
Endpoints related to metadata extraction are currently a beta feature offered subject to Box’s Main Beta Agreement, and the available capabilities may change. Box AI API is available to all Enterprise Plus customers.
</Message>

Box updates the default models across the endpoints on a regular basis to stay up to date with the most advanced options.

If your implementation is based on Box AI, a new default model might alter the results in a way that could break or change a downstream process. Switching to a specific version may prevent encountering any issues.
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
---
rank: 8
related_guides:
- box-ai/ai-tutorials/ask-questions
- box-ai/ai-tutorials/generate-text
- box-ai/ai-tutorials/extract-metadata
- box-ai/ai-tutorials/extract-metadata-structured
- box-ai/ai-agents/get-agent-default-config
---

# Google Gemini 2.0 Flash

**Google Gemini 2.0 Flash** is a multimodal model designed for optimal for high-volume, high-frequency tasks at scale. It capable of multimodal reasoning and has a context window of 1 million tokens.

## Model details

| Item | Value | Description |
|-----------|----------|----------|
|Model name|**Google Gemini 2.0 Flash**| The name of the model. |
|API model name|`google__gemini_2_0_flash_001`| The name of the model that is used in the [Box AI API for model overrides][overrides]. The user must provide this exact name for the API to work. |
|Hosting layer| **Google** | The trusted organization that securely hosts LLM. |
|Model provider|**Google**| The organization that provides this model. |
|Release date|**February 5th 2025** | The release date for the model.|
|Knowledge cutoff date| **June 2024**| The date after which the model does not get any information updates. |
|Input context window |**1m tokens**| The number of tokens supported by the input context window.|
|Maximum output tokens |**8k tokens** |The number of tokens that can be generated by the model in a single request.|
|Empirical throughput| **168** | The number of tokens the model can generate per second.|
|Open source | **No** | Specifies if the model's code is available for public use.|

## Additional documentation

For additional information, see [official Google Gemini 2.0 Flash documentation][vertex-ai-gemini-models].

[vertex-ai-gemini-models]: https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#gemini-models
[overrides]: g://box-ai/ai-agents/ai-agent-overrides
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
---
rank: 9
related_guides:
- box-ai/ai-tutorials/ask-questions
- box-ai/ai-tutorials/generate-text
- box-ai/ai-tutorials/extract-metadata
- box-ai/ai-tutorials/extract-metadata-structured
- box-ai/ai-agents/get-agent-default-config
---

# Google Gemini 2.0 Flash Lite

**Google Gemini 2.0 Flash Lite** is a multimodal model designed to handle lightweight tasks. It is designed for high-volume, low-latency tasks, making it highly efficient for large-scale use cases like summarization, multimodal processing, and categorization but with higher quality than Gemini 1.5 Flash.

## Model details

| Item | Value | Description |
|-----------|----------|----------|
|Model name|**Google Gemini 2.0 Flash Lite**| The name of the model. |
|API model name|`google__gemini_2_0_flash_lite_preview`| The name of the model that is used in the [Box AI API for model overrides][overrides]. The user must provide this exact name for the API to work. |
|Hosting layer| **Google** | The trusted organization that securely hosts LLM. |
|Model provider|**Google**| The organization that provides this model. |
|Release date|**February 5th 2025** | The release date for the model.|
|Knowledge cutoff date| **June 2024**| The date after which the model does not get any information updates. |
|Input context window |**1m tokens**| The number of tokens supported by the input context window.|
|Maximum output tokens |**8k tokens** |The number of tokens that can be generated by the model in a single request.|
|Empirical throughput| **168** | The number of tokens the model can generate per second.|
|Open source | **No** | Specifies if the model's code is available for public use.|

## Additional documentation

For additional information, see [official Google Gemini 2.0 Flash Lite documentation][vertex-ai-gemini-models].

[vertex-ai-gemini-models]: https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#gemini-models
[overrides]: g://box-ai/ai-agents/ai-agent-overrides
35 changes: 0 additions & 35 deletions content/guides/box-ai/ai-models/google-text-bison-32-model-card.md

This file was deleted.

35 changes: 0 additions & 35 deletions content/guides/box-ai/ai-models/google-text-bison-model-card.md

This file was deleted.

35 changes: 0 additions & 35 deletions content/guides/box-ai/ai-models/google-text-unicorn-model-card.md

This file was deleted.

This file was deleted.

This file was deleted.

Loading