AI Runtime Security
AI Models on Public Clouds Support Table
Table of Contents
Expand All
|
Collapse All
AI Runtime Security Docs
AI Models on Public Clouds Support Table
AI Models on public clouds support table
The following matrix shows the AI model groups, the AI model name, and the model ID
supported by the AI Runtime Security instance in the respective public
cloud.
We support each model name along with any Model
IDs that start with the specified name. For example, support for 'gemini-1.5-pro'
includes 'gemini-1.5-pro' itself and any Model IDs that begin with 'gemini-1.5-pro'
followed by additional identifiers, such as 'gemini-1.5-pro-x.
AI Model Group | Model Name | Model ID |
Google Vertex AI | GCP - Embeddings for Text |
text-embedding-004
textembedding-gecko
|
Google Vertex AI | GCP - Multilingual Embeddings for Text |
textembedding-gecko-multilingual
text-multilingual-embedding
|
Google Vertex AI | GCP - Gemini 1.0 Pro | gemini-pro gemini-1.0-pro |
Google Vertex AI | GCP - Gemini 1.0 Ultra | gemini-1.0-ultra |
Google Vertex AI | GCP - Gemini 1.0 Pro Vision |
gemini-1.0-pro-vision
|
Google Vertex AI | GCP - Gemini 1.0 Ultra Vision | gemini-1.0-ultra-vision |
Google Vertex AI | GCP - Gemini 1.5 Pro |
gemini-1.5-pro
|
Google Vertex AI | GCP - Gemini Experimental | gemini-experimental |
Google Vertex AI | GCP - PaLM 2 Text Bison | text-bison |
Google Vertex AI | GCP - PaLM 2 Text Bison 32K | text-bison-32k |
Google Vertex AI | GCP - PaLM 2 Text Unicorn | text-unicorn |
Google Vertex AI | GCP - PaLM 2 Chat Bison | chat-bison |
Google Vertex AI | GCP - PaLM 2 Chat Bison 32K | chat-bison-32k |
Google Vertex AI | GCP - Codey Code Bison | code-bison |
Google Vertex AI | GCP - Codey Code Bison 32K | code-bison-32k |
Google Vertex AI | GCP - Codey Code Gecko | code-gecko |
Google Vertex AI | GCP - Codey CodeChat Bison | codechat-bison |
Google Vertex AI | GCP - Codey CodeChat Bison 32K | codechat-bison-32k |
Google Vertex AI |
GCP - Vertex Enterprise Search
Note: The model name refers to the queries made to the
Vertex AI
Search.
| - |
Google Vertex AI | GCP - Gemini 1.5 Flash |
gemini-1.5-flash
|
Google Vertex AI | GCP - Other Models |
Finetuned Models:
projects/${PROJECT_ID}/locations/${LOCATION_ID}/endpoints/${ENDPOINT_ID}
"GCP - Other Models" refers to API
requests to custom endpoints created in Vertex AI. These
endpoints can be used to serve custom or fine tuned models.
Requests to these endpoints will have the above API
structure, as defined by GCP. Other Models: Fallback Model Name
|
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Titan Text G1 - Express | amazon.titan-text-express-v1 |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Titan Text G1 - Lite | amazon.titan-text-lite-v1 |
Amazon Bedrock
Invoke Model API
| AWS - Titan Embeddings G1 - Text | amazon.titan-embed-text-v1 |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Claude | anthropic.claude-v2 |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Claude 3 Sonnet | anthropic.claude-3-sonnet-20240229-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Claude 3 Haiku | anthropic.claude-3-haiku-20240307-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Claude Instant | anthropic.claude-instant-v1 |
Amazon Bedrock
Invoke Model API
| AWS - Jurassic-2 Mid | ai21.j2-mid-v1 |
Amazon Bedrock
Invoke Model API
| AWS - Jurassic-2 Ultra | ai21.j2-ultra-v1 |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Cohere Command | cohere.command-text-v14 |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Cohere Command Light | cohere.command-light-text-v14 |
Amazon Bedrock
Invoke Model API
| AWS - Cohere Embed English | cohere.embed-english-v3 |
Amazon Bedrock
Invoke Model API
| AWS - Cohere Embed Multilingual | cohere.embed-multilingual-v3 |
Amazon Bedrock
Invoke Model API
| AWS - Llama 2 Chat 13B | meta.llama2-13b-chat-v1 |
Amazon Bedrock
Invoke Model API
| AWS - Llama 2 Chat 70B | meta.llama2-70b-chat-v1 |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Mistral 7B Instruct | mistral.mistral-7b-instruct-v0: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Mixtral 8X7B Instruct | mistral.mixtral-8x7b-instruct-v0: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Mistral Large | mistral.mistral-large-2402-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Claude 3 Opus | anthropic.claude-3-opus-20240229-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Claude 3.5 Sonnet | anthropic.claude-3-5-sonnet-20240620-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Llama 3 8B Instruct | meta.llama3-8b-instruct-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Llama 3 70B Instruct | meta.llama3-70b-instruct-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Llama 3.1 8B Instruct | meta.llama3-1-8b-instruct-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Llama 3.1 70B Instruct | meta.llama3-1-70b-instruct-v1: |
Amazon Bedrock
Invoke Model API
Converse API
| AWS - Llama 3.1 405B Instruct | meta.llama3-1-405b-instruct-v1: |
Amazon Bedrock
Invoke Model API
| AWS - Other Models |
For example,
arn:aws:bedrock:us-east-1:654654158677:provisioned-model/p1vgneruau99
"AWS - Other Models" refers to any
model on AWS Bedrock that uses provisioned throughput,
including custom and fine-tuned models |
Amazon Bedrock
Converse API
Invoke Model API
| AWS - Claude 3.5 Haiku | us.anthropic.claude-3-5-haiku-20241022-v1:0 |
Amazon Bedrock
Converse API
Invoke Model API
| AWS - Llama 3.2 1B Instruct | us.meta.llama3-2-1b-instruct-v1:0, eu.meta.llama3-2-1b-instruct-v1:0 |
Amazon Bedrock
Converse API
Invoke Model API
| AWS - Llama 3.2 3B Instruct | us.meta.llama3-2-3b-instruct-v1:0, eu.meta.llama3-2-3b-instruct-v1:0 |
Amazon Bedrock
Converse API
Invoke Model API
| AWS - Llama 3.2 11B Instruct | us.meta.llama3-2-11b-instruct-v1:0 |
Amazon Bedrock
Converse API
Invoke Model API
| AWS - Llama 3.2 90B Instruct | us.meta.llama3-2-90b-instruct-v1:0 |
Azure OpenAI | Azure OpenAI - Language Models |
gpt-3.5-turbo
gpt-4
gpt-4-turbo
gpt-4o
gpt-4o-mini
|
Azure OpenAI | Azure OpenAI - Embedding Models |
text-embedding-3-large
text-embedding-3-small
text-embedding-ada-002
|
Azure OpenAI | Azure OpenAI - Other Models | - |
Azure OpenAI |
Azure OpenAI - Other Models
Note: This name refers to the above list of model IDs,
as well as fine tuned versions of GPT-3.5 and GPT-4.
| <model name>.ft-<random string>-<user defined suffix> |
OpenAI | OpenAI - GPT 3.5 Turbo |
gpt-3.5-turbo
|
OpenAI | OpenAI - GPT 4 Turbo and GPT 4 |
gpt-4
gpt-4-turbo
|
OpenAI | OpenAI - Text Embedding V3 large | text-embedding-3-large |
OpenAI | OpenAI - Text Embedding V3 small | text-embedding-3-small |
OpenAI | OpenAI - Text Embedding Ada 002 | text-embedding-ada-002 |
OpenAI | OpenAI - Other Models |
ft:<model name>:<org_name>:<user defined
project name>:<random string>
"OpenAI - Other Models" refer to fine-tuned versions of
GPT-3.5 and GPT-4 |
OpenAI | OpenAI - GPT 4o | gpt-4o |
OpenAI | OpenAI - GPT 4o mini | gpt-4o-mini |