AI Models on Public Clouds Support Table
Focus
Focus
AI Runtime Security

AI Models on Public Clouds Support Table

Table of Contents

AI Models on Public Clouds Support Table

AI Models on public clouds support table
The following matrix shows the AI model groups, the AI model name, and the model ID supported by the AI Runtime Security instance in the respective public cloud.
We support each model name along with any Model IDs that start with the specified name. For example, support for 'gemini-1.5-pro' includes 'gemini-1.5-pro' itself and any Model IDs that begin with 'gemini-1.5-pro' followed by additional identifiers, such as 'gemini-1.5-pro-x.
AI Model GroupModel NameModel ID
Google Vertex AIGCP - Embeddings for Text
text-embedding-004
textembedding-gecko
Google Vertex AIGCP - Multilingual Embeddings for Text
textembedding-gecko-multilingual
text-multilingual-embedding
Google Vertex AIGCP - Gemini 1.0 Pro
gemini-pro
gemini-1.0-pro
Google Vertex AIGCP - Gemini 1.0 Ultragemini-1.0-ultra
Google Vertex AIGCP - Gemini 1.0 Pro Vision
gemini-1.0-pro-vision
Google Vertex AIGCP - Gemini 1.0 Ultra Visiongemini-1.0-ultra-vision
Google Vertex AIGCP - Gemini 1.5 Pro
gemini-1.5-pro
Google Vertex AIGCP - Gemini Experimentalgemini-experimental
Google Vertex AIGCP - PaLM 2 Text Bisontext-bison
Google Vertex AIGCP - PaLM 2 Text Bison 32Ktext-bison-32k
Google Vertex AIGCP - PaLM 2 Text Unicorntext-unicorn
Google Vertex AIGCP - PaLM 2 Chat Bisonchat-bison
Google Vertex AIGCP - PaLM 2 Chat Bison 32Kchat-bison-32k
Google Vertex AIGCP - Codey Code Bisoncode-bison
Google Vertex AIGCP - Codey Code Bison 32Kcode-bison-32k
Google Vertex AIGCP - Codey Code Geckocode-gecko
Google Vertex AIGCP - Codey CodeChat Bisoncodechat-bison
Google Vertex AIGCP - Codey CodeChat Bison 32Kcodechat-bison-32k
Google Vertex AI
GCP - Vertex Enterprise Search
Note: The model name refers to the queries made to the Vertex AI Search.
-
Google Vertex AIGCP - Gemini 1.5 Flash
gemini-1.5-flash
Google Vertex AIGCP - Other Models
Finetuned Models: projects/${PROJECT_ID}/locations/${LOCATION_ID}/endpoints/${ENDPOINT_ID}
"GCP - Other Models" refers to API requests to custom endpoints created in Vertex AI. These endpoints can be used to serve custom or fine tuned models. Requests to these endpoints will have the above API structure, as defined by GCP.
Other Models: Fallback Model Name
Amazon Bedrock
Invoke Model API
Converse API
AWS - Titan Text G1 - Expressamazon.titan-text-express-v1
Amazon Bedrock
Invoke Model API
Converse API
AWS - Titan Text G1 - Liteamazon.titan-text-lite-v1
Amazon Bedrock
Invoke Model API
AWS - Titan Embeddings G1 - Textamazon.titan-embed-text-v1
Amazon Bedrock
Invoke Model API
Converse API
AWS - Claudeanthropic.claude-v2
Amazon Bedrock
Invoke Model API
Converse API
AWS - Claude 3 Sonnetanthropic.claude-3-sonnet-20240229-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Claude 3 Haikuanthropic.claude-3-haiku-20240307-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Claude Instantanthropic.claude-instant-v1
Amazon Bedrock
Invoke Model API
AWS - Jurassic-2 Midai21.j2-mid-v1
Amazon Bedrock
Invoke Model API
AWS - Jurassic-2 Ultraai21.j2-ultra-v1
Amazon Bedrock
Invoke Model API
Converse API
AWS - Cohere Commandcohere.command-text-v14
Amazon Bedrock
Invoke Model API
Converse API
AWS - Cohere Command Lightcohere.command-light-text-v14
Amazon Bedrock
Invoke Model API
AWS - Cohere Embed Englishcohere.embed-english-v3
Amazon Bedrock
Invoke Model API
AWS - Cohere Embed Multilingualcohere.embed-multilingual-v3
Amazon Bedrock
Invoke Model API
AWS - Llama 2 Chat 13Bmeta.llama2-13b-chat-v1
Amazon Bedrock
Invoke Model API
AWS - Llama 2 Chat 70Bmeta.llama2-70b-chat-v1
Amazon Bedrock
Invoke Model API
Converse API
AWS - Mistral 7B Instructmistral.mistral-7b-instruct-v0:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Mixtral 8X7B Instructmistral.mixtral-8x7b-instruct-v0:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Mistral Largemistral.mistral-large-2402-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Claude 3 Opusanthropic.claude-3-opus-20240229-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Claude 3.5 Sonnetanthropic.claude-3-5-sonnet-20240620-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Llama 3 8B Instructmeta.llama3-8b-instruct-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Llama 3 70B Instructmeta.llama3-70b-instruct-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Llama 3.1 8B Instructmeta.llama3-1-8b-instruct-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Llama 3.1 70B Instructmeta.llama3-1-70b-instruct-v1:
Amazon Bedrock
Invoke Model API
Converse API
AWS - Llama 3.1 405B Instructmeta.llama3-1-405b-instruct-v1:
Amazon Bedrock
Invoke Model API
AWS - Other Models
For example, arn:aws:bedrock:us-east-1:654654158677:provisioned-model/p1vgneruau99
"AWS - Other Models" refers to any model on AWS Bedrock that uses provisioned throughput, including custom and fine-tuned models
Azure OpenAIAzure OpenAI - Language Models
gpt-3.5-turbo
gpt-4
gpt-4-turbo
gpt-4o
gpt-4o-mini
Azure OpenAIAzure OpenAI - Embedding Models
text-embedding-3-large
text-embedding-3-small
text-embedding-ada-002
Azure OpenAIAzure OpenAI - Other Models-
Azure OpenAI
Azure OpenAI - Other Models
Note: This name refers to the above list of model IDs, as well as fine tuned versions of GPT-3.5 and GPT-4.
<model name>.ft-<random string>-<user defined suffix>
OpenAIOpenAI - GPT 3.5 Turbo
gpt-3.5-turbo
OpenAIOpenAI - GPT 4 Turbo and GPT 4
gpt-4
gpt-4-turbo
OpenAIOpenAI - Text Embedding V3 largetext-embedding-3-large
OpenAIOpenAI - Text Embedding V3 smalltext-embedding-3-small
OpenAIOpenAI - Text Embedding Ada 002text-embedding-ada-002
OpenAIOpenAI - Other Models
ft:<model name>:<org_name>:<user defined project name>:<random string>
"OpenAI - Other Models" refer to fine-tuned versions of GPT-3.5 and GPT-4
OpenAIOpenAI - GPT 4ogpt-4o
OpenAIOpenAI - GPT 4o minigpt-4o-mini