AWS Bedrock Connection Method

Table of Contents

AWS Bedrock Connection Method

Use AWS Bedrock connection method for adding targets.

An AWS Bedrock connection method leverages the fully managed service provided by Amazon Web Services to facilitate the ability to build and scale generative AI applications. When you use the AWS Bedrock connection method you configure AWS authentication and model details.

After specifying Target Details, set the Connection Method to AWS Bedrock.
Select Next: Add/Verify Parameters.
In the Add/Verify Parameters page, you'll need to set the authentication mechanism and additional connection details. In the AWS Authentication Details section:
1. Specify the Region.
2. Enter the IAM Access ID.
3. Enter the IAM Access Secret.
4. Optionally enter the Session Token.
In the Model Details section:
1. Enter a Model Name. For example, gpt 3.5 turbo.
2. Enable or disable Model Streaming.
Select Next: Verify & Edit JSON.
In the Verify & Edit JSON page, specify the JSON structure of the request.
Click Next: Advanced Configurations.
In the Advanced Configurations page you'll configure Rate Limits and set Guardrails/Content Filters.
Enable Rate Limits for applications on the target endpoint.
1. Specify the Endpoint Rate Limit. This value represents the maximum number of allowed requests per minute for the specified endpoint.
2. Specify the Endpoint Rate Limit Error Code. This field represents the error code your system uses for rate limiting violations.
3. Provide a Sample Exception JSON.
Enable Guardrails/Content Filters. These fields are used for output guardrails or content filters applicable on the target endpoint.
1. Specify the Error code for Guardrails or Content Filters. This field represents the error code your system uses when a response is prevented by filters or safeguards.
2. Provide a Sample Exception JSON.
Select Add Target.
Once the target is created you can start a scan, or view previously created targets: