Open AI and Hugging Face Connection Method

1. After specifying Target Details, set theConnection Method to Open AI or Hugging Face.
2. Click Next: Add/Verify Parameters.
3. In the Add/Verify Parameters page, you'll need to set the authentication mechanism and additional connection details:

   1. In the API Details section, enter the API Key.
   2. Enter the API Endpoint. For example, https://api.openai.com/v1/chat/completions.
   3. Specify Model Details. Enter a Model Name (for example, gpt 3.5 turbo), configure Model Streaming by enabling or disabling it.
4. Select Next: Verify & Edit JSON.
5. In the Verify & Edit JSON page, specify the JSON structure of the request.
6. Click Next: Advanced Configurations.

   In the Advanced Configurations page you'll configure Rate Limits and set Guardrails/Content Filters.
7. Enable Rate Limits for applications on the target endpoint.

   1. Specify the Endpoint Rate Limit. This value represents the maximum number of allowed requests per minute for the specified endpoint.
   2. Specify the Endpoint Rate Limit Error Code. This field represents the error code your system uses for rate limiting violations.
   3. Provide a Sample Exception JSON.
8. Enable Guardrails/Content Filters. These fields are used for output guardrails or content filters applicable on the target endpoint.

   1. Specify the Error code for Guardrails or Content Filters. This field represents the error code your system uses when a response is prevented by filters or safeguards.
   2. Provide a Sample Exception JSON.
9. Select Add Target.

   Once the target is created you can start a scan, or view previously created targets: