Skip to main content
All CollectionsMonitoring
Enable AI Summaries for Tests
Enable AI Summaries for Tests

Enable AI-powered summaries to quickly generate explanations for test failures in Adaptive Automation, streamlining issue resolution.

Updated over 2 months ago

Use our AI-powered feature to quickly generate summaries for test failures in Adaptive Automation tests. When a test fails, Drata's AI provides an explanation directly in the test drawer, eliminating the need to switch screens. You can also download a CSV with detailed failure reasons and resource IDs, streamlining issue resolution.

Prerequisites

Only Admins can enable AI summaries. If you are not an admin, you cannot enable or disable AI in Drata. If an admin did not enable AI, you will not have AI enabled in Drata.

Enable or disable AI

Admins can enable AI summarization through the Company settings page.

  1. Go to your Settings page. Under Company Settings, select AI Settings.

  2. Select the AI option and save your choice.

To disable AI, de-select Enable AI option and save your choice. If you disable AI, your AI summaries will be hidden and no additional AI summaries will be generated.

View test failure details

You can view test details such Provider name, Account Alias or ID, and test status (Failing or Passing) within the Last test result section. To view these details:

  1. Navigate to the Monitoring page and select a failed Drata test.

  2. In the test detail drawer, scroll to the Last test result section to access the following information for each account

    • Provider name

    • Account Alias/ID

    • Status (such as Failing or Passing)

    • View event link

  3. Select the View event link and you will be redirected to the Audit event for that particular account where you can view the test info and the raw test evidence.

Generate an AI summary of your test failure

Note: AI summaries for test failures are only available for tests built on Adaptive Automation. At the moment, this would only apply to custom tests in your account.

  1. Navigate to the Monitoring page and select the desired failing custom test.

  2. Within the test detail drawer, scroll down to the Last test result section. Select the Generate Summary button below the table.

  3. Drata AI will use the test logic configured and for each resource across all accounts that failed, it will generate an explanation. If the number of resources that failed for the test is large, generating an AI summary can take some time

  4. Once Drata AI completes the summary, select the download icon to download a CSV with the following information for each failed resource.

    • Provider Name

    • Account Alias/ID

    • Resource Name

    • Resource ID

    • AI summary

View AI summary for each account

You can also view the AI summary for each specific account.

  1. Navigate to the Monitoring page and select the desired failing test.

  2. Within the test detail drawer, scroll down to the Last test result section and select View event link.

  3. You will be redirected to the Audit event for that account test failure. Select Raw test evidence section to view the AI generated Summary of test failures. It contains the following info:

    • Resource name (Buckets for example)

    • Cause: A short summary for the reason those resources are failing

    • Failed Resource: Shows the number of resources that failed for this reason.

    • Summary of the reason those resources failed.

  4. Select the copy icon at the top right of the AI summary to copy all of the text to your clipboard. You’re also able to generate a csv for this particular account with the same info as above.

Note: Given the density and volume of information, the AI may fail to extract certain information. We have thoroughly tested this to minimize the chance of this happening as much as possible, but please make sure to always review AI outputs when making security and compliance decisions.

Did this answer your question?