Overall Provision Accuracy

This is a simple, bottom-line assessment of overall accuracy, assessed with the formula:

In its default state, this number represents all extractions, but it changes to indicate individual provision types (clause, field, obligation, or table), if they are selected in other charts or filtered.

Provision Usage Breakdown (for Reviewed Documents)

This table indicates the number of times each provision model type (clause, field, obligation, or table) has been used to extract data from documents. These are further divided into custom and out-of-the-box (OOTB) categories.

Accuracy By - Provisions Category

This graphic presents accuracy by provision model type: out-of-the-box vs. custom. This percentage is an expression of the nominal accuracy described in Overall Provision Accuracy.

Accuracy By - Provision Type

This bar chart offers a visualization of extractions by type (clause, field, obligation, or table)

Monthly Accuracy Trends

Three charts depict the accuracy of Discovery AI with respect to contract type (such as master service agreements, non-disclosures, etc.), provision model category (OOTB and custom), and provision model types (fields, clauses, obligations, and tables). Accuracy is calculated as described in Overall Provision Accuracy.

Custom and Out-of-the-Box Provision Lists

Two tables provide the raw data for all these charts, for both OOTB and custom provision models. Each table provides these data categories:

• Provision Name
• Provision Field ID
• Provision Type
• Data Type
• Description
• Language
• True Positive
• True Negative
• False Positive
• False Negative
• User Modified
• Correct Extractions
• Incorrect Extractions
• Total Extractions
• Accuracy

You can filter by date range, provision category, provision type, provision language, accuracy, and incorrect extractions. Filtering does not affect the monthly accuracy trend charts.

Total Documents Processed and Completed

The top two screen panels offer you simple, unambiguous, bottom-line performance metrics, identifying how many documents have been processed (i.e., ingested into the system) and how many of those documents have been completed (are out of processing and in the Complete state).

Documents Processed by Status and Record Type

This bar chart provides a view of all documents in the system and their current status, categorized by record type (e.g., master service agreement, purchase order, etc.) Hovering over any bar pops up a numeric breakdown of document statuses for that document type. Clicking any of the bar segments or record type legends toggles the availability of that status in the visualization, adding that document status as a cross-filter to the standard filter. You can also select all or invert your selection.

Accuracy by Record Type and Average Review Times

These two charts are dynamically plotted based on the document data as filtered. Record types are such categories as MSA, SOW, purchase order, and the like. The average review time is also plotted by these document types.

Document List

You can filter by Reviewed On, Contract Type, Document Status, Uploaded By, Worksheet, Reviewed By, Approved By, and Number of Extractions. Filtering affects all charts on this page. You can export all report and chart elements as data or graphics.