Managing Annotations

Annotations are feedback left by reviewers as they review the document extractions. They consist of:

Thumbs-up/thumbs-down indications
Text selections from documents associated with a provision
Edits to text selections and extractions

The AI uses all these types of information to train itself. For a given custom provision, you can include the annotations reviewers have made or delete them, removing them from AI training.

A thumbs-up or thumbs-down sends the extraction to the AI model for training, and user feedback is only valid if either a thumbs-up or thumbs-down is selected. If neither is selected, changes (add, update, or delete) made to an extraction are not sent to the AI for training. If the extraction is annotated (an add or update) and you select the checkbox to the left, your annotation is saved to the agreement record even if you do not select thumbs-up or thumbs-down feedback.

To review annotations

From the left navigation bar of the Conga Start window, select the menu icon () and then pick Admin Apps.
Click the AI icon () to open Discovery AI's administrative view.
Click the Admin Dashboard button to raise the Discovery AI Admin Home page.
From the Admin Dashboard (Admin Home), click the Provision Library tab in the left navigation bar to open the Provision Library.
Click the name of an existing custom provision.
Click the ANNOTATIONS tab. The default view shows columns for document name, the content of the annotation, the date of the review, and feedback (a thumbs-up or thumbs-down indication).
Under the Feedback column, select the thumbs-up icon to include an annotation as suitable for training this provision, or select the thumbs-down icon to indicate a bad training example.