Conga Product Documentation

Welcome to the new doc site. Some of your old bookmarks will no longer work. Please use the search bar to find your desired topic.

Show Page Sections

Annotations

Annotations are feedback left by reviewers as they review the document extractions. They consist of:

  • Thumbs-up/thumbs-down indications
  • Text selections from documents associated with a provision
  • Edits to text selections and extractions
The AI uses these types of information to train itself. For a given custom provision, you can include the annotations reviewers have made or delete them, removing them from AI training.
Note: Extractions using a prompt or key phrase are not used in continuous learning, but Discovery AI does store user feedback.
A thumbs-up sends the extraction to the AI model for training. Changes (add, update, or delete) made to an extraction without a thumbs-up are not used to train the AI, though this does not adversely affect the ongoing transaction. Thumbs-down indications are also used for training. Both thumbs-up and thumbs-down indications are recorded. If the extraction is annotated (an add or update) and you select the checkbox to the left, your annotation is saved to the agreement record even if you do not give thumbs-up feedback.
Note: Feedback for image-based extractions is currently saved. However, because feedback is user-annotated text and not an image, it does not improve the accuracy of future image-based extractions.

Reviewing Annotations

  1. From the left navigation bar of the Conga Start window, select the menu icon () and then pick Admin Apps.
  2. Click the AI icon () to open Discovery AI's administrative view.
  3. Click the Admin Dashboard button to raise the Discovery AI Admin Home page.
  4. From the Admin Dashboard (Admin Home), click the Provision Library tab in the left navigation bar to open the Provision Library.
  5. Click the name of an existing custom provision.
  6. Click the ANNOTATIONS tab. The default view shows columns for document name, the content of the annotation, the date of the review, and feedback (a thumbs-up or thumbs-down indication).
  7. Under the Feedback column, select the thumbs-up icon to include an annotation as suitable for training this provision, or select the thumbs-down icon to indicate a bad training example.

Exporting the Annotations Table

You can review the annotations table off-platform by exporting it the tabular comma-separated value format.
  1. Follow the instructions in To review annotations to the ANNOTATIONS tab.
  2. Click the EXPORT CSV button at top right.
This generates and exports a CSV listing of all visible annotation information, irrespective of the live selections.

Deleting Annotations

  1. Follow the instructions in Reviewing Annotations to the ANNOTATIONS tab.
  2. Select the document annotations you will remove.
  3. Click the Delete icon ().