Step 3: Assign and Evaluate Training Batches

Instructions

  1. On the Home page, select Browse:

  2. In Facet View, select the initial training set that has been created. 

  3. Open this initial training set in the Document List.
  4. Copy the URL of the Document List and email it to the reviewer.
  5. When the reviewer is finished with reviewing, open the project in Assisted Review.
  6. Review the Statistics and Graphs in the Assisted Review Progress tab.
  7. Add a New Training Batch. The size of the new training batch is dependent on the number of available reviewers.
  8. On the Home page, select Browse.
  9. In Facet View, select the added Training Batch.
  10. Open the Training Batch in the Document List.
  11. Add the ranking field for the Training Batch.

  12. Sort on the ranking field with the highest ranking on top.

  13. Now, based on this sorting order, create Review Batches.

  14. Divide the sub-batches over all reviewers (add the Review Batches field to sort on the different sub-batches).

  15. Inform all reviewers which Review Batch to review.
  16. Repeat step 5 to 15 until all documents are reviewed.