To review a quality, simply adjust the slider for the image based on the following guidelines:

The "information" (keypoints) in the image that we want to classify

• When deciding the quality of an image, it is important to keep in mind what information the underlying image analysis algorithms care about. Looking at the image above, the white ellipsis on the body of the animal indicate what informaiton is the most important, whereas the red and orange ellipsis indicate information that is less important.
• The quality of the annotation is decided by 4 metrics (by order of importance):
  • Partially Visible - the entire animal is not visible due to visual obstruction by non-landscape objects (other animals, cars, buildings, the animal is off the side of the image, etc.)
  • Occlusion - the entire animal is not visible due to visual obstruction by natural landscape (brush, trees, grass, etc.)
  • Focus - the image of the animal is out of focus
  • Lighting and Shadow - the animal is under- or over-exposed, shadowed by another object, or its own pose is causing shadows on its body
• The way you measure the image's quality will change for each viewpoint. If the viewpoint would not normally allow for one of the metrics above (e.g. a frontal image of a Plains Zebra would not normally give a view of the rump) then that metric can be ignored. Judge the image on what an "ideal" image of that species given the viewpoint the animal is in.
  For example:


Junk


• Severe occlusion
• Little to no parts visible
• Out of focus
• Lots of shadow






Poor


• Severe occlusion
• Head, shoulder, OR rump visible
• Mildly out of focus
• Lots of shadow






OK


• Little occlusion
• Head, shoulder, AND rump visible
• In focus
• Moderate shadow






Good
• Little occlusion
• Entire animal visible
• In focus
• Little shadow






Excellent
• No occlusion
• Entire animal visible
• In focus
• No shadow




• For faster quality annotation, the number keys or a keypad can be used. The numbers 1 thru 5 are mapped to their corresponding star ratings. We urge every reviewer to use the number pad to input the quality for speed purposes.
• If the quality cannot be determined due to not enough information (e.g., the animal is no animal in the image, the image is too blurry or there isn't enough light, there is only a small chunk of an animal in the image - like a leg or a piece of the head), you have two choices:
  1. edit the annotation by revisiting the image (link below the image)
  2. simply press the Delete button
• The Space key deletes the image and does not save any quality information for that image. The Enter key submits the current value of the slider as the image's quality.
• Enter qualities as fast as you can while maintaining perfect accuracy.
• To bring up these instructions again, click on the button