Skip to content

Latest commit

 

History

History
343 lines (223 loc) · 11.4 KB

Sango2024_ImageAnnotation_Training.md

File metadata and controls

343 lines (223 loc) · 11.4 KB

Guide to annotating images in DetWeb

Introduction

Sango is a 60 000 ha property located within the Save Valley Conservancy (SVC) in the south-east lowveld of Zimbabwe. Since 1998 Sango has used a Cessna 206 to conduct a total wildlife count following the traditional Rear Seat Observer (RSO) method. However, photocounts are proving to be a safer, more cost effective, and possibly more accurate method of counting animals. Sango thus aims to replace its traditional RSO count with a photo count.

In September 2024 Sango conducted a photo count alongside their RSO count. The objective of this document is to provide training for the manual annotation of wildlife and reviewing automated detections of wildlife within these images. Roughly ~16 000 images were captured during the survey.

Notes

  • Please report any issues and post photos of unidentifiable animals and unkown objects on the detweb-dev chat on slack
  • Alternatively you can contact Brandon at [email protected]
  • If an image is not loading for whatever reason do not move to the next image. Instead refresh the page and a new image should appear. By clicking next on the image you are essentially telling the system that image has been checked, when if fact it has not. When you refresh that image will be put back into the queue.
  • All progress and user stats are automatically tracked in debtweb. Users with admin rights have access to these stats.
  • NB! Each blue box is called a job. You are allowed to annotate outside of the blue box. However, there is no need to spend a lot of time looking outside the box as theres areas will appear in another job. For example, if you come across a big elephant herd it is worth zooming out and annotating the entire herd even if some individuals are far outside of the box. Just dont go looking far outside the box as you will be waisting time!
  • You do not need to worry about saving, detweb saves and tracks your progress automatically.
  • Jobs are in a random sequence so you will get images that may look like very different places directly after the other.
  • If an update is pushed while you are working it is important to refresh the page so that you are working on the latest version.
  • Learn the hot keys, it will allow you to annotate much faster. Use the arrow keys to move to the next image. Hover over the legend marker in the bottom right corner to see all the categories and their hotkeys.
  • You can click on a category in the legend to make that your default for mouse click annotations.

Getting started

Create account

Follow the link below to create an account on the DetWeb test site.

Create account on DetWeb

Full in your details. For 'Username' Please use your Name and Surname seperated by an underscore e.g., Name_Surname. Click create account.

Create account

Copy the verification code emailed to the address you used to create the acccount.

Email code

You should now see the page below. If not follow the 'Create account on DetWeb' link above and sign in.

Login page

Contact your lab manager or other point of contact requesting permssion to start annoting images! You can also use the detweb-dev chat on slack to request permission to start annotating images.

Where to annotate?

Each image is divided into jobs. The jobs will be demarcated by a blue annotation box. Annotations should be made in the blue box only. If you see an animal outside of the blue box you can annotate it but do not spend time and effort looking outside the blue box as these areas will come up again in another job.

Annotation box

How to annotate?

Video tutorial for manual image annotation

Video tutorial for manually revieiwing automated annotations

LEFT CLICK on the center of the animals body. Do not left click next to or on top of the animal. Alternatively, it is recommened that you use the short cut keys as it is much faster. Simply hover your mouse over the animal and press the shortcut key.

An icon will appear.

To choose a different species RIGHT CLICK on the icon. A list of options will appear. LEFT CLICK on your chosen option. The colour of the icon should change to the colour which has been associated to that annotation. If you hover your curser over the icon a text box will appear confiriming your choice.

To delete an annotation LEFT CLICK and the delete option should appear at the top of the list.

Image annotation

Once you have annotated everything within the blue box you can skip to the next image using the right arrow key. You can use the left arrow key to go back to the previous image if you need to.

What to annotate

Below is a list of annotation choices

What to annotate

and a list of shortcut keys.

Shortcut keys

Notes

Annotate as unkown when you think it may be an animal but not sure.

Annotate as unidentifiable animal when you can identify that it is an animal but you are unsure of the species.

Annotate as point of interest for anything man made e.g., vehicle, building, person, pipeline, ect.


Training images

Tips and tricks

If you are struggling to identify a species due to image quality look at the animals shadow. The horns are often clearly visible in the shadow and can be used to help identify the species.

Look at colours, you will start to recognise colour palletes for each species. Even when image quality is low you may be able identify the animal based on the colour of the pixels

Dont forget to look under trees! The oblique nature of the images allows you to view animals under trees. These areas are often over looked because of the shadow caste by the tree.

Scan from left to right - opposite to reading. It helps to keep focus and prevents 'zoning out'. Although this is just a suggestion, find what works for you.

If you have any of your own tips or techniques please share them on the detweb-dev chat on slack!

Impala

Impala can be really difficult to identify. A few tricks are to look at size and colour. Impala are a rich redish orange or coppery tan with a white underside which is sometimes visiable in images and males have cureved horns. They can easily be confused with eland which are a warm tan or light brown with undertones of grey, however, eland are much larger and have straight horns. Impala are usually in herds and seldom on their own, if you find one be sure to look out for more. Remember to look at shadows, male impalas have distintive horns that make a unique shadow while females can be distiguishable by the shadow their ears make.

Impala training image

Impala training image

Impala training image

Impala training image

Impala training image

Impala training image



Giraffe

Giraffe training image

Giraffe training image

Giraffe training image



Buffalo

Buffalo training image

Buffalo training image



Elephant

Elephant training image

Elephant training image

Elephant training image

Elephant training image



Kudu

The Kudu is generally light brown or grayish-brown. They have large ears which can often be seen in images, sometimes creating a distintive shadow.

Kudu training image

Kudu training image



Jackal

Both the black backed and side striped jackal occur on Sango, however, the former is more common.

Jackal training image



Baobab

Baobab training image

Baobab training image

Baobab training image

Baobab training image



Blue wildebeest

The blue wildebeest is a grayish-blue or slate-gray color. Its body is often marked with darker vertical stripes, giving it a brindled appearance. They have muscular body with a distinctive, sloped back that gives it a unique profile.

Blue wildebeest training image



This wildebeest is really difficult to identify, however, he was a part of a larger herd captured in the image. So based on the colouration alone it can be confirmed this is wildebeest.

Blue wildebeest training image



Lion

Lion training image



Eland

The eland are a tan or light brown colour, often with a slight reddish tint. They also have characteristic series of thin white stripes running vertically along their sides. Eland have a muscular body, supported by long, slender legs. They have a slight hump over the shoulders and a short thick neck. Both male and female have straight, spiraling horns.

Eland training image

Eland training image

Eland training image



Unidentifiable animal

If you are not able to identify which species of animal it is use unidentifiable animal. Sometimes the quality of the image is not good enough or the animal is partially obstructed a tree.

Unidentifiable animal training image

Unidentifiable animal training image

Unidentifiable animal training image

Unidentifiable animal training image



Zebra

Zebra are known for their destinctive black and white stripes. They have a compact, sturdy body with a barrel-shaped torso.

Zebra training image

Zebra training image



Waterpoint

Waterpoint training image

Waterpoint training image



Rhino

Rhino training image