Projects:A robust ant detection and tracking in response to a plane tilt

From Collective Computational Unit
Jump to navigation Jump to search

Contents

Overview

The ability of swarms to form structures was shown to be present in small insects like ants. The Eciton army ant form collective structures from them itself to support the colony. This project aims to measure the activity of individuals on their tail to collect food through a plane with different adjustment of tilt to encourage the swarm to form a supporting structure which leads higher efficiency of the whole colony in transporting food.

The experiments were performed with a static plane sensed with a conventional camera under in the outdoor setting where the illumination is dynamically changing.


Contact

Aims

Track the individual ants and count their activity


Estimated level of difficulty

There are several challenges related to tracking individual ants:

  • The individuals are visually very similar
  • The individuals get spatially very close over time
  • The scenes are captured in the wild thus illumination is changing over time

The first two problems cause that the classical model based trackers cannot be used because= they are usually designed to objects which have at least slightly distinct colors. b

Suggested/tested approaches

The approach was unsuccessfully tested with the classical model based trackers (Boost, MIL, MedianFlow). The model-based trackers need at least one positive sample of the object in order to build a model to track. For the above-mentioned problems, the model-based trackers failed on this task.

The setting is, however, except lighting conditions, relatively static because other non-tracked parts remain fixed thus we can use the background subtraction which provides unreliable, but sufficiently accurate detections which can be passively tracked with the multi-object tracking approaches like [1,2]

Code

Results and Visualisations

 
Detections of a plane which is tilted by 20 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 20 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 20 degrees
 
Detections of a plane which is tilted by 30 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 30 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 30 degrees
 
Detections of a plane which is tilted by 40 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 40 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 40 degrees
 
Detections of a plane which is tilted by 50 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 50 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 50 degrees
 
Detections of a plane which is tilted by 60 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 60 degrees
 
Trajectories of ants of first 1000 frames of a plane which is tilted by 60 degrees
 
Detections of a plane which is tilted by 20 degrees