Difference between revisions of "Projects:Fish heart and breath rate sensing"

From Collective Computational Unit
Jump to navigation Jump to search
(Created page with "== Overview == == Contact == * [https://www.cvia.uni-konstanz.de/members/prof-dr-bastian-goldluecke/ Prof. Dr. Bastian Goldluecke] * [http://collectivebehaviour.com/jorda...")
 
Line 1: Line 1:
−
== Overview ==
 
−
 
−
 
 
== Contact ==
 
== Contact ==
  
Line 11: Line 8:
 
== Aims ==
 
== Aims ==
  
−
The aim of the project is to calculate the frequency of hearth and breath rate of a fish.  
+
This project introduces the quantitative methods in computer vision which may be useful and interesting for biologists. The course has two main goals. The first is to show the state-of-the-art computer vision techniques which may be potentially useful for various tasks addressed by biologists. And the second goal is to show the practical code snippets which are developed with respect to simplicity and ease of use for non-programmers.
  
 
== Provided data ==
 
== Provided data ==
  
−
== Suggested/tested approaches ==
+
* [http://sulc.one/QFB2018.pdf Presentation]
−
 
+
* [http://sulc.one/QFB2018.zip Code]
−
The pipeline consists of multiple steps where each step has a drastic influence on the resulting quality. The stage consist of a single fish or each fish can be tracked individually and independently on other fishes present in the scene. From the tracking stage, we have a bounding box. The image within the bounding box is then fed to a minimalistic encoder-decoded network where the latent space is used to detect different stages of the fish (either hearth or beat rate).
 
−
 
 
−
The architecture of the network is very minimalistic due extremely small training dataset (3x3 consecutive convolutions, the image is rescaled to 64x64 pixels with three channels) which on average consist of no more than 2000 frames. The overfitting is prevented by using a very short training stage (100 iterations is incomparably less than what is usually used). The bounding boxed from different videos cannot be used because of the setting (fishes, scene) or alignment is different for each video.
 
−
 
 
−
Latent space usually consists of multiple dimensions, some of them are redundant, but we calculate the average of the entire latent space for each frame. The absolute value provides us a rough clue of at which stage the fish is.
 

Revision as of 09:41, 17 May 2019

Contact

Aims

This project introduces the quantitative methods in computer vision which may be useful and interesting for biologists. The course has two main goals. The first is to show the state-of-the-art computer vision techniques which may be potentially useful for various tasks addressed by biologists. And the second goal is to show the practical code snippets which are developed with respect to simplicity and ease of use for non-programmers.

Provided data

Retrieved from "https://ccu.uni-konstanz.de:443/w/index.php?title=Projects:Fish_heart_and_breath_rate_sensing&oldid=172"