Method for segmentation of overlapping fish images in aquaculture

Authors

  • Chao Zhou 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China;
  • Kai Lin Beijing Fisheries Research Institute, Beijing, 100068, China
  • Daming Xu 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China;
  • Jintao Liu 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China; 4. Department of Computer Science, University of Almeria, Almeria, 04120, Spain
  • Song Zhang 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China;
  • Chuanheng Sun 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China;
  • Xinting Yang 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China;

Keywords:

aquaculture, image processing, overlapping segmentation, corner detection, improved Zhang-Suen algorithm

Abstract

Individual fish segmentation is a prerequisite for feature extraction and object identification in any machine vision system. In this paper, a method for segmentation of overlapping fish images in aquaculture was proposed. First, the shape factor was used to determine whether an overlap exists in the picture. Then, the corner points were extracted using the curvature scale space algorithm, and the skeleton obtained by the improved Zhang-Suen thinning algorithm. Finally, intersecting points were obtained, and the overlapped region was segmented. The results show that the average error rate and average segmentation efficiency of this method was 10% and 90%, respectively. Compared with the traditional watershed method, the separation point is accurate, and the segmentation accuracy is high. Thus, the proposed method achieves better performance in segmentation accuracy and effectiveness. This method can be applied to multi-target segmentation and fish behavior analysis systems, and it can effectively improve recognition precision. Keywords: aquaculture, image processing, overlapping segmentation, corner detection, improved Zhang-Suen algorithm DOI: 10.25165/j.ijabe.20191206.3217 Citation: Zhou C, Lin K, Xu D M, Liu J T, Zhang S, Sun C H, et al. Method for segmentation of overlapping fish images in aquaculture. Int J Agric & Biol Eng, 2019; 12(6): 135–142.

Author Biography

Chao Zhou, 1. Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China; 2. National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China, 3. National Engineering Laboratory for Agri-product Quality Traceability, Beijing, 100097, China;

Dr. Chao Zhou is an assistant researcher of National Engineering Research Center for Information Technology in Agriculture, Beijing, China, and he is also working for his Ph.D in School of Automation, Beijing Institute of Technology. His main research interests are in the areas of the application of Information Technology in aquaculture, such as computer vision, control theory and control engineering.

References

[1] Zhou C, Xu D, Chen L, Zhang S, Sun C, Yang X, et al. Evaluation of fish feeding intensity in aquaculture using a convolutional neural network and machine vision. Aquaculture, 2019; 507: 457–465.
[2] Mao Y R, He D J, Song H B. Automatic detection of ruminant cows' mouth area during rumination based on machine vision and video analysis technology. International Journal of Agricultural and Biological Engineering, 2019; 12(1): 186–191.
[3] Costa C, Febbi P, Pallottino F, Cecchini M, Figorilli S, Antonucci F, et al. Stereovision system for estimating tractors and agricultural machines transit area under orchards canopy. International Journal of Agricultural and Biological Engineering, 2019; 12(1): 1–5.
[4] Zhou C, Sun C, Lin K, Xu D, Guo Q, Chen L, et al. Handling Water Reflections for Computer Vision in Aquaculture. Transactions of the ASABE, 2018; 61(2): 469–479.
[5] Zhou C, Yang X, Zhang B, Lin K, Xu D, Guo Q, et al. An adaptive image enhancement method for a recirculating aquaculture system. Scientific Reports, 2017; 7(1): 6243.
[6] Atienza-Vanacloig V, Andreu-García G, López-García F, Valiente-González JM, Puig-Pons V. Vision-based discrimination of tuna individuals in grow-out cages through a fish bending model. Computers and Electronics in Agriculture, 2016; 130: 142–150.
[7] Lin K, Zhou C, Xu D M, Guo Q, Yang X T, Sun C H. Three-dimensional location of target fish by monocular infrared imaging sensor based on a L–z correlation model. Infrared Physics & Technology, 2018; 88: 106–113.
[8] Costa C, Loy A, Cataudella S, Davis D, Scardi M. Extracting fish size using dual underwater cameras. Aquacultural Engineering, 2006; 35(3): 218–227.
[9] Li D L, Hao Y F, Duan Y Q. Nonintrusive methods for biomass estimation in aquaculture with emphasis on fish: a review. Reviews in Aquaculture, 2019; https://doi.org/10.1111/raq.12388
[10] Cha B J, Bae B S, Cho S K, Oh J K. A simple method to quantify fish behavior by forming time-lapse images. Aquacultural Engineering, 2012; 51: 15–20.
[11] Saberioon M M, Cisar P. Automated multiple fish tracking in three-dimension using a structured light sensor. Computers and Electronics in Agriculture, 2016; 121: 215–221.
[12] Zhao J, Gu Z, Shi M, Lu H, Li J, Shen M, et al. Spatial behavioral characteristics and statistics-based kinetic energy modeling in special behaviors detection of a shoal of fish in a recirculating aquaculture system. Computers and Electronics in Agriculture, 2016; 127: 271–280.
[13] Zhou C, Xu D, Lin K, Sun C, Yang X. Intelligent feeding control methods in aquaculture with an emphasis on fish: a review. Reviews in Aquaculture, 2018; 10(4): 975–993.
[14] Zion B. The use of computer vision technologies in aquaculture – A review. Computers and Electronics in Agriculture, 2012; 88: 125–132.
[15] Les T, Markiewicz T, Osowski S, Jesiotr M. Automatic reconstruction of overlapped cells in breast cancer FISH images. Expert Systems with Applications, 2019; 137: 335–342.
[16] Wan T, Xu S S, Sang C, Jin Y L, Qin Z C. Accurate segmentation of overlapping cells in cervical cytology with deep convolutional neural networks. Neurocomputing, 2019; 365: 157–170.
[17] Ye H J, Liu C Q, Niu P Y. Cucumber appearance quality detection under complex background based on image processing. International Journal of Agricultural and Biological Engineering, 2018; 11(4): 193–199.
[18] Hamuda E, Mc Ginley B, Glavin M, Jones E. Automatic crop detection under field conditions using the HSV colour space and morphological operations. Computers and Electronics in Agriculture, 2017; 133: 97–107.
[19] Yang W, Wang S, Zhao X, Zhang J, Feng J. Greenness identification based on HSV decision tree. Information Processing in Agriculture, 2015; 2(3): 149–160.
[20] Tan S, Ma X, Mai Z, Qi L, Wang Y. Segmentation and counting algorithm for touching hybrid rice grains. Computers and Electronics in Agriculture, 2019; 162: 493–504.
[21] Wang Z, Wang K, Yang F, Pan S, Han Y. Image segmentation of overlapping leaves based on Chan–Vese model and Sobel operator. Information Processing in Agriculture, 2018; 5(1): 1–10.
[22] Tripathi M K, Maktedar D D. A role of computer vision in fruits and vegetables among various horticulture products of agriculture fields: A survey. Information Processing in Agriculture, 2019.
[23] Li J B, Zhang R Y, Li J B, Wang Z L, Zhang H L, Zhan B S, et al. Detection of early decayed oranges based on multispectral principal component image combining both bi-dimensional empirical mode decomposition and watershed segmentation method. Postharvest Biology and Technology, 2019; 158: 11.
[24] El-Faki M S, Song Y Q, Zhang N Q, El-Shafie H A, Xin P. Automated detection of parasitized Cadra cautella eggs by Trichogramma bourarachae using machine vision. Int J Agric & Biol Eng, 2018; 11(3): 94–101.
[25] Holmgren J, Lindberg E. Tree crown segmentation based on a tree crown density model derived from Airborne Laser Scanning. Remote Sensing Letters, 2019; 10(12): 1143–1152.
[26] Chen L, Yang X, Sun C, Wang Y, Xu D, Zhou C. Feed intake prediction model for group fish using the MEA-BP neural network in intensive aquaculture. Information Processing in Agriculture, 2019. (in press).
[27] Zhou C, Zhang B, Lin K, Xu D, Chen C, Yang X, et al. Near-infrared imaging to quantify the feeding behavior of fish in aquaculture. Computers and Electronics in Agriculture, 2017; 135: 233–241.
[28] Liu Z, Li X, Fan L, Lu H, Liu L, Liu Y. Measuring feeding activity of fish in RAS using computer vision. Aquacultural Engineering, 2014; 60: 20–27.
[29] Pautsina A, Císař P, Štys D, Terjesen B F, Espmark Å M O. Infrared reflection system for indoor 3D tracking of fish. Aquacultural Engineering, 2015; 69: 7–17.
[30] Moreda G P, Muñoz M A, Ruiz-Altisent M, Perdigones A. Shape determination of horticultural produce using two-dimensional computer vision – A review. Journal of Food Engineering, 2012; 108(2): 245–261.
[31] Zhang Q, Shaojie Chen M E, Li B. A visual navigation algorithm for paddy field weeding robot based on image understanding. Computers and Electronics in Agriculture, 2017; 143: 66–78.
[32] Lin X Y, Zhu C, Liu Y P, Zhang Q. Robust corner detection using altitude to chord ratio accumulation. Multimedia Tools and Applications, 2019; 78(1): 177–195.
[33] Gu X D, Yu D H, Zhang L M. Image thinning using pulse coupled neural network. Pattern Recognition Letters, 2004; 25(9): 1075–1084.
[34] Liu Z, Cheng F, Zhang W. A novel segmentation algorithm for clustered flexional agricultural products based on image analysis. Computers and Electronics in Agriculture, 2016; 126: 44–54.

Downloads

Published

2019-12-04

How to Cite

Zhou, C., Lin, K., Xu, D., Liu, J., Zhang, S., Sun, C., & Yang, X. (2019). Method for segmentation of overlapping fish images in aquaculture. International Journal of Agricultural and Biological Engineering, 12(6), 135–142. Retrieved from https://ijabe.migration.pkpps03.publicknowledgeproject.org/index.php/ijabe/article/view/3217

Issue

Vol. 12 No. 6 (2019): IJABE

Section

Information Technology, Sensors and Control Systems

License

IJABE is an international peer reviewed open access journal, adopting Creative Commons Copyright Notices as follows.


Authors who publish with this journal agree to the following terms:


  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).