| 融合通道剪枝与ByteTrack的轻量化金枪鱼渔获数量实时检测 |
| |
| 引用本文： | 刘雨青,李杰,宋利明,魏星,陈明,隋恒寿,李彬,李同.融合通道剪枝与ByteTrack的轻量化金枪鱼渔获数量实时检测[J].上海海洋大学学报,2023,32(5):1080-1089. |
| |
| 作者姓名： | 刘雨青 李杰 宋利明 魏星 陈明 隋恒寿 李彬 李同 |
| |
| 作者单位： | 上海海洋大学 工程学院,上海海洋大学 工程学院,上海海洋大学 海洋科学学院,上海海洋大学 工程学院,上海海洋大学 工程学院,中水集团远洋股份有限公司,中水集团远洋股份有限公司,中水集团远洋股份有限公司 |
| |
| 基金项目： | 国家自然基金项目（32273185）；中水集团远洋股份有限公司技术研发项目（D-8006-20-0180） |
| |
| 摘 要： | 自动准确收集渔业捕捞数据是电子观察员系统的重要组成部分，然而，由于工作环境的复杂性和跟踪的不稳定性，金枪鱼延绳钓渔获数量自动估计在实践部署中仍存在挑战。本研究设计了一个轻量级计数网络对渔船上的实时视频数据进行自动处理，实现对金枪鱼渔获物的实时跟踪和计数。本研究选择YOLOv5s作为基准网络，首先采用通道剪枝算法对YOLOv5s的主干网络进行修剪，结果表明，剪枝后的模型检测精度mAP0.5-0.95达到68.8%，CPU下检测速度为16.5帧/秒（FPS），与原始模型相比，检测效果基本不变，模型的参数量、模型大小和计算量分别减少了67.2%、66.4%和42.5%，检测速度提高了32.5%。其次，利用ByteTrack算法实现了多目标的实时跟踪，优化了计数区域形状，解决了被跟踪金枪鱼身份（ID）跳变导致的计数偏差问题，10个视频的测试结果表明，该方法的平均计数准确率为80%，视频处理速度为50.7帧/秒，满足工业级实时检测要求。综上，该模型具有轻量化、高精度、实时性等优点，可在复杂的工作环境下完成对延绳钓捕捞结果的实时监控，为实现渔业自动化提供思路。
|
| 关 键 词： | 金枪鱼数量 通道剪枝 ByteTrack 实时检测 YOLOv5 多目标追踪 |
| 收稿时间： | 2023/6/15 0:00:00 |
| 修稿时间： | 2023/8/7 0:00:00 |
Tuna catch real-time detection by fusing channel pruning with ByteTrack lightweight network |
| |
| LIU Yuqing,LI Jie,SONG Liming,WEI Xing,CHEN Ming,SUI Hengshou,LI Bin,LI Tong.Tuna catch real-time detection by fusing channel pruning with ByteTrack lightweight network[J].Journal of Shanghai Ocean University,2023,32(5):1080-1089. |
| |
| Authors: | LIU Yuqing LI Jie SONG Liming WEI Xing CHEN Ming SUI Hengshou LI Bin LI Tong |
| |
| Institution: | College of Engineering Science and Technology,Shanghai Ocean University,College of Engineering Science and Technology,Shanghai Ocean University,College of Marine Sciences,Shanghai Ocean University,College of Engineering Science and Technology,Shanghai Ocean University,College of Engineering Science and Technology,Shanghai Ocean University,CNFC Overseas Fisheries Co., LTD.,CNFC Overseas Fisheries Co., LTD.,CNFC Overseas Fisheries Co., LTD. |
| |
| Abstract: | Automatic and accurate collection of fishery catch data is an important part of the electronic observer system. However, automated tuna longline catch estimation remains challenging to deploy in practice due to the complexity of the working environment and the instability of tracking. In this study, a lightweight counting network was designed to automate the processing of real-time video data from fishing vessels in order to enable real-time tracking and counting of tuna catches on board fishing vessels. YOLOv5s was selected as the benchmark network in this study. The channel pruning algorithm was first used to prune the backbone network of YOLOv5s, and the results showed that the detection accuracy of the pruned model mAP0.5-0.95 reached 68.8%, and the detection speed was 16.5 frames per second (FPS) under CPU, which was basically unchanged compared with the original model. The number of parameters, model size and computation of the model awere reduced by 67.2%, 66.4% and 42.5% respectively, and the detection speed was increased by 32.5%. Secondly, the ByteTrack algorithm was used to achieve real-time tracking of multiple targets, optimize the shape of the counting area and solve the problem of counting deviation caused by the jump in the identity (ID) of the tuna being tracked. The test results of 10 videos showed that the average counting accuracy of the method was 80% and the video processing speed was 50.7 fps, which meets the requirements of industrial-grade real-time detection. In summary, the model had the advantages of light weight, high accuracy and real-time, which could complete the real-time monitoring of longline catch in complex working environments and provide a solution for realizing fisheries automation. |
| |
| Keywords: | Tuna individuals channel pruning ByteTrack real-time detection YOLOv5 multi-target tracking |
|
| 点击此处可从《上海海洋大学学报》浏览原始摘要信息 |
| 点击此处可从《上海海洋大学学报》下载免费的PDF全文 |
|
