{"product_id":"ieej-20250228c00701-010","title":"Leveraging Computer Vision and LLM for Smart Railway Fastener Defect Detection and Management","description":"\u003cp\u003e\u003cstrong\u003eカテゴリ: \u003c\/strong\u003e研究会(論文単位)\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e論文No: \u003c\/strong\u003eCMN25030\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eグループ名: \u003c\/strong\u003e【C】電子・情報・システム部門 通信研究会\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e発行日: \u003c\/strong\u003e2025\/02\/28\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eタイトル(英語): \u003c\/strong\u003eLeveraging Computer Vision and LLM for Smart Railway Fastener Defect Detection and Management\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e著者名: \u003c\/strong\u003eBiswas Soumen(Hitachi India Pvt. Ltd.),Mitra Abhsihek(Hitachi India Pvt. Ltd.),Ganesh Ananth(Hitachi India Pvt. Ltd.),Chankravortty Nilanjan(Hitachi India Pvt. Ltd.)\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e著者名(英語): \u003c\/strong\u003eSoumen Biswas(Hitachi India Pvt. Ltd.),Abhsihek Mitra(Hitachi India Pvt. Ltd.),Ananth Ganesh(Hitachi India Pvt. Ltd.),Nilanjan Chankravortty(Hitachi India Pvt. Ltd.)\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eキーワード: \u003c\/strong\u003eRailway Fastener|Defect Detection|Object Detection|Computer Vision Application|Large Language Model|Railway Fastener|Defect Detection|Object Detection|Computer Vision Application|Large Language Model\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e要約(日本語): \u003c\/strong\u003eThe identification and systematic documentation of various defects in railway track fasteners are critical concerns, as these defects pose significant safety risks and could potentially lead to rail accidents if not promptly addressed. The present paper i\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e要約(英語): \u003c\/strong\u003eThe identification and systematic documentation of various defects in railway track fasteners are critical concerns, as these defects pose significant safety risks and could potentially lead to rail accidents if not promptly addressed. The present paper introduces a methodology that facilitate user interaction and expedite data analysis to detect the railway fastener defects accurately with cutting-edge Vision-LLM powered chatbot. The proposed methodology incorporates several key components: 1) a geotagging camera mounted on a train inspection vehicle, 2) a YOLO-based model for accurate identification of fastener defects, and 3) a chatbot system for facilitating user interaction. A geotagging camera installed on a train inspection vehicle captures image frames of railway track fasteners, which are then analysed for defects. A YOLO-based object detection model is employed to accurately identify various types of track defects in these frames, creating a comprehensive database that includes fastener defects information, their confidence score to measure criticalness of the defects and their precise GPS locations . To enhance accessibility and understanding of the defects within this database, a large language model (LLM)-powered chatbot is integrated. This chatbot allows users to query the database and receive relevant, detailed responses in a clear and conversational manner, simplifying the process of defect visualization and information retrieval. The proposed solution demonstrates improved accuracy in detecting fastener defects, while also providing a smart method for retrieving detailed information about the detected defects. This assists the track maintenance team in prioritizing high-risk defects that may require immediate attention.\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e本誌: \u003c\/strong\u003e\u003ca href=\"\/products\/ieej-20250228c00701\"\u003e2025年3月3日-2025年3月4日通信研究会\u003c\/a\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e本誌掲載ページ: \u003c\/strong\u003e47-51 p\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e原稿種別: \u003c\/strong\u003e英語\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003ePDFファイルサイズ: \u003c\/strong\u003e2,055 Kバイト\u003c\/p\u003e","brand":"IEEJ-P10","offers":[{"title":"冊子印刷（一般価格660円\/会員価格440円） \/ A4 \/ 5","offer_id":46408137081071,"sku":"IEEJ-20250228C00701-010-PRT","price":660.0,"currency_code":"JPY","in_stock":true},{"title":"PDFダウンロード（一般価格330円\/会員価格220円） \/ A4 \/ 5","offer_id":46408572403951,"sku":"IEEJ-20250228C00701-010-PDF","price":330.0,"currency_code":"JPY","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0718\/9512\/2159\/files\/IEEJ-KENKYUKAI_6ab38973-f042-4f45-b064-f0f3218e8ea7.png?v=1745232973","url":"https:\/\/ieej.bookpark.ne.jp\/products\/ieej-20250228c00701-010","provider":"電気学会 電子図書館","version":"1.0","type":"link"}