{"product_id":"ieej-20241202c00801-007","title":"Evaluating Large Language Model Generated Knowledge Graphs through Intermediate Artifact Analysis","description":"\u003cp\u003e\u003cstrong\u003eカテゴリ: \u003c\/strong\u003e研究会(論文単位)\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e論文No: \u003c\/strong\u003eIS24034\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eグループ名: \u003c\/strong\u003e【C】電子・情報・システム部門 情報システム研究会\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e発行日: \u003c\/strong\u003e2024\/12\/02\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eタイトル(英語): \u003c\/strong\u003eEvaluating Large Language Model Generated Knowledge Graphs through Intermediate Artifact Analysis\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e著者名: \u003c\/strong\u003e高 子豪(神奈川大学),秋吉 政徳(神奈川大学)\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e著者名(英語): \u003c\/strong\u003eZihao Gao(Kanagawa University),Masanori Akiyoshi(Kanagawa University)\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eキーワード: \u003c\/strong\u003e知識グラフ|大規模言語モデル|Knowledge Graph|Large Language Model\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e要約(日本語): \u003c\/strong\u003eThis research proposes a novel metric to evaluate the global quality of knowledge graphs generated by Large Language Models. Using The Tale of the Heike as topic for KG generation, we demonstrate how intermediate artifacts can be extracted from the complete KG using queries designed according to the schema, and we use this sub-graph to compare with a historical record (family tree) for refinement and evaluation in terms of local KG quality.\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e要約(英語): \u003c\/strong\u003eThis research proposes a novel metric to evaluate the global quality of knowledge graphs generated by Large Language Models. Using The Tale of the Heike as topic for KG generation, we demonstrate how intermediate artifacts can be extracted from the complete KG using queries designed according to the schema, and we use this sub-graph to compare with a historical record (family tree) for refinement and evaluation in terms of local KG quality.\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e本誌: \u003c\/strong\u003e\u003ca href=\"\/products\/ieej-20241202c00801\"\u003e2024年12月5日-2024年12月6日情報システム研究会\u003c\/a\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e本誌掲載ページ: \u003c\/strong\u003e29-33 p\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003e原稿種別: \u003c\/strong\u003e英語\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003ePDFファイルサイズ: \u003c\/strong\u003e360 Kバイト\u003c\/p\u003e","brand":"IEEJ-P10","offers":[{"title":"冊子印刷（一般価格660円\/会員価格440円） \/ A4 \/ 5","offer_id":46352635625711,"sku":"IEEJ-20241202C00801-007-PRT","price":660.0,"currency_code":"JPY","in_stock":true},{"title":"PDFダウンロード（一般価格330円\/会員価格220円） \/ A4 \/ 5","offer_id":46355821265135,"sku":"IEEJ-20241202C00801-007-PDF","price":330.0,"currency_code":"JPY","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0718\/9512\/2159\/files\/IEEJ-KENKYUKAI_58be24ba-2583-44d5-acfd-a9d0517d6863.png?v=1743255024","url":"https:\/\/ieej.bookpark.ne.jp\/products\/ieej-20241202c00801-007","provider":"電気学会 電子図書館","version":"1.0","type":"link"}