Assessing the Evolution of LLM capabilities for Knowledge Graph Engineering in 2023
May 29, 2024 82 views 
0.25
0.5
0.75
1.25
1.5
1.75
2
In this article, we evaluate the evolution of LLM capabilities w.r.t. the RDF Turtle and SPARQL language as foundational skills to assist with various KGE tasks. We measure the LLM response quality using 6 LLM-KG-Bench tasks for a total of 15 LLM versions available over the course of 2023, covering 5 different ”major version” LLM classes (GPT-3.5 Turbo, GPT-4, Claude 1.x, Claude 2.x, and Claude Instant 1.x).