NL2SHACL-Bench: A Benchmark Suite for Natural Language to SHACL Translation
The results show that current LLMs are highly capable of generating syntactically valid SHACL, but still struggle to produce semantically equivalent constraints for complex logical and structural patterns, which indicates that NL2SHACL-Bench provides a meaningful basis for measuring advances in the NL2SHACL state of th...