This project contains all relevant modules of the domain-specific language KEML (=Knowledge Elicitation Modeling Language) designed for modelling knowledge elicitation by an LLM as perceived by a human author prompting it.

We design KEML to document and analyse the interaction with LLMs and potentially more conversation partners. Our main concern is the trust into single pieces of information we receive by the LLM or other sources.

A rough explanation of the language is available on the ReadMe of the metamodel of KEML. An in depth introduction of KEML is available in our introductory paper.

There is also a KEML web-editor that is publicly available for free. Here, users can create and edit their KEML files in a web GUI.

KEML is an Eclipse EMF project meaning it consists of a set of Eclipse Plugins that create several handy editors and analyzers for KEML files. It follows the standard structure of EMF projects:

1. Modeling project keml: The central definition of the .ecore file. The two projects edit and editor can be generated in Eclipse just based on this file. Since edit had some customizations, it is recommended to fork it from this GitLab group.

2. Edit code project keml.edit: While a customized version with own icons exists on keml.edit ARCHIVE, its maintenance has stopped. We hence recommend that you use the normal generated version: Just run 'Generate' -> 'Edit code' on the Modeling project's central file. The edit code is a prerequiste for other projects, including the editor and IO as well as analysis.

3. Editor project keml.editor: Generated project, currently no Git instance exists - just run 'Generate' -> 'Editor code' on the Modeling project's central file. By executing this project as an Eclipse application a text-based editor for KEML files is started.

4. KEML file generation from extern sources keml.io: This project can run independently of the Eclipse environment. It converts a yEd graphical file into an KEML file. Other IO functionality is used by the analysis project.

5. Analysis of KEML files keml.analysis: This project can run independently of the Eclipse environment. It generates statistical information in various formats about an input KEML file.

6. KEML (and yEd) samples keml.sample: Example files including yEd graphical representations and KEML files.

More information about the subprojects is available in their respective ReadMes.

Support is currently offered by the main developer, Susanne Göbel under [email protected].

• A graphical web-based editor for KEML files is currently under construction. Since the project is in an early state, it is not shared publically yet.
• We also plan a tool for ad-hoc analysis of an on-going LLM conversation in the near future.

We are open to contributors. Maybe you would like to write your bachelor's or master's thesis on KEML? Get in touch with Susanne Göbel [email protected].

The KEML project is subject to (C) 2023-2024, SoftLang Research Team, University of Koblenz, Faculty of CS, contact Susanne Göbel or Ralf Lämmel. It is provided under the CC BY 4.0 license. Basically, you are free to share and adapt the material as long as you give proper credit to us and our project. Feel free to include KEML into your research but please cite us, especially our introductory paper.

Group icon by Camel icons created by Freepik - Flaticon