langkit

We have hosted the application langkit in order to run this application in our online workstations with Wine or directly.

Quick description about langkit:

LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library whylogs. Productionizing language models, including LLMs, comes with a range of risks due to the infinite amount of input combinations, which can elicit an infinite amount of outputs. The unstructured nature of text poses a challenge in the ML observability space - a challenge worth solving, since the lack of visibility on the model's behavior can have serious consequences.

Features:

• Readability score
• Similarity scores between prompt/responses
• Text Relevance
• Sentiment and Toxicity
• Security and Privacy
• Sentiment analysis

Programming Language: Python.
Categories: