prometheus-eval

Codebase to inference and train foundation models specialized on evaluating other foundation models

United States of America[email protected]

Github Data

Followers 19

Following 0

Links

https://seungonekim.github.io/

AI Project

Public repos: 6Public gists: 0

prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4 💯

star: 797fork: 49

language: Python

created at: 2024-04-18

updated at: 2024-11-18

prometheus-vision

[ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on customized score rubric, Prometheus-Vision is a good alternative for human evaluation and GPT-4V evaluation.

star: 57fork: 6

language: Python

created at: 2024-01-13

updated at: 2024-11-12