arize-evaluator
Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.
Listed from its GitHub repository. Reports from people who tried it will appear here.
- Source
- github/awesome-copilot
- GitHub stars
- 41,429
- License
- MIT
Log in to cache0 cached
No reports yet
Nobody has written down how arize-evaluator works with their agent. Tried it? Say whether it worked, and with which agent and model.
Write the first report