v1.5.8

What's Changed

• add support for custom models for ragas ATH-1721 by @akshat-g in #91

Full Changelog: v1.5.7...v1.5.8

v1.5.7

What's Changed

• Remove urlencode for params as request library already does it by @vivek-athina in #97

Full Changelog: v1.5.6...v1.5.7

v1.5.6

What's Changed

• Bugs fixes in extract_json_path, API call and improvements in json validation eval by @vivek-athina in #95
• Vivek/ath 1698 fix json validation eval by @vivek-athina in #96

Full Changelog: v1.5.4...v1.5.6

v1.5.4

What's Changed

• add weaviate retrieval step by @akshat-g in #94

Full Changelog: v1.5.3...v1.5.4

v1.5.3

What's Changed

• ATH-1806 by @akshat-g in #90
• API step improved by @vivek-athina in #92
• Upgrades to API step and version bump by @vivek-athina in #93

Full Changelog: v1.5.0...v1.5.3

v1.5.0

What's Changed

• Added JsonEval by @vivek-athina in #65
• Added reason to JsonEval validations by @vivek-athina in #67
• Add retrieval nodes by @akshat-g in #62
• Fix/json eval text validation reason by @vivek-athina in #68
• remove supported models check by @akshat-g in #69
• Added support to pass dataset id in run eval suite flow by @vivek-athina in #70
• Fix/add conversation coherence eval by @akshat-g in #71
• fix logger issues by @akshat-g in #72
• add chat history to faifulness by @akshat-g in #73
• Added code execution and jsonpath extract steps by @vivek-athina in #74
• Custom code eval by @vivek-athina in #75
• JsonEval split into two evals by @vivek-athina in #76
• Minor fixes in import by @vivek-athina in #77
• Improved custom code handling by @vivek-athina in #79
• Fix ragas aspect critque metrics by @akshat-g in #78
• Added re package support in custom code. Bumped version by @vivek-athina in #81
• bump json schema version by @akshat-g in #83
• Fix/litellm version specified by @vivek-athina in #84
• Version fixes by @vivek-athina in #85
• non boolean custom evals by @akshat-g in #82
• fix ragas aspect critique issues ATH-1641 by @akshat-g in #86
• Minor fix for error message in JSONSchema Eval by @vivek-athina in #87
• Tools support in evals by @vivek-athina in #88
• Error handling in dynamic columns by @vivek-athina in #89

Full Changelog: v1.4.3...v1.5.0

v1.4.3

What's Changed

• Fix for boolean evals to return 0 or 1 by @vivek-athina in #66
• modify prompt execution step by @akshat-g in #64

Full Changelog: v1.4.0...v1.4.3

v1.2.15

What's Changed

• add chat history to context contains enough information evaluator ATH-1029 by @akshat-g in #52

Full Changelog: v1.2.14...v1.2.15

Release v1.2.14

Fix context similarity grounded eval

v1.2.13

• Adds Groundedness Eval to LLM EvalType enum