Request body for creating an evaluation rule.
Checklist for agents and SDK clients:
evaluator.name
evaluator.type
target=observation
target=experiment
GET /api/public/v2/datasets
id
filter[].value
llm_as_judge
code
filter
enabled=true
Request body for creating an evaluation rule.
Checklist for agents and SDK clients:
evaluator.nameandevaluator.typetarget=observationortarget=experimenttarget=experimentand you want a dataset filter, callGET /api/public/v2/datasetsfirst and use datasetidvalues infilter[].valuellm_as_judge, fetch or inspect the evaluator first and provide a complete mapping for every prompt variablecode, do not send variables or mappings; Langfuse stores the fixed code runtime mapping automaticallyfilterenabled=trueonly when you want live execution immediately