https://github.com/lambda-feedback/user-documentation/blob/main/docs/advanced/evaluation_functions/local.md
Trying to follow these docs locally in a repo, Claude came up with this:
The docs page you linked describes the older Lambda-runtime path and wrapped body, which this image rejects with a validation error. This repo uses the Shimmy base image, so the shape is:
URL: POST http://localhost:9000/
Header: command: eval (or preview, healthcheck)
Body: bare {"response": ..., "answer": ..., "params": {...}}
Response: {"command": "eval", "result": {"is_correct": ..., "feedback": "..."}}
Looks like the docs need updating for Shimmy usage?
https://github.com/lambda-feedback/user-documentation/blob/main/docs/advanced/evaluation_functions/local.md
Trying to follow these docs locally in a repo, Claude came up with this:
The docs page you linked describes the older Lambda-runtime path and wrapped body, which this image rejects with a validation error. This repo uses the Shimmy base image, so the shape is:
URL: POST http://localhost:9000/
Header: command: eval (or preview, healthcheck)
Body: bare {"response": ..., "answer": ..., "params": {...}}
Response: {"command": "eval", "result": {"is_correct": ..., "feedback": "..."}}
Looks like the docs need updating for Shimmy usage?