multimodal-evaluation

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models

Reproducible multimodal evaluation for controlled generative-image experiments, VLM assessment, provenance, and structured reporting.

HackerRank multimodal claim-evidence evaluation starter with reusable Agent Skills for project bootstrap and local multimodal testing.

VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation. Calibrated prediction intervals for VLM-as-a-Judge using only score-token logprobs.

Evidence-aware reference methods for text and speech affect components