chore: end-to-end guardrails logging of traces (llm_call--> guardrails execution) in Sentry and other chores

[Prajna1999]

Summary

Target issue is #150 #153 #154

• Sentry / Otel wiring up for guardrails execution hooked up with kaapi-backend project
• Remove guardrails hub online inference dependency (using validators as packages now)
• Fix CI to make sure guardrails dont require online validations.
• Disable llamaguard_7b validator for now as online inference has been sunset by guardrails hub

Checklist

Before submitting a pull request, please ensure that you mark these task.

• Ran fastapi run --reload app/main.py or docker compose up in the repository root and test.
• If you've fixed a bug or added code that is tested and has test cases.

Notes

Please add here if any other information is required for the reviewer.

[coderabbitai]

Important

• 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Team

Run ID: 2513ecbd-389e-4d84-9b1b-4d95b6f0a4cf

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[Prajna1999]

Remove spans for queries altogether, they expose user query and llm_response @Prajna1999