Skip to content

Add Winston AI detector submission - #205

Open
Philrobots wants to merge 1 commit into
liamdugan:mainfrom
gowinston-ai:submission/winston-ai
Open

Philrobots wants to merge 1 commit into
liamdugan:mainfrom
gowinston-ai:submission/winston-ai

Conversation

@Philrobots

@Philrobots Philrobots commented Sep 24, 2026 •

Copy link
Copy Markdown

Thank you for this project. It's really great to be able to evaluate models using external public benchmarks.

Purpose

We are opening this PR to run some evaluations and see how our detector scores on the hidden test set. We are still evaluating the model's accuracy and may push follow-up commits with updated predictions as we iterate.

We will comment on this PR to confirm when the submission is final.

Thank you

@github-actions

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Winston AI

Release date: 2026-09-24

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.98% at FPR=5% and 99.89% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.98 and a TPR of 100.00% at FPR=5% and 100.00% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@Philrobots
Philrobots marked this pull request as ready for review September 28, 2026 17:06
@Philrobots

Copy link
Copy Markdown
Author

@liamdugan This submission is final. Ready to merge, thank you in advance!

This branch had an error being deployed

1 failed deployment
raid-main — ba0b2d10 Deployed Sep 24, 2026 by Philrobots via evaluate #348
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant