Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update harassment-abuse tag-consensus model penalty, update user enrollment, and re-tune diligence model #203

Merged
merged 1 commit into from
Feb 24, 2024

Conversation

jbaxter
Copy link
Collaborator

@jbaxter jbaxter commented Feb 24, 2024

  1. Raters who rate a note with a high harassment-abuse tag-consensus model note intercept will get an increased penalty to their raterAgreeRatio.
  2. Work in progress changes to user enrollment: treat earnedOutNoAcknowledge the same as earnedOutAcknowledged going forward, and start counting the number of times earned out going forward.
  3. Re-calibrate low diligence threshold so that it catches the same percent of notes prior to the harassment-abuse change.

1. Raters who rate a note with a high harassment-abuse tag-consensus model note intercept will get an increased penalty to their raterAgreeRatio.
2. Work in progress changes to user enrollment: treat earnedOutNoAcknowledge the same as earnedOutAcknowledged going forward, and start counting the number of times earned out going forward.
3. Re-calibrate low diligence threshold so that it catches the same percent of notes prior to the harassment-abuse change.
@jbaxter jbaxter merged commit c7db275 into main Feb 24, 2024
@jbaxter jbaxter deleted the jbaxter/2024_02_harassment_abuse branch June 27, 2024 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

1 participant