Hello,
I'm using Stata 13.1. Can you please give me some guidance on how to estimate 95% CI for weighted kappa and interater agreement among 3 observers and 6 ratings? Ratings can be analyzed as both ordinal or nominal scores.
My data look like this:
I've used 'kapci rater1 rater2 rater3, wgt(w)' for kappa weight, but it gives me a different 95%CI from the one I get in other programs or online calculators. Is this command correct to calculate weighted kappa?
Is there a command to estimate 95%CI for percent agreement?
Thank you!
I'm using Stata 13.1. Can you please give me some guidance on how to estimate 95% CI for weighted kappa and interater agreement among 3 observers and 6 ratings? Ratings can be analyzed as both ordinal or nominal scores.
My data look like this:
| id | rater1 | rater2 | rater3 |
| 90 | 0 | 1 | 0 |
| 63 | 2 | 2 | 3 |
| 85 | 4 | 5 | 4 |
| 210 | 3 | 3 | 4 |
| 74 | 4 | 4 | 4 |
I've used 'kapci rater1 rater2 rater3, wgt(w)' for kappa weight, but it gives me a different 95%CI from the one I get in other programs or online calculators. Is this command correct to calculate weighted kappa?
Is there a command to estimate 95%CI for percent agreement?
Thank you!