Coefficient Kappa: Some Uses, Misuses, and Alternatives
Abstract
This paper considers some appropriate and inappropriate uses of coefficient kappa and alternative kappa-like statistics. Discussion is restricted to the descriptive characteristics of these statistics for measuring agreement with categorical data in studies of reliability and validity. Special consideration is given to assumptions about whether marginals are fixed a priori, or free to vary. In reliability studies, when marginals are fixed, coefficient kappa is found to be appropriate. When either or both of the marginals are free to vary, however, it is suggested that the "chance" term in kappa be replaced by 1/n, where n is the number of categories. In validity studies, we suggest considering whether one wants an index of improvement beyond "chance" or beyond the best a priori strategy employing base rates. In the former case, considerations are similar to those in reliability studies with the marginals for the criterion measure considered as fixed. In the latter case, it is suggested that the largest marginal proportion for the criterion measure be used in place of the "chance" term in kappa. Similarities and differences among these statistics are discussed and illustrated with synthetic data.
Get full access to this article
View all access and purchase options for this article.
References
Bennett, E.M., Alpert, R., and Goldstein, A.C. Communications through limited response questioning. Public Opinion Quarterly, 1954, 18, 303-308.
Cohen, J. A coefficient of agreement for nominal scales. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20, 37-46.
Cohen, J. Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 1968, 70, 213-220.
Crittenden, K.S. and Hill, R.J. Coding reliability and validity of interview data. American Sociological Review, 1971, 36, 1073-1080.
Cronbach, L.J. and Gleser, G.C. Psychological tests and personnel decisions. Urbana : University of Illinois Press, 1965.
Fleiss, J.L. Measuring agreement between two judges on the presence or absence of a trait . Biometrics, 1975, 31, 651-659.
Goodman, L.A. and Kruskal, W.H. Measures of association for cross classifications. American Statistical Association Journal, 1954, 49, 732-764.
Gottfredson, G.D. and Holland, J.L. Vocational choices of men and women: A comparison of predictors from the self-directed search. Journal of Counseling Psychology, 1975, 22, 28-34.
Guttman, L. Mathematical and tabulation techniques. In P. Horst (Ed.) The prediction of personal adjustment (Bulletin 48). New York: Social Science Council, 1941.
Guttman, L. The test-retest reliability of qualitative data. Psychometrika, 1946, 11, 81-95.
Kendall, M.G. and Stuart, A. The advanced theory of statistics (Second edition, Vol. 2). New York: Hafner, 1967.
Krippendorff, K. Bivariate agreement coefficients for reliability of data. In E. F. Borgatta and G. W. Bohrnstedt (Eds.), Sociological methodology. San Francisco: Jossey-Bass, 1970 .
Lawlis, G.F. and Lu, E. Judgments of counseling process: Reliability, agreement, and error . Psychological Bulletin, 1972, 78, 17-20.
Marx, T.J. Statistical measurement of agreement for data in the nominal scale with applications to educational research and decisions. Unpublished doctoral dissertation, Harvard University, 1972.
Scott, W.A. Reliability of content analysis: The case of nominal scale coding . Public Opinion Quarterly, 1955, 19, 321-325.
Tinsley, H.A. and Weiss, D.J. Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 1975, 22, 358-376.
Touchton, J.G. and Magoon, T.M. Occupational daydreams as predictors of vocational plans of college women . Journal of Vocational Behavior, 1977, 10, 156-166.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published: October 1981
Issue published: October 1981
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Educational and Psychological Measurement.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 2629
*Article usage tracking started in December 2016
Altmetric
See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 873 view articles Opens in new tab
Crossref: 883
- Climate and human activities impact on runoff and sediment yield in th...
- Patient Reported Outcome Measurement (PROM) under real-life conditions...
- ‘I already forgot half of it’ – Interviewing people with dementia for ...
- Digital game-based language learning for vocabulary development
- Competing Together, Nations Apart: Identity and Nationality at the 202...
- Towards automating self-admitted technical debt repayment
- Academics' motivation for joining an educational leadership training p...
- “The supreme discipline of Nursing”–A qualitative content analysis of ...
- Mixed-Keying or Desirability-Matching in the Construction of Forced-Ch...
- Exploring subjective social inclusion of paralympic athletes in market...
- Climate change content in Colombian schoolbooks
- Development and in-depth investigation of pre-service teachers' digita...
- Development of Distance Simulation Educator Guidelines in Healthcare
- Why we fight: investigating the moral appeals in terrorist propaganda,...
- Relationship Between Future Thinking and Prospective Memory in Alzheim...
- Early Adolescents Can Extract Distinct Moral Lessons from Narrative Me...
- Results of University Curricula Analysis
- Why Do We Agree to Disagree? Agreement and Reasons for Disagreement in...
- Preservice Biology Teachers’ Socioscientific Argumentation: Analyzing ...
- Measuring the adoption and discontinuance of low carbon digitally-enab...
- Statistical Methods for the Analysis of Inter-Reader Agreement Among T...
- Diagnostic value of kappa free light chain index in patients with prim...
- Team teachers’ emotions and their antecedents in the classroom
- Empirical studies on how ethical recommendations are translated into p...
- SmartMoms – a web application to raise awareness and provide informati...
- Spatiotemporal description of African swine fever virus nucleic acid a...
- CEO performance management behaviors’ influence on TMT flourishing, jo...
- Associations between the circumstances and severity of head impacts in...
- Pre-service Chemistry Teachers’ Views about the Tentative and Durable ...
- Rise of Distributed Deep Learning Training in the Big Model Era: From ...
- Erfassung von Barrieren und Faszilitatoren zur Aufnahme einer Psychoth...
- Spatial and temporal distribution analysis of dominant algae in Lake T...
- The impact of bionic prostheses on users' self-perceptions: A qualitat...
- A Qualitative Research of Young People’s Motivation to Start, Continue...
- “I Remember the Fall”: Memory of Falls in Older Adults
- Majoritarian and consensual patterns in political news: A longitudinal...
- Does role play manipulate students? Persuasive effects of role play on...
- Abductive reasoning in modeling biological phenomena as complex system...
- Preservice Biology Teachers’ Generic and Subject-specific Career Choic...
- Clinical utility of new cut-off scores for the world health organizati...
- Persistence, context, and visual strategy of graph understanding: Gaze...
- Videobasierte Reflexion von klassenführungsspezifischen Ereignissen – ...
- Investigating pre-service science teachers’ metaknowledge about the mo...
- Comparison of visual assessments of anisocytosis in canine blood smear...
- More than words – how second language learners initiate and respond du...
- How Can Multilingual Classrooms Succeed? An Analysis of Critical Incid...
- Individuelle Lernunterstützung in der Arbeitsphase einer standardisier...
- WORDS MATTER: Presidents Obama and Trump, Twitter, and U.S. Soft Power
- Measuring Agreement Using Guessing Models and Knowledge Coefficients
- Repeatability and reproducibility of comparison decisions by firearms ...
- Lernen aus Beispielen – eine Studie zu Vergleichsprozessen von Schüler...
- Spot the bot: Investigating user's detection cues for social bots and ...
- Virtual reality for prospective and process-related competence modelin...
- Design Considerations for a Socially Assistive Robots in the Home to S...
- Automated measurement of infant and mother Duchenne facial expressions...
- Mapping the Media Genome: An Unsupervised Machine Learning Analysis of...
- Advancing open government data portals: a comparative usability evalua...
- “I feel enthusiastic, when the homework is done well”: teachers’ emoti...
- Telehealth Needs and Concerns of Stakeholders in Pediatric Palliative ...
- Online-Therapie zusätzlich zur Psychoanalyse? Welche Bedarfe ...
- Evaluation of structured doctoral training programs in German life sci...
- Students’ systems thinking while modeling a dynamic ecological system
- A novel agreement statistic using data on uncertainty in ratings
- “I wish I could say, ‘Yeah, both the same’”: Cultural stereotypes and ...
- Key features of teacher identity: a systematic meta-review study with ...
- What matters? A case study of elementary english language learners in ...
- Language in primary and secondary geography education: a systematic li...
- Exploring students’ and lecturers’ views on collaboration and cooperat...
- Implementation of repairs in dental practice
- Sun Protection Counseling at the Pharmacy: A German Qualitative Study ...
- Technology Implementation in Pre-Service Science Teacher Education Bas...
- Autobiographical memory in the digital age: Insights based on the subj...
- An evidence-based roadmap for IoT software systems engineering
- Does forest access reduce reliance on costly shock-coping strategies? ...
- Free word association analysis of German laypeople’s perception of bio...
- What’s mathematics doing here? The role of mathematics in German Physi...
- The Dependence of Chance-Corrected Weighted Agreement Coefficients on ...
- Improving protein-protein interaction site prediction using deep resid...
- Selbstberichtete Gründe für die (Nicht‑)Nutzung von Familiensprachen b...
- Feasibility of Osseous Landmarks for ACL Reconstruction—A Macroscopic ...
- Changes, challenges and support in work, education and finances of ado...
- ‘She never actually let you walk into a trap’: exploring relational tu...
- Is the quality of systematic reviews influenced by prospective registr...
- How do students apply the octet rule and how do they justify this appl...
- "We are a startup to the core": A qualitative interview study on the s...
- Customer deviance in retailing: Managers’ emotional support and employ...
- “What if everyone is able to program?” – Exploring the Role of Softwar...
- Values and Value Conflicts in the Context of OSINT Technologies for Cy...
- Women’s Experiences of Different Types of Orgasms—A Call for Pleasure ...
- Same text, same discourse? Empirical validation of a discourse analysi...
- “It’s where learning and teaching begins ‒ is this relationship” — ins...
- Evaluating and tracking qualitative content coder performance using it...
- Developing a Healthcare Technology Acceptance Model (H-TAM) for Older ...
- Infant AFAR: Automated facial action recognition in infants
- The Rhythm of Flow: Detecting Facial Expressions of Flow Experiences U...
- When nationalism beats populism: The secessionist movement in Texas
- Reflections Of Squid Game on Children's Games and Viewers; An Example ...
- Affected but not involved: Two-scenario based investigation of individ...
- New models developed for detection of misconceptions in physics with a...
- A Systematic Review of Peer Assessment Design Elements
- Konfliktmanagement von interpersonellen und Intragruppenkonflikten in ...
- The smell of my self: Odor exposure increases the number of self-defin...
- The Role of Dyadic Teacher–Student Relationships for Primary School Te...
- Only Small Effects of Mindfulness-Based Interventions on Biomarker Lev...
- Comparison Between the Direct Method and Friedewald's Formula for the ...
- Motor Speech Phenotypes in Children With Epilepsy: Preliminary Finding...
- Remembering beloved objects from early childhood, middle childhood, an...
- Imagery Rescripting for Patients With Posttraumatic Stress Disorder: A...
- Diagnosis for the refrigerant undercharge fault of chiller using deep ...
- The Guiding Principles of the Profession: A Comparative Study
- Visual attention across cultures: Similarities and differences in chil...
- An Analysis of Misclassification Rates in Rater Agreement Studies
- What do bereaved relatives of cancer patients dying in hospital want t...
- Teacher professional knowledge: The implementation of STEM pedagogical...
- Teachers’ Use of Explicit Instruction When Planning Lessons to Foster ...
- The Homogeneity Index as a Measure of Interrater Agreement for Ratings...
- Identification of the Needs and Preferences of Patients With Cancer fo...
- CODE-MM: Convex Deep Mangrove Mapping Algorithm Based on Optical Satel...
- Adding Why to What? Analyses of an Everyday Explanation
- Self-Regulation for Reading Comprehension: Assessment of Strategies an...
- Evaluation des KoKit-Beratungskonzepts
- An Action Research on Improving Parents’ Digital Advertising Literacy ...
- Unethical customer behaviour: causes and consequences
- Let’s draw molecules: Students’ sequential drawing processes of resona...
- Explicit instruction on procedural and epistemic knowledge – is it hap...
- „Du musst noch nicht die ganze Welt bewegen, du hast gerade erst angef...
- Virtuelle Unterrichtsszenarien in der Lehrpersonenbildung – eine Studi...
- Two sides of the same coin? Patient and therapist experiences with a t...
- Interrater reliability estimators tested against true interrater relia...
- Measuring medically unjustified hospitalizations in Switzerland
- Development and validation of a questionnaire to evaluate the knowledg...
- Designing Categories for a Mixed-Method Research on Competence Develop...
- How Essential is Kratom Availability and use during COVID-19? Use Patt...
- Exploring folk theories of algorithmic news curation for explainable d...
- Management behaviors during the COVID-19 pandemic: The case of healthc...
- Mitigating subway construction collapse risk using Bayesian network mo...
- Psychomotor development in two‐year‐old Ivorian and Ghanaian children ...
- Examining the theory of challenge and threat states in athletes: do pr...
- Mechanism comics as a task in a written exam in organic chemistry for ...
- Exploring risk culture controls: to what extent can the development of...
- What Do Parents Want in Terms of Early Childhood Education and Care?
- Change Detection of SAR images based on Spatial and Frequency Domain N...
- Instructional guidelines based on conceptions of students and scientis...
- A Measurement-Based Protocol Improves Interrater Agreement and Accurac...
- What constitutes a fulfilled life? A mixed methods study on lay perspe...
- Housing finance inaccessibility: evidence from the Nigerian Pensioners
- The pupil and myself: pupil dilation during retrieval of self-defining...
- Reflecting geometrical shapes: approaches of primary students to refle...
- Digital prevention of depression for farmers? A qualitative study on p...
- Predictive value of video alone in diagnosis of epileptic vs paroxysma...
- Minority Stress and Positive Identity Aspects in Members of LGBTQ+ Par...
- Relationship between Beliefs of Teachers about and Their Use of Explic...
- A comprehensive look at explicit screening tools for potentially inapp...
- Commonality Autoencoder: Learning Common Features for Change Detection...
- How do children acquire knowledge about voice assistants? A longitudin...
- Students’ conceptions of keeping fattening pigs and dairy cows: an exp...
- Scenario-based solutions for implementing an internet of things system...
- Statistical Inference for G-indices of Agreement
- Notions of Creativity in Mathematics Education Research: a Systematic ...
- An Update for Taxonomy Designers
- “Cooperation with a peer in practicum is nice but teaching alone makes...
- Corporate Social Responsibility: What Are Foodservice Companies Report...
- ReCDroid+: Automated End-to-End Crash Reproduction from Bug Reports fo...
- Bibliography
- Maternal Ethnotheories About Infants’ Ideal States in Two Cultures
- Reimagining the Personal Network: The Case of Path
- Promoting Student Teachers’ Well-Being
- Event related potential exploration of the organizational structure of...
- Gelenekselden Dijitale Reklam Sloganlarında Söz Sanatları: Kırmızı Ödü...
- What Do University Students Truly Learn When Watching Tutorial Videos ...
- Multi-rater delta: extending the delta nominal measure of agreement be...
- QADI as a New Method and Alternative to Kappa for Accuracy Assessment ...
- A chart review tool to systematically assess the safety of prehospital...
- Psychological burden and coping in destination therapy patients with a...
- Perceptions of accountability for the transfer of training by leadersh...
- “Resistance!”: Collective Action Cues in Conspiracy Theory-Endorsing F...
- Robustness of κ‐type coefficients for clinical agreement
- Couples Coping With Hematological Cancer: Support Within and Outside t...
- The discounted future: Relationship between temporal discounting and f...
- How professional pilots perceive interactions of working conditions, r...
- “Because you always learn something new yourself!” An expectancy-value...
- On the Detection of Snow Cover Changes over the Australian Snowy Mount...
- The beginning of the life story: The meaning of the earliest autobiogr...
- Choosing the right (HR) metrics: digital data for capturing team proac...
- Vaccine discourse in white nationalist online communication: A mixed-m...
- Belastungen, positive Veränderungen und Ressourcen von Familien in der...
- Artificial Intelligence for Reducing Workload in Breast Cancer ...
- An Assessment of Diagnostic Assays and Sample Types in the Detection o...
- Benchmarking procedures for characterizing the extent of rater agreeme...
- Interobserver Variability of Hip Dysplasia Indices on Sweep Ultrasound...
- Student teachers’ perceptions of trust during the team practicum
- “I Can’t Just Pull a Woman Out of a Hat”: A Mixed-Methods Study on Jou...
- Predicting the objective and priority of issue reports in software rep...
- Förderung diagnostischer Kompetenz im Rahmen der Ausbildung von Lehrkr...
- “Vegan Teachers Make Students Feel Really Bad”: Is Teaching Sustainabl...
- Spatially Balanced Sampling for Validation of GlobeLand30 Using Landsc...
- Clarifying Agreement Calculations and Analysis for End-User Elicitatio...
- Always in flux: the role of attentional focus in emotion regulation dy...
- Teachers’ Emotion Regulation in the Team-Taught Classroom: Insights In...
- Change Detection of SAR images based on Convolution Neural Network wit...
- “It is the beautiful things that let us live”: How engaging in creativ...
- Problem Solving and Digital Transformation: Acquiring Skills through P...
- Performance of the Digital Dietary Assessment Tool MyFoodRepo
- Austrian teachers’ understanding and teaching of historical culture: c...
- Expert-Informed Topic Models for Document Set Discovery
- The image of memory: relationship between autobiographical memory and ...
- A Study on the Mental Models of Users Concerning Existing Software
- Statistical Methods for Annotation Analysis
- Spatio-Temporal Analysis of Built-Up Area Expansion on Agricultural La...
- Akzeptanz und Alltagsintegration von assistiven Technologien im Projek...
- Inter-rater Agreement Based Risk Assessment Scheme for ICT Corporates
- Monitoring deterioration of knee osteoarthritis using vibration arthro...
- Semisupervised SAR image change detection based on a siamese variation...
- Memories of Falls: Resolved or Unresolved Memories?
- An Evidence-Based Roadmap for Iot Software Systems Engineering
- Barriers to and Facilitators of Engaging With and Adhering to Guided I...
- The Child Neglect Assessment technique (C.N.A.). A path of the S.I.P.P...
- Image Quality and Lesion Detectability of Lower-Dose Abdominopelvic CT...
- Users’ needs for a digital smoking cessation application and how to ad...
- Affect in Multimedia: Benchmarking Violent Scenes Detection
- Building Data Sets for Rainforest Deforestation Detection Through a Ci...
- Unsupervised Change Detection From Heterogeneous Data Based on Image T...
- Automated diagnosis of hip dysplasia from 3D ultrasound using artifici...
- Cost of Myopia Correction: A Systematic Review
- Students With Emotional and Behavioral Problems in Inclusive Classes: ...
- ‘At first I was overwhelmed, but then—I have to say—I did almost enjoy...
- Wie erleben und bewältigen Lehrende der berufsbezogenen Weiterbildung ...
- ‘We would rather die from Covid-19 than from hunger’ - Exploring lockd...
- Acceptance towards digital health interventions – Model validation and...
- Item desirability matching in forced-choice test construction
- Reliability of the Service Trip Audit Tool to assess the quality of sh...
- The impact of grey zones on the accuracy of agreement measures for ord...
- Perspective of potential patients on the hospital volume-outcome relat...
- Visual assessment of movement quality: a study on intra- and interrate...
- Change Detection in Synthetic Aperture Radar Images Based on a General...
- Psychometric Validation of Central Venous Catheter Insertion Mastery L...
- Predicting the suitable habitats of parasitic desert species based on ...
- Multi-scale Features Fusion Network for Unsupervised Change Detection ...
- Translation and cultural validation of the Revised Illness Perception ...
- The Unknown Prevalence of Postrandomization Bias in 15 Physical Therap...
- What do Students Want to Know About the Digital World?
- Exploring students' stereotypes regarding computer science and stimula...
- Bayesian approaches to the weighted kappa-like inter-rater agreement ...
- Why Do Citizens Engage With the TikTok Accounts of Public Hospitals in...
- Computer-aided diagnosis tool for cervical cancer screening with weakl...
- Low Inter-Rater Reliability of a High Stakes Performance Assessment of...
- Exploring the application of the Charlson Comorbidity Index to assess ...
- Why school-related content knowledge for pre-service chemistry teacher...
- Accelerating Deductive Coding of Qualitative Data: An Experimental Stu...
- Use of knowledge pieces and context features during the transfer proce...
- Impact of increasing levels of adaptive statistical iterative reconstr...
- Why Commercial Pilots Voluntarily Report Self-Inflicted Incidents
- Nurse‐Family Partnership nurses’ attitudes and confidence in identifyi...
- Appropriation of adaptive literacy games into the German elementary sc...
- Emotions in social interactions in pre-service teachers’ team practica
- Pulmonary imaging in coronavirus disease 2019 (COVID-19): a series of ...
- Außerunterrichtliches Peer Tutoring mit deutsch-türkischsprachigen Gru...
- Unterstützung von Schulen durch Schulaufsicht – Zur Ausdifferenzierung...
- Aktivitäten von Akteuren in Schweizer Bildungslandschaften – Welchen p...
- A Prospective Evaluation of Clinical HEART Score Agreement, Accuracy, ...
- The role of preacademic activities and adult-centeredness in mother-ch...
- 3D SKETCHES IN VIRTUAL REALITY AND THEIR EFFECT ON DEVELOPMENT TIMES
- Advance care planning by proxy in German nursing homes: Descriptive an...
- COVID-19 Pandemisinde YouTube Ads Leaderboard’da Listelenen Türkiye’de...
- Methods of assessing categorical agreement between correlated screenin...
- Assessing L2 English speaking using automated scoring technology: exam...
- A Quadrilogy for (Big) Data Reliabilities
- A Unified Treatment of Agreement Coefficients and their Asymptotic Res...
- The effect of verbal priming of visual attention styles in 4- to 9-yea...
- Defect Detection of Metal Nuts Applying Convolutional Neural Networks
- Change Capsule Network for Optical Remote Sensing Image Change Detecti...
- Image repair during a U.S. Securities and Exchange Commission investig...
- On students’ perception of low‐cost experimental equipment. Distillati...
- Reliability of Perceptual Judgments of Phonetic Accuracy and Hypernasa...
- Kompetenzen und Wege der Kompetenzentwicklung in der Industrie 4.0
- Boolean Analysis of Interobserver Agreement: Formal and Functional Evi...
- Processing Body Image on Social Media: Gender Differences in Adolescen...
- Environmentally Sound Agriculture Between Transformation and Conformat...
- Business-Driven Technical Debt Prioritization: An Industrial Case Stud...
- Evaluation of Inter-Observer Reliability of Animal Welfare Indicators:...
- Designing Knowledge Sharing System for Statistical Activities in BPS-S...
- The Task Navigator Following the STRAKNAP Concept: Development, Applic...
- Resilient cross-border regional innovation systems for sustainability?...
- Home video prediction of epileptic vs. nonepileptic seizures in US vet...
- Children Who Lead Get the Language They Need!?
- Reliability and Validity of a German Standardized Diagnostic Interview...
- Do you remember? Similarities and differences between the earliest chi...
- School-Related Content Knowledge in Organic Chemistry—How Does the Stu...
- The show must go on - virtualisation of sport events during the COVID-...
- Kappa coefficients for dichotomous-nominal classifications
- Measuring deterioration of small-area housing environment: Constructio...
- Quantifying Spatial Activation Patterns of Motor Units in Finger Exten...
- Multisite Comparison of MRI Defacing Software Across Multiple Cohorts
- Measuring Social Class with Changing Occupational Classifications: Re...
- Assessing the Assessment: Evidence of Reliability and Validity in the ...
- Accessing Young Children’s Ideas about Energy
- “I’ve Heard of It, Yes, but I Can’t Remember What Exactly It Was”—A Qu...
- Digital Transformation in Banking: A Managerial Perspective on Barrier...
- Comparison of different cardiovascular risk tools used in HIV patient ...
- Visual and Statistical Methods to Calculate Intercoder Reliability for...
- How to Design IIoT-Platforms Your Partners are Eager to Join: Learning...
- Unterschiedliche Perspektiven auf Schülerfeedback
- Virtuelle Labore für den MINT-Unterricht – Transferprozess einer hochs...
- The Treasure Chest of CFA
- Faded Smiles? A Largescale Observational Study of Smiling from Adolesc...
- Influence of a novel deep-learning based reconstruction software on th...
- Self-regulation for Reading Comprehension: Psychometric Properties of ...
- Perspectives of patients with multiple myeloma on accepting their prog...
- Einstellungen von österreichischen Geschichtslehrkräften zu ...
- АНГІОСОНОГРАФІЧНІ ПАРАЛЕЛІ ДІАГНОСТИКИ УРАЖЕННЯ АРТЕРІАЛЬНОЇ СИСТЕМИ У...
- Assessing Pre-Service Science Teachers’ Scientific Reasoning Competenc...
- Attitudes of Biology Teachers Towards Learner-Generated External Visua...
- Measuring intrarater association between correlated ordinal ratings
- Can you explain AI to me? Teachers’ pre-concepts about Artificial Inte...
- Self-defining Memories and their Contribution to the Sense of Self in ...
- An approach for selecting and using a method of inter-coder reliabilit...
- An effective approach for mapping permafrost in a large area using sub...
- A Self-administered Version of the Functioning Assessment Short Test f...
- Observational Methods
- The smells we know and love: variation in codability and description s...
- Mapping of Cotton Fields Within-Season Using Phenology-Based Metrics D...
- A Feature Space Constraint-Based Method for Change Detection in Hetero...
- An international perspective of the business incubators' perception ab...
- Changes in Dairy Products Value Chain in Georgia
- Interobserver reliability of measures of the Welfare Quality® animal w...
- Unveiling Elite Developers’ Activities in Open Source Projects
- Regulations and practices of structured doctoral education in the life...
- The Development of Context-Sensitive Attention in Urban and Rural Braz...
- Describing the Composition of Individualized Education Plans for Stude...
- American society of biomechanics journal of biomechanics award 2019: C...
- Students’ Conceptions of Sustainable Nutrition
- Exo-anal imaging of the anal sphincter: a comparison between introital...
- Self-Supervised Representation Learning for Remote Sensing Image Chang...
- Cytologic grading of primary malignant salivary gland tumors: A blinde...
- Development of a Scoring Tool for Chronic Nonbacterial Osteomyelitis M...
- Weighted inter-rater agreement measures for ordinal outcomes
- Fit Themes in Volunteering: How Do Volunteers Perceive Person–Environm...
- Crossing Domains for AU Coding: Perspectives, Approaches, and Measures
- Pain assessment for cognitively impaired older adults: Do items of ava...
- Automated lithological mapping by integrating spectral enhancement tec...
- Anwendungsszenarien und Technologiebewertung von digitalen Werkerassis...
- Can foot orthoses impose different gait features based on geometrical ...
- Explaining the unsuitability of the kappa coefficient in the assessmen...
- Hubert's multi‐rater kappa revisited
- MOOC in Higher Education from the Students’ Perspective. A Sustainable...
- Defend Your Enemy. A Qualitative Study on Defending Political Opponent...
- Interrater Reliability
- Deep-wavelet neural networks for breast cancer early diagnosis using m...
- Children's trust in informants in risky decisions
- Investigating the Acceptance of Video Consultation by Patients in Rura...
- How Health Communication via Tik Tok Makes a Difference: A Content Ana...
- Mesenchymal stromal cells modulate tissue repair responses within the ...
- Multitask learning and benchmarking with clinical time series data
- Functional movement analysis in patients with chronic nonspecific low ...
- Bleeding Assessment Scale in Critically Ill Children (BASIC): Physicia...
- Is the Finding Too Good to Be True? Moving from “More Is Better” to Th...
- Studying for a University Degree in Penitentiary Centers in Spain: Cha...
- Sexual Violence Against Women in India: Daily Life and Coping Strategi...
- How Reliable are Students’ Evaluations of Teaching (SETs)? A Study to ...
- Appropriate Statistics for Determining Chance-Removed Interpractitione...
- How to Transform Programming Processes in Scratch to Graphical Visuali...
- Which Perceptions Do Primary School Children Have about Programming?
- Student teachers’ emotions in anticipation of their first team practic...
- Development and Application of a Category System to Describe Pre-Servi...
- Facebook Groups on Chronic Obstructive Pulmonary Disease: Social Media...
- DNA flow cytometric and interobserver study of crypt cell atypia in in...
- Why Cohen’s Kappa should be avoided as performance measure in classifi...
- Self-defining Memories in Normal Aging
- Checking quality of sensory data via an agreement-based approach
- A Novel Neural Network for Remote Sensing Image Matching
- The Intonation of the Left Periphery: A Matter of Pragmatics or Syntax...
- Development and validation of the African Women Awareness of CANcer (A...
- Sea Ice Change Detection in SAR Images Based on Convolutional-Wavelet ...
- Smell your memories: Positive effect of odor exposure on recent and re...
- Impact of Symptom Reporting Agreement on Interdisciplinary Pain Progra...
- Populism in Online Election Coverage
- Kappa Coefficients for Missing Data
- What Drives Populist Styles? Analyzing Immigration and Labor Market Ne...
- Iterative CT reconstruction in abdominal low-dose CT used for hybrid S...
- Emotional and Phenomenological Properties of Odor-Evoked Autobiographi...
- A coupling translation network for change detection in heterogeneous i...
- Social Media Content Analysis of Public Diabetes Facebook Groups
- Evaluation of Land Cover Change and Agricultural Protection Sites: A G...
- Cross-domain AU Detection: Domains, Learning Approaches, and Measures
- Automatic Measurement of Visual Attention to Video Content using Deep ...
- Similarity measures for 2 × 2 tables
- Zur Verknüpfung von Lernstandeinschätzung und Weiterarbeit im Arithmet...
- Interobserver Reliability of the Animal Welfare Indicators Welfare Ass...
- Multiple Flights or Single Flight Instrument Fusion of Hyperspectral a...
- EASIER: An Evaluation Model for Public–Private Partnerships Contributi...
- A Mastery Learning Capstone Course to Teach and Assess Components of T...
- Change Detection in Remote Sensing Images Based on Image Mapping and a...
- Sensitivity and specificity of patient-entered red flags for lower bac...
- Visual Recognition of Gestures in a Meeting to Detect When Documents B...
- Interrater Agreement
- Analyzing Intercoder Agreement
- An Explorative Laboratory Study: Changing Representations of Functiona...
- Inferring Rater Agreement with Ordinal Classification
- Concepts for Improving Machine Learning Based Landslide Assessment
- Motivation und Gelegenheit zur kognitiven Verarbeitung beim Codieren
- Affective facial computing: Generalizability across domains
- Comparing Similarity Perception in Time Series Visualizations
- FORMACIÓN DE CODIFICADORES Y FIABILIDAD DE LOS REGISTROS. UNA APLICACI...
- The Genesis of Control Configurations during Organizational Founding
- Implementing a General Framework for Assessing Interrater Agreement in...
- Agreement of Teachers on Evaluating Assessments of Learning Progressio...
- Students' understanding of the nature and purpose of models
- Automated Affect Detection in Deep Brain Stimulation for Obsessive-Com...
- The Effects of Right-Wing Populist Communication on Emotions and Cogni...
- Die Leistungs- und Verhaltensbeurteilung in Arbeit...
- Active Learning Approaches for Deforested Area Classification
- Trollslayer: Crowdsourcing and Characterization of Abusive Birds in Tw...
- Remote sensing study of wetlands in the Pearl River Delta during 1995–...
- Misinformation on vaccination: A quantitative analysis of YouTube vide...
- Fallacies of Agreement
- Bedingungsfaktoren und Funktionen von Emotionen von Lehrpersonen im Un...
- Learning Facial Action Units from Web Images with Scalable Weakly Supe...
- Sea Ice Change Detection from Synthetic Aperture Radar Images Based on...
- River damming drives population fragmentation and habitat loss of the ...
- Phenomenological Characteristics of Future Thinking in Alzheimer’s Dis...
- Facial Expressiveness in Infants With and Without Craniofacial Microso...
- Permutation methods. Part II
- The Concordance of Self-Reported and Officially Recorded Criminal Onse...
- Adoption and Outcomes of ISO 14001: A Systematic Review
- Shear wave elastography and Afirma™ gene expression classifier in thyr...
- Framing organized crime and entrepreneurs’ reactions in Mexico: variat...
- Context Memory in Alzheimer’s Disease: The “Who, Where, and When”
- A Deep Convolutional Coupling Network for Change Detection Based on He...
- Measurement of Rater Consistency by Chance-Corrected Agreement Coeffic...
- Kappa Coefficient
- Automatic, Objective, and Efficient Measurement of Pain Using Automate...
- Nominal-Level Variables, II
- Gelingensbedingungen für Teamteaching im Praktikum
- From Nose to Memory: The Involuntary Nature of Odor-evoked Autobiograp...
- SOMDNCD: Image Change Detection Based on Self-Organizing Maps and Deep...
- Synthetic aperture radar image change detection based on frequency-dom...
- Kappa and Rater Accuracy: Paradigms and Parameters
- “I see you, I know you, it feels good” – Qualitative and quantitative ...
- Discriminative Feature Learning for Unsupervised Change Detection in H...
- Intraosseous access can be taught to medical students using the four-s...
- Validity of informed birth weight. Study of Cardiovascular Risk in Ado...
- Upscaling CH4 Fluxes Using High-Resolution Imagery in Arctic Tundra Ec...
- Gender Differences in Scratch Programs of Primary School Children
- The expert-judgement validation and finalization of proposed interacti...
- Diagnosing Students’ Understanding of the Nature of Models
- Patient recall of specific cognitive therapy contents predicts adheren...
- Smiling from adolescence to old age: A large observational study
- Automatic action unit detection in infants using convolutional neural ...
- Extreme parties and populism: an analysis of Facebook and Twitter acro...
- Conceptual assessment tool for advanced undergraduate electrodynamics
- Cobb angle measurements on digital radiographs using Bunnell scoliomet...
- Novel PCR primers to diagnose visceral leishmaniasis using peripheral ...
- Veterinary student competence in equine lameness recognition and asses...
- Retrograde Amnesia for Episodic and Semantic Memories in Amnestic Mild...
- Breastfeeding is Natural but Not the Cultural Norm: A Mixed-Methods St...
- Towards a classification of supply chain relationships: a routine base...
- Historical Heterogeneity Predicts Smiling: Evidence from Large-Scale O...
- Sayette Group Formation Task (GFT) Spontaneous Facial Expression Datab...
- A large-scale analysis of sex differences in facial expressions
- The Application and Evaluation of Simple Permafrost Distribution Model...
- The role of prosody and voice quality in indirect storytelling speech:...
- Assessing learning outcomes in middle-division classical mechanics: Th...
- Analysis of scratch projects of an introductory programming course for...
- Assessment of long-term water quality variation affected by high-inten...
- Puanlayıcılar Arası Güvenirlik Belirleme Tekniklerinin Karşılaştırılma...
- Large-Scale Observational Evidence of Cross-Cultural Differences in Fa...
- Bayesian testing of agreement criteria under order constraints
- An allograft generated from adult stem cells and their secreted produc...
- Validity and Reliability of a Tool to Assess Quality Improvement Knowl...
- Gradual development of constructional complexity in German spatial lan...
- Qualitative Content Analysis of Programming Errors
- Interrater Reliability
- Validating a Distractor-Driven Geometry Test Using a Generalized Diagn...
- Kappa Coefficient
- Sleep Stages Clustering Using Time and Spectral Features of EEG Signal...
- Persuading Me to Eat Healthy: A Content Analysis of YouTube Public Ser...
- Operationalizing Engagement with Multimedia as User Coherence with Con...
- Assessing Adolescent Anxiety in General Psychiatric Care...
- Coupled Dictionary Learning for Change Detection From Multisource Data
- The impact of narcoterrorism on HRM systems
- Interrater Agreement Measures for Nominal and Ordinal Data
- How Robust Are Multirater Interrater Reliability Indices to Changes in...
- The Reliability of Multi-Valued Coding of Data
- Overcoming the Challenges of Unstructured Data in Multisite, Electroni...
- Gender, Race, and Risk: Intersectional Risk Management in the Sale of ...
- Testing the Difference of Correlated Agreement Coefficients for Statis...
- Dificultades del profesorado para planificar, coordinar y evaluar comp...
- Incidence and Risk for Mood and Anxiety Disorders in a Representative ...
- Performance of ACMG-AMP Variant-Interpretation Guidelines among Nine L...
- Between-Subjects Elicitation Studies
- Influence of problem-based learning strategy on enhancing student’s in...
- Individually different weighting of multiple processes underlies effec...
- Variability by country in the European Neuroanaesthesia and Critical C...
- Onset of Alcohol Use Disorders and Comorbid Psychiatric Disorders in a...
- Estimating the age of Risso’s dolphins ( Grampus griseus ) based on sk...
- An investigation of the validity of the Work Assessment Triage Tool cl...
- Influence of personal choices on lexical variability in referring expr...
- Different Perceptions of Computer Science
- Configural Frequency Analysis for Research on Developmental Processes
- Forensic Interviewing for Child Sexual Abuse: Why Psychometrics Matter...
- Introduction
- Randomized Block Designs: Ordinal Data
- Randomized Block Designs: Nominal Data
- Completely Randomized Data
- Randomized Designs: Interval Data
- Regression Analysis of Interval Data
- Randomized Designs: Ordinal Data, I
- Randomized Designs: Ordinal Data, II
- Randomized Designs: Nominal Data
- Randomized Block Data
- Randomized Block Designs: Interval Data
- Vielfalt im Online-Diskurs zum Klimawandel
- Does retrieval frequency account for the pattern of autobiographical m...
- An Educational Intervention to Improve Ultrasound Competency in Ultras...
- A Ratio Test of Interrater Agreement With High Specificity
- Some common errors of experimental design, interpretation and inferenc...
- Guidelines for Establishing Reliability When Coding Narrative Data
- Experience Corps Baltimore: Exploring the Stressors and Rewards of Hig...
- Anxiety Disorders among Adolescents referred to General Psychiatry for...
- Weighted kappa as a function of unweighted kappas
- Flexibility decline contributes to similarity of past and future think...
- Frames, Stories, and Images: The Advantages of a Multimodal Approach i...
- Self-defining memories during exposure to music in Alzheimer's disease
- Self-Disclosure Characteristics and Motivations in Social Media: Exten...
- Operationalisation of quality of life for adults with severe disabilit...
- A Novel “Maximizing Kappa” Approach for Assessing the Ability of a Dia...
- The Development of Self-Criticism and Dependency in Early Adolescence ...
- Impact of Pathologists and Evaluation Methods on Performance Assessmen...
- Where should a school shoe provide flexibility and support for the asy...
- Learning from healthy and stable eyes: A new approach for detection of...
- Inter-Rater Agreement between Trachoma Graders: Comparison of Grades G...
- A Replication of Failure, Not a Failure to Replicate
- Repair During Marital Conflict in Newlyweds: How Couples Move from Att...
- Improving a tone labeling algorithm for Sesotho
- Reliability of the Robinson classification for displaced comminuted mi...
- Caregiver person-centeredness and behavioral symptoms during mealtime ...
- Quantum mechanics concept assessment: Development and validation study
- Societal Change and Values in Arab Communities in Israel...
- Similarity between remembering the past and imagining the future in Al...
- Analysis on urban lake change during rapid urbanization using a synerg...
- Efficacy of upper limb strengthening in children with Cerebral Palsy: ...
- Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Ind...
- Entrepreneurs’ Responses to Crime-Entrepreneurs in Mexico
- Continuous Requirements Risk Profiling in Information Systems Developm...
- What to Expect in the Intake Interview? Impression Management Tactics ...
- Measurement of Inter-Rater Reliability in Systematic Review
- Glaucoma progression detection using nonlocal Markov random field prio...
- Socio-economic Gradients in Children's Cognitive Skills: Are Cross-Cou...
- Reproducibility of diabetes quality of care indicators as reported by ...
- Observer agreement paradoxes in 2x2 tables: comparison of agreement me...
- On Marginal Dependencies of the 2 × 2 Kappa
- Content Bias in Online Health Search
- Integrating Content Knowledge-Building and Student-Regulated Comprehen...
- Utility of 3-dimensional image reconstruction in the diagnosis of smal...
- Does the CT improve inter- and intra-observer agreement for the AO, Fe...
- Deliberative Performance of Television News in Three Types of Democrac...
- Intrarater Reliability
- Obsessive-Compulsive Disorder in the Media
- Eltern und Patienten als Subjekt der Behandlung
- Result and Purpose relations with and without ‘so’
- Die Einschätzung der Qualität historischer Urteile von Schülerinnen un...
- Cohen's kappa for capturing discrimination
- Gone Today but here Tomorrow: Extending the Unfolding Model of Turnove...
- Intrarater Reliability
- YouTube as a source of chronic obstructive pulmonary disease patient e...
- Intercoder reliability indices: disuse, misuse, and abuse
- Uplifting Manhood to Wonderful Heights? News Coverage of the Human Cos...
- The impact of instructor’s group management strategies on students’ at...
- Parent Training for Children Born Premature: A Pilot Study Examining t...
- A framework for selection and fusion of pattern classifiers in multime...
- Rank Aggregation for Pattern Classifier Selection in Remote Sensing Im...
- Temporal Accuracy in Urban Growth Forecasting: A Study Using the ...
- DWI Intensity Values Predict FLAIR Lesions in Acute Ischemic Stroke
- The Development and Nature of Femoral Head Cam Lesions following Aceta...
- Using Science Centers and Museums for Teacher Training in Turkey
- Defining language networks from resting‐state fMRI for surgical planni...
- “Doesn’t Everyone Want That? It’s Just a Given”...
- 1980–2000
- Beyond 2000
- Existing instruments for assessing physician communication skills: Are...
- Pedagogical content knowledge for computer science in German teacher e...
- Setting a standard for electricity pilot studies
- Medical assessments of patient decisions and health literacy. A scenar...
- The Effect of the Raters' Marginal Distributions on Their Matched Agre...
- Four-Film X-ray Series Is More Sensitive Than 2-Film for Diagnosis of ...
- EXTERNAL VALIDATION OF EXISTING FORMULAS TO PREDICT THE RISK OF DEVELO...
- Factors affecting intercoder reliability: a Monte Carlo experiment
- Underlying determinants driving agreement among coders
- Effectiveness of the PECS Phase III app and choice between the app and...
- The effect of trotting speed on the evaluation of subtle lameness in h...
- Classifier Selection Based on the Correlation of Diversity Measures: W...
- CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON
- Beliefs and biases in web search
- Smoke-Free Workplace Ballot Campaigns: Case Studies from Missouri and ...
- The use of emerging technologies for authentic learning: A ...
- Best-Case Kappa Scores Calculated Retrospectively From EEG Report Data...
- A novel semantic information retrieval system based on a three-level d...
- Guided ordering: Clinician interactions with complex order-sets
- AN ASSESSMENT OF VARIANTS IN THE PROFESSIONAL JUDGEMENT OF GEOMORPHOLO...
- What Is the Truth? An Application of the Extended Parallel Process Mod...
- Fetal Heart Disease: Severity, Associated Anomalies and Parental Decis...
- References
- Fifty most cited articles in orthopedic shoulder surgery
- Access to multimodal articles for individuals with sight impairments
- Measuring the quality of Patients’ goals and action plans: development...
- Developing a standardized approach to the assessment of pain in childr...
- Perpetuating the Myth of the Culture War Court? Issue Attention in New...
- A Study on Comparison of Generalized Kappa Statistics in Agreement Ana...
- Inter-examiner reliability of active combined movements assessment of ...
- Validity of Alternative Cut-Off Scores for the Back-Saver Sit and Reac...
- Coordination Tests in Persons With Acute Central Nervous System Pathol...
- Colorado Upper-Division Electrostatics diagnostic: A conceptual assess...
- Individualisierende Lernaufgaben im Geschichtsunterricht
- Mindfulness groups for early psychosis: A qualitative study
- A comprehensive process of content validation of curriculum consensus ...
- Improving the Reproducibility of the Gleason Scores in Small Foci of P...
- The Element of Naturalness When Evaluating Image Quality of Digital Ph...
- Automatic fusion of region-based classifiers for coffee crop recogniti...
- Cephalometric Evaluation of Airways after Maxillary Anterior Advanceme...
- Agreement between Internet-Based Self- and Proxy-Reported Health Care ...
- Cohen’s quadratically weighted kappa is higher than linearly weighted ...
- A family of multi-rater kappas that can always be increased and decrea...
- The effect of combining categories on Bennett, Alpert and Goldstein’s
- Equivalences of weighted kappas for multiple raters
- Classification Algorithm for the Determination of Suicide Attempt and ...
- Autism and epistemology III: Child development, behavioral stability, ...
- Some Paradoxical Results for the Quadratically Weighted Kappa
- Cohen’s linearly weighted kappa is a weighted average
- Use of simulation-based education to improve resident learning and pat...
- Changes in bird communities in Swaziland savannas between 1998 and 200...
- Repeatability and Reproducibility of Decisions by Latent Fingerprint E...
- The Personality of a Nonperson: Gauging the Inner Skinner
- The Female Sexual Function Index: Translation and Validation of an Ira...
- Field reliability of competence to stand trial opinions: How often do ...
- The potential for integration of environmental data from regional stra...
- Obesity in the New Media: A Content Analysis of Obesity Videos on YouT...
- Reliability of the Spinal Deformity Study Group Classification of Lumb...
- Molecular characterisation of cell line models for triple-negative bre...
- Meta-analysis of Cohen’s kappa
- Evaluation of image quality of digital photo documentation of female g...
- Classification and treatment of proximal humerus fractures: inter-obse...
- Cohen’s kappa is a weighted average
- Assumed Transmission in Political Science: A Call for Bringing Descrip...
- Characteristics of Creative Expression Activities: The Links Between C...
- Reliability and Diagnostic Accuracy of the Lachman Test Performed in a...
- Dimensional mapping: Applying DQR and MDS to explore the perceptions o...
- Statistical Issues in the Interpretation of Pearson et alʼs Study of L...
- Isocitrate Dehydrogenase 1 Analysis Differentiates Gangliogliomas from...
- Death to Kappa: birth of quantity disagreement and allocation disagree...
- Knowledge-telling and knowledge-transforming arguments in mock jurors'...
- Use of a continuing medical education course to improve fellows' knowl...
- The Guy's Stone Score—Grading the Complexity of Percutaneous Nephrolit...
- Cohen’s Linearly Weighted Kappa is a Weighted Average of 2×2 Kappas
- Comparison of different diagnostic procedures for the staging of malfo...
- Utility of Combined Two-Dimensional and Three-Dimensional Transesophag...
- Global public health training in the UK: preparing for the future
- Discriminant validity and test-retest reliability of a self-administer...
- Progress Toward Improving the Quality of Cardiac Arrest Medical Team R...
- Patient-reported outcomes in clinical trials of inhaled asthma medicat...
- Validation of a novel method to identify healthcare-associated infecti...
- Agreement and Information in the Reliability of Coding
- Precision of Lumbar Intervertebral Measurements
- Using Consensus Analysis to Investigate Cultural Models of Alzheimer's...
- Enhancing Vocabulary Intervention for Kindergarten Students: Strategic...
- When coders are reliable: The application of three measures to assess ...
- Weighted kappa is higher than Cohen’s kappa for tridiagonal agreement ...
- Microarray-Based Class Discovery for Molecular Classification of Breas...
- Patient-Specific Computational Hemodynamics of Intracranial Aneurysms ...
- An empirical investigation of virtual world projects and metaverse tec...
- Some metrological aspects of the comparison between two ordinal measur...
- YOUTUBE AND THE CHALLENGE TO JOURNALISM
- The Role of Computed Tomography in the Diagnosis and Management of Fem...
- Clinical Indicators for Routine Use in the Evaluation of Early Psychos...
- Kappa Coefficient
- Usefulness
- Bringing baby home together: Examining the impact of a couple‐focused ...
- Scientific peer review
- Inequalities between multi-rater kappas
- A preliminary evaluation of the validity of at-risk criteria for bipol...
- A Formal Proof of a Paradox Associated with Cohen’s Kappa
- Cohen’s kappa can always be increased and decreased by combining categ...
- Quantitative experimental comparison of single-beam, sidescan, and mul...
- Testing for neglect in right-hemispheric stroke patients using a new a...
- Long-Term Retention of Central Venous Catheter Insertion Skills After ...
- Analysis of Spatial Similarities Between NEXRAD and NLDAS Precipitatio...
- Photo Documentation Image Quality Scoring System in the Evaluation of ...
- Finding a place in history: Symbolic and social networks in creative c...
- Constructing business profiles based on keyword patterns on Web sites
- Applying the Health Belief Model to Examine News Coverage Regarding St...
- References
- SPCCTDM, a Catalogue for Analysis of Therapeutic Drug Monitoring Relat...
- How reliable are annotations via crowdsourcing
- Institutional Logics and Institutional Pluralism: The Contestation of ...
- Inequalities Between Kappa and Kappa-Like Statistics for k×k Tables
- Consistency of accuracy assessment indices for soft classification: Si...
- Reproducibility of Proximal Isovelocity Surface Area, Vena Contracta, ...
- Defining Respectful Leadership: What It Is, How It Can Be Measured, an...
- Accuracy assessments and uncertainty analysis of spatially explicit mo...
- The Impact of Gender Differences on Response Strategy in e-Negotiation
- Analysis of Negotiation Processes
- Peirce's i ...
- Relative expertise in an everyday reasoning task: Epistemic understand...
- Simulation-based mastery learning reduces complications during central...
- Simulation-based mastery learning reduces complications during central...
- Use of simulation‐based mastery learning to improve the quality of cen...
- Trust in virtual teams
- Mastery Learning of Temporary Hemodialysis Catheter Insertion by Nephr...
- Diagnostic accuracy of positive contrast computed tomography arthrogra...
- Query-based opinion summarization for legal blog entries
- Generating Robot/Agent backchannels during a storytelling experiment
- Aldosterone Excess or Escape: Treating Resistant Hypertension
- Standard Setting in Relation to the Common European Framework of Refer...
- Possible Selves in Marital Roles: The Impact of the Anticipated Divisi...
- Magnetic Resonance Imaging Interpretation in Patients With Symptomatic...
- Creating a better discharge summary: Improvement in quality and timeli...
- Business Process Modeling: Perceived Benefits
- Systematic and Random Disagreement and the Reliability of Nominal Data
- Inter-Coder Agreement for Computational Linguistics
- Intrarater Reliability
- Variance Estimation of Nominal-Scale Inter-Rater Reliability with Rand...
- On population‐based measures of agreement for binary classifications
- Using Pooled Kappa to Summarize Interrater Agreement across Many Items
- Resampling Probability Values for Weighted Kappa with Multiple Raters
- Testing Measurement Reliability in Older Populations...
- Constructing self‐efficacy at work: a person‐centered perspective
- Chance-Corrected Measures of Reliability and Validity in 2 × 2 Tables
- Respektvolle Führung und ihre Bedeutung für die Gestaltung von Verände...
- Understanding Methodological Differences to Study Convergence in Group...
- On the Marginal Dependency of Cohen’s κ
- What Happened to Cross-Cultural Dyadic E-Negotiation?
- Simulation-Based Education Improves Quality of Care During Cardiac Arr...
- In Defense of Content Analysis Methodology
- Mastery learning of thoracentesis skills by internal medicine resident...
- A comparison of the methodological quality of articles in computer sci...
- The Exact Variance of Weighted Kappa with Multiple Raters
- Is the World Flat or Spiky? Information Intensity, Skills, and Global ...
- Content Analysis Through the Machine Learning Mill
- Measurement System Analysis for Categorical Measurements: Agreement an...
- An Alternative Measure of Effect Size for Cochran's Q Test for Related...
- Agreement and Kappa-Type Indices
- Comparative assessment of the measures of thematic classification accu...
- A Cross-Cultural Analysis of Privacy Notices of the Global 2000
- Answering the Call for a Standard Reliability Measure for Coding Data
- Estimation for the Change of Daily Maxima Temperature
- A New Method of Yielding the GDP of Korea Small Business: Conversion o...
- A New Measure of Agreement to Resolve the Two Paradoxes of Cohen's Kap...
- Development and Evaluation of High-Fidelity Simulation Case Scenarios ...
- From Words to Numbers: How to Transform Qualitative Data into Meaningf...
- THE EXACT VARIANCE OF WEIGHTED KAPPA WITH MULTIPLE RATERS
- ETHNOCOMPUTING IN TANZANIA: DESIGN AND ANALYSIS OF A CONTEXTUALIZED IC...
- Including Omission Mistakes in the Calculation of Cohen's Kappa and an...
- A Longitudinal Study of Internal Medicine Residents??? Retention of Ad...
- The State of Internet-Related Research in Communications, Marketing, a...
- SO YOU DIDN'T GET THE JOB … NOW WHAT DO Y...
- Gender Salience in Electronic Negotiations
- The phenomenology of fit: Linking the person and environment to the su...
- Observation of children with attention‐deficit hyperactivity (ADHD) pr...
- Scope of Self: Toward a Model of Television's Effects on Self-Complexi...
- Peirce's 19th Century Mixture Model Approach to Rater Agreement
- Book Review: Analyzing Rater Agreement: Manifest Variable Methods
- Mastery learning of advanced cardiac life support skills by internal m...
- An Alternative to Cohen's κ
- Graduating internal medicine residents’ self-assessment and performanc...
- Chance-corrected measures of reliability and validity in K K tables
- A Comparison of Methods for the Evaluation of Binary Measurement Syste...
- The continuing challenges of testing species distribution models
- The Roles of Marriage and Anger Dysregulation in Biobehavioral Stress ...
- Simulation-Based Training of Internal Medicine Residents in Advanced C...
- The Kappa Statistic in Reliability Studies: Use, Interpretation, and S...
- Deriving word meaning from written context: a process analysis
- Can One Use Cohen’s Kappa to Examine Disagreement?
- The effects of species’ range sizes on the accuracy of distribution mo...
- Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavi...
- Reliability in Content Analysis.
- Assessing pain in patients with severe cerebral palsy: Development, re...
- Interexaminer Reliability of Symptom-Provoking Active Sidebend, Rotati...
- Correlates of Wisdom‐Related Performance in Adolescence and Adulthood:...
- Interrater Agreement Measures: Comments on Kappa n ...
- Measuring intercultural sensitivity: The intercultural development inv...
- Content Analysis in Mass Communication: Assessment and Reporting of In...
- Conversational Functions of Autobiographical Remembering: Long-Married...
- Kappa coefficients in medical research
- The role of functional capacity evaluation in management of foot and a...
- An Examination of Interrater Reliability for Scoring the Rorschach Com...
- Indexing systematic rater agreement with a latent-class model.
- Models for Ordinal Agreement Data
- The Use of Electronic Medical Records: Communication Patterns in Outpa...
- The SEGUE Framework for teaching and assessing communication skills
- Kappa as a Parameter of a Symmetry Model for Rater Agreement
- Predicting Student Success on a State-mandated Performance-based Asses...
- Nonasymptotic Significance Tests for Two Measures of Agreement
- A Measure of Agreement for Interval or Nominal Multivariate Observatio...
- Interrater Agreement and Reliability
- Comparing case-based reasoning classifiers for predicting high risk so...
- Seeds of wisdom: Adolescents' knowledge and judgment about difficult l...
- Interrater Reliability
- NONASYMPTOTIC SIGNIFICANCE TESTS FOR TWO MEASURES OF AGREEMENT
- Statistical description of interrater variability in ordinal ratings
- When experience counts most: effects of experiential similarity on men...
- THE SELF-CONCEPT IN INSTITUTIONALIZED AND NON-INSTITUTIONALIZED ELDERL...
- Examining Information Processing on the World Wide Web Using Think Alo...
- Some Characteristics of Positive and Negative (“Most Traumatic”) Event...
- A note on interval estimation of kappa in a series of 2×2 tables
- ‘Mental Model’ Comparison of Automated and Human Scoring
- Simple Procedures to Estimate Chance Agreement and Kappa for the Inter...
- Testing Contrasting Interaction Models for Discriminating between Cons...
- Combining Qualitative and Quantitative Methodologies to Study Group Pr...
- Methodological Comment: Temporal Stability of Older Person's Spontaneo...
- Comkappa: A Windows ’95 program for calculating kappa and related stat...
- Temporal Linkages Between Wives' Pursuit and Husbands' Withdrawal Duri...
- Medical Student Performance on a Geriatrics Problem in a Clinical Prac...
- A Cognitive Evaluation of Frame-of-Reference Rater Training: Content a...
- Functional Capacity Evaluation
- A comparison study of selected training algorithms for neural networks...
- Observer variation in gynaecological cytopathology
- Selecting and interpreting measures of thematic classification accurac...
- Framing Flames: The structure of argumentative messages on the net
- Planning Skills and Negotiator Goal Accomplishment...
- RETROSPECTIVE REPORTS IN ORGANIZATIONAL RESEARCH: A REEXAMINATION OF R...
- Revising the indexing hypothesis: Officials, media, and the Libya cris...
- The meaning of kappa: Probabilistic concepts of reliability and validi...
- Use of the weighted Kappa coefficient in classification error assessme...
- Why Talk about Mental States? The Significance of Children's Conversat...
- The Hierarchy Principle in Strategic Communication
- Rater Agreement Indexes for Performance Assessment
- Conditional tau coefficient for assessment of producer's accuracy of c...
- Reliability of medical audit in quality assessment of medical care
- Weighting Class Importance in Agricultural Crop Classification from Re...
- Error assessment in decision-tree models applied to vegetation analysi...
- Health promotion in primary care: Physician-patient communication and ...
- Individual Differences in Young Children's Pretend Play with Mother an...
- Training pattern replication and weighted class allocation in artifici...
- Gender differences in gift exchanges: New directions from projections
- The Quality of Qualitative Data: Two Strategies for Analyzing Medical ...
- Children's reasoning about authority in home and school contexts
- The effects of cycled versus noncycled lighting on growth and developm...
- Deciphering media independence: The gulf war debate in television and ...
- Crisis negotiations: A Preliminary investigation of facework in natura...
- DO CHAMELEONS GET AHEAD? THE EFFECTS OF SELF-MONITORING ON MANAGERIAL ...
- Reliability and expected loss: A unifying principle
- “Who's in charge?” Preschool children's concepts of authority
- Reliability Measures for Qualitative Data: Theory and Implications
- Serious and playful aggression in Brazilian girls and boys
- HOW reliable are change‐corrected measures of agreement?
- Social interaction, relationships, and the development of causal disco...
- Communication failure and plan adaptation: If at first you don't succe...
- The Child Behavior Checklist/4-18 and Related Materials: Reliability a...
- Bias, prevalence and kappa
- SPEECH PATTERNS AND THE CONCEPT OF UTILITY IN COGNITIVE MAPS: THE CASE...
- Prevalence of non‐cavitated and cavitated carious lesions in a random ...
- Measures of clinical agreement for nominal and categorical data: The k...
- Discriminant effects of performance-oriented and structure-oriented ma...
- Psychopathy and violent recidivism.
- Testing a cyclical model of communicative openness in relationship dev...
- A comparison of methods for calculating a stratified kappa
- The Influence of Effort, Experience, and Persistence on the Elements o...
- Detecting and Labeling Prejudice: Do Female Perpetrators Go Undetected...
- Family Interactions and the Development of Moral Reasoning
- Models of Chance when Measuring Interrater Agreement with Kappa
- Development and validation of a food use checklist for evaluation of c...
- Toward a contingency approach to marital interaction: An empirical int...
- Sensorimotor and Action Development in Autistic Children from Infancy ...
- Acquiring Assistance from Others The Effect of Indirect Requests and R...
- Intercoder Reliability Estimation Approaches in Marketing: A Generaliz...
- Interjudge Agreement and the Maximum Value of Kappa
- Measuring Patient Intensity: A Reliability Study
- Reliability of Nominal Data Based on Qualitative Judgments
- A Generalization of Cohen's Kappa Agreement Measure to Interval Measur...
- Cross Validation of the Einstein Assessment of School-Related Skills
- Micro-CONGRU: A microcomputer program for measuring levels of overall ...
- High Ability/Learning Disabled Students: How Are They Different?
- Interpretation of bitewing radiographs: Application of the kappa stati...
- Threshold Loss Agreement Indices for Criterion-Referenced Measures: A ...
- The Formation of Social Relationships A Longitudinal Study of Social P...
- ANOTHER LOOK AT INTER‐RATER AGREEMENT
- Kappa, Measures of Marginal Symmetry and Intraclass Correlations
- Agreement among 2 × 2 Agreement Indices
- The Analysis of Verbal Explanations for Marital Separation: Implicatio...
- Gender, social support, and experiential similarity during chronic str...
- SPCCTDM, a Catalogue for Analysis of Therapeutic Drug Monitoring Relat...
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
