2025 Data (Information)

Online Supplement 10 Appendix for Bowers et al. (2025) Mapping Public Open Access K-12 State Education Indicator Data Across 7 States and Washington D.C. Using the FAIR Data Principles: Interrater Reliability Tracker Data

Bowers, Alex J.; Choi, Yeonsoo; Huan, Yingqi; Huang, Yanxing; Jiang, Jingjing; Cibrian Lopez, Ghipsel; Murdoch, Alyssa; Pu, Kecen; Sill, Maeghan; Williams, Jonathan; Wu, Yue Summer; Xu, Guoliang; Saldaña, Christopher; Halverson, Richard

This .xlsx file is the Online Supplement 10 Appendix for the following report published online:

Bowers, A.J., Choi, Y., Huan, Y., Huang, Y., Jiang, J., Cibrian Lopez, G., Murdoch, A., Pu, K., Sill, M., Williams, J., Wu, Y., Xu, G., Saldaña, C., Halverson, R. (2025) Mapping Public Open Access K-12 State Education Indicator Data Across 7 States and Washington D.C. Using the FAIR Data Principles. Teachers College, Columbia University, New York, NY. https://doi.org/10.7916/c0jk-5e64

This .xlsx file includes the Interrater Reliability Tracker data described in the report for each of the 7 states and Washington D.C. The file has four tabs: ABY_Merge, Conference_Notes, Final_Decisions, and Data_Dictionary. ABY_Merge includes two raters’ ratings for each dataset assessed for eligibility in the Screening phase of the project. Each row is for a unique rater and indicator combination and includes the following variables: id, validation_round, rating, quote, quote_page, reasoning, year, supplemental_links, dataset_name, and rater. Conference_Notes includes one row for each dataset screened for eligibility and includes notes about whether the raters conferenced about disagreements in their ratings. The validator_conference, state_captain_conference, and pi_conference columns are all binary, with 0 indicating that level of conferencing did not take place and a 1 indicating that it did. The variables for this tab include: id, conference_notes, validator_conference, state_captain_conference, pi_conference, year, dataset_name, rater_a, rater_b. The Final_Decisions tab includes the results that the two raters agreed upon after any necessary conferencing. There is one row for each dataset and indicator combination. It includes the following variables: id, indicator, rating, quote, quote_page, reasoning, year, supplemental_links, and dataset_name. The fourth tab contains a data dictionary with the variable_name, variable_label, variable_type, and data_values for each variable across the other three tabs. For more information about the screening process and its results, please refer to the full “Mapping Public Open Access K-12 State Education Indicator Data Across 7 States and Washington D.C. Using the FAIR Data Principles” report.

For more information, please see the research report.