| accuracy |
Overall accuracy |
| address |
Street address of the institution |
| affiliations |
Institutional affiliations of the author |
| agreement_rate |
Agreement rate for this field |
| agreement_sample_size |
Number of items compared |
| ai_assistance_config |
AI assistance configuration for a review stage |
| ai_confidence_threshold |
Minimum confidence score for accepting AI outputs |
| ai_config_id |
Reference to the AIAssistance configuration used |
| ai_error_handling |
Strategy for handling AI errors or failures |
| ai_id |
Unique identifier for AI assistance configuration |
| ai_model |
Name of the AI model |
| ai_parameters |
Model parameters and settings |
| ai_performance_metrics |
Performance metrics for the AI assistance |
| ai_prompts |
Prompts used to interact with the AI |
| ai_provider |
AI service provider |
| ai_purpose |
Purposes for which AI is used |
| ai_session_id |
Unique identifier for AI session |
| ai_training_description |
Description of training data or fine-tuning |
| ai_validation_rules |
Rules for validating AI outputs |
| ai_version |
Version of the AI model |
| api_calls |
Number of API calls made |
| area_under_curve |
Area under the ROC curve |
| artifact_links_verified |
Whether links to supporting artifacts were verified |
| assigned_items_count |
Number of items assigned to this participant |
| average_items_per_day |
Average items processed per day |
| average_resolution_time |
Average time to resolve in minutes |
| backlog_size |
Number of items remaining |
| balanced_accuracy |
Average of sensitivity and specificity |
| base_agreement_metrics |
Base agreement metrics |
| base_calibration_performed |
Base calibration performed flag |
| base_completed_date |
Base stage completion date |
| base_completion_rate |
Base completion rate |
| base_discrepancy_resolutions |
Base discrepancy resolutions |
| base_double_checking_rate |
Base double-checking rate |
| base_items_completed |
Base items completed |
| base_participant_workloads |
Base participant workloads |
| base_protocol_date |
Base protocol date |
| base_protocol_description |
Base protocol description |
| base_protocol_deviations |
Base protocol deviations |
| base_protocol_id |
Base protocol identifier |
| base_protocol_notes |
Base protocol notes |
| base_protocol_software |
Base protocol software |
| base_protocol_tools |
Base protocol tools |
| base_protocol_training |
Base protocol training |
| base_protocol_version |
Base protocol version |
| base_qc_id |
Base QC identifier |
| base_qc_notes |
Base QC notes |
| base_qc_type |
Base QC type |
| base_spot_check_rate |
Base spot check rate |
| base_started_date |
Base stage start date |
| base_stats_id |
Base statistics identifier |
| base_stats_notes |
Base statistics notes |
| base_total_hours |
Base total hours |
| base_total_items |
Base total items |
| checklist_standard |
Name or identifier of the checklist standard |
| checklist_verified |
Whether reporting checklist completion was verified |
| checks_performed |
Specific checks performed |
| checksum |
Checksum of the output file |
| city |
City where the institution is located |
| cohen_kappa |
Cohen's kappa for inter-rater agreement |
| common_causes |
Common causes of this conflict pattern |
| completed_items |
Number of items completed |
| completed_items_count |
Number of items completed by this participant |
| completion_rate |
Proportion of items completed |
| confidence_calibration |
Calibration of AI confidence scores |
| confidence_interval |
Confidence interval for the agreement rate |
| confidence_level |
Confidence level (e |
| conflict_of_interest_declared |
Whether conflicts of interest were declared |
| conflict_type |
Type of conflict being resolved |
| conflicting_items |
IDs of items in conflict |
| corrective_actions |
Corrective actions taken |
| cost |
Estimated cost |
| count |
Number of times this method was used |
| country |
Country where the institution is located |
| data_availability_plan |
Plan for data availability statements and shared data |
| dataset_name |
Name of the dataset |
| department |
Department or division within the institution |
| deviation_description |
Description of the deviation |
| deviation_from |
Protocol, analysis plan, or workflow element from which the report deviated |
| deviation_impact |
Impact of the deviation on interpretation or conclusions |
| deviation_rationale |
Rationale for the deviation |
| deviation_reported_where |
Location where the deviation is reported |
| diagnostic_odds_ratio |
Ratio of odds of positive test in diseased vs non-diseased |
| disagreement_count |
Number of disagreements |
| disagreement_types |
Types of disagreements observed |
| email |
Email address of the author |
| ended_at |
End time |
| errors_encountered |
Errors encountered during the session |
| expertise_areas |
Areas of expertise relevant to the review |
| f1_score |
Harmonic mean of precision and recall |
| false_discovery_rate |
Expected proportion of false discoveries |
| false_negative_rate |
Type II error rate |
| false_omission_rate |
Proportion of false negatives among negative calls |
| false_positive_rate |
Type I error rate |
| family_name |
Family/last name of the author |
| field_identifier |
Identifier of the field or item |
| field_level_agreements |
Agreement metrics for individual fields |
| final_decision |
Final resolved decision or value |
| first_item_date |
Date of first item processed |
| fleiss_kappa |
Fleiss' kappa for multiple raters |
| flow_counts_reconciled |
Whether flow diagram counts were reconciled against review data |
| format |
File format or MIME type |
| frequency |
How often this pattern occurs |
| given_name |
Given/first name of the author |
| human_agreement_rate |
Rate of agreement with human reviewers |
| human_modifications |
Modifications made by humans to AI outputs |
| human_oversight_level |
Level of human review required |
| inputs |
Input artifacts |
| institution_name |
Name of the affiliated institution |
| involved_fields |
Fields commonly involved in this pattern |
| involved_participants |
Participants commonly involved |
| issues_found |
Number of issues identified |
| issues_resolved |
Number of issues resolved |
| item_ids_processed |
IDs of items processed in this session |
| item_modified |
Item or field that was modified |
| items_per_day |
Average items processed per day |
| items_processed_count |
Total items processed |
| kind |
Kind or type of stage output |
| krippendorff_alpha |
Krippendorff's alpha reliability coefficient |
| last_item_date |
Date of last item processed |
| license |
License governing the dataset |
| lower_bound |
Lower bound of the interval |
| matthews_correlation |
Matthews correlation coefficient |
| median_time_per_item |
Median time per item in minutes |
| method |
The resolution method |
| modification_id |
Unique identifier for modification |
| modification_reason |
Reason for the modification |
| modification_timestamp |
When the modification was made |
| modified_value |
Value after human modification |
| modifier_id |
ID of the person who made the modification |
| most_common_conflict_type |
Most frequently occurring conflict type |
| name |
Full name of the author |
| negative_predictive_value |
Negative predictive value |
| notes |
Additional notes |
| open_access_plan |
Open access plan for reports or manuscripts |
| orcid |
ORCID identifier for the author |
| original_ai_value |
Original value produced by AI |
| original_decisions |
Original conflicting decisions or values |
| output_created_at |
Creation timestamp |
| output_label |
Human-readable label |
| outputs |
Output artifacts |
| overall_agreement |
Overall agreement rate across all items |
| param_category |
Parameter category |
| param_default |
Default value |
| param_description |
Parameter description |
| param_id |
Parameter identifier |
| param_name |
Parameter name |
| param_required |
Whether parameter is required |
| param_type |
Parameter data type |
| param_value |
Parameter value |
| parameter_description |
Description of what this parameter controls |
| parameter_name |
Name of the parameter |
| parameter_value |
Value of the parameter |
| participant_agreement_matrix |
Matrix showing agreement patterns between participants |
| participant_avg_time_per_item |
Average time spent per item (minutes) |
| participant_id |
Reference to the participant |
| participant_notes |
Additional notes about the participant |
| participant_role |
Role(s) of the participant in the review |
| pattern_id |
Unique identifier for this pattern |
| pattern_type |
Type of conflict pattern |
| peak_items_per_day |
Maximum items processed in a single day |
| pending_conflicts |
Number of conflicts pending resolution |
| percent_agreement |
Simple percentage agreement |
| planned_reporting_standards |
Reporting standards planned for use |
| precision |
Positive predictive value |
| preprint_plan |
Plan for preprint posting |
| prisma_flow_diagram |
PRISMA flow diagram information if applicable |
| prisma_flow_id |
Identifier for a PRISMA flow diagram |
| prisma_flow_notes |
Notes about the PRISMA flow diagram |
| prisma_flow_output |
PRISMA flow diagram artifact |
| prisma_flow_standard |
PRISMA flow standard used |
| prisma_studies_included |
Number of studies included in the review |
| process_avg_time_per_item |
Average time per item in minutes |
| process_total_time_hours |
Total time spent in hours |
| processing_speed |
Average processing time per item (seconds) |
| prompt_examples |
Few-shot examples included in the prompt |
| prompt_id |
Unique identifier for prompt |
| prompt_text |
The actual prompt text |
| prompt_type |
Type of prompting strategy |
| prompt_version |
Version of this prompt |
| publication_acceptance_date |
Date and time of acceptance |
| publication_doi |
Publication DOI |
| publication_id |
Identifier for a publication record |
| publication_notes |
Notes about the publication record |
| publication_publication_date |
Date and time of publication |
| publication_records |
Publication, submission, and dissemination records |
| publication_submission_date |
Date and time of submission |
| publication_url |
Publication URL |
| publication_venue |
Journal, platform, repository, or venue |
| publications_count |
Number of publication records |
| qc_id |
Unique identifier for this quality control check |
| qc_pass_rate |
Proportion of items passing QC |
| qc_performed_by |
Who performed the QC |
| qc_sample_size |
Size of the sample checked |
| qc_timestamp |
When QC was performed |
| qc_type |
Type of quality control performed |
| range_description |
Description of a date range |
| range_end |
End of a date range |
| range_start |
Start of a date range |
| records_identified |
Number of records identified |
| records_screened |
Number of records screened |
| report_date |
Date associated with the report document |
| report_document_id |
Identifier for a report document |
| report_document_type |
Type of report document |
| report_documents |
Manuscripts, preprints, reports, and supplementary reporting documents |
| report_documents_count |
Number of report documents |
| report_doi |
DOI for the report document |
| report_output |
Report document output artifact |
| report_publication_status |
Publication status of the report |
| report_status |
Status of the report document |
| report_title |
Title of the report document |
| report_uri |
URI for the report document |
| report_version |
Version of the report document |
| reporting_approval_date |
Date and time of approval |
| reporting_approval_id |
Identifier for a reporting approval |
| reporting_approval_notes |
Notes about the approval |
| reporting_approval_role |
Role of the approver |
| reporting_approval_status |
Status of the approval |
| reporting_approvals |
Author, stakeholder, or governance approvals for reports |
| reporting_approver |
Participant providing approval |
| reporting_checklist_id |
Identifier for a reporting checklist |
| reporting_checklist_items |
Items in the reporting checklist |
| reporting_checklist_items_complete |
Number of completed reporting checklist items |
| reporting_checklist_items_total |
Total number of reporting checklist items |
| reporting_checklist_output |
Checklist artifact output |
| reporting_checklist_status |
Overall checklist completion status |
| reporting_checklist_version |
Version of the reporting checklist |
| reporting_checklists |
Reporting checklists and item-level completion information |
| reporting_deviation_id |
Identifier for a reporting deviation |
| reporting_deviations |
Protocol deviations disclosed in reporting |
| reporting_deviations_count |
Number of reporting deviations |
| reporting_item_artifact_refs |
References to model artifacts supporting the reporting item |
| reporting_item_id |
Identifier for a reporting checklist item |
| reporting_item_label |
Short label for the reporting item |
| reporting_item_location |
Location in the report where the item is addressed |
| reporting_item_notes |
Notes about the reporting item |
| reporting_item_status |
Completion status for the reporting item |
| reporting_item_text |
Text or description of the reporting item |
| reporting_peer_review |
Whether reporting received internal peer review |
| reporting_protocol |
Protocol or plan for reporting the review |
| reporting_quality_control |
Quality control measures for reporting |
| reporting_standard_id |
Identifier for a reporting standard |
| reporting_standard_name |
Name of the reporting standard |
| reporting_standard_scope |
Scope or applicability of the reporting standard |
| reporting_standard_status |
Completion status for the reporting standard |
| reporting_standard_uri |
URI for the reporting standard |
| reporting_standard_version |
Version of the reporting standard |
| reporting_standards |
Reporting standards used or planned |
| reporting_standards_count |
Number of reporting standards documented |
| reporting_statistics |
Summary statistics for the reporting process |
| reporting_timeline |
Timeline or schedule for reporting |
| reporting_transparency_check |
Whether transparency statements were checked |
| reports_assessed |
Number of reports assessed for eligibility |
| reports_sought |
Number of reports sought for retrieval |
| resolution_confidence |
Confidence in the resolution |
| resolution_duration |
Time taken to resolve in minutes |
| resolution_id |
Unique identifier for this resolution |
| resolution_method |
Method used to resolve the conflict |
| resolution_methods_used |
Count of each resolution method used |
| resolution_notes |
Notes about the resolution process |
| resolution_rate |
Proportion of conflicts resolved |
| resolution_success_rate |
Success rate of resolutions |
| resolution_timestamp |
When the conflict was resolved |
| resolved_conflicts |
Number of conflicts resolved |
| resolver |
Person or process that resolved the conflict |
| resource_uri |
URI locating the resource |
| ror_id |
Research Organization Registry identifier for the institution |
| sample_method |
Method used for sampling |
| sensitivity |
True positive rate (recall) |
| session_duration |
Duration of the session in seconds |
| session_timestamp |
When this AI session occurred |
| snapshot_hash |
Checksum of the dataset snapshot |
| specificity |
True negative rate |
| stage_description |
Detailed description |
| stage_label |
Human-readable label |
| stage_training_completion_rate |
Stage training completion rate |
| stage_training_duration_hours |
Stage training duration in hours |
| stage_training_materials_uri |
URI to stage training materials |
| stage_training_notes |
Stage training notes |
| stage_training_provided |
Whether stage training was provided |
| stage_type |
Type of stage executed |
| started_at |
Start time |
| success_rate |
Success rate of this method |
| target_audiences |
Intended audiences for the report |
| target_field |
Field or task this prompt targets |
| target_publication_types |
Planned publication or dissemination types |
| throughput_trend |
Trend in processing speed |
| time_spent_hours |
Total time spent in hours |
| token_usage |
Number of tokens used |
| tool_ai_models |
AI models used by the tool |
| tool_api_endpoint |
API endpoint URL |
| tool_api_version |
API version |
| tool_citation |
Recommended citation |
| tool_configuration_file |
URI to configuration file |
| tool_configuration_parameters |
Configuration parameters |
| tool_cost |
Cost information |
| tool_documentation_url |
URL to documentation |
| tool_export_formats |
Supported export formats |
| tool_features_used |
Features of the tool that were used |
| tool_id |
Unique identifier for the tool |
| tool_import_formats |
Supported import formats |
| tool_license_type |
Type of license |
| tool_limitations |
Known limitations |
| tool_name |
Name of the tool or platform |
| tool_notes |
Additional notes |
| tool_purpose |
Purpose for which the tool was used |
| tool_settings |
Tool settings description |
| tool_subscription_level |
Subscription level or plan |
| tool_url |
URL to access the tool |
| tool_vendor |
Vendor or organization providing the tool |
| tool_version |
Version of the tool |
| total_comparisons |
Total number of comparisons made |
| total_conflicts |
Total number of conflicts identified |
| total_items |
Total number of items to process |
| training_completed |
Training or calibration exercises completed |
| upper_bound |
Upper bound of the interval |