Skip to content

stage_quality_control

Shared quality control components for review stages

URI: https://open-and-sustainable.github.io/revaise-model/schema/objects/stage_quality_control

Name: stage_quality_control

Classes

Class Description
Affiliation Institutional affiliation
AgreementMetrics Metrics for measuring agreement between reviewers/extractors
Author Author of a review or publication
        Participant A person participating in the review process
ConfidenceInterval Confidence interval specification
ConflictPattern Pattern analysis of conflicts
ConflictResolution Resolution of conflicts or disagreements between reviewers
DatasetRef External dataset reference
DateRange A simple date range representation
FieldAgreement Agreement metrics for a specific field or item
ParticipantWorkload Workload statistics for a participant
PerformanceMetrics General performance metrics
ProcessMetrics Metrics related to process efficiency and completion
QualityControl Quality control measures and checks
ResolutionMethodCount Count of a specific resolution method usage
ResolutionStatistics Statistics about conflict resolution
StageExecution Base class for executing a specific stage of the review
StageOutput Output file or log produced by a review stage (results, logs, code, visualiza...
StageOutputRef Reference to a stage output in this or another RevAIse bundle
StageQualityControl Base class for quality control measures across review stages

Slots

Slot Description
accuracy Overall accuracy
address Street address of the institution
affiliations Institutional affiliations of the author
agreement_rate Agreement rate for this field
agreement_sample_size Number of items compared
area_under_curve Area under the ROC curve
assigned_items_count Number of items assigned to this participant
average_items_per_day Average items processed per day
average_resolution_time Average time to resolve in minutes
backlog_size Number of items remaining
balanced_accuracy Average of sensitivity and specificity
base_agreement_metrics Base agreement metrics
base_calibration_performed Base calibration performed flag
base_discrepancy_resolutions Base discrepancy resolutions
base_double_checking_rate Base double-checking rate
base_qc_id Base QC identifier
base_qc_notes Base QC notes
base_qc_type Base QC type
base_spot_check_rate Base spot check rate
checks_performed Specific checks performed
checksum Checksum of the output file
city City where the institution is located
cohen_kappa Cohen's kappa for inter-rater agreement
common_causes Common causes of this conflict pattern
completed_items Number of items completed
completed_items_count Number of items completed by this participant
completion_rate Proportion of items completed
confidence_interval Confidence interval for the agreement rate
confidence_level Confidence level (e
conflict_of_interest_declared Whether conflicts of interest were declared
conflict_type Type of conflict being resolved
conflicting_items IDs of items in conflict
corrective_actions Corrective actions taken
cost Estimated cost
count Number of times this method was used
country Country where the institution is located
dataset_name Name of the dataset
department Department or division within the institution
diagnostic_odds_ratio Ratio of odds of positive test in diseased vs non-diseased
disagreement_count Number of disagreements
disagreement_types Types of disagreements observed
email Email address of the author
ended_at End time
expertise_areas Areas of expertise relevant to the review
f1_score Harmonic mean of precision and recall
false_discovery_rate Expected proportion of false discoveries
false_negative_rate Type II error rate
false_omission_rate Proportion of false negatives among negative calls
false_positive_rate Type I error rate
family_name Family/last name of the author
field_identifier Identifier of the field or item
field_level_agreements Agreement metrics for individual fields
final_decision Final resolved decision or value
first_item_date Date of first item processed
fleiss_kappa Fleiss' kappa for multiple raters
format File format or MIME type
frequency How often this pattern occurs
given_name Given/first name of the author
inputs Input artifacts
institution_name Name of the affiliated institution
involved_fields Fields commonly involved in this pattern
involved_participants Participants commonly involved
issues_found Number of issues identified
issues_resolved Number of issues resolved
items_per_day Average items processed per day
items_processed_count Total items processed
kind Kind or type of stage output
krippendorff_alpha Krippendorff's alpha reliability coefficient
last_item_date Date of last item processed
license License governing the dataset
lower_bound Lower bound of the interval
matthews_correlation Matthews correlation coefficient
median_time_per_item Median time per item in minutes
method The resolution method
most_common_conflict_type Most frequently occurring conflict type
name Full name of the author
negative_predictive_value Negative predictive value
notes Additional notes
orcid ORCID identifier for the author
original_decisions Original conflicting decisions or values
output_created_at Creation timestamp
output_label Human-readable label
outputs Output artifacts
overall_agreement Overall agreement rate across all items
participant_agreement_matrix Matrix showing agreement patterns between participants
participant_avg_time_per_item Average time spent per item (minutes)
participant_id Reference to the participant
participant_notes Additional notes about the participant
participant_role Role(s) of the participant in the review
pattern_id Unique identifier for this pattern
pattern_type Type of conflict pattern
peak_items_per_day Maximum items processed in a single day
pending_conflicts Number of conflicts pending resolution
percent_agreement Simple percentage agreement
precision Positive predictive value
process_avg_time_per_item Average time per item in minutes
process_total_time_hours Total time spent in hours
qc_id Unique identifier for this quality control check
qc_pass_rate Proportion of items passing QC
qc_performed_by Who performed the QC
qc_sample_size Size of the sample checked
qc_timestamp When QC was performed
qc_type Type of quality control performed
range_description Description of a date range
range_end End of a date range
range_start Start of a date range
resolution_confidence Confidence in the resolution
resolution_duration Time taken to resolve in minutes
resolution_id Unique identifier for this resolution
resolution_method Method used to resolve the conflict
resolution_methods_used Count of each resolution method used
resolution_notes Notes about the resolution process
resolution_rate Proportion of conflicts resolved
resolution_success_rate Success rate of resolutions
resolution_timestamp When the conflict was resolved
resolved_conflicts Number of conflicts resolved
resolver Person or process that resolved the conflict
resource_uri URI locating the resource
ror_id Research Organization Registry identifier for the institution
sample_method Method used for sampling
sensitivity True positive rate (recall)
snapshot_hash Checksum of the dataset snapshot
specificity True negative rate
stage_description Detailed description
stage_label Human-readable label
stage_type Type of stage executed
started_at Start time
success_rate Success rate of this method
throughput_trend Trend in processing speed
time_spent_hours Total time spent in hours
total_comparisons Total number of comparisons made
total_conflicts Total number of conflicts identified
total_items Total number of items to process
training_completed Training or calibration exercises completed
upper_bound Upper bound of the interval

Enumerations

Enumeration Description
ConflictType Types of conflicts that can occur
DatasetKind Types of datasets used in systematic reviews
ParticipantRole Roles that participants can have in the review process
QualityControlType Types of quality control checks
ResolutionMethod Methods for resolving conflicts
SamplingMethod Methods for sampling items for quality control
StageOutputKind Types of outputs that can be produced by review stages
StageType Logical stages of a systematic review (typical flow)

Types

Type Description
Boolean A binary (true or false) value
Curie a compact URI
Date a date (year, month and day) in an idealized calendar
DateOrDatetime Either a date or a datetime
Datetime The combination of a date and time
Decimal A real number with arbitrary precision that conforms to the xsd:decimal speci...
Double A real number that conforms to the xsd:double specification
Float A real number that conforms to the xsd:float specification
Integer An integer
Jsonpath A string encoding a JSON Path
Jsonpointer A string encoding a JSON Pointer
Ncname Prefix part of CURIE
Nodeidentifier A URI, CURIE or BNODE that represents a node in a model
Objectidentifier A URI or CURIE that represents an object in the model
Sparqlpath A string encoding a SPARQL Property Path
String A character string
Time A time object represents a (local) time of day, independent of any particular...
Uri a complete URI
Uriorcurie a URI or a CURIE

Subsets

Subset Description