Skip to content

quality_metrics

Shared quality and performance metrics used across review stages

URI: https://open-and-sustainable.github.io/revaise-model/schema/objects/quality_metrics

Name: quality_metrics

Classes

Class Description
AgreementMetrics Metrics for measuring agreement between reviewers/extractors
ConfidenceInterval Confidence interval specification
FieldAgreement Agreement metrics for a specific field or item
PerformanceMetrics General performance metrics
ProcessMetrics Metrics related to process efficiency and completion
QualityControl Quality control measures and checks

Slots

Slot Description
accuracy Overall accuracy
agreement_rate Agreement rate for this field
agreement_sample_size Number of items compared
area_under_curve Area under the ROC curve
backlog_size Number of items remaining
balanced_accuracy Average of sensitivity and specificity
checks_performed Specific checks performed
cohen_kappa Cohen's kappa for inter-rater agreement
completed_items Number of items completed
completion_rate Proportion of items completed
confidence_interval Confidence interval for the agreement rate
confidence_level Confidence level (e
corrective_actions Corrective actions taken
diagnostic_odds_ratio Ratio of odds of positive test in diseased vs non-diseased
disagreement_count Number of disagreements
disagreement_types Types of disagreements observed
f1_score Harmonic mean of precision and recall
false_discovery_rate Expected proportion of false discoveries
false_negative_rate Type II error rate
false_omission_rate Proportion of false negatives among negative calls
false_positive_rate Type I error rate
field_identifier Identifier of the field or item
field_level_agreements Agreement metrics for individual fields
fleiss_kappa Fleiss' kappa for multiple raters
issues_found Number of issues identified
issues_resolved Number of issues resolved
items_per_day Average items processed per day
krippendorff_alpha Krippendorff's alpha reliability coefficient
lower_bound Lower bound of the interval
matthews_correlation Matthews correlation coefficient
median_time_per_item Median time per item in minutes
negative_predictive_value Negative predictive value
overall_agreement Overall agreement rate across all items
percent_agreement Simple percentage agreement
precision Positive predictive value
process_avg_time_per_item Average time per item in minutes
process_total_time_hours Total time spent in hours
qc_id Unique identifier for this quality control check
qc_pass_rate Proportion of items passing QC
qc_performed_by Who performed the QC
qc_sample_size Size of the sample checked
qc_timestamp When QC was performed
qc_type Type of quality control performed
sample_method Method used for sampling
sensitivity True positive rate (recall)
specificity True negative rate
throughput_trend Trend in processing speed
total_comparisons Total number of comparisons made
total_items Total number of items to process
upper_bound Upper bound of the interval

Enumerations

Enumeration Description
QualityControlType Types of quality control checks
SamplingMethod Methods for sampling items for quality control

Types

Type Description
Boolean A binary (true or false) value
Curie a compact URI
Date a date (year, month and day) in an idealized calendar
DateOrDatetime Either a date or a datetime
Datetime The combination of a date and time
Decimal A real number with arbitrary precision that conforms to the xsd:decimal speci...
Double A real number that conforms to the xsd:double specification
Float A real number that conforms to the xsd:float specification
Integer An integer
Jsonpath A string encoding a JSON Path
Jsonpointer A string encoding a JSON Pointer
Ncname Prefix part of CURIE
Nodeidentifier A URI, CURIE or BNODE that represents a node in a model
Objectidentifier A URI or CURIE that represents an object in the model
Sparqlpath A string encoding a SPARQL Property Path
String A character string
Time A time object represents a (local) time of day, independent of any particular...
Uri a complete URI
Uriorcurie a URI or a CURIE

Subsets

Subset Description