Skip to content

synthesis_stage

Synthesis stage for systematic reviews, covering both narrative and quantitative synthesis methods

URI: https://open-and-sustainable.github.io/revaise-model/schema/stages/synthesis

Name: synthesis_stage

Classes

Class Description
Affiliation Institutional affiliation
AgreementMetrics Metrics for measuring agreement between reviewers/extractors
AIAssistance Configuration for AI assistance in any review stage
AIParameter AI model parameter configuration
AIPrompt Prompt configuration for AI interaction
AISession Session details for AI-assisted work
Author Author of a review or publication
        Participant A person participating in the review process
BatchProcessing Batch processing within a session
ConfidenceInterval Confidence interval specification
ConflictPattern Pattern analysis of conflicts
ConflictResolution Resolution of conflicts or disagreements between reviewers
DatasetRef External dataset reference
DateRange A simple date range representation
EvidenceGrading Grading of evidence quality/certainty
ExternalTool External tool or platform used in the review process
FieldAgreement Agreement metrics for a specific field or item
HeterogeneityStatistics Statistics measuring heterogeneity in meta-analysis
HumanModification Record of human modification to AI output
MetaAnalysis Results from a meta-analysis
NarrativeSynthesis Results from narrative synthesis
ParticipantWorkload Workload statistics for a participant
PerformanceMetrics General performance metrics
        AIPerformanceMetrics Performance metrics for AI assistance, extending general performance metrics ...
ProcessMetrics Metrics related to process efficiency and completion
PublicationBiasAssessment Assessment of publication bias
QualityControl Quality control measures and checks
QualityDomain Individual quality domain assessment
ResolutionMethodCount Count of a specific resolution method usage
ResolutionStatistics Statistics about conflict resolution
SensitivityAnalysis Sensitivity analysis to test robustness of results
SessionEnvironment Environment details for a work session
SessionMetrics Metrics for a work session
StageExecution Base class for executing a specific stage of the review
        SynthesisStage Stage for synthesizing evidence from included studies
StageOutput Output file or log produced by a review stage (results, logs, code, visualiza...
StageOutputRef Reference to a stage output in this or another RevAIse bundle
StageProtocol Base class for protocols defining how a review stage should be conducted
        SynthesisProtocol Protocol defining synthesis approach and methods
StageQualityControl Base class for quality control measures across review stages
        SynthesisQualityControl Quality control for synthesis process
StageStatistics Base class for statistics collected about review stages
        SynthesisStatistics Statistics about the synthesis process
StageTrainingInfo Shared training information for review stages
StatisticalTestResult Result of a statistical test
SubgroupAnalysis Subgroup analysis within meta-analysis
SubgroupResult Result for a specific subgroup
SynthesisMethod Specific method used for synthesis
SynthesisTheme Theme identified in narrative synthesis
ToolParameter Configuration parameter for a tool
TrimFillResult Result of trim and fill analysis
WorkSession A work session by a participant on review tasks

Slots

Slot Description
accuracy Overall accuracy
active_duration Active working time in minutes
address Street address of the institution
adjusted_ci_lower Adjusted CI lower
adjusted_ci_upper Adjusted CI upper
adjusted_effect Adjusted effect
adjustment_direction Adjustment direction
affiliations Institutional affiliations of the author
agreement_rate Agreement rate for this field
agreement_sample_size Number of items compared
ai_analysis_session AI analysis session
ai_confidence_threshold Minimum confidence score for accepting AI outputs
ai_config_id Reference to the AIAssistance configuration used
ai_error_handling Strategy for handling AI errors or failures
ai_id Unique identifier for AI assistance configuration
ai_model Name of the AI model
ai_parameters Model parameters and settings
ai_performance_metrics Performance metrics for the AI assistance
ai_prompts Prompts used to interact with the AI
ai_provider AI service provider
ai_purpose Purposes for which AI is used
ai_session_id Unique identifier for AI session
ai_synthesis_session AI session for synthesis
ai_training_description Description of training data or fine-tuning
ai_validation_rules Rules for validating AI outputs
ai_version Version of the AI model
analysis_id Analysis identifier
analysis_name Analysis name
analysis_notes Analysis notes
analysis_sessions Analysis sessions
analyst_ids Analyst identifiers
api_calls Number of API calls made
area_under_curve Area under the ROC curve
assessment_methods Assessment methods
assigned_items_count Number of items assigned to this participant
average_items_per_day Average items processed per day
average_resolution_time Average time to resolve in minutes
backlog_size Number of items remaining
balanced_accuracy Average of sensitivity and specificity
base_agreement_metrics Base agreement metrics
base_calibration_performed Base calibration performed flag
base_completed_date Base stage completion date
base_completion_rate Base completion rate
base_discrepancy_resolutions Base discrepancy resolutions
base_double_checking_rate Base double-checking rate
base_items_completed Base items completed
base_participant_workloads Base participant workloads
base_protocol_date Base protocol date
base_protocol_description Base protocol description
base_protocol_deviations Base protocol deviations
base_protocol_id Base protocol identifier
base_protocol_notes Base protocol notes
base_protocol_software Base protocol software
base_protocol_tools Base protocol tools
base_protocol_training Base protocol training
base_protocol_version Base protocol version
base_qc_id Base QC identifier
base_qc_notes Base QC notes
base_qc_type Base QC type
base_spot_check_rate Base spot check rate
base_started_date Base stage start date
base_stats_id Base statistics identifier
base_stats_notes Base statistics notes
base_total_hours Base total hours
base_total_items Base total items
batch_completion_rate Proportion of batch completed
batch_id Unique identifier for this batch
batch_number Sequential number of this batch
batch_size Number of items in the batch
batch_started_at When batch processing started
beggs_test_result Begg's test result
bias_assessment_id Bias assessment identifier
bias_assessment_notes Bias assessment notes
bias_conclusion Bias conclusion
bias_impact Bias impact
break_frequency Average time between breaks in minutes
browser Browser used if applicable
calculation_verification Calculation verification
checks_performed Specific checks performed
checksum Checksum of the output file
city City where the institution is located
code_review Code review conducted
cohen_kappa Cohen's kappa for inter-rater agreement
common_causes Common causes of this conflict pattern
comparison_groups Comparison groups
completed_at When batch processing completed
completed_items Number of items completed
completed_items_count Number of items completed by this participant
completion_rate Proportion of items completed
conclusion_changed Conclusion changed
confidence_calibration Calibration of AI confidence scores
confidence_interval Confidence interval for the agreement rate
confidence_interval_lower Lower CI
confidence_interval_upper Upper CI
confidence_level Confidence level (e
conflict_of_interest_declared Whether conflicts of interest were declared
conflict_type Type of conflict being resolved
conflicting_items IDs of items in conflict
connection_quality Network connection quality
corrective_actions Corrective actions taken
cost Estimated cost
count Number of times this method was used
country Country where the institution is located
data_transformation_rules Data transformation rules
dataset_name Name of the dataset
department Department or division within the institution
diagnostic_odds_ratio Ratio of odds of positive test in diseased vs non-diseased
disagreement_count Number of disagreements
disagreement_types Types of disagreements observed
downgrade_reasons Downgrade reasons
effect_change_percentage Effect change percentage
effect_measures Effect measures
effect_size Effect size
eggers_test_result Egger's test result
email Email address of the author
ended_at End time
error_rate Rate of errors made
errors_encountered Errors encountered during the session
evidence_grading Evidence quality grading
expertise_areas Areas of expertise relevant to the review
external_review External review conducted
f1_score Harmonic mean of precision and recall
failsafe_n Fail-safe N
false_discovery_rate Expected proportion of false discoveries
false_negative_rate Type II error rate
false_omission_rate Proportion of false negatives among negative calls
false_positive_rate Type I error rate
family_name Family/last name of the author
field_identifier Identifier of the field or item
field_level_agreements Agreement metrics for individual fields
final_decision Final resolved decision or value
final_quality Final quality
first_item_date Date of first item processed
fleiss_kappa Fleiss' kappa for multiple raters
focus_score Measure of session focus/consistency
forest_plot_output Forest plot output
format File format or MIME type
frequency How often this pattern occurs
funnel_plot_output Funnel plot output
given_name Given/first name of the author
grader_ids Grader identifiers
grading_date Grading date
grading_id Grading identifier
grading_notes Grading notes
grading_system Grading system
heterogeneity_assessment Heterogeneity assessment approach
heterogeneity_between_groups Between-group heterogeneity
heterogeneity_statistics Heterogeneity statistics
human_agreement_rate Rate of agreement with human reviewers
human_modifications Modifications made by humans to AI outputs
human_oversight_level Level of human review required
i_squared I-squared statistic
included_studies Included studies
initial_quality Initial quality
inputs Input artifacts
institution_name Name of the affiliated institution
interaction_test_p_value Interaction test p-value
interpretation Interpretation
involved_fields Fields commonly involved in this pattern
involved_participants Participants commonly involved
issues_found Number of issues identified
issues_resolved Number of issues resolved
item_ids_processed IDs of items processed in this session
item_modified Item or field that was modified
items_completed Number of items completed
items_in_batch IDs of items in this batch
items_per_day Average items processed per day
items_per_hour Items processed per hour
items_processed_count Total items processed
kind Kind or type of stage output
krippendorff_alpha Krippendorff's alpha reliability coefficient
last_item_date Date of last item processed
license License governing the dataset
location Location or setting of work
lower_bound Lower bound of the interval
matthews_correlation Matthews correlation coefficient
median_time_per_item Median time per item in minutes
meta_analyses Meta-analyses performed
meta_analyses_count Meta-analyses count
method The resolution method
method_assumptions Method assumptions
method_description Method description
method_id Method identifier
method_justification Justification for method
method_limitations Method limitations
method_name Method name
method_reference Method reference
method_type Type of method
missing_data_strategy Missing data strategy
model_type Model type
modification_id Unique identifier for modification
modification_reason Reason for the modification
modification_timestamp When the modification was made
modified_value Value after human modification
modifier_id ID of the person who made the modification
most_common_conflict_type Most frequently occurring conflict type
n_studies Number of studies
name Full name of the author
narrative_syntheses_count Narrative syntheses count
narrative_synthesis Narrative synthesis results
negative_predictive_value Negative predictive value
notes Additional notes
orcid ORCID identifier for the author
original_ai_value Original value produced by AI
original_decisions Original conflicting decisions or values
original_effect Original effect
outcome_assessed Outcome assessed
outcome_measure Outcome measure
output_created_at Creation timestamp
output_label Human-readable label
outputs Output artifacts
overall_agreement Overall agreement rate across all items
p_value P-value
param_category Parameter category
param_default Default value
param_description Parameter description
param_id Parameter identifier
param_name Parameter name
param_required Whether parameter is required
param_type Parameter data type
param_value Parameter value
parameter_description Description of what this parameter controls
parameter_name Name of the parameter
parameter_value Value of the parameter
parent_analysis_id Parent analysis identifier
participant Participant conducting this session
participant_agreement_matrix Matrix showing agreement patterns between participants
participant_avg_time_per_item Average time spent per item (minutes)
participant_id Reference to the participant
participant_notes Additional notes about the participant
participant_role Role(s) of the participant in the review
pattern_id Unique identifier for this pattern
pattern_type Type of conflict pattern
paused_duration Total paused time in minutes
peak_items_per_day Maximum items processed in a single day
pending_conflicts Number of conflicts pending resolution
percent_agreement Simple percentage agreement
planned_comparisons Planned comparisons
platform Platform or system used
precision Positive predictive value
prediction_interval_lower Prediction interval lower
prediction_interval_upper Prediction interval upper
process_avg_time_per_item Average time per item in minutes
process_total_time_hours Total time spent in hours
processing_speed Average processing time per item (seconds)
prompt_examples Few-shot examples included in the prompt
prompt_id Unique identifier for prompt
prompt_text The actual prompt text
prompt_type Type of prompting strategy
prompt_version Version of this prompt
publication_bias_assessment Publication bias assessment
q_p_value Q p-value
q_statistic Q statistic
qc_id Unique identifier for this quality control check
qc_pass_rate Proportion of items passing QC
qc_performed_by Who performed the QC
qc_sample_size Size of the sample checked
qc_timestamp When QC was performed
qc_type Type of quality control performed
quality_domain_justification Quality domain justification
quality_domain_name Quality domain name
quality_domain_rating Quality domain rating
quality_domains Quality domains
range_description Description of a date range
range_end End of a date range
range_start Start of a date range
resolution_confidence Confidence in the resolution
resolution_duration Time taken to resolve in minutes
resolution_id Unique identifier for this resolution
resolution_method Method used to resolve the conflict
resolution_methods_used Count of each resolution method used
resolution_notes Notes about the resolution process
resolution_rate Proportion of conflicts resolved
resolution_success_rate Success rate of resolutions
resolution_timestamp When the conflict was resolved
resolved_conflicts Number of conflicts resolved
resolver Person or process that resolved the conflict
resource_uri URI locating the resource
rework_rate Rate of items requiring rework
ror_id Research Organization Registry identifier for the institution
sample_method Method used for sampling
selection_models Selection models
sensitivity True positive rate (recall)
sensitivity_analyses Sensitivity analyses
sensitivity_analyses_count Sensitivity analyses count
sensitivity_description Sensitivity description
sensitivity_effect Sensitivity effect
sensitivity_id Sensitivity analysis identifier
sensitivity_notes Sensitivity notes
sensitivity_type Sensitivity type
session_avg_time_per_item Average time per item in minutes
session_duration Duration of the session in seconds
session_ended_at When the session ended
session_environment Environment details for the session
session_id Unique identifier for this session
session_item_ids IDs of items processed in this session
session_notes Notes about the session
session_started_at When the session started
session_status Current status of the session
session_timestamp When this AI session occurred
session_type Type of work session
snapshot_hash Checksum of the dataset snapshot
specificity True negative rate
stage_description Detailed description
stage_label Human-readable label
stage_training_completion_rate Stage training completion rate
stage_training_duration_hours Stage training duration in hours
stage_training_materials_uri URI to stage training materials
stage_training_notes Stage training notes
stage_training_provided Whether stage training was provided
stage_type Type of stage executed
started_at Start time
studies_excluded Studies excluded
studies_filled Studies filled
studies_included Studies included
studies_trimmed Studies trimmed
subgroup_analyses Subgroup analyses
subgroup_analyses_count Subgroup analyses count
subgroup_categories Subgroup categories
subgroup_id Subgroup identifier
subgroup_name Subgroup name
subgroup_notes Subgroup notes
subgroup_results Subgroup results
subgroup_variable Subgroup variable
success_rate Success rate of this method
supporting_studies Supporting studies
supporting_tables Supporting tables
synthesis_approach Approach to synthesis
synthesis_confidence Confidence in synthesis
synthesis_framework Synthesis framework
synthesis_id Synthesis identifier
synthesis_methods Methods used for synthesis
synthesis_patterns Patterns identified
synthesis_protocol Protocol for synthesis
synthesis_quality_control Quality control for synthesis
synthesis_sessions Work sessions
synthesis_statistics Synthesis statistics
synthesis_text Synthesis text
synthesis_themes Synthesis themes
synthesis_visualizations Synthesis visualizations
synthesist_ids Synthesist identifiers
target_field Field or task this prompt targets
tau_squared Tau-squared statistic
test_statistic Test statistic
theme_description Theme description
theme_id Theme identifier
theme_name Theme name
theme_notes Theme notes
theme_strength Theme strength
throughput_trend Trend in processing speed
time_spent_hours Total time spent in hours
token_usage Number of tokens used
tool_ai_models AI models used by the tool
tool_api_endpoint API endpoint URL
tool_api_version API version
tool_citation Recommended citation
tool_configuration_file URI to configuration file
tool_configuration_parameters Configuration parameters
tool_cost Cost information
tool_documentation_url URL to documentation
tool_export_formats Supported export formats
tool_features_used Features of the tool that were used
tool_id Unique identifier for the tool
tool_import_formats Supported import formats
tool_license_type Type of license
tool_limitations Known limitations
tool_name Name of the tool or platform
tool_notes Additional notes
tool_purpose Purpose for which the tool was used
tool_settings Tool settings description
tool_subscription_level Subscription level or plan
tool_url URL to access the tool
tool_vendor Vendor or organization providing the tool
tool_version Version of the tool
tools_used Tools or software used during session
total_comparisons Total number of comparisons made
total_conflicts Total number of conflicts identified
total_items Total number of items to process
total_outcomes_analyzed Total outcomes analyzed
total_participants Total participants
total_studies_synthesized Total studies synthesized
training_completed Training or calibration exercises completed
transparency_measures Transparency measures
trim_fill_result Trim and fill result
upgrade_reasons Upgrade reasons
upper_bound Upper bound of the interval

Enumerations

Enumeration Description
AIPurpose Purpose for which AI is being used
BiasRisk Risk of bias level
ConflictType Types of conflicts that can occur
DatasetKind Types of datasets used in systematic reviews
DomainRating Rating for quality domains
EffectMeasure Types of effect measures
EvidenceQuality Quality/certainty of evidence (GRADE)
EvidenceStrength Strength of evidence
GradingSystem System used for grading evidence
HumanOversightLevel Level of human oversight required
MetaAnalysisModel Type of meta-analysis model
MissingDataStrategy Strategy for handling missing data
ModificationReason Reason for modifying AI output
ParameterType Data types for tool parameters
ParticipantRole Roles that participants can have in the review process
PromptType Type of prompting strategy
PublicationBiasMethod Methods for assessing publication bias
QualityControlType Types of quality control checks
ResolutionMethod Methods for resolving conflicts
SamplingMethod Methods for sampling items for quality control
SensitivityType Type of sensitivity analysis
SessionStatus Status of a work session
SessionType Types of work sessions
StageOutputKind Types of outputs that can be produced by review stages
StageType Logical stages of a systematic review (typical flow)
SynthesisApproach Overall approach to synthesis
SynthesisMethodType Specific type of synthesis method
ToolLicenseType Types of tool licenses
ToolPurpose Purposes for which tools can be used

Types

Type Description
Boolean A binary (true or false) value
Curie a compact URI
Date a date (year, month and day) in an idealized calendar
DateOrDatetime Either a date or a datetime
Datetime The combination of a date and time
Decimal A real number with arbitrary precision that conforms to the xsd:decimal speci...
Double A real number that conforms to the xsd:double specification
Float A real number that conforms to the xsd:float specification
Integer An integer
Jsonpath A string encoding a JSON Path
Jsonpointer A string encoding a JSON Pointer
Ncname Prefix part of CURIE
Nodeidentifier A URI, CURIE or BNODE that represents a node in a model
Objectidentifier A URI or CURIE that represents an object in the model
Sparqlpath A string encoding a SPARQL Property Path
String A character string
Time A time object represents a (local) time of day, independent of any particular...
Uri a complete URI
Uriorcurie a URI or a CURIE

Subsets

Subset Description