Skip to content

additional checks and data validation tools are included in the RDBES data upload process #231

@luciazarauz

Description

@luciazarauz

At the RCG TM 2025, the ISSG Overviews presented a smapling overviews summarizing the data uploaded in CS files, and highligthing some inconsistencies. The group recommended that additional checks and data validation tools are included in the RDBES data upload process, to prevent errors and suggested to post an issue in RDBES gitHub.
Here we present a proposal for these checks, but please, contact the ISSG if further details or clarifications are needed

  1. DEsampScheme: Don’t allow “National Routine”
  2. BVvalueMeas: validation rules depend on the variable BVtypeMeas. In the table below there is a proposal for basic checks
<style> </style>
Condition Type Basic checks
BVtypeMeas  = Age Integer  
BVtypeMeas = Maturity BVvalUnitScale  = SMSF String Code List: stages and substages. WKSMSF 2018 Maturity Scale. Table provided by WGBIOP is pesented below
BVtypeMeas = Sex String Code List: proposed M, F, T, U (for male, female, transitioning or undetermined)
BVtypeMeas = InfoGenetic String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = OtolithCollected String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = Stock String Code List (ices)
BVtypeMeas = ScaleCollected String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = InfoParasite String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = IlliciumCollected String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = InfoGonad String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = SpecimenState   Not sure. Same as SAspecState? https://vocab.ices.dk/?ref=1668
BVtypeMeas = LengthTotal Integer The measured length in mm
BVtypeMeas = LengthPinched Integer The measured length in mm
BVtypeMeas = LengthCarapace Integer The measured length in mm
BVtypeMeas = LengthMantle Integer The measured length in mm
BVtypeMeas = WeightLive Integer The measured weight in g
BVtypeMeas = WeightGutted Integer The measured weight in g
BVtypeMeas = WeightMeasured Integer The measured weight in g
BVtypeMeas is not NA   BVvalueMeas cannot be NA

this is the table provided by WGBIOP for maturity scales:

<style> </style>
Stage Code Description
A. Immature    
B. Developing Ba Developing but functionally immature (first-time developer)
B. Developing Bb Developing and functionally mature
C. Spawning Ca Actively spawning
C. Spawning Cb Spawning capable
D. Regressing/Regenerating Da Regressing
D. Regressing/Regenerating Db Regenerating
E. Omitted spawning    
F. Abnormal    

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions