Skip to content

Register independent unseen-object BayesianPhysTwin validation #461

Description

@FlorianPfaff

Objective

Test the bounded Bayesian discrepancy/covariance interface on genuinely unseen physical objects or independently acquired object sessions. This is the principal remaining scientific gate after the full-22 tournament retained last_residual and the existing PokeFlex result established same-object new-interaction transfer only.

Frozen statistical design

Use complete physical object-session groups as the independent units. Before target outcomes are opened, freeze:

  • disjoint development, calibration, target, and—where feasible—confirmation object/session rosters;
  • the unchanged physical fallback;
  • last_residual as the principal matched deterministic comparator;
  • at most one Bayesian candidate, without reopening the completed full-22 challenger tournament;
  • the calibration-domain guard and domain covariance-calibration grid;
  • horizons, physical queries, group weighting, bootstrap/permutation procedure, and random seeds;
  • exact fallback and unsupported-domain behavior; and
  • all repository, package, provider, model-set, and numerical-environment identities.

Frames, points, tracks, views, and taxels are not independent groups.

Endpoints

Primary endpoint: equal-object/session difference in a preregistered proper predictive score relative to last_residual and physical fallback.

Secondary endpoints:

  • object-balanced Chamfer distance and track error;
  • coverage and interval width by horizon and domain;
  • harmful accepted-update frequency;
  • exact-fallback frequency and reason;
  • worst-domain and worst-object/session regret;
  • object/session win count; and
  • provider competence reported separately from downstream physical-query benefit.

Decision rule

Advance only if the frozen candidate improves the primary proper score, has no preregistered harmful group regression, passes the domain guard, and preserves exact fallback. A tie retains last_residual. A negative result is complete evidence and must not be retuned on the same target cohort.

Required artifacts

  • protocol and roster identities;
  • calibration and target access attestations;
  • locked numerical environment and dependency resolver input;
  • sealed predictions before target scoring;
  • group-level score table and exact randomization/bootstrap record;
  • content-addressed decision and claim bundle; and
  • explicit paper-facing claim boundary.

Boundary

No existing opened MotionCrafter or Deform360 calibration cohort may be relabelled as fresh confirmation. Physical acquisition or access to a genuinely independent cohort is required before this issue can be completed.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions