CDLSO Services

Validation & Verification Support

METHOS SUPPORT BY DISCIPLINE

Validation is not one protocol applied uniformly across a laboratory. The performance characteristics that must be established, the experiments that establish them, and the failure modes that must be ruled out differ substantially by analyte class, platform, and specimen matrix.

 

The sections below describe how nuCARE’s support is applied within each discipline we work in, and where the analytical risk tends to concentrate in each.

Establishing Scope Before Designing Studies

Before any experiment is designed, the laboratory must determine which regulatory pathway applies under 42 CFR §493.1253. The determination drives everything downstream, and a misclassified scope is among the more consequential findings a laboratory can carry into an inspection.

Verification

Applies to unmodified FDA-cleared or FDA-approved methods. The laboratory demonstrates that it can reproduce the manufacturer's established performance in its own hands, with its own operators and specimens: accuracy, precision, reportable range, and confirmation that the manufacturer's reference intervals are appropriate for the population the laboratory serves.

Validation

Applies to laboratory-developed tests, to modified FDA-cleared methods, and to non-waived methods not subject to FDA clearance. Here the laboratory establishes rather than verifies: accuracy, precision, analytical sensitivity, analytical specificity including interfering substances, reportable range, reference intervals, and any other performance characteristic required for test performance.

The line between the two is crossed more easily than most laboratories expect. Changing the specimen type, transport or collection device, extraction chemistry, sample volume, cutoff, or instrument platform converts a verification into a validation. nuCARE helps laboratories make that determination, and document the reasoning behind it, before study design begins.

Toxicology

Toxicology validation is dominated by two problems: resolving structurally related compounds from one another, and demonstrating defensible performance in the immediate vicinity of the decision point. Presumptive immunoassay screening and definitive chromatographic-mass spectrometric methods carry different obligations and are validated as distinct method systems, not as a single workflow.

Performance Characteristics

• Calibration model and weighting across the intended quantitative range, evaluated on the behavior of the residuals and back-calculated calibrators rather than on the correlation coefficient alone

• Limit of detection, lower limit of quantitation, and cutoff performance, with concordance evaluated at concentrations bracketing the administrative cutoff — commonly ±25% and ±50% of the decision point

• Within-run, between-run, and between-day precision established at low, near-cutoff, and upper-range concentrations

• Bias and accuracy assessed against reference material sourced independently from the calibrator material

• Carryover, evaluated by analyzing blank matrix immediately following the highest calibrator or a supraphysiologic specimen

• Dilution integrity for specimens exceeding the quantitative range

• Stability under the laboratory’s actual handling conditions: benchtop, refrigerated, frozen, freeze–thaw cycling, and processed-extract stability in the autosampler

Method-Specific Considerations

Molecular Infectious Disease by PCR

Most syndromic molecular panels in this space are laboratory-developed tests, which places them squarely in the full validation pathway. The validation burden scales with the number of organism targets multiplied by the number of accepted specimen sources — each source is a distinct matrix with its own extraction behavior, background flora, and inhibitor profile. A panel validated on one specimen type has not been validated on the others.
Performance Characteristics

• Limit of detection determined per target and per specimen matrix, using replicate testing across a dilution series bracketing the endpoint and analyzed by probit or comparable regression, rather than assigned from the last dilution that happened to amplify

• Analytical inclusivity across the strains, serovars, and genotypes clinically relevant to each organism target, supported by in silico alignment of primer and probe sequences and by wet testing where isolates are obtainable

• Analytical specificity and exclusivity against phylogenetic near neighbors, commensal flora native to the matrix, and off-panel organisms that produce the same clinical syndrome

• Competitive interference within the multiplex, challenged with high-titer and low-titer target combinations that reflect realistic co-infection rather than single-organism spikes

• Reproducibility across operators, instruments, extraction batches, reagent lots, and days

• Inhibition monitoring through an internal or extraction control, with defined cycle-threshold shift criteria that render a result invalid

• Threshold and cycle-cutoff determination, with documented criteria for indeterminate results and defined repeat or reflex algorithms

• Specimen stability and transport-medium compatibility established for every collection device the laboratory accepts

Considerations by Specimen Source
Resistance Markers and Contamination Control

• Resistance determinants. Detection of a resistance gene in a polymicrobial specimen cannot be attributed to a specific organism present, and genotype does not establish phenotype. The reporting language and limitation statements that convey this are part of what is validated, not commentary appended afterward.

 

• Amplicon contamination control. Unidirectional workflow, physical separation of pre- and post-amplification areas, dUTP/UNG carryover prevention where the chemistry supports it, no-template controls, and environmental surface monitoring are treated as validated elements of the method system with defined acceptance criteria.

General Chemistry

Chemistry is the discipline where verification is most often treated as a formality. Because the assays are typically FDA-cleared, the regulatory obligation is the shorter one — but the elements that most affect patient results, particularly reference interval suitability, interference behavior, and the reportable range, are also the ones most commonly abbreviated.
Performance Characteristics

• Precision established at two or more concentrations spanning the medical decision points, over multiple days rather than within a single run, and compared explicitly against the manufacturer’s claim

• Trueness and bias by method comparison against the incumbent or a reference method, using patient specimens distributed across the analytical measurement range and evaluated by Deming or Passing–Bablok regression with difference plots — a correlation coefficient does not demonstrate agreement

• Reportable range: linearity across the analytical measurement range, calibration verification at defined intervals, and validated dilution protocols where a clinical reportable range extends beyond it

• Reference intervals verified by transference where the laboratory’s population matches the manufacturer’s, established directly where it does not, with attention to partitioning by age and sex

• Analytical sensitivity — limit of blank, detection, and quantitation — where the low end of the range carries clinical weight

• Interference: hemolysis, icterus, and lipemia thresholds established or verified on the specific platform, alongside analyte-specific and common drug interferents

• Carryover between high- and low-concentration specimens, including sample probe and reagent cross-contamination pathways

• Specimen-type equivalence across every tube type the laboratory accepts — serum, lithium heparin plasma, and gel-barrier tubes are not interchangeable by assumption

Method-Specific Considerations

Pharmacogenetics

Pharmacogenetic validation has two halves that are easily conflated: establishing that the assay calls genotypes correctly, and establishing that the laboratory translates those genotypes into diplotypes, phenotypes, and interpretive text correctly. The second half is validated far less often than the first, and it is where reporting error tends to originate.
Performance Characteristics

• Accuracy against well-characterized reference materials, with orthogonal confirmation by an independent method for every interrogated variant. Genotyping accuracy is conventionally held to complete concordance rather than to a statistical acceptance band

• Precision and reproducibility across runs, operators, instruments, reagent lots, and days, including repeat determination on the same specimen

• Analytical sensitivity expressed as the validated input range and quality tolerance for nucleic acid, established at both the low and high ends rather than at a single nominal input

• Specimen-type validation for each accepted source — whole blood, buccal swab, saliva — treated as distinct matrices, with heparinized specimens evaluated specifically for inhibition

• Call rate and no-call rate characterized, with defined repeat and reflex criteria

• Reportable range defined explicitly as the list of variants interrogated, with the corollary that undetected does not mean absent

Method-Specific Considerations

Cancer Genomics

Next-generation sequencing is where the wet bench and the bioinformatics pipeline must be validated as a single system, and where the pipeline is the component most often under-documented. A panel that performed acceptably at validation can behave differently after a chemistry change, a panel content update, or a pipeline version increment, which is why the deliverable here is a defined revalidation framework rather than a single completed study.
Performance Characteristics

• Limit of detection expressed by variant class and by variant allele fraction, established across a dilution series of blended reference material rather than at a single dilution point

• Accuracy and concordance against orthogonally characterized specimens and consensus reference materials, with sensitivity, specificity, and positive predictive value reported separately for single-nucleotide variants, small insertions and deletions, large insertions and deletions, copy-number alterations, and fusions — aggregate accuracy across variant classes conceals the classes that perform worst

• Coverage depth and uniformity, with a defined minimum depth per interrogated position and an explicit policy for positions falling below it

• Reproducibility within run, between runs, between instruments, between operators, and across reagent lots

• Specificity and false-positive characterization, including systematic artifact classes: fixation-induced deamination, homopolymer-associated indel artifact, and mapping error in paralogous and pseudogene regions

• Reportable range defined as the specific genomic regions and variant classes the assay interrogates at validated performance, stated as such in the report

Method-Specific Considerations

After Implementation

Validation establishes that a method performs. Keeping it performing is a separate discipline, and the two are connected by the decisions made during the study: the acceptance criteria set during validation become the control limits that govern daily operation.

 

Across every discipline above, nuCARE supports the transition — quality control strategy carried forward from validation data, proficiency testing enrollment or documented alternative performance assessment, calibration verification intervals, competency assessment tied to the methods actually performed, and a defined set of revalidation triggers so the laboratory knows in advance which changes require what response.

 

As with the validation studies themselves, these remain the laboratory’s activities, performed by the laboratory’s qualified personnel, under the authority of its Laboratory Director. Our role is to provide the scientific expertise, structure, training, and guidance that make the process defensible — and to leave the laboratory able to explain its own methods, in its own words, long after the study is filed.

Scroll to Top