← all readouts

Do ClinVar-Pathogenic BRCA1 Variants Sit at Lower gnomAD Population Frequency Than Benign Ones?

Exact input: not recorded — legacy attempt

Execution template: not recorded — legacy attempt

annotation

execution observatory

Attempt 2 of 2

done Completed · publish stage
committed record

immutable execution contract

exact input
not recorded — legacy attempt
execution template
not recorded — legacy attempt
  1. scope
  2. dataset
  3. run
  4. write
  5. review
  6. correct
  7. publish

latest committed step

post publication ANNOTATION (methodological_error, flagged via internal_review): The terminal outcome label was recorded as success even though the executed analysis reported p = 0.406 and significant_at_0.05 = false. The paper text correctly describes a non-significant null result; treat this attempt as a null result. Immutable execution rows remain retained unchanged.

correction_recorded · notice · observed · human

committed steps
32
accepted / verified
6
warnings / rejects
1
elapsed
6 minutes
last recorded
tokens recorded
not recorded
data downloaded
994 KB

canonical execution ledger

Every committed step

Public execution facts only — never private model reasoning, prompts, or raw process output.

attempt-2-ledger hal9000/run/68157df7/2 chronological · persisted · archived Reload
  1. 001 orchestration run_queued run · queued · rails Execution attempt 2 queued.
  2. 002 orchestration rerun_requested notice · observed · human Administrator requested a new execution attempt.
  3. 003 orchestration run_claimed run · claimed · rails Engine claimed this execution attempt.
  4. 004 orchestration runner_launch_authorized run · started · rails Execution lease acquired; the runner may launch once.
  5. 005 orchestration wrapper_started run · started · wrapper Opencode process started for this exact attempt.
  6. 006 scoping scope_started action · started · agent Beginning scoping for execution attempt 2.
  7. 007 scoping scope_proposed gate · proposed · agent Proposed one falsifiable scoped question using the supported reference analysis.
  8. 008 data dataset_search_started action · started · agent Searching one bounded zero-auth public source.
  9. 009 data dataset_search_started action · started · agent Searching one bounded zero-auth public source.
  10. 010 data dataset_search_started action · started · agent Searching one bounded zero-auth public source.
  11. 011 data dataset_proposed artifact · proposed · agent Proposed a bounded dataset provenance record for terminal validation.
  12. 012 data dataset_proposed artifact · proposed · agent Proposed a bounded dataset provenance record for terminal validation.
  13. 013 data dataset_proposed artifact · proposed · agent Proposed a bounded dataset provenance record for terminal validation.
  14. 014 analysis analysis_started action · started · agent Executing the allowlisted analysis with a fixed seed.
  15. 015 analysis analysis_observed metric · observed · agent Observed the analysis result and measured its process duration.
  16. 016 writing draft_started action · started · agent Building the initial paper from committed evidence.
  17. 017 writing draft_written artifact · proposed · agent Wrote the initial paper draft from the available evidence.
  18. 018 review review_started action · started · agent Starting an adversarial review against the available source artifacts.
  19. 019 review review_observed gate · observed · agent Observed the review severity counts.
  20. 020 correction correction_started action · started · agent Starting evidence-preserving corrections from the review report.
  21. 021 correction correction_observed gate · observed · agent Observed correction resolution counts and the publication gate.
  22. 022 publishing publication_started action · started · agent Assembling the corrected artifacts for terminal validation.
  23. 023 correction ingest_rejected gate · rejected · rails Terminal payload rejected: dataset 2 access URL contains an invalid public URL
  24. 024 scoping scope_accepted gate · accepted · rails Accepted the run's scoped research question.
  25. 025 data datasets_accepted artifact · accepted · rails Accepted 3 dataset provenance records for this run.
  26. 026 analysis analysis_accepted artifact · accepted · rails Accepted the executed analysis and its server-derived script hash.
  27. 027 publishing figure_accepted artifact · accepted · rails Accepted the validated PNG figure for this run.
  28. 028 publishing paper_accepted artifact · accepted · rails Accepted the run-owned paper for publication.
  29. 029 publishing run_published run · completed · rails Execution attempt 2 published with outcome success.
  30. 030 orchestration wrapper_duration metric · observed · wrapper Measured opencode process duration.
  31. 031 orchestration wrapper_exited run · observed · wrapper Opencode process exited.
  32. 032 post publication correction_recorded notice · observed · human ANNOTATION (methodological_error, flagged via internal_review): The terminal outcome label was recorded as success even though the executed analysis reported p = 0.406 and significant_at_0.05 = false. The paper text correctly describes a non-significant null result; treat this attempt as a null result. Immutable execution rows remain retained unchanged.

exact-attempt artifacts

Artifacts & paper

Nothing on this attempt is borrowed from a newer run.

ℹ This paper carries an annotation. Jul 16, 2026 · methodological error · flagged via internal review. The terminal outcome label was recorded as success even though the executed analysis reported p = 0.406 and significant_at_0.05 = false. The paper text correctly describes a non-significant null result; treat this attempt as a null result. Immutable execution rows remain retained unchanged.

Corrected: Outcome label: null result (the analysis completed successfully, but did not find a statistically significant difference).

The original paper, run-log, and provenance below are unchanged — this notice is added to the record, never a replacement.

Abstract

hal9000/run/68157df7/attempt/2 · published Jul 16, 2026 · p = 4.06e-01 (Mann-Whitney U, two-sided)

p = 4.06e-01 (Mann-Whitney U, two-sided)

We tested whether ClinVar-classified pathogenic variants in BRCA1 have lower population allele frequencies (AF) in gnomAD than benign variants, using a Mann-Whitney U test on raw allele frequencies from 163 variants that overlap both ClinVar and gnomAD (39 pathogenic, 124 benign). The pathogenic group did not show significantly lower frequencies (median AF = 1.37e-06) compared to the benign group (median AF = 6.9e-07); the test yielded p = 4.06e-01 (Mann-Whitney U, two-sided), which is not significant at the 0.05 level. Contrary to the textbook expectation that pathogenic variants are rarer, the observed direction was "pathogenic not rarer" — pathogenic variants actually trended toward higher allele frequencies in this particular slice. We report this as a non-significant null result.

Computed figure for Do ClinVar-Pathogenic BRCA1 Variants Sit at Lower gnomAD Population Frequency Than Benign Ones?
Figure · computed from the named dataset, not illustrative.

Introduction

Pathogenic variants that cause severe disease — particularly early-onset cancers — are expected to be kept at low frequency by purifying selection. For BRCA1, a well-characterized tumor suppressor gene on chromosome 17, loss-of-function variants are strongly associated with hereditary breast and ovarian cancer. The textbook expectation is that ClinVar-classified pathogenic variants should show lower population allele frequencies in gnomAD compared to benign or likely-benign variants.

We tested this hypothesis directly using the anchor cross-annotation analysis (ClinVar × gnomAD × Ensembl), which is the guaranteed-demo path of the HAL 9000 research sprint pipeline.

Methods

Data Sources

Three zero-auth public genomic data sources were queried:

  1. Ensembl REST — Gene lookup for BRCA1 to resolve genomic coordinates (ENSG00000012048, chr17:43044292-43170245, GRCh38).
  2. gnomAD v4 — All exome+genome variants for BRCA1 via the GraphQL API, yielding 7,279 variants with allele frequencies.
  3. ClinVar — The 500 most recent ClinVar records for BRCA1 (retmax=500), of which 275 carried a classifiable clinical significance.

Analysis

  • ClinVar variants were classified as pathogenic (including likely pathogenic) or benign (including likely benign) based on the clinical_significance field. Variants with "conflicting" annotations were excluded from both groups. Of 275 classified variants, 275 were pathogenic or benign.
  • gnomAD variants with AF > 0 were retained (n = 7,279).
  • The join was performed on genomic locus (chrom:pos), since ClinVar often lacks ref/alt alleles and dbSNP rsIDs. gnomAD variants were collapsed to the maximum AF per locus (accounting for multiallelic sites).
  • After the inner join, 163 variants had both a ClinVar significance call and a gnomAD allele frequency: 39 pathogenic, 124 benign.
  • A Mann-Whitney U test (two-sided) was applied to the raw allele frequencies between the pathogenic and benign groups. This non-parametric test was chosen because allele frequencies are heavily right-skewed and span many orders of magnitude. Because the Mann-Whitney U test is rank-based, the result is invariant to monotonic transformations (e.g., log10); the figure uses a log10 scale for visualization only and does not affect the statistic.
  • The analysis used a fixed seed of 1234 for reproducible strip-plot jitter in the figure.

Limitations

  • The ClinVar × gnomAD join is at locus (chrom:pos) granularity, not ref/alt-specific. A single genomic position can carry multiple distinct variants; collapsing to max-AF per locus discards allelic heterogeneity.
  • ClinVar records are capped at retmax=500, so rare or recently submitted variants may be missing.
  • This analysis uses summary-level population frequencies and does not consider individual-level data.
  • ClinVar clinical significance annotations reflect expert curation and may evolve over time; the snapshot here is from July 2026.

Results

Of 275 ClinVar-classified BRCA1 variants, 163 overlapped with gnomAD variants at the same genomic locus: 39 pathogenic and 124 benign variants.

Group n variants Median AF
Pathogenic 39 1.37e-06
Benign 124 6.9e-07

A Mann-Whitney U test on raw allele frequency yielded p = 4.06e-01 (U = 2621.5), which is not significant at the 0.05 level. (The test is rank-based and thus invariant to monotonic transformations; the log10 scale in the figure is for visualization only.) We did not find evidence that pathogenic variants have lower population allele frequencies than benign ones.

The observed direction was "pathogenic not rarer" — pathogenic variants actually showed a higher median allele frequency (1.37e-06) compared to benign variants (6.9e-07). This result contradicts the textbook expectation and warrants cautious interpretation (see Discussion).

Discussion

The null result is surprising given the strong prior expectation that pathogenic BRCA1 variants should be rarer than benign ones. Several factors may explain this:

  1. Locus-level join artifacts. The chrom:pos join is ref/alt-agnostic. A pathogenic variant classified at a given position may not correspond to the same allele reported by gnomAD, inflating the apparent AF of the "pathogenic" group.
  2. ClinVar ascertainment bias. ClinVar records for BRCA1 are enriched for variants with known clinical significance and may over-represent common pathogenic founder mutations that have appreciable population frequency.
  3. Sample size. With only 39 pathogenic variants in the overlap set, the test is underpowered to detect moderate effects.

The result is not evidence that pathogenic BRCA1 variants are common; it is an honest null from a specific analytical slice.

Conclusion

In this analysis of 163 ClinVar × gnomAD overlapping BRCA1 variants (39 pathogenic, 124 benign), we did not find a statistically significant difference in population allele frequency between pathogenic and benign variants (Mann-Whitney U, p = 4.06e-01). The textbook expectation of pathogenic variants being rarer was not supported by this particular join-level analysis.

Provenance

Field Value
Sprint 1
Run 10
Reference template clinvargnomadensembl
Gene BRCA1 (ENSG00000012048)
Seed 1234
Dataset 1 Ensembl REST, ENSG00000012048, chr17:43044292-43170245
Dataset 2 gnomAD (gnomad_r4), ENSG00000012048, chr17:43044295-43170245, 7279 variants
Dataset 3 ClinVar (NCBI E-utilities), BRCA1[gene], 500 records retmax, 275 classified
Total download 1,017,440 bytes
Outcome success (non-significant result)
Headline statistic p = 4.06e-01 (Mann-Whitney U)
Provenance · exact attempt · re-runnable
attempt 2 · exact retained execution
exact input not recorded — legacy attempt
execution template not recorded — legacy attempt
dataset Ensembl REST (ENSG00000012048) · 17:43044292-43170245 (BRCA1, GRCh38)
dataset gnomAD (gnomad_r4) (ENSG00000012048) · 17:43044295-43170245 (BRCA1, GRCh38)
dataset ClinVar (NCBI E-utilities) (BRCA1[gene]) · BRCA1 gene, 500 ClinVar records (retmax=500)
script sha256 722559d586880cac990f8a5552986b941d6a36459b17297e290a1bff24a3a12d
seed 1234
app git sha edcf67e94c93ee9002c7a762caa46984c9aff7c1
statistic {"gene":"BRCA1","seed":1234,"reference_template":"clinvar_gnomad_ensembl","join_key":"genomic locus chrom:pos (ref/alt-agnostic)","n_clinvar_classified":275,"n_merged_with_gnomad_af":163,"n_pathogenic":39,"n_benign":124,"outcome":"success","test":"Mann-Whitney U (two-sided) on allele frequency","u_statistic":2621.5,"p_value":0.4062813737023052,"median_af_pathogenic":0.00000137,"median_af_benign":0.00000069,"direction":"pathogenic not rarer","significant_at_0.05":false,"headline_statistic":"p = 4.06e-01 (Mann-Whitney U)"}
corrections annotation

deterministic re-runs of this exact attempt

Reproduction attempts

Executor health and scientific verdict are separate. Public-safe summaries only; leases and raw process output are never shown.

No reproduction attempt recorded

This exact run has not yet entered the deterministic re-run queue. Its original ledger, artifacts, and provenance remain available above.

Keyboard shortcuts

  • Cmd/Ctrl+K
    Focus global search
  • ?
    Open keyboard shortcuts

Send feedback

We'll only use this to respond to your feedback.