← all readouts

Population Frequency of ClinVar Pathogenic vs Benign Variants in BRCA1: A Null Result from gnomAD

Exact input: Do ClinVar pathogenic missense variants in BRCA1 occur at lower gnomAD frequencies than benign variants in the same gene?

Execution template: clinvar gnomad ensembl

execution observatory

Attempt 1 of 1

null result Completed · publish stage
committed record

immutable execution contract

exact input
Do ClinVar pathogenic missense variants in BRCA1 occur at lower gnomAD frequencies than benign variants in the same gene?
execution template
clinvar gnomad ensembl
  1. scope
  2. dataset
  3. run
  4. write
  5. review
  6. correct
  7. publish

latest committed step

orchestration Opencode process exited.

wrapper_exited · run · observed · wrapper

committed steps
34
accepted / verified
6
warnings / rejects
1
elapsed
14 minutes
last recorded
tokens recorded
not recorded
data downloaded
994 KB

canonical execution ledger

Every committed step

Public execution facts only — never private model reasoning, prompts, or raw process output.

attempt-1-ledger hal9000/run/52ee0696/1 chronological · persisted · archived Reload
  1. 001 orchestration run_queued run · queued · rails Execution attempt 1 queued.
  2. 002 orchestration investigation_selected notice · observed · rails Capability gate passed with clinvar_gnomad_ensembl. Started manually by an administrator.
  3. 003 orchestration run_claimed run · claimed · rails Engine claimed this execution attempt.
  4. 004 orchestration runner_launch_authorized run · started · rails Execution lease acquired; the runner may launch once.
  5. 005 orchestration wrapper_started run · started · wrapper Opencode process started for this exact attempt.
  6. 006 scoping scope_started action · started · agent Beginning scoping for this exact execution attempt.
  7. 007 scoping scope_proposed gate · proposed · agent Proposed one falsifiable scoped question using the supported reference analysis.
  8. 008 data dataset_search_started action · started · agent Searching Ensembl REST for BRCA1 gene coordinates.
  9. 009 data dataset_proposed artifact · proposed · agent Proposed a bounded dataset provenance record for terminal validation.
  10. 010 data dataset_search_started action · started · agent Searching gnomAD GraphQL for BRCA1 variants.
  11. 011 data dataset_proposed artifact · proposed · agent Proposed a bounded dataset provenance record for terminal validation.
  12. 012 data dataset_search_started action · started · agent Searching ClinVar for BRCA1 variants via NCBI E-utilities.
  13. 013 data dataset_proposed artifact · proposed · agent Proposed a bounded dataset provenance record for terminal validation.
  14. 014 analysis analysis_started action · started · agent Executing the allowlisted analysis with a fixed seed.
  15. 015 analysis analysis_observed metric · observed · agent Observed the analysis result and measured its process duration.
  16. 016 writing draft_started action · started · agent Building the initial paper from committed evidence.
  17. 017 writing draft_written artifact · proposed · agent Wrote the initial paper draft from the available evidence.
  18. 018 orchestration notice notice · observed · agent test
  19. 019 review review_started action · started · agent Adversarial review round 1 against every available source artifact.
  20. 020 review review_observed gate · observed · agent Round 1 review severity counts: 1 blocker, 2 major, 2 minor.
  21. 021 correction correction_started action · started · agent Evidence-preserving corrections for round 1 findings.
  22. 022 correction correction_observed gate · observed · agent Round 1 correction resolution counts: 5 resolved, 0 remaining.
  23. 023 review review_started action · started · agent Adversarial review round 2 on corrected paper.
  24. 024 review review_observed gate · observed · agent Round 2 review severity counts: 0 blocker, 0 major, 0 minor. Verdict PASS.
  25. 025 publishing publication_started action · started · agent Assembling the corrected artifacts for terminal validation.
  26. 026 correction ingest_rejected gate · rejected · rails Terminal payload rejected: dataset 2 access URL contains an invalid public URL
  27. 027 scoping scope_accepted gate · accepted · rails Accepted the run's scoped research question.
  28. 028 data datasets_accepted artifact · accepted · rails Accepted 3 dataset provenance records for this run.
  29. 029 analysis analysis_accepted artifact · accepted · rails Accepted the executed analysis, server-derived script hash, and 3 exact input artifacts.
  30. 030 publishing figure_accepted artifact · accepted · rails Accepted the validated PNG figure for this run.
  31. 031 publishing paper_accepted artifact · accepted · rails Accepted the run-owned paper for publication.
  32. 032 publishing run_published run · completed · rails Execution attempt 1 published with outcome null_result.
  33. 033 orchestration wrapper_duration metric · observed · wrapper Measured opencode process duration.
  34. 034 orchestration wrapper_exited run · observed · wrapper Opencode process exited.

exact-attempt artifacts

Artifacts & paper

Nothing on this attempt is borrowed from a newer run.

Abstract

hal9000/run/52ee0696/attempt/1 · published Jul 18, 2026 · p = 4.06e-01 (Mann-Whitney U)

p = 4.06e-01 (Mann-Whitney U)

We tested whether ClinVar-classified pathogenic variants in BRCA1 occur at lower population allele frequencies than benign variants in gnomAD (gnomAD v4), as expected under purifying selection against deleterious alleles. Using a coordinate-based join of 500 ClinVar records (275 classified) and 7,279 gnomAD BRCA1 variants, we obtained 39 pathogenic and 124 benign variants with both clinical annotation and allele frequency data. A two-sided Mann-Whitney U test on allele frequencies yielded no significant difference (U = 2621.5, p = 0.406). The median allele frequency was 1.37 × 10⁻⁶ for pathogenic variants and 6.90 × 10⁻⁷ for benign variants — numerically in the opposite direction from the expected pattern. This null result may reflect the predominantly rare-variant spectrum in both ClinVar and gnomAD for BRCA1, limited statistical power at these frequencies, or the locus-level join granularity, which does not distinguish ref/alt alleles.

Computed figure for Population Frequency of ClinVar Pathogenic vs Benign Variants in BRCA1: A Null Result from gnomAD
Figure · computed from the named dataset, not illustrative.

Introduction

Pathogenic variants in disease genes are expected to be maintained at lower population frequencies than benign variants, consistent with purifying selection acting against deleterious alleles (Crow & Kimura, 1965; Balick et al., 2017). BRCA1 (ENSG00000012048) is one of the most clinically annotated genes in ClinVar, with extensive classification of variants as pathogenic or benign. We asked whether this expected frequency difference is detectable when comparing ClinVar annotations against gnomAD population allele frequencies.

Methods

Data Sources

Three zero-auth public datasets were fetched for BRCA1 (GRCh38: 17:43044292–43170245):

  1. Ensembl REST — gene coordinates and metadata for ENSG00000012048
  2. gnomAD v4 — 7,279 variants with allele frequencies across the BRCA1 locus
  3. ClinVar — 500 records (retmax = 500) with clinical significance classifications

Variant Classification

ClinVar records were classified into "pathogenic" (including "pathogenic" and "likely pathogenic") and "benign" (including "benign" and "likely benign") categories. Records with conflicting classifications or ambiguous labels were excluded. This yielded 275 classified variants from the 500 fetched. Of these, 163 had both a genomic position suitable for joining with gnomAD and a non-zero gnomAD allele frequency; the remaining 112 were excluded either because they lacked genomic coordinates in ClinVar or because their gnomAD allele frequency was zero (not observed in the gnomAD sample). After joining, 39 were classified as pathogenic and 124 as benign.

Join Strategy

Variants were joined between ClinVar and gnomAD using genomic locus (chrom:pos), as ClinVar records frequently lack dbSNP rsIDs and ref/alt allele information. gnomAD variants at each locus were collapsed to the maximum allele frequency (representing the most common alt allele at multiallelic sites). This locus-level join is necessarily ref/alt-agnostic and may pair a ClinVar pathogenic allele with a different alt allele's frequency in gnomAD — a limitation we discuss below.

Statistical Test

A two-sided Mann-Whitney U test was applied to the allele frequencies of the pathogenic and benign groups. This non-parametric test was chosen because allele frequencies are heavily right-skewed. A fixed seed (1234) was used for all random operations (strip-plot jitter only; no randomness enters the statistic).

Results

After joining ClinVar and gnomAD by genomic locus, 163 variants had both a clinical classification and a gnomAD allele frequency > 0. Of these, 39 were classified as pathogenic and 124 as benign.

The Mann-Whitney U test did not detect a significant difference in allele frequencies between the two groups (U = 2621.5, p = 0.406). The median gnomAD allele frequency for pathogenic variants was 1.37 × 10⁻⁶, while the median for benign variants was 6.90 × 10⁻⁷. The observed direction (pathogenic variants having a numerically higher median frequency) is opposite to the expected pattern.

Figure: Distribution of gnomAD allele frequencies for ClinVar pathogenic (red, n = 39) and benign (blue, n = 124) BRCA1 variants. Box plots show medians and interquartile ranges; individual points are jittered variants.

Discussion

The null result — no detectable difference between pathogenic and benign variant frequencies in BRCA1 — contrasts with the textbook expectation that pathogenic variants should be rarer. Several factors may explain this.

First, both groups are extremely rare. BRCA1 is under strong purifying selection, and gnomAD allele frequencies for all classified variants are in the 10⁻⁶ to 10⁻⁵ range, near the detection limit of the current gnomAD sample size (~76,000 exomes/genomes). The distributions overlap substantially, reducing the power of any rank-based test.

Second, the locus-level join (chrom:pos without ref/alt) may mispair alleles. At a given locus, ClinVar may annotate one alternate allele as pathogenic while gnomAD reports a different alternate allele's frequency. This noise would attenuate any true signal, pushing toward the null.

Third, the ClinVar retmax cap of 500 means not all BRCA1 ClinVar records were retrieved, potentially biasing toward more frequently submitted (and possibly more common) pathogenic variants.

Fourth, the unexpected direction (pathogenic median AF numerically higher than benign) could reflect sampling variability given the small sample sizes (n = 39 and n = 124), or it could indicate that benign variants in BRCA1 are maintained at similarly rare frequencies because most of the coding space in this gene is functionally constrained.

Limitations

  • The ClinVar × gnomAD join is at locus (chrom:pos) granularity without ref/alt matching, which may cause allele mispairing.
  • The retmax cap of 500 ClinVar records means the full ClinVar BRCA1 corpus was not sampled.
  • Summary-level data were used; individual-level genotypes were not accessed.
  • Both groups are near the frequency detection floor of gnomAD, limiting statistical power.
  • The analysis includes all variant types (missense, frameshift, synonymous, etc.) classified as pathogenic or benign; restricting to missense variants only might yield different results.
  • Ensembl and gnomAD gene boundaries differ by 3 bp at the start coordinate (43044292 vs 43044295); this does not materially affect the analysis but is noted for completeness.

Provenance

Dataset Source Accession Access URL Region Slice
Ensembl gene Ensembl REST ENSG00000012048 rest.ensembl.org 17:43044292–43170245
gnomAD variants gnomAD v4 ENSG00000012048 gnomad.broadinstitute.org/api 17:43044295–43170245
ClinVar records NCBI ClinVar BRCA1[gene] eutils.ncbi.nlm.nih.gov BRCA1 gene, 500 records

Analysis: clinvar_gnomad_ensembl reference template, seed = 1234, Mann-Whitney U (two-sided). Script: anchor_clinvar_gnomad_ensembl.py.

Provenance · exact attempt · input bundle retained
attempt 1 · exact retained execution
exact input Do ClinVar pathogenic missense variants in BRCA1 occur at lower gnomAD frequencies than benign variants in the same gene?
execution template clinvar gnomad ensembl
Acquisition → Analysis
  1. Step 1 Ensembl fetcher

    argv
    1. lookup
    2. --symbol
    3. BRCA1
    4. --out
    5. {{workspace:gene.json}}
    declared outputs
    • gene.json
  2. Step 2 gnomAD fetcher

    argv
    1. --gene
    2. BRCA1
    3. --dataset
    4. gnomad_r4
    5. --out
    6. {{workspace:gnomad.csv}}
    declared outputs
    • gnomad.csv
  3. Step 3 ClinVar fetcher

    argv
    1. --gene
    2. BRCA1
    3. --out
    4. {{workspace:clinvar.csv}}
    5. --retmax
    6. 500
    declared outputs
    • clinvar.csv

Analysis

argv
  1. --clinvar
  2. {{workspace:clinvar.csv}}
  3. --gnomad
  4. {{workspace:gnomad.csv}}
  5. --gene
  6. BRCA1
  7. --seed
  8. {{seed}}
  9. --outdir
  10. {{workdir}}
dataset Ensembl REST (ENSG00000012048) · 17:43044292-43170245 (BRCA1, GRCh38)
dataset gnomAD (gnomad_r4) (ENSG00000012048) · 17:43044295-43170245 (BRCA1, GRCh38)
dataset ClinVar (NCBI E-utilities) (BRCA1[gene]) · BRCA1 gene, 500 records (retmax=500)
exact inputs 3 files · 993 KB retained
clinvar.csv input · text/csv · 94.4 KB
cec97b1265e60cc06d59609e4cd3039f68c301a2f4589322f3acf46cbd169a9f
fetched 2026-07-18T18:24:50Z · ClinVar (NCBI E-utilities)
gene.json input · application/json · 269 Bytes
089adee33f00ce3de70c04da90cf4656c158da91de958ed5f3356f7dc2fc3037
fetched 2026-07-18T18:24:06Z · Ensembl REST
gnomad.csv input · text/csv · 899 KB
7596f3afb75920ab815732dde0959ca4bd697cabf7b7f2d113503ea3d65afa8d
fetched 2026-07-18T18:24:27Z · gnomAD (gnomad_r4)
script sha256 914cc037f6e7eb34be2ddfc77474c3d65b6e26711c0097c3bd76af912506b479
seed 1234
app git sha 5625dd5f30547fb07997efeb3ab46d953d71f60c
exact replay Exact input bytes and invocation manifest retained; runtime lock and hardened executor readiness are not yet available.
statistic {"gene":"BRCA1","seed":1234,"reference_template":"clinvar_gnomad_ensembl","join_key":"genomic locus chrom:pos (ref/alt-agnostic)","n_clinvar_classified":275,"n_merged_with_gnomad_af":163,"n_pathogenic":39,"n_benign":124,"outcome":"null_result","test":"Mann-Whitney U (two-sided) on allele frequency","u_statistic":2621.5,"p_value":0.4062813737023052,"median_af_pathogenic":0.00000137,"median_af_benign":0.00000069,"direction":"pathogenic not rarer","significant_at_0.05":false,"headline_statistic":"p = 4.06e-01 (Mann-Whitney U)"}
corrections none

deterministic re-runs of this exact attempt

Reproduction attempts

Executor health and scientific verdict are separate. Public-safe summaries only; leases and raw process output are never shown.

No reproduction attempt recorded

This exact run has not yet entered the deterministic re-run queue. Its original ledger, artifacts, and provenance remain available above.

Keyboard shortcuts

  • Cmd/Ctrl+K
    Focus global search
  • ?
    Open keyboard shortcuts

Send feedback

We'll only use this to respond to your feedback.