Nanopublication

< Home

ID

https://w3id.org/np/RALNQ7NiBxnVFrsl-iRniCuyqmw-CGfMiYNJ2XzBTEWtQ

Formats

.trig | .trig.txt | .jelly | .jelly.txt | .jsonld | .jsonld.txt | .nq | .nq.txt | .xml | .xml.txt

Content

@prefix this: <https://w3id.org/np/RALNQ7NiBxnVFrsl-iRniCuyqmw-CGfMiYNJ2XzBTEWtQ> .
@prefix sub: <https://w3id.org/np/RALNQ7NiBxnVFrsl-iRniCuyqmw-CGfMiYNJ2XzBTEWtQ/> .
@prefix np: <http://www.nanopub.org/nschema#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix prov: <http://www.w3.org/ns/prov#> .
@prefix npx: <http://purl.org/nanopub/x/> .
@prefix dc: <http://purl.org/dc/terms/> .
@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .

sub:Head {
  this: a np:Nanopublication;
    np:hasAssertion sub:assertion;
    np:hasProvenance sub:provenance;
    np:hasPublicationInfo sub:pubinfo .
}

sub:assertion {
  <https://w3id.org/delphi/resource/assessment/levin-2022-tame-19--claim-test--overnight-go-overlap>
    a <https://w3id.org/delphi/ontology/Assessment>;
    dc:description "fetch.py downloads go-basic.obo, the GOA human GAF and the HGNC protein-coding list, and queries INDRA CoGEx (execute_cypher over the public MCP endpoint, batches of 250 HGNC ids) for each gene's count of distinct indra_rel statement hashes. analysis.py drops NOT-qualified and obsolete-term lines, maps UniProt accessions to 19,276 HGNC protein-coding genes, propagates annotations over is_a/part_of, and builds the 2x2 table of GO:0009653 x GO:0007611 membership overall (E1) and within the GO:0005216 (E2) and GO:0005921 (E3) subsets. The null shuffles learning-or-memory labels within strata of annotation count x INDRA degree (5x5 quantile strata for E1, 3x3 within subsets), 10,000 permutations, seed 20261101; p = (1 + #null OR >= observed) / 10,001. The primary run excludes IEA; a labelled secondary run includes it.";
    <http://www.w3.org/2000/01/rdf-schema#comment> "Measured: 5.9585 odds ratio, GO:0009653 x GO:0007611 human protein-coding genes, IEA excluded (n = 19276, 95% CI 4.0202-8.8316; matched-permutation p = 0.0002). Interpretation: TAME (Levin 2022) predicts that genes involved in morphogenesis overlap widely with memory and learning genes. 'Morphogenesis' is GO:0009653 anatomical structure morphogenesis and 'learning and memory' is GO:0007611 learning or memory, each with is_a/part_of descendants, in human protein-coding genes. 'Beyond pleiotropy' is operationalised as beyond a permutation null matched on number of GO annotations (annotation volume) and number of INDRA CoGEx statements (how studied and how connected a gene is). The ion-channel and gap-junction subsets are the bioelectric machinery Levin names. Primary evidence rule is every GO evidence code except IEA (so ISS, IBA, TAS and similar curated inferences are included, unlike the earlier mouse experimental-only test in the parent directory).";
    <http://www.w3.org/2000/01/rdf-schema#label> "Claim test of levin-2022-tame-19 (overnight-go-overlap): mixed, confidence 0.6";
    <http://www.w3.org/2000/01/rdf-schema#seeAlso> <https://github.com/fractastical/delphisci/blob/bf2af6ee0a84e23ffa6414ad7a0a50a8c276506e/test-data/claim-tests/levin-papers/levin-2022-tame-19/overnight-go-overlap/result.json>;
    prov:wasAttributedTo <https://w3id.org/delphi/resource/agent/delphisci-claim-tester-claude-opus-5-5>;
    <https://w3id.org/delphi/ontology/admissibleDatasets> "Current GO Consortium human annotations and ontology, HGNC protein-coding gene list, INDRA CoGEx statement graph; all public, none derived from Levin's papers.";
    <https://w3id.org/delphi/ontology/assessmentType> "claim-test/0.1.0";
    <https://w3id.org/delphi/ontology/dataKind> "biological";
    <https://w3id.org/delphi/ontology/disconfirmingObservation> "The full-set odds ratio lies inside the matched null (p >= 0.01) or is <= 2.";
    <https://w3id.org/delphi/ontology/evidenceAgainst> "60,356 GAF lines did not map to an approved HGNC protein-coding gene through HGNC's UniProt list and were dropped; 10 HGNC ids are absent from CoGEx and were given degree 0.",
      "Approach executed by a Claude Opus 5.5 agent on a plan proposed by grok-4-7. During the run the repo was restructured (test-data moved under ); the pre-registered result.json was written before any data were fetched (prereg 2026-11-01T05:50Z, first download 10:15Z).",
      "GO annotation bias: genes are annotated to learning or memory mostly after behavioural knockout studies, which favour genes already studied in development. Matching on annotation count and INDRA degree absorbs this only approximately; INDRA degree is itself literature-derived.",
      "GO, GOA, HGNC and CoGEx are 'current' and unversioned in their URLs; re-running later will fetch newer releases and numbers will drift. The SHA-256s identify the files used; the INDRA table is regenerated by query.",
      "Only 117 human genes carry non-IEA learning-or-memory annotations, so the learning set is small and subset endpoints have little power.",
      "Pre-registered rule gives 'mixed': the full-set endpoint passes (OR 5.96, 95% CI 4.02-8.83, 37 genes vs 8.6 expected; matched-null median OR 2.62, p = 0.0002), the ion-channel endpoint fails (2 of 7 learning-or-memory ion-channel genes are morphogenesis genes; OR 8.02 but p = 0.23, CI 1.46-44.1), and the gap-junction endpoint is underpowered (26 genes, 0 annotated to learning or memory). The bioelectric subsets Levin names therefore give no support, mostly for lack of data.",
      "The IEA-included run gives the same picture (E1 OR 5.65, p = 0.0002; E2 OR 10.42, p = 0.10; E3 underpowered), so the full-set hit is not an IEA artefact.",
      "The OR > 2 threshold is weak on its own: the matched null's median OR is already 2.62, so the informative quantity is the excess over the null (2.27x) and the permutation p.",
      "This conflicts in direction with the earlier mouse test in the parent directory (experimental codes only, annotation-depth decile Mantel-Haenszel OR 0.94, refutes). Species, evidence codes and the matching scheme differ; 5x5 quantile strata control annotation volume more coarsely than within-decile stratification, so residual study bias may remain.";
    <https://w3id.org/delphi/ontology/expectedObservation> "Morphogenesis and learning-or-memory gene sets overlap with odds ratio > 2 and above a size-, annotation-count- and INDRA-degree-matched permutation null (p < 0.01), overall and within ion-channel and gap-junction genes.";
    <https://w3id.org/delphi/ontology/failCriterion> "Pre-registered. Verdict 'refutes' if E1 fails in the primary run (observed OR <= 2 or matched-permutation p >= 0.01), i.e. the full-set overlap is not wide beyond annotation volume and statement-graph degree. Verdict 'mixed' if E1 passes but E2 or E3 fails or is underpowered. A subset endpoint is underpowered (and counted as not passing) if its universe has fewer than 5 learning-or-memory genes or fewer than 5 morphogenesis genes. A pass that appears only in the IEA-included run does not count toward any verdict; that run is reported, labelled, as a secondary analysis.";
    <https://w3id.org/delphi/ontology/hasConfidence> "0.6"^^xsd:double;
    <https://w3id.org/delphi/ontology/hasEvidence> <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-1>,
      <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-2>,
      <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-3>,
      <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-4>;
    <https://w3id.org/delphi/ontology/hasVerdict> "mixed";
    <https://w3id.org/delphi/ontology/hypothesis> "Among human protein-coding genes, genes annotated (non-IEA) to GO:0009653 anatomical structure morphogenesis and genes annotated (non-IEA) to GO:0007611 learning or memory overlap with odds ratio > 2, and that overlap exceeds a permutation null that preserves both set sizes and matches genes on number of GO annotations and on degree in the INDRA CoGEx statement graph; the same holds within the ion-channel subset (GO:0005216) and within the gap-junction subset (GO:0005921).";
    <https://w3id.org/delphi/ontology/inferenceMethod> "Observed 2x2 odds ratio compared with 10,000 stratified label permutations matched on annotation count and INDRA degree; thresholds OR > 2 and one-sided permutation p < 0.01 per endpoint.";
    <https://w3id.org/delphi/ontology/passCriterion> "Pre-registered. Primary run (IEA excluded). For each of three endpoints, (E1) all human protein-coding genes, (E2) the subset annotated to GO:0005216 monoatomic ion channel activity or descendants, (E3) the subset annotated to GO:0005921 gap junction or descendants, the endpoint passes if the observed odds ratio of the 2x2 table (morphogenesis membership x learning-or-memory membership, within that endpoint's universe) is > 2 AND the one-sided matched-permutation p-value, (1 + #{null OR >= observed OR}) / (1 + 10000), is < 0.01. Verdict 'supports' requires E1, E2 and E3 all to pass in the primary run.";
    <https://w3id.org/delphi/ontology/preregistered> "false"^^xsd:boolean .
  
  <https://w3id.org/delphi/resource/claim/levin-2022-tame-19> <https://w3id.org/delphi/ontology/hasAssessment>
      <https://w3id.org/delphi/resource/assessment/levin-2022-tame-19--claim-test--overnight-go-overlap> .
  
  <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-1>
    a <https://w3id.org/delphi/ontology/EvidenceItem>;
    dc:description "term hierarchy (is_a, part_of) for propagation and set definition";
    dc:license "CC BY 4.0";
    <http://www.w3.org/2000/01/rdf-schema#label> "Dataset: Gene Ontology, basic edition (go-basic.obo)";
    prov:atLocation <https://purl.obolibrary.org/obo/go/go-basic.obo>;
    prov:wasDerivedFrom <https://geneontology.org/docs/download-ontology/>;
    <https://w3id.org/delphi/ontology/hasChecksum> "sha256:b08d45b268b8c24ccb2513dbbbc7d4df9f6521c099b413f79eb31e06e0fa3bcc" .
  
  <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-2>
    a <https://w3id.org/delphi/ontology/EvidenceItem>;
    dc:description "gene-to-GO annotations with evidence codes (set membership, annotation counts, subsets)";
    dc:license "CC BY 4.0";
    <http://www.w3.org/2000/01/rdf-schema#label> "Dataset: GOA human GO annotations (GAF 2.2), via the GO Consortium";
    prov:atLocation <https://current.geneontology.org/annotations/goa_human.gaf.gz>;
    prov:wasDerivedFrom <https://current.geneontology.org/products/pages/downloads.html>;
    <https://w3id.org/delphi/ontology/hasChecksum> "sha256:db472faff1785878521693af62646546cea6af4a386609dd01c72c0554a46a30" .
  
  <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-3>
    a <https://w3id.org/delphi/ontology/EvidenceItem>;
    dc:description "universe of human protein-coding genes and UniProt-to-HGNC mapping";
    dc:license "CC0";
    <http://www.w3.org/2000/01/rdf-schema#label> "Dataset: HGNC approved genes, locus type 'gene with protein product'";
    prov:atLocation <https://storage.googleapis.com/public-download-files/hgnc/tsv/tsv/locus_types/gene_with_protein_product.txt>;
    prov:wasDerivedFrom <https://www.genenames.org/download/statistics-and-files/>;
    <https://w3id.org/delphi/ontology/hasChecksum> "sha256:6a274291fd9029a2ca41b8b00cd114b039629db3a6d68a52eedd3e6b422a3304" .
  
  <https://w3id.org/delphi/resource/evidence/levin-2022-tame-19--claim-test--overnight-go-overlap--dataset-4>
    a <https://w3id.org/delphi/ontology/EvidenceItem>;
    dc:description "statement-graph degree, a matching covariate of the permutation null";
    dc:license "INDRA CoGEx public service terms (BSD-2 code; content per upstream sources)";
    <http://www.w3.org/2000/01/rdf-schema#label> "Dataset: INDRA CoGEx knowledge graph, per-gene count of distinct INDRA statements";
    prov:atLocation <https://discovery.indra.bio/mcp>;
    prov:wasDerivedFrom <https://discovery.indra.bio/>;
    <https://w3id.org/delphi/ontology/hasChecksum> "sha256:bf594d1a330454034d7f3edb4ece8b4dd046a5cf0fcec234ffc43357f6dd490a" .
}

sub:provenance {
  <https://w3id.org/delphi/resource/agent/delphisci-claim-tester-claude-opus-5-5> a
      prov:SoftwareAgent;
    <http://www.w3.org/2000/01/rdf-schema#label> "delphisci claim tester (claude-opus-5.5; approach morphogenesis-cognition-gene-overlap--grok-4-7--1)";
    prov:actedOnBehalfOf <https://orcid.org/0009-0007-4948-9192>;
    <https://w3id.org/delphi/ontology/usesModel> <https://w3id.org/delphi/resource/model/claude-opus-5-5> .
  
  <https://w3id.org/delphi/resource/model/claude-opus-5-5> a <https://w3id.org/delphi/ontology/LanguageModel>;
    dc:identifier "claude-opus-5.5" .
  
  sub:assertion prov:wasAttributedTo <https://w3id.org/delphi/resource/agent/delphisci-claim-tester-claude-opus-5-5>;
    prov:wasDerivedFrom <https://github.com/fractastical/delphisci/blob/bf2af6ee0a84e23ffa6414ad7a0a50a8c276506e/test-data/claim-tests/levin-papers/levin-2022-tame-19/overnight-go-overlap/result.json>;
    prov:wasGeneratedBy sub:test .
  
  sub:plan prov:hadPlan <https://github.com/fractastical/delphisci/blob/bf2af6ee0a84e23ffa6414ad7a0a50a8c276506e/test-data/claim-tests/README.md> .
  
  sub:test a prov:Activity;
    prov:qualifiedAssociation sub:plan;
    prov:wasAssociatedWith <https://w3id.org/delphi/resource/agent/delphisci-claim-tester-claude-opus-5-5> .
}

sub:pubinfo {
  this: dc:created "2026-11-08T16:24:31.878Z"^^xsd:dateTime;
    dc:creator <https://orcid.org/0009-0007-4948-9192>;
    dc:license <https://creativecommons.org/licenses/by/4.0/>;
    npx:hasNanopubType <https://w3id.org/delphi/ontology/Assessment>;
    npx:introduces <https://w3id.org/delphi/resource/assessment/levin-2022-tame-19--claim-test--overnight-go-overlap>;
    <http://www.w3.org/2000/01/rdf-schema#label> "Claim test of levin-2022-tame-19 (overnight-go-overlap): mixed, confidence 0.6";
    <https://w3id.org/delphi/ontology/domain> <https://w3id.org/delphi/resource/domain/levin-papers> .
  
  sub:sig npx:hasAlgorithm "RSA";
    npx:hasPublicKey "MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAyFHtPB6p0mCjDozxlOY9CmO3nBm7Te3jFbXyLmM+G1tGe47Da0jYIbhkl9Oo1ZjxmCa3LCwlEqK8gj6hEIcL4ahW30JXh9HycfKVk1bugkzMEV15tJdTzAU3sGMFnbNsn43xY2LFLy45tApkRm5byEiM7oRRrooIdwoQKnP4Wzq/bfAoJ9qvW+MGkelyOTd1jbSt+KfmT7xKmDfWzAHddUlWwMX2QJOLxDaffOteTop6ZRgPiNmPJKA/S62Gac9XtSYT3oDkZ6/nr5cxxNLpOyxTf5FPISiCe11xYO/unYjY+mwnOfA8yhJIyx1l0O9I0vpOpn+E5TvyHJV+oSTrvwIDAQAB";
    npx:hasSignature "TqTIFr26+krw6A68Du35YNYfzD3d+s7pOATINSoLcvPPr8iEcu81t/Y0zXJcxnJXwT6QdLJBqW6lIH9zzhckQwZo4UZL4NAezbRI09cahu9sYXHV2+LGVbGzlA9aUJJS4fGNTcWanuqQgTU+wQGESOTAQDJ0EHHQfhx544SM3OGW1OhK6ZJ23Jlv1l8V5TKDEBuTTeU36Aeu+lg5bKoza2tSjMQpWX1j3FL4BKw7ZqaQfQWZgBeQCNh28vKNsmvq5fB3G4ixtXQbnQ0pewTYAa/4K7sEUdD4j/N2Pyh3Zc23mUPWthxwbHvtqjBRFYNY8a6lcAyTo4pZdgXTv5T7mg==";
    npx:hasSignatureTarget this:;
    npx:signedBy <https://orcid.org/0009-0007-4948-9192> .
}