Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions

Broadening symptom criteria improves early case identification in SARS-CoV-2 contacts

Hamish Houston, Seran Hakki, Timesh D Pillay, Kieran Madon, Nieves Derqui-Fernandez, Aleksandra Koycheva, Anika Singanayagam, Joe Fenn, Rhia Kundu, Emily Conibear, Robert Varro, Jessica Cutajar, Valerie Quinn, Lulu Wang, Janakan S Narean, Mica R Tolosa-Wright, Jack Barnett, Onn Min Kon, Richard Tedder, Graham Taylor, Maria Zambon, Neil Ferguson, Jake Dunning, Jonathan J Deeks, Ajit Lalvani
European Respiratory Journal 2021; DOI: 10.1183/13993003.02308-2021
Hamish Houston
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
9HH & SH contributed equally
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hamish Houston
Seran Hakki
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
9HH & SH contributed equally
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Timesh D Pillay
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kieran Madon
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nieves Derqui-Fernandez
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nieves Derqui-Fernandez
Aleksandra Koycheva
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anika Singanayagam
2National Infection Service, Public Health England, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joe Fenn
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rhia Kundu
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emily Conibear
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Varro
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jessica Cutajar
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Valerie Quinn
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lulu Wang
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Janakan S Narean
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mica R Tolosa-Wright
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jack Barnett
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Onn Min Kon
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
3Tuberculosis Service, Imperial College Healthcare NHS Trust, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Onn Min Kon
Richard Tedder
4Molecular Diagnostic's Unit, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Graham Taylor
5Section of Virology, Department of Infectious Disease, Imperial College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maria Zambon
2National Infection Service, Public Health England, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Neil Ferguson
6Department of Infectious Disease Epidemiology, Faculty of Medicine, Imperial College London, St Mary's Campus, Norfolk Place, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jake Dunning
2National Infection Service, Public Health England, London, UK
7NIHR Health Protection Research Unit in Emerging and Zoonotic Infections, University of Oxford, Oxford, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan J Deeks
8Test Evaluation Research Group, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
9HH & SH contributed equally
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ajit Lalvani
1NIHR Health Protection Research Unit in Respiratory Infections, Imperial College London, London, UK
10JDe & AL contributed equally
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: a.lalvani@imperial.ac.uk
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Introduction The success of case isolation and contact tracing for the control of SARS-CoV-2 transmission depends on the accuracy and speed of case identification. We assessed whether inclusion of additional symptoms alongside three canonical symptoms (CS) - fever; cough; loss or change in smell or taste – could improve case definitions and accelerate case identification in SARS-CoV-2 contacts.

Methods Two prospective longitudinal London-based cohorts of community SARS-CoV-2 contacts, recruited within 5 days of exposure, provided independent training and test datasets. Infected and uninfected contacts completed daily symptom diaries from the earliest possible time-points. Diagnostic information gained by adding symptoms to the CS was quantified using likelihood ratios and AUC-ROC. Improvements in sensitivity and time-to-detection were compared to penalties in terms of specificity and number-needed-to-test.

Results Of 529 contacts within two cohorts, 164 (31%) developed PCR-confirmed infection and 365 (69%) remained uninfected. In the training dataset (n=168), 29% of infected contacts did not report the CS. Four symptoms (sore throat, muscle aches, headache and appetite loss) were identified as early-predictors (EP) which added diagnostic value to the CS. The broadened symptom criterion “≥1 of the CS, or ≥2 of the EP” identified PCR-positive contacts in the test dataset on average 2 days earlier after exposure (p=0.07) than “≥1 of the CS”, with only modest reduction in specificity (5.7%).

Conclusions Broadening symptom criteria to include individuals with at least 2 of muscle aches, headache, appetite loss and sore throat identifies more infections and reduces time-to-detection, providing greater opportunities to prevent SARS-CoV-2 transmission.

INTRODUCTION

SARS-CoV-2 transmission is not entirely prevented by current vaccines. [1] As vaccination coverage increases, blanket isolation rules for SARS-CoV-2 contacts (i.e. test-trace-isolate) become less acceptable to society. Rapid identification and isolation of contacts who become infected is an increasingly important alternative strategy for prevention and containment. [2] Effectiveness depends crucially on how quickly such cases are detected and initiate self-isolation, [3] because individuals are most infectious early in the course of infection. [4, 5] However, case definitions must also be sufficiently specific to avoid overwhelming testing capacity. [6, 7]

There is considerable international heterogeneity in policy for COVID-19 community testing within the general population (S1). Most criteria include fever, cough, and loss or change in smell or taste (hereafter referred to as the canonical symptoms [CS]) alongside a range of other symptoms. Some countries are currently considering altering their case definitions. [13] There is thus an urgent need for empirical data to identify whether additional symptoms (we call early-predictors [EPs]) can augment the CS within community case definitions.

Surprisingly, empirical longitudinal data from recently exposed SARS-CoV-2 contacts are scarce. Recent large-scale cross-sectional studies of community testing data support adding more symptoms to the CS. [7, 14] Descriptive longitudinal retrospective studies of SARS-CoV-2 infections also exist. [15, 16] However, a high-resolution longitudinal evaluation of symptom combinations for differentiating infected SARS-CoV-2 contacts from exposed but uninfected controls has not, to our knowledge, been performed before.

Using data from two prospective longitudinal cohorts of SARS-CoV-2 contacts, we aimed to establish definitively whether broadening symptom criteria beyond the CS can accelerate and improve case detection without weakening specificity. Rapid recruitment following clearly defined exposure enabled optimal symptom criteria to be identified. Daily contemporaneously recorded symptom diaries ensured symptom onset times were recorded and time-savings measured with maximum precision. Through direct study of relevant community-based cohorts we provide generalisable evidence-based criteria for effective case definitions to rapidly identify and isolate infectious cases.

METHODS

Recruitment and study procedures

INSTINCT (Integrated Network for Surveillance, Trials and Investigations into COVID-19 Transmission) and ATACCC (Assessment of Transmission And Contagiousness of COVID-19 in Contacts) were two community-based cohort studies in which contacts of COVID-19 cases in Greater London were identified and recruited from 10th May 2020 through 31st March 2021.

Index cases, or contacts identified by the UK contact tracing system (NHS Test and Trace [NTAT]), were referred from Public Health England (PHE). Initially, referrals were also received from the Royal College of General Practitioners Research and Surveillance Centre (RCGP-RSC) network. Contacts referred within five days of their index case symptom onset (ISO), who provided valid informed consent were enrolled within our recruitment capacity until the end of the 2nd pandemic wave in the UK. Ethics approval was granted by the Health Research Authority (Research Ethics Committee reference: 20/NW/0231).

In INSTINCT, household-contacts living with their index cases were enrolled at home by research nurses (day 0) and visited again on days 7, 14 and 27. Date of ISO was recorded at enrolment and served as a proxy for exposure. Combined nose and throat swabs (CNTS) for RT-PCR testing and blood samples for serology were taken by research nurses at each visit and an additional CNTS by participants on day 4. Samples were processed at the Molecular Diagnostics Unit, Imperial College London. Antibody (IgM and IgG) to SARS-CoV-2 receptor binding domain (anti-RBD) was measured using a two-step double antigen binding assay (DABA) with recombinant S1 antigen on the solid-phase and labelled recombinant RBD as detector in the fluid-phase. [16] In ATACCC, household and non-household-contacts (i.e. not residing with their index) were enrolled. Dates of ISO (household-contacts) or exposure event (non-household-contacts) were provided by NTAT. After nurse-delivered training, participants self-sampled CNTS daily for 14 consecutive days. SARS-CoV-2 RT-PCR testing was performed at the Virus Reference Department, PHE Colindale.

At enrolment, demographic information was collected and participants recorded the onset date of prior symptoms. After enrolment, participants completed a daily symptom diary which assessed 20 symptoms (S2). Loss or change in smell or taste was recorded as one item (hereafter referred to as anosmia).

Definitions and reference standards

INSTINCT data were used as the training dataset. “Current infection” was set as the target condition and a rigorous composite reference standard was constructed to establish its presence or absence with maximum accuracy. [17] Contacts were assigned to the “infected” group if they were PCR-positive at day 0, 4 or 7. Contacts were assigned to the “uninfected” group if they were PCR-negative and had undetectable SARS-CoV-2 antibodies at all time-points. Participants were excluded if they had no serology results or were PCR-negative at all time-points but had detectable SARS-CoV-2 antibodies at study day 0, 7 or 27.

ATACCC data were used as the test dataset. In this cohort, daily PCR results were available but serological testing was not performed routinely. Contacts were assigned to the “PCR-positive” group if they had a positive PCR result by 7 days after enrolment and PCR-negative if all results were negative. Participants who became PCR-positive after study day 7 or had no PCR results were excluded from the analysis. Participants with only one positive PCR result with a high Ct value (>28) were excluded to minimise false-positives caused by recent rather than current infection.

In both cohorts, participants were made aware of their PCR results as they became available. Participants with missing ISO or exposure dates were excluded from analyses requiring these data. The study flowchart (figure 1) depicts participant numbers included in each analysis.

FIGURE 1
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1

Flow diagram for the inclusion and exclusion of INSTINCT and ATACCC study participants for each analysis. Cohort A was used for a time-to-event analysis describing symptom onset in time post index symptom onset (ISO). Cohorts B and C were used to create Spiegelhalter Knill-Jones models for each study day. Cohort D was used to evaluate the performance of simple case definitions at different time-points following exposure. 383 participants were recruited within INSTINCT, of which 138 were indexes and were excluded. 6/245 contacts were excluded because of missing PCR data or enrolment symptom data and 1 was excluded as they became PCR-positive after study day 7. 73/238 contacts were PCR-positive and assigned to the “infected” group. 43/165 PCR-negative contacts were seropositive at study day 0 or 7 (possible prior infection or vaccination) and 2/165 seroconverted at day 27, (possible separate exposure event) and were excluded. 0/168 PCR-negative participants seroconverted at study day 14. 25/165 PCR-negative participants had no serology data available and were excluded. 21/168 contacts were excluded from cohort A due to missing ISO date, and 1 was excluded as they reported symptoms several days prior to ISO. 411 contacts were recruited in ATACCC. 31 were excluded because of missing PCR or enrolment symptom data and 1 was excluded as they became PCR-positive after study day 7. 15 were excluded because they were PCR-positive at only one time-point with a high Ct value. 91 of the remaining 361 contacts had at least one positive PCR result by study day 7. 6/361 were excluded from cohort D because of missing exposure date.

Statistical analyses

Time-to-event analysis

We used time-to-event analysis to describe the onset of COVID-19-related symptoms relative to ISO in INSTINCT (figure 1 cohort A). Briefly, we used symptoms reported by “uninfected” contacts to define baseline time-dependent hazards, and the difference between “infected” and “uninfected” contacts to define COVID-19-related hazards for each symptom (S3 for detailed methodology). Symptoms with a probability of occurring due to COVID-19 of >15% by 10 days post-ISO were selected as candidate symptoms for further evaluation.

Spiegelhalter knill-Jones models

We aimed to quantify any additional diagnostic value gained by adding each of the candidate symptoms to the CS using likelihood ratios (LRs) estimated for individual symptoms within combinations of symptoms. The Spiegelhalter Knill-Jones (SKJ) method was used rather than the independence Bayes approach in order to adjust for dependency caused by symptom co-occurrence. [18] This method is summarised in S4, having been described in detail previously. [18–22] Symptoms were considered as a series of binary tests based on their occurrence by each study day (e.g. fever by day 3 would be regarded as positive if fever had been reported on study day 2). Persistent cough and productive cough were combined into a single cough variable. We compared models using the CS to those with an additional symptom. AUC-ROC allows evaluation of model discrimination in training and test datasets. Candidate symptoms with useful LRs after adjustment for dependency with the CS and whose addition improved AUC-ROC across multiple early time-points were considered “early-predictors” (EP).

Evaluating simple case definitions

To assess real-world impact through readily applicable case definitions, each of the EP were added to the CS individually and together as a list requiring more than 1 to be positive by using the words “at least”. Diagnostic performance was assessed against the serial PCR reference standard in the test dataset (cohort D, figure 1) at each day post-exposure. We used time-to-event analysis to measure how quickly broadened case definitions would identify PCR-positive individuals and log-rank tests to make comparisons with the CS. Finally, we quantified the prevalence-dependent trade-off between true-positives and false-positives by calculating the NNT: the number of false-positives for every true-positive plus 1.

Software

Statistical analyses were performed in Stata version 17.0 (StataCorp, LLC, College Station TX) and R (R Core Team, 2020).

RESULTS

Patient cohorts

53011 referrals were received via three recruitment pathways (S5). Of 529 contacts within two cohorts, 164 (31%) developed PCR-confirmed infection and 365 (69%) remained uninfected. S6 shows demographic details for INSTINCT and ATACCC. Sex, ethnicity and BMI were similar between cohorts. Participants were slightly older in ATACCC than in INSTINCT (median 38 versus 34 years, p<0.001).

Participants were enrolled a median 3 days (IQR 2–4) post-ISO in INSTINCT, 4 days (IQR 4–5) post-ISO in household-contacts in ATACCC and 5 days (IQR 4–6) post-exposure-event in non-household-contacts. In INSTINCT 22/168 (13.1%) contacts were linked to index cases identified through the RCGP-RSC network with suspected, but not confirmed COVID-19 and were included to avoid selection bias. Symptom diaries were completed in INSTINCT for median 26 days (IQR 7–27) by “infected” and 7 days (IQR 0–27) by “uninfected” contacts, and in ATACCC for 13 days (IQR 0–20) by “PCR-positives” and 7 days (IQR 0–14) by “PCR-negatives”.

Four participants with confirmed infection required hospitalisation. Whilst more than 90% of “infected” contacts in INSTINCT (68/73, 93.1%) reported at least one of the 20 symptoms by day 7, over a quarter (21/73, 28.8%) did not report fever, cough or anosmia by day 7.

Sequence of onset of COVID-19 related symptoms

Time-to-event analysis of symptom onset following exposure (S7–8) showed that fever preceded anosmia and persistent cough preceded productive cough. Sore throat and rhinitis occurred early, and breathlessness later. Fatigue was commonly reported by “uninfected” contacts.

Thirteen symptoms had a probability of occurring due to COVID-19 of >15% by 10 days post-ISO (fever, persistent cough, productive cough, anosmia, headache, muscle aches, sore throat, rhinitis, appetite loss, breathlessness, diarrhoea, nausea and abdominal pain). 9 of these 13 symptoms are not included in the CS and were denoted candidate symptoms in further analyses. Other than the CS: rhinitis, sore throat, headache, muscle aches, and appetite loss had the largest cumulative COVID-19-related hazards.

Additional diagnostic value of candidate symptoms

Raw counts of participants who had reported each symptom by each study day in the training cohort are presented in S9. Used alone, cough, rhinitis, headache and muscle aches were the most sensitive symptoms whilst nausea and abdominal pain were insensitive (S10). Anosmia, fever, and appetite loss were highly specific symptoms.

The crude LRs (S11) show that any of the symptoms will affect post-test odds when they are used alone. However, when used in combination with other symptoms, their LRs after adjustment using the SKJ approach (figure 2, table 1, Table S12) were all less extreme than their crude LRs, indicating considerable dependency between symptoms.

FIGURE 2
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2

Adjusted likelihood ratios for individual symptoms within symptom combinations. Symptoms were considered as a series of binary tests based on their occurrence by each study day. Spieglhalter Knill-Jones models were created using (A) 3 predictors (fever, cough, anosmia) to evaluate the diagnostic performance of the canonical symptoms (CS), and (B) 4 predictors to evaluate the effect of adding one of the 9 candidate variables to the CS (fever, cough, anosmia, candidate). Models were created for the day of enrolment and each of the first 7 study days. Positive and negative LRs for the presence or absence of each symptom by each study day were calculated (S11) and then adjusted for dependency with the other predictors within the model to measure the independent predictive value of each symptom within the symptom combination. See S4 for full description of the SKJ method and a worked example. Adjusted LRs for study days 0, 2 & 4 are presented in table 1. Adjusted positive LRs are shown on the left and adjusted negative LRs on the right. In each plot the horizontal line drawn is drawn at 1. LRs lying above the line increase post-test odds and those below the line reduce post-test odds. Bootstrap CIs for adjusted LRs could not be calculated because some bootstrap iterations resulted in samples with singularities. LR=Likelihood Ratio, CI=Confidence Interval.

View this table:
  • View inline
  • View popup
TABLE 1

Adjusted Likelihood Ratios for individual symptoms when canonical symptoms are used in combination with an additional candidate symptom

When cough was used in combination with fever and anosmia it's adjusted LRs were closer to 1 than those of anosmia or fever (figure 2A, Figure S12). This was most likely due to the higher specificity of anosmia and fever (S10). When combined with the CS the presence or absence of nausea did not independently affect post-test odds, its adjusted LRs lying close to 1 (figure 2). Breathlessness was more common in the “infected” group. However, whilst breathlessness was reported without fever, anosmia or cough by “uninfected” contacts, this was rare in the “infected”, explaining why its adjusted positive LRs are below 1 and negative LRs above 1.

In training and test datasets, AUC-ROCs increased with study day reflecting improved discrimination afforded by greater accumulation of symptoms by later study days in “infected” contacts (figure 3). AUC-ROC was often greater in test data than training data, likely reflecting the longer median time to recruitment in ATACCC.

FIGURE 3
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3

Direct Comparison of Area under the Receiver Operating Characteristic Curve in Training and Test Datasets Symptoms were considered as a series of binary tests based on their occurrence by each study day. A series of Spieglhalter Knill-Jones models were created, one for each study day, using 3 predictors (fever, cough, anosmia) to evaluate the canonical symptoms (CS) (black points). Nine further series of models were created using 4 predictors (fever, cough, anosmia, candidate) to evaluate the effect of adding one of the 9 candidate variables to the CS at each study day (coloured points). Model predictions were evaluated in training and test datasets by calculating area under the receiver operating characteristic curves. AUC Train=Area under the receiver operating characteristic curve in training dataset (cohort B, figure 1). AUC Test=Area under the receiver operating characteristic curve in test dataset (cohort C, figure 1). The hard-line marks AUC Test for the CS model. The dotted-line marks AUC Train for the CS. Models where the addition of a candidate symptom yielded better predictions in the training dataset lie to the right of the dotted-line and models where better predictions were yielded in the test dataset lie above the hard-line.

Between study days 0 to 3, the addition of headache, sore throat, muscle aches and appetite loss to the CS yielded the greatest improvements in AUC-ROC in the test dataset. When combined with the CS, appetite loss, headache, sore throat and muscle aches all consistently had positive adjusted LRs above 1 and negative adjusted LRs below 1 showing that both their presence and their absence added to the CS's ability to discriminate between the infected and uninfected. These symptoms were therefore considered “early-predictors” (EP).

Evaluating simple case definitions

Each of the four EP were combined individually with the CS using an “or” operator, as well as together using “or” and “at least” operators (Box 1).

Box 1 Construction of easily comprehensible case definitions using Boolean operators

Case definitions can contain Boolean logical operators such as: AND, OR and at least (see supplementary box 1 for examples in current use)
Symptom groups:Referred to in text as:
fever, cough, anosmiaCanonical Symptoms (CS)
headache, sore throat, muscle aches, appetite lossEarly-predictors (EP)
The “early-predictors” were each combined individually with the CS using an “OR” operator.
fever OR cough OR anosmia OR headacheCS or headache
fever OR cough OR anosmia OR sore throatCS or sore throat
fever OR cough OR anosmia OR muscle achesCS or muscle aches
fever OR cough OR anosmia OR appetite lossCS or appetite loss
The “early-predictors were all combined together with the CS using “at least” and “OR” operators.
fever OR cough OR anosmia OR AT LEAST 1 OF headache, sore throat, muscle aches and appetite loss≥1 of the CS, or ≥1 of the EP
fever OR cough OR anosmia OR AT LEAST 1 OF headache, sore throat, muscle aches and appetite loss≥1 of the CS, or ≥2 of the EP
fever OR cough OR anosmia OR AT LEAST 1 OF headache, sore throat, muscle aches and appetite loss≥1 of the CS, or ≥3 of the EP
fever OR cough OR anosmia OR AT LEAST 1 OF headache, sore throat, muscle aches and appetite loss≥1 of the CS, or ≥4 of the EP

The addition of any symptom to the CS using an “or” operator increased sensitivity (figure 4A) whilst reducing specificity (figure 4B). The addition of appetite loss produced the smallest changes compared to the CS.

FIGURE 4
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4

Sensitivity, specificity and number-needed-to-test for the canonical symptoms and broadened symptom criteria. The “early-predictors” (EP): sore throat, headache, muscle aches, appetite loss, were each combined individually with the canonical symptoms (CS): fever, cough and anosmia, using an “OR” operator and all were added together using “at least” and “OR” operators (as described in Box 1). Sensitivity [A], specificity [B] and number-needed-to-test [C] were calculated for each symptom criterion by day post exposure (ISO for household-contacts) against a serial PCR reference standard. Full results are given in S13. Number-needed-to-test is calculated by dividing the number of false-positives by the number of true-positives and adding 1. Rarely, symptoms were reported at enrolment without an onset date. We imputed onset dates for these symptoms by assuming the median number of days pre-enrolment (maximum 2 participants [0.55%] for rhinitis).

The CS identified 50% of PCR-positives by 6 days post exposure (figure 5, table 2, Table S14). Adding headache yields the greatest increase in sensitivity (figure 4A, Figure S13A) and would identify PCR-positives on average 2 days earlier (p=0.02), but causes the largest reduction in specificity (15.2% at 5 days post-exposure; figure 4B, Figure S13A). In contrast, CS or sore throat only reduced specificity by 5.7% at 5 days and identified PCR-positive cases earlier than the CS, by 1 day on average. This change was not statistically significant given the small number of PCR-positive participants in the cohort (p=0.1, n=91).

View this table:
  • View inline
  • View popup
TABLE 2

Time until positive identification by simple case definitions including the canonical symptoms (CS) and broadened symptom criteria

When all 4 EP are added to the CS, if all 4 are required, there is very little difference to the CS. In contrast, the case definition ≥1 of the CS, or ≥1 of the EP would increase sensitivity and identify PCR-positive cases a median 2 days earlier than the CS (p=0.002). However, the corresponding reduction in specificity by 5 days post-exposure (19.7%, figure 4B, Figure S13B) would lead 25% of PCR-negative individuals to be inappropriately identified (table 2, figure 5B). ≥1 of the CS, or ≥2 of the EP identified PCR-positive cases a median 2 days earlier than the CS (p=0.07) with a reduction in specificity of only 5.7% at 5 days post-exposure. This reduction is smaller than that caused by moving from the CS to various other international case definitions (S16). None of the EP were dispensable from this proposed criterion (S17).

The number of individuals identified in order to yield a single PCR-positive case, the NNT, increases rapidly immediately after exposure, reflecting an initial accumulation of false-positives because no one has yet developed symptoms actually caused by infection (figure 4C). NNT plateaus around 4–5 days following exposure, reflecting the incubation period. At 25.6% prevalence, ≥1 of the CS, or ≥2 of the EP had a NNT at 5 days post-exposure of 1.78 compared to 1.61 for the CS, indicating 17 additional individuals identified for every 100 infected individuals identified.

DISCUSSION

This, to our knowledge, is the first study to use daily symptom data prospectively collected from recently exposed infected and uninfected SARS-CoV-2 contacts to evaluate the diagnostic performance of symptom combinations for detecting infection.

Using this definitive study design, we found that 29% of individuals with PCR-confirmed COVID-19 did not report any of the CS, but 93% reported at least one symptom from a broader list of 20. We identified 4 EP symptoms (sore throat, headache, muscle aches, and appetite loss) providing additional early predictive power for identifying SARS-CoV-2-infected contacts. The case definition ≥1 of the CS, or ≥2 of the EP identified PCR-positive contacts 2 days earlier after exposure than the CS alone (p=0.07). This time-saving is critical given that shortening the delay from infectiousness to self-isolation from 2.6 to 1.2 days has been estimated to reduce transmission by 47%. [3] Moreover, the proportion of “symptomatic” infections and time-to-symptom onset are critical parameters in studies modelling effectiveness of testing and isolation strategies for contacts. [24]

Consistent with previous studies, headache and sore throat were sensitive symptoms, [7] which occurred early in the course of infection, [15] and were prevalent in our relatively young participants. [24] Importance of these symptoms will increase as vaccination of older age groups increases the proportion of infections occurring in the young. In agreement with the Real-time Assessment of Community Transmission-1 (REACT-1) study, we found that headache, muscle aches and appetite loss improved discrimination within statistical prediction models. [14] We add a crucial evaluation of readily applicable case definitions. We observed that both the structure of symptom criteria (e.g. use of the Boolean operator “at least”) and time-from-exposure had a considerable effect on diagnostic performance.

The SKJ approach enabled another important new observation. Although an important indicator of disease severity, [26] breathlessness was not a useful additional symptom for identifying early and mild infections because a hierarchy of symptoms exists. Breathlessness is unlikely to occur due to COVID-19 without prior fever, cough or anosmia and its inclusion reduces specificity.

Further strengths include day-by-day measurement of diagnostic performance following exposure and prospective data collection which mitigates recall bias. The rigorous reference standard employed in our training cohort maximised accuracy for the target condition and ensured only the most useful symptoms were taken forward to the test data. Neither serology nor PCR have 100% sensitivity for SARS-CoV-2 infection. [27] Using both serology and PCR at multiple time-points to define the absence of infection we minimised false-negatives. False-positive PCR results caused by recent rather than current infection were likely less common in our longitudinal study of recently exposed contacts than in studies involving random community-sampling. [14]

Limitations include modest sample size, largely White British population, minor differences between training and test cohorts and the potential for tick-box and behavioural biases. Study participants were usually highly motivated and attentiveness to mild symptoms (e.g. rhinitis) may have been increased by awareness of exposure, frequent study visits and co-residence with other participants. Contacts could not be blinded to their PCR results or those of their index.

Since we studied community-based COVID-19 contacts identified through NTAT, our findings are very likely generalizable. As large-scale cross-sectional data replicate our findings in smaller-scale daily-resolution longitudinal data, the combined evidence-base is now sufficient to influence policy. Broadening symptom criteria for use in the general population would likely identify more infections and reduce time-to-detection, reducing transmission. We propose that symptom criteria within case definitions to prompt symptomatic isolation and testing of SARS-CoV-2 contacts should include headache, sore throat, muscle aches and appetite loss as well as the canonical symptoms to optimise sensitivity. Two of these additional symptoms should be required to maximise specificity.

As highly vaccinated regions transition to lower COVID-19 incidence, investment in RT-PCR testing capacity will make such broader case definitions feasible. As societies develop alternatives to test-trace-isolate, application of evidence-based symptom criteria alongside judicious testing will be critical for early discrimination of infected and uninfected contacts. Accordingly, our findings should inform development of evidence-based national testing policies in many parts of the world now and in subsequent phases of the pandemic.

Acknowledgements

We would like to thank all the participants who were involved in the study and the support of our study research nurses Kristel Timcang, Sarah Hammett, Eimear McDermott, Constanta Luca, Sam Bremang Jada Samuel. We thank Myra McClure and Ellie Parker on behalf of the Molecular Diagnostic's Unit, Imperial College London. We thank Joanna Ellis and the Virus Reference Department Staff, and Lucy Mosscrop, Carolina Rosadas and the Molecular Diagnostic's Unit staff for providing SARS-CoV-2 PCR data. We thank PHE England staff for facilitating recruitment into the study. We thank Michael Whitfield, Mohammed Essoussi, Chitra Tejpal, Guilia Miserocchi, Harriet Catchpole and Anjeli Ketkar for conducting data entry and quality control, Holly Grey and Megan Davies for providing further logistical support and Charlotte Williams and Michael Whitfield for performing a literature search of the SARS-CoV-2 symptom case definitions used worldwide.

Footnotes

  • This article has supplementary material available from erj.ersjournals.com

  • Reporting standards: Results are presented in accordance with STARD (Standards for Reporting of Diagnostic Accuracy Studies) and STROBE (Strengthening Reporting of Observational Studies in Epidemiology) guidelines.

  • Funding Statement: This work is supported by a Department of Health and Social Care COVID-19 Fighting Fund award (ATACCC), by the NIHR Health Protection Research Unit in Respiratory Infections at Imperial College London in partnership with Public Health England (award NIHR200927) and by MRC/UKRI; nCoV: Serological detection of past SARS-CoV-2 infection by non-invasive sampling for field epidemiology and quantitative antibody detection. UK Research and Innovation; DOI: http://dx.doi.org/10.13039/100014013; Grant: CV 220-111; Department of Health and Social Care; DOI: http://dx.doi.org/10.13039/501100000276; Grant: COVID-19 Fighting Fund award (ATACCC); Public Health England; DOI: http://dx.doi.org/10.13039/501100002141; Grant: NIHR200927; National Institute for Health Research; DOI: http://dx.doi.org/10.13039/501100000272; Grant: NIHR200927; Medical Research Council; DOI: http://dx.doi.org/10.13039/501100000265; Grant: CV 220-111.

  • Author contributions: HH, SH & AL made substantial contribution to the conception of the work. TP, RK, RV, JF, HH, SH and AL contributed to study design and data collection methodology. HH, SH, AL, NF & JDe made substantial contribution to the design of the analyses. RV, MT-W, JB, VQ, JC, JDu, EC, LW, JN, JF, RK, SH, ND-F, AK, GT & MZ delivered and supported the administrative and technical study logistics. SH, ND-F, AK, & KM carried out the initial data acquisition. RT provided the serology data. GT & MZ provided the RT-PCR data. HH, KM & JDe analysed the data. Statistical analyses were checked by JDe. HH, SH, KM, JDe, AS, JDu, OMK & AL contributed to data interpretation. HH & SH drafted the manuscript. AL was the Principal Investigator for INSTINCT. AL and JDu were joint Principal Investigators for ATACCC. All authors contributed to revising the manuscript critically for important intellectual content, approved the final manuscript and are accountable for all aspects of the work.

  • Conflict of interest: No competing interests were declared by any of the study authors.

  • Received August 22, 2021.
  • Accepted November 11, 2021.
  • Copyright ©The authors 2021
http://creativecommons.org/licenses/by/4.0/

This version is distributed under the terms of the Creative Commons Attribution Licence 4.0.

References

  1. ↵
    1. Singanayagam A,
    2. Hakki S,
    3. Dunning J, et al.
    Community transmission and viral load kinetics of the SARS-CoV-2 delta (B.1.617.2) variant in vaccinated and unvaccinated individuals in the UK: a prospective, longitudinal, cohort study. Lancet Infect Dis 2021. https://linkinghub.elsevier.com/retrieve/pii/S1473309921006484.34756186
  2. ↵
    1. World Health Organization
    . Contact tracing in the context of COVID-19. World Health Organization. www.who.int/publications/i/item/contact-tracing-in-the-context-of-covid-19.
  3. ↵
    1. Kucharski AJ,
    2. Klepac P,
    3. Conlan AJK, et al.
    Effectiveness of isolation, testing, contact tracing, and physical distancing on reducing transmission of SARS-CoV-2 in different settings: a mathematical modelling study. Lancet Infect Dis 2020; 20: 1151–1160. doi:10.1016/S1473-3099(20)30457-6
    OpenUrlCrossRefPubMed
  4. ↵
    1. Bullard J,
    2. Dust K,
    3. Funk D, et al.
    Predicting infectious severe acute respiratory syndrome coronavirus 2 from diagnostic samples. Clin Infect Dis 2020; 71: 2663–2666. doi:10.1093/cid/ciaa638
    OpenUrlCrossRefPubMed
  5. ↵
    1. Salvatore PP,
    2. Dawson P,
    3. Wadhwa A, et al.
    Epidemiological correlates of polymerase chain reaction cycle threshold values in the detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Clin Infect Dis 2021; 72: e761–e767. doi:10.1093/cid/ciaa1469
    OpenUrl
  6. ↵
    1. Fragaszy E,
    2. Shrotri M,
    3. Geismar C, et al.
    Symptom profiles and accuracy of clinical definitions for COVID-19 in the community. Results of the Virus Watch community cohort. MedRxiv [pre-print] 2021. https://doi.org/10.1101/2021.05.14.21257229.
  7. ↵
    1. Antonelli M,
    2. Capdevila J,
    3. Chaudhari A, et al.
    Optimal symptom combinations to aid COVID-19 case identification: analysis from a community-based, prospective, observational cohort. Journal of Infection 2021; 82: 384–390. doi:10.1016/j.jinf.2021.02.015
    OpenUrl
    1. World Health Organisation
    . WHO COVID-19 Case definition. www.who.int/publications-detail-redirect/WHO-2019-nCoV-Surveillance_Case_Definition-2020.2.
    1. Centers for Disease Control and Prevention
    . Coronavirus disease 2019 (covid-19) 2020 interim case definition. 2020. wwwn.cdc.gov/nndss/conditions/coronavirus-disease-2019-covid-19/case-definition/2020/08/05/.
    1. Gouvernement de la République française
    . Tester- Alerter- Protéger (2021). www.gouvernement.fr/info-coronavirus/tests-et-depistage.
    1. Ministerio de Sanidad and Instituto de Salud Carlos III
    . Estrategia de detección precoz, vigilancia y control de covid-19. (2021). www.mscbs.gob.es/profesionales/saludPublica/ccayes/alertasActual/nCov/documentos/COVID19_Estrategia_vigilancia_y_control_e_indicadores.pdf.
    1. UK Government
    . Get a free PCR test to check if you have coronavirus. www.gov.uk/get-coronavirus-test.
  8. ↵
    1. Crozier A,
    2. Dunning J,
    3. Rajan S, et al.
    Could expanding the covid-19 case definition improve the UK's pandemic response? BMJ 2021; 374: n1625. www.bmj.com/lookup/doi/10.1136/bmj.n1625. doi:10.1136/bmj.n1625
    OpenUrlFREE Full Text
  9. ↵
    1. Elliott J,
    2. Whitaker M,
    3. Bodinier B, et al.
    Predictive symptoms for COVID-19 in the community: REACT-1 study of over 1 million people. PLoS Med 2021; 18: e1003777. doi:10.1371/journal.pmed.1003777
    OpenUrl
  10. ↵
    1. Wiegele PN,
    2. Kabar I,
    3. Kerschke L, et al.
    Symptom diary-based analysis of disease course among patients with mild coronavirus disease, Germany, 2020. Emerg Infect Dis 2021; 27: 1353–1361. doi:10.3201/eid2705.204507
    OpenUrl
  11. ↵
    1. Khan SM,
    2. Farland LV,
    3. Austhof E, et al.
    Symptoms of COVID-19 in a population-based cohort study. medRxiv [pre-print] 2021. https://doi.org/10.1101/2021.03.20.21254040.
  12. ↵
    1. Rosadas C,
    2. Randell P,
    3. Khan M, et al.
    Testing for responses to the wrong SARS-CoV-2 antigen? Lancet 2020; 396: 1291–1292. doi:10.1016/S0140-6736(20)31830-4
    OpenUrl
  13. ↵
    1. Medicines and Healthcare products Regulatory Agency (B) (MHRA)
    . Target product profile: In Vitro Diagnostic (IVD) self-tests for the detection of SARS-CoV-2 in people without symptoms. www.gov.uk/government/publications/how-tests-and-testing-kits-for-coronavirus-covid-19-work.
    1. Chan SF,
    2. Deeks JJ,
    3. Macaskill P, et al.
    Three methods to construct predictive models using logistic regression and likelihood ratios to facilitate adjustment for pretest probability give similar results. J Clin Epidemiol 2008; 61: 52–63. doi:10.1016/j.jclinepi.2007.02.012
    OpenUrlCrossRefPubMedWeb of Science
    1. Spiegelhalter DJ,
    2. Knill-Jones RP
    . Statistical and knowledge-based approaches to clinical decision-support systems, with an application in gastroenterology. Journal of the Royal Statistical Society Series A (General) 1984; 147: 35–77. doi:10.2307/2981737
    OpenUrl
    1. Spiegelhalter DJ
    . Probabilistic prediction in patient management and clinical trials. Stat Med 1986; 5: 421–433. doi:10.1002/sim.4780050506
    OpenUrlCrossRefPubMedWeb of Science
  14. ↵
    1. Knill-Jones RP
    . Diagnostic systems as an aid to clinical decision making. Br Med J (Clin Res Ed) 1987; 295: 1392–1396. doi:10.1136/bmj.295.6610.1392
    OpenUrlFREE Full Text
    1. Seymour DG,
    2. Green M,
    3. Vaz FG
    . Making better decisions: construction of clinical scoring systems by the Spiegelhalter-Knill-Jones approach. BMJ 1990; 300: 223–226. doi:10.1136/bmj.300.6719.223
    OpenUrlAbstract/FREE Full Text
  15. ↵
    1. Quilty BJ,
    2. Clifford S,
    3. Hellewell J, et al.
    Quarantine and testing strategies in contact tracing for SARS-CoV-2: a modelling study. Lancet Public Health 2021; 6: e175–e183. doi:10.1016/S2468-2667(20)30308-X
    OpenUrlPubMed
    1. Swann OV,
    2. Holden KA,
    3. Turtle L, et al.
    Clinical characteristics of children and young people admitted to hospital with covid-19 in United Kingdom: prospective multicentre observational cohort study. The BMJ 2020; 370: m3249. doi:10.1136/bmj.m3249
    OpenUrl
  16. ↵
    1. Borges do Nascimento IJB,
    2. von Groote TC,
    3. O'Mathúna DP, et al.
    Clinical, laboratory and radiological characteristics and outcomes of novel coronavirus (SARS-CoV-2) infection in humans: A systematic review and series of meta-analyses. PLoS ONE 2020; 15: e0239235. doi:10.1371/journal.pone.0239235
    OpenUrl
  17. ↵
    1. Long QX,
    2. Tang XJ,
    3. Shi QL, et al.
    Clinical and immunological assessment of asymptomatic SARS-CoV-2 infections. Nature Medicine 2020; 26: 1200–1204.
    OpenUrlCrossRefPubMed
PreviousNext
Back to top
View this article with LENS
Vol 60 Issue 2 Table of Contents
European Respiratory Journal: 60 (2)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Broadening symptom criteria improves early case identification in SARS-CoV-2 contacts
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
Broadening symptom criteria improves early case identification in SARS-CoV-2 contacts
Hamish Houston, Seran Hakki, Timesh D Pillay, Kieran Madon, Nieves Derqui-Fernandez, Aleksandra Koycheva, Anika Singanayagam, Joe Fenn, Rhia Kundu, Emily Conibear, Robert Varro, Jessica Cutajar, Valerie Quinn, Lulu Wang, Janakan S Narean, Mica R Tolosa-Wright, Jack Barnett, Onn Min Kon, Richard Tedder, Graham Taylor, Maria Zambon, Neil Ferguson, Jake Dunning, Jonathan J Deeks, Ajit Lalvani
European Respiratory Journal Jan 2021, 2102308; DOI: 10.1183/13993003.02308-2021

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Broadening symptom criteria improves early case identification in SARS-CoV-2 contacts
Hamish Houston, Seran Hakki, Timesh D Pillay, Kieran Madon, Nieves Derqui-Fernandez, Aleksandra Koycheva, Anika Singanayagam, Joe Fenn, Rhia Kundu, Emily Conibear, Robert Varro, Jessica Cutajar, Valerie Quinn, Lulu Wang, Janakan S Narean, Mica R Tolosa-Wright, Jack Barnett, Onn Min Kon, Richard Tedder, Graham Taylor, Maria Zambon, Neil Ferguson, Jake Dunning, Jonathan J Deeks, Ajit Lalvani
European Respiratory Journal Jan 2021, 2102308; DOI: 10.1183/13993003.02308-2021
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Acknowledgements
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • PDF

Subjects

  • Respiratory infections and tuberculosis
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

  • Sensitisation to recombinant Aspergillus fumigatus allergens and clinical outcomes in COPD
  • Immunomodulation and endothelial barrier protection mediate the association between oral imatinib and mortality in hospitalised COVID-19 patients
  • Impact of COVID-19 social distancing measures on lung transplant recipients: decline in overall respiratory virus infections is associated with stabilisation of lung function
Show more Original research article

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Reviewers
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2022 by the European Respiratory Society