Skip to main content

ORIGINAL ARTICLE

Int J Public Health, 05 September 2023

Mental Health Status, Risk and Protective Factors for Healthcare Staff Prior to the First Major COVID-19 Outbreak in Western Australia

Elizabeth A. Newnham,,
Elizabeth A. Newnham1,2,3*Enrique L. P. MergelsbergEnrique L. P. Mergelsberg4Jessica Tearne,Jessica Tearne5,6Peter McEvoy,,Peter McEvoy1,2,7Susanne StanleySusanne Stanley8Antonio Celenza,Antonio Celenza9,10Hyranthi KavanaghHyranthi Kavanagh5Teresa StevensonTeresa Stevenson11Nahal MavaddatNahal Mavaddat12Gavin Demore,Gavin Demore9,13Sean Hood,Sean Hood8,14
  • 1School of Population Health, Curtin University, Perth, WA, Australia
  • 2Curtin enAble Institute, Perth, WA, Australia
  • 3François-Xavier Bagnoud Center for Health and Human Rights, Harvard T.H. Chan School of Public Health, Boston, MA, United States
  • 4EnBerg Analytics, Perth, WA, Australia
  • 5Department of Clinical Psychology and Clinical Neuropsychology, Fiona Stanley Hospital, Perth, WA, Australia
  • 6State Major Trauma Unit, Royal Perth Hospital, Perth, WA, Australia
  • 7Centre for Clinical Interventions, North Metropolitan Health Service, Perth, WA, Australia
  • 8Division of Psychiatry, School of Medicine, The University of Western Australia, Perth, WA, Australia
  • 9Emergency Medicine, School of Medicine, University of Western Australia, Perth, WA, Australia
  • 10Emergency Department, Sir Charles Gairdner Hospital, Perth, WA, Australia
  • 11Peel and Rockingham Kwinana Mental Health Service, Rockingham, WA, Australia
  • 12Discipline of General Practice, School of Medicine, University of Western Australia, Perth, WA, Australia
  • 13Western Australia Country Health Service, Perth, WA, Australia
  • 14Sir Charles Gairdner Hospital Mental Health Unit, North Metropolitan Health Service Mental Health, Public Health and Dental Services (MHPHDS), Perth, WA, Australia

Objectives: Western Australia’s unique public health response delayed the first wave of community COVID-19 transmission for 2 years. We aimed to determine the status of post-traumatic stress (PTSS), depressive, and anxiety symptoms among healthcare staff in major tertiary hospitals, together with associated risk and protective factors prior to the first substantial outbreak of COVID-19.

Methods: A cross-sectional study was conducted with 431 healthcare staff immediately prior to the Western Australian border re-opening in 2022. Staff were recruited via notices in email newsletters, at four tertiary hospitals and a public mental health clinic in metropolitan Perth. Validated and original questionnaires were administered via Qualtrics.

Results: Moderate levels of PTSS (22.3%), depression (21.9%), and anxiety (25.9%) were reported. Pathway analyses indicated that sleep difficulties, workplace stressors, and infectious disease training were associated with higher PTSS, depression and anxiety symptoms, and younger age was associated with higher levels of depression and anxiety. Nursing roles were associated with higher PTSS. Social support and workplace support were associated with lower levels of depression and anxiety but were not associated with PTSS.

Conclusion: The findings illustrate high levels of resilience, but indicate a need for structural supports within the health system to foster staff mental health prior to the onset of emergencies.

Introduction

Western Australia’s trajectory during the COVID-19 pandemic provides a novel opportunity to investigate mental health status among healthcare workers in anticipation of a large-scale health emergency. Low population density, geographic isolation and a strategic state-wide public health response in Western Australia placed the state in a rare position to minimise the transmission of SARS-COV-2 (COVID-19) for the first 2 years of the global pandemic. By limiting international and interstate arrivals, implementing strict quarantine procedures, establishing rapid city-wide lockdowns, and encouraging physical distancing, the government enabled sufficient time for more than 95% of the population (over 16 years) to have received two vaccines and 66% to have had three vaccine doses by 3rd March 2022, when the international and state borders were officially reopened [1, 2]. At the time, the Western Australian healthcare system had not experienced the immense burden of COVID-19 cases evident internationally. Prior to the border re-opening in 2022, 70 people had been hospitalised and 11 people had died from COVID-19 in Western Australia in total [1, 2]. Accordingly, the WA health system had additional time to prepare for the pandemic response with knowledge gained from global health settings.

The COVID-19 pandemic has had significant impacts on healthcare professionals’ mental health internationally. Recent cross-sectional studies indicate significantly elevated rates of post-traumatic stress symptoms, depression, and anxiety among healthcare staff responding to the COVID-19 pandemic [3, 4]. Poorer mental health status has been associated with a variety of individual, professional and workplace factors. First, nurses’ professional positions compared to doctors and other health professionals have been associated with poorer mental health status, likely due to the frontline roles, changing demands, and exposure risks that nurses have experienced during the pandemic [57]. Second, physical health risks, such as greater exposure to COVID-19 patients in the healthcare setting [8], safety protection concerns at work [8, 9], worry about infecting family members or blame from colleagues for not taking adequate precautions [10, 11], and higher levels of health-related fears [8] place healthcare workers at higher risk of mental health concerns. Third, poor sleep quality and duration has also been associated with poor mental health outcomes [12], but the need for further research on the role of sleep during COVID-19 has been highlighted [13]. Consistent with an empirical gap in disaster and pandemic research [14], fewer studies have investigated protective factors associated with mental health outcomes among healthcare staff. An emerging evidence base suggests that adaptive coping strategies [15, 16], social support [17, 18], workplace supports [19], and additional infectious disease training [16, 17] may play important roles in reducing mental health concerns for healthcare staff.

Western Australian healthcare workers witnessed the catastrophic outcomes of the global pandemic from afar, whilst preparing for the arrival of a first wave in 2022. Despite the delay in large-scale outbreaks of COVID-19 cases in the community, healthcare staff were under significant strain with shortages in staff and rapid policy changes to prepare for the onset of the pandemic [20, 21]. Changes to personal protective equipment policies, training requirements, staff schedules and roles were rapidly implemented. Following 2 years of international and state border closures with limited flights and hotel quarantine requirements (although short periods of interstate travel were allowed when case numbers where low), March 2022 presented the first opportunity for travel and migration.

The unique context in Western Australia prior to March 2022 provided an opportunity to investigate the mental health impacts for healthcare workers preparing for an impending pandemic. Understanding the factors associated with healthcare workers’ mental health in anticipation of a large-scale health emergency will inform avenues for health system preparedness and maximise sustainability of the workforce. Accordingly, the present study captured healthcare workers’ mental health data in the 3 months leading up to the Western Australian 2022 interstate and international border re-opening. We aimed to determine the status of post-traumatic stress, depressive, and anxiety symptoms among healthcare staff in major tertiary hospitals and clinics in Perth, Western Australia, and the associated individual, social and workplace risk and protective factors prior to a substantial COVID-19 outbreak. Building on prior findings among studies of healthcare professionals in settings affected by COVID-19, it was hypothesized that:

First (H1): Mental health status would differ by profession type, with nurses reporting higher levels of mental health concerns, and lower levels reported by doctors, allied health, executives and management.

Second (H2): Workplace stressors would be positively associated with PTSS, depression, and anxiety symptoms for all profession groups.

Third (H3): Sleep difficulties would be positively associated with PTSS, depression and anxiety symptoms for all profession groups.

Fourth (H4): Resilient coping, social support, infectious disease training, and workplace supports would be negatively associated with PTSS, depression and anxiety symptoms among all healthcare workers.

Methods

Participants and Procedure

This study presents the cross-sectional baseline survey data for a larger longitudinal study of secondary and tertiary hospital staff wellbeing and mental health during the COVID-19 pandemic. All healthcare staff (including doctors, nurses, midwives, allied health professionals, auxiliary staff, executives and management) employed at four major tertiary hospitals and a large public mental health service in metropolitan Perth, WA, were eligible to participate. Hospitals and clinics in Perth are managed by overarching Health Service Providers (HSPs) through the Department of Health. The study was promoted via a small advertisement in the all-staff email newsletter at some HSPs, online flyers distributed through HSP communications, at hospital-wide forums and at team meetings attended by investigators on the project. In one HSP, two follow-up reminders were included in all-staff newsletters. Hospital executive and management staff were not involved in the recruitment or knowledgeable about participation of staff. Participants were recruited between 30 November 2021 and 7 March 2022, and the questionnaire was accessed online. All respondents provided informed consent to participate. The data were deidentified. Participants created a private unique code to link data at later stages. Respondents were asked to provide their email address to enable follow-up, which was stored separately to the data. Ethics approvals were granted by the Department of Health North Metropolitan Area Mental Health Services Human Research Ethics Committee (RGS0000004034).

Measures

The survey was hosted online via Qualtrics [22] and comprised validated measures of psychological symptoms, validated and original measures of risk and protective factors, and a checklist of mental health supports.

Demographics

Demographic items included age, gender, profession, department, work setting and employment status. We measured respondents’ prior experience working with infectious disease (one item; yes = 1, no = 0), direct and indirect COVID-19 exposure in their current workplace (sum of three items; yes = 1, no = 0), and training (one item; yes = 1, no = 0, with a follow-up question when answered ‘yes’ to assess when they had the training: pre-, during or both pre- and during COVID).

Workplace Factors

Work related stressors and supports scales were developed by the study team, based on a review of the relevant literature, consultations with healthcare staff (n = 7), and team expertise. The scales were designed to capture specific stressors and supports highlighted as relevant to healthcare staff in the early stages of the pandemic (please see Supplementary Material for scale). Workplace stressors (12 items including concerns about exposure to COVID-19 at work, financial security, changes to workload, risk of infecting people in your household with COVID-19, and risk of contracting other infectious illnesses) were measured on a 5-point Likert scale ranging from “Not at all concerned” [1] to “Very concerned” [5]. Sum scores were calculated, higher sum scores indicated higher levels of work-related stress (range: 12–60). Internal consistency was high (α = .88). McDonald’s Omega coefficient (ωt) for the workplace stressors scale was 0.900 (above 0.700 is sufficient reliability).

Satisfaction with work-related support (11 items, including the timely provision of information, managerial support, clarity of instructions, and access to personal protective equipment), was measured via a 5-point Likert scale assessing level of satisfaction respectively, from “Not at all satisfied” [1] to “Very satisfied” [5] (please see Supplementary Material for scale). Internal consistency was high (α = .91, ωt = 0.921). Sum scores were calculated (range: 11–55), with high scores indicating high level of satisfaction with the provision of support.

Protective Factors

Coping strategies were assessed with the 4-item Brief Resilient Coping Scale questionnaire (BRCS) [23], rated on a 5-point Likert scale ranging from “Does not describe me” [1] to “Describes me very well” [5] with good internal consistency (α = .71). We calculated a sum score (ranging 4–20) with higher scores indicating better coping. Social support was measured with the 3-item Oslo Social Support Scale [24] (α = .77). A sum score was calculated (range: 3–14) with higher scores indicating stronger social support. The average inter-item correlation was good (Mr = .55) with a = .77.

Sleep Quality

Sleep difficulties were assessed with the Sleep Condition Indicator (SCI; 25). A sum score was calculated ranging from 0–32, higher scores indicating more sleep problems. We applied a cut-off at a score of 16 to report prevalence of probable insomnia disorder, as this has shown to have a sensitivity of 89% and 82% specificity, respectively [25]. The average inter-item correlation was good (Mr = .52) with a = .88.

Post-Traumatic Stress Symptoms

The PCL-5 Trauma Checklist was administered to measure trauma exposure, and post-traumatic stress symptoms were assessed using the Primary Care PTSD Screen for DSM-5 (PC-PTSD-5; 26). A sum score was calculated for those who experienced trauma on 5-items asking to rate whether they experienced symptoms (e.g., having nightmares: yes = 1, no = 0) related to the experience they listed as most distressing (range: 0–5, higher scores indicated higher levels of PTSS). The average inter-item correlation was ideal (Mr = .31) with a = .69. Prevalence of probable clinical levels of PTSS was reported using a cut-off point of 4 points as recommended [26, 27]. For analyses, trauma exposure was coded as trauma [0 = none, 1 = infectious disease, 2 = work-related trauma (physical/sexual assault at work, death of patient and medical litigation), 3 = not work-related trauma (all other exposures)].

Depressive Symptoms

Depression was assessed with the Patient Health Questionnaire (PHQ-9; [28]), scoring each of the nine DSM-5 depression criteria on a 4-point Likert scale ranging from “Not at all” (0) to “Nearly every day” [3]. The average inter-item correlation was ideal (Mr = .46) with a = .88. Sum scores were calculated (range: 0–27), with higher scores indicating higher levels of depression. Scores of 5, 10, 15, and 20 were taken as the cut-off points for mild, moderate, moderately severe, and severe depression respectively, consistent with prior research in a comparative sample [10].

Anxiety Symptoms

Anxiety was assessed using the Generalised Anxiety Disorder Questionnaire (GAD-7; [29, 30]) using 4 response options ranging from “Not at all” (0) to “Nearly every day” [3]. The average inter-item correlation was good (Mr = .61) with a = .92. Sum scores were calculated (range: 0–21) and scores of 5, 10, and 15 were taken as the cut-off points for mild, moderate, and severe anxiety, respectively. consistent with prior research [10].

Access to Psychological Services

Access to psychological and wellbeing services were assessed with an 18-item checklist that included general services (e.g., accessing a General Practitioner, psychologist, online information, listening to a podcast) as well as services delivered in specific hospital settings (such as a drop-in wellbeing hub) nominated by clinicians in the research team. For each item, participants were asked to tick whether they had accessed the service, and for those they had, rate their satisfaction on a Likert scale of 5 (Highly Satisfied) to 1 (Highly Dissatisfied).

Data Analysis

Data were exported from Qualtrics and uploaded in R statistics [31]. We reported descriptives, before completing a missing values analysis using Little’s MCAR test [32] with the naniar package. In cases of random missingness we imputed the data for participants who had less than 50% missingness using the regression imputation method with the impute_lm function from the simputation package in R [33] as recommended by Newman [34]. We ran Pearson correlations between all measured variables to assess associations and assured the lack of multicollinearity, and conducted a pathway analysis to test whether demographic variables, risk factors and protective factors were associated with PTSS, depression, and anxiety symptoms.

Results

Sample Characteristics

A total of 563 individuals accessed the online survey, of these 533 provided consent to participate. Completed data were available for n = 431 (102 participants closed Qualtrics before completing measures). Mean age was 42.4 (SD = 11.9, range = 21–71). Most participants (81%) identified as women, 18% as men, 0.5% as another gender, and 0.5% preferred not to say. Occupational characteristics of the sample are shown in Table 1. Prior experience with infectious disease outbreaks was reported by 21% (n = 91) of the sample, and only 39% (n = 167) reported having received training in epidemic/pandemic infectious disease management. Of those, most had received training only during the COVID-19 pandemic (n = 84, 51%), or both before and during the pandemic (n = 66, 40%). Sixteen participants (9.6%) reported only having received training prior to the COVID-19 pandemic.

TABLE 1
www.frontiersin.org

TABLE 1. Demographic characteristics of all participating healthcare workers (N = 431) and by probable mental health status. Western Australia, 2021–2022.

A large majority of the sample reported prior lifetime trauma exposure (n = 333, 85%), with an average of 3.3 types of trauma exposures per person (SD = 2.1). The most frequently reported trauma exposures were the unexpected death of a patient (n = 199, 37%), physical assault in the workplace (n = 174, 33%), experience of a life threatening illness (n = 156, 29%), infectious disease outbreak (n = 124, 23%), physical assault external to work (n = 76, 14%), natural disaster (n = 71, 13%), serious accident (n = 66, 12%), medical litigation (n = 65, 12%), sexual assault external to work (n = 62, 12%), and child abuse (n = 62, 12%). Of the respondents who completed the Sleep Condition Indicator, half reported difficulties with sleep (n = 185, 50%).

Missing Values Analysis

The missing values analysis showed that the data were missing completely at random (MCAR), X2 (7818) = 4,770, p = 1.00. The average missing values among respondents was 18.9%, with an average of 81.1% complete. Twenty-six participants had more than 70% missing and 19 participants had between 50% and 69% missingness. The remaining (and included) participants had between 0% and 33% missingness with an average of 1.4% missingness. Hence missing data were imputed for those with less than 50% missingness (n = 27 deleted case-wise), leaving N = 404. Of these, n = 247 (61.1%) had a complete data set. In 17 cases, imputation failed due to missing data in predictor variables needed for imputation, and so they were omitted from analysis. The final dataset for the regression models comprised 387 cases.

Mental Health Status

Mental health symptom reports for the total sample indicated: probable PTSS (n = 78, 22.3%), depression in the severe (n = 5, 1.2%), moderate severe (n = 24, 5.6%), moderate (n = 65, 15.1%), and mild range (n = 113, 26.2%), and anxiety in the severe (n = 33, 8.35%), moderate (n = 69, 17.5%) and mild range (n = 106, 26.8%). We examined differences in psychological symptoms by discipline, shown in Table 2. Pairwise comparisons adjusted by Bonferroni showed that nurses reported significantly higher PTSS, depression, and anxiety scores, compared to doctors (p = .006, p = .038, and p = .006, respectively). Nurses also reported significantly higher PTSS compared to Allied Health staff (p = .015). Executive and administrative staff reported marginally higher depression scores compared to doctors (p = .078). All other differences were not significant (p > .210).

TABLE 2
www.frontiersin.org

TABLE 2. Mental health status of healthcare workers in WA per profession (N = 430) Western Australia, 2021–2022.

Risk and Protective Factors for Mental Health

Pearson correlations were conducted on the final sample (n = 387, see Supplementary Material). We found significant correlations with all adverse mental health outcomes and the measured predictor variables (i.e., age, gender, profession, exposure to COVID-19, work related stressors, trauma, sleep quality, work related support, coping strategies, and social support). The highest correlations were between insomnia and the adverse mental health outcomes (PTSS: r = .36, p < .001; depression r = .53, p < .001; anxiety: r = .51, p < .001). The smallest significant correlations were found with previous experience with infectious diseases variables, which only correlated with PTSS, age and profession (r = .11, p < .050, r = .11, p < .050 and r = .18, p < .001, respectively).

Model fit of the pathway model (Figure 1), along with unstandardized coefficients with standard errors and 95% confidence intervals are shown in Table 3. The model had excellent fit and showed that younger healthcare workers reported higher levels of depression and anxiety, but that gender was not associated with adverse mental health outcomes. The largest effect was found for difficulties with sleep, which was associated with higher levels of PTSS, depressive and anxiety symptoms. Further, we found that a greater number of workplace stressors and having received infectious disease training were associated with higher levels of PTSS, depression and anxiety symptoms. Nurses were most likely to report PTSS than other disciplines, and prior experience with infectious disease outbreaks was associated with lower levels of depressive symptoms. Contrary to expectation, there was no association between exposure to patients with COVID-19 and adverse mental health outcomes for healthcare staff. Social support and workplace support were associated with lower levels of depression and anxiety but were not associated with lower levels of PTSS.

FIGURE 1
www.frontiersin.org

FIGURE 1. Diagram of pathway analysis assessing causal effects of risk and protector factors and mental health outcomes. Western Australia, 2021–2022.

TABLE 3
www.frontiersin.org

TABLE 3. Regression coefficients of associative paths of PTSS, Depression and Anxiety (N = 387) Western Australia, 2021–2022.

Mental Health Support

A large majority of respondents (n = 323, 85%) reported having accessed psychological support. Respondents most frequently sought psychological support from colleagues (74%) highlighting the importance of peer-support in healthcare settings. In addition, most reported that they had accessed psychological support during the past 2 years (85%, n = 323) with GPs and online information the most frequently accessed sources of help. Table 4 shows the types of support accessed including the frequency and satisfaction score for each. Accessing support via psychologists, colleagues and podcasts received the highest satisfaction rankings respectively.

TABLE 4
www.frontiersin.org

TABLE 4. Psychological support accessed by healthcare staff (n = 431) Western Australia, 2021–2022.

With regards to workplace supports, respondents reported an average satisfaction score of 35.1 (SD = 10.5, range 11–55, normally distributed) indicating moderately high levels of satisfaction when asked how satisfied they were with how the workplace supported their needs during the COVID-19 pandemic. The work support satisfaction score did not differ between professions, F (3,205) = 0.75, p = .525.

Discussion

This study provides unique evidence for the mental health status of healthcare workers preparing for COVID-19 in a city that did not experience a major community outbreak until March 2022. Western Australian healthcare workers reported moderate levels of post-traumatic stress (22.3%), depressive (21.9%), and anxiety (25.9%) symptoms during the 3 months leading up to the re-opening of the state and international borders during the COVID-19 pandemic. Psychological symptom levels reported in Western Australia were consistent or slightly lower than assessments of healthcare workers in other Australian states [10, 35, 36], and substantially lower than pooled prevalence estimates reported in recent meta-analyses of global healthcare workers’ PTSS (31.4%–49%), depression (31.3%–40%) and anxiety (30%–37%) symptoms durings the COVID-19 pandemic [3, 37]. Smallwood et al.’ [10] assessment of psychological status among healthcare workers primarily located in Victoria, indicated higher levels of moderate to severe depression (28%) and moderate to severe anxiety (28.3%), likely reflecting the higher COVID-19 caseloads and more restrictive lockdowns in the eastern states of Australia. Western Australia’s successful implementation of border restrictions, rapid lockdowns and high vaccination rates before the first major COVID-19 outbreak may have supported resilience among healthcare staff. However, a sizeable minority of healthcare workers reported PTSS, depression and anxiety symptoms at moderate to severe levels, highlighting the impact of pre-existing and anticipatory stressors. Despite the lower levels of mental health difficulties in our sample, the mechanisms associated with psychological distress were consistent with the Australian and global literature [5, 6, 810, 38]. Workplace stressors such as increases to workload, a lack of timely communication, fear of infection, and concerns about access to personal protective equipment were significantly associated with higher levels of psychological symptoms, highlighting the importance of addressing structural workplace risks for mental health.

In partial support of Hypothesis One, mental health status differed by professional group. Doctors reported less severe PTSS than other disciplines, potentially reflecting a higher level of control over workplace factors, lower risk of moral injury, or reduced exposure to high-risk scenarios (including workplace violence and unexpected deaths) [39, 40]. Nursing roles were significantly associated with higher levels of PTSS. Higher levels of mental health concerns among nurses is consistent with research conducted prior to [41] and during [10] the COVID-19 pandemic from healthcare settings across Australia. The discrepancy may reveal the effects of longer periods spent attending to patients, higher risk of infection, and in some cases, threats of violence against nurses compared to other professions [40]. One third of the current sample reported exposure to physical violence at work, which highlights the need for safety improvements in the workplace for all staff, and nurses in particular [42]. The current findings indicated that executive and management staff reported high levels of PTSS, depression and anxiety, which has not been explored in prior studies of healthcare workers’ mental health, and warrants further investigation. Executive and management staff were under significant pressure to ensure that new COVID-19 policies and practices were implemented throughout the study period, while maintaining cost-efficiencies. Further, staff shortages due to border restrictions, rapid changes to staffing structures (including more junior personnel) and anticipatory stress among staff created additional concerns for management.

Workplace stressors including concerns about changes in policy, work hours, access to PPE, timely distribution of information, fear of infection, and fear of COVID-19 transmission to family members, were significantly associated with all mental health outcomes, supporting Hypothesis Two and augmenting findings on organizational stressors for healthcare workers in China [9], the United States [8], Italy [43], and Australia [38]. Despite the low COVID-19 caseload, the Western Australian health service implemented significant policy changes in preparation for the pandemic, creating additional workload and stressors for staff. Sleep difficulties were reported by half of the sample and were significantly associated with poorer mental health outcomes, lending support for Hypothesis Three. Healthcare workers employed in shift work or long hours are at greater risk of sleep-disorders [37], with implications for alertness, performance and mental health [44]. These factors are likely to be exacerbated during a pandemic [12, 37].

Hypothesis Four, that resilient coping, social support, infectious disease training and workplace supports would be associated with lower levels of PTSS, depressive and anxiety symptoms, was partially supported. The current findings demonstrated that social support and structural workplace supports (e.g., managerial support, timely and frequent information, access to sufficient PPE) were associated with lower depression and anxiety symptoms, signifying the importance of organizational support in the workplace to ensure psychological resilience among healthcare staff [38, 45, 46]. Resilient coping was not associated with mental health symptoms, and infectious disease training was positively associated with higher levels of PTSS, depressive and anxiety symptoms in contrast with prior research [16, 17]. It may be the case that staff with infectious disease training were more likely to be working in frontline roles, and were thus at greater risk of infection.

In addition, our findings indicated that younger healthcare workers were at higher risk of depression and anxiety, which may suggest the need for stronger mentoring processes and wellbeing supports tailored for early career professionals. Workforce instability in the healthcare system may disproportionately affect younger workers, creating higher levels of distress [39, 47]. Changes during the pandemic may have required younger staff to take on additional responsibilities, or step into roles previously held by senior staff who have left the workforce, highlighting a need for organizational support strategies to ensure emotional wellbeing among early career professionals. A large majority of our sample reported accessing mental health and wellbeing supports via colleagues, their general practitioner, or online, with high levels of satisfaction. Yet despite a growing focus on individual psychopathology among healthcare workers and high levels of access to psychosocial supports, the current findings contribute to a clear evidence base that argues the need for organizational change, including shorter shifts, collegial supports, access to effective PPE, and improved physical safety to support psychological health [11, 38, 46, 48].

Policy and Practical Implications

It is critical that Health Emergency and Disaster Risk Management (Health EDRM) planning incorporates provisions for healthcare workers’ mental health and occupational support. To date, the World Health Organization’s Health EDRM Framework has focused on building capacity, core competencies, and skills within the existing healthcare workforce to address pandemics and disasters [49, 50]. The current findings suggest that attention to the mental health of healthcare staff is vital to ensure capacity to respond to large scale emergencies, and that organizational practices and mental health supports must be in place prior to the onset of mass trauma events. Pandemics are associated with higher levels of post-traumatic stress symptoms and anxiety than most other types of disasters [14]. Accordingly, greater investment in reducing exposure to infectious disease risk at work through the provision of PPE, ensuring timely communication of decisions, managerial responsiveness to feedback, and access to social and psychological supports in the workplace will enable health departments to retain staff throughout high-stress periods [11, 51]. Staff should also be confident in organisational disaster preparedness efforts [38]. Dedicated improvements to workplace culture are not only necessary during the COVID-19 pandemic, but vital to the ongoing functioning of the healthcare system.

Limitations

This study presents the baseline data for a longitudinal study of mental health outcomes among tertiary hospital and community mental health clinic staff in Western Australia. The data were collected prior to Western Australia’s first major COVID-19 wave, but do not reflect ‘pre-pandemic’ mental health. Cross-sectional data provide an indication of potential risk and protective factors for mental health outcomes, but longitudinal data are needed to ascertain specific relationships over time. The sample comprised largely women (81%), reflecting gender imbalances in nursing and allied health [52]. Although the sample was inclusive of disciplines and roles within tertiary hospital settings and community mental health clinic settings, recruitment strategies and voluntary participation may have influenced representation within the sample, and thus the findings should not be generalised to all healthcare staff. Although we sought to recruit from four tertiary hospitals and a mental health clinic in metropolitan Perth, the rate of participation could not be determined due to the broad range of recruitment strategies used across different Health Service Providers, which limits the generalizability of findings. The proportion of doctors within the sample is low. Self-reported questionnaires do not provide a diagnostic assessment, and are likely to inflate the level of mental health need [53] and thus the current findings should be considered an indication of symptom levels among Western Australian healthcare workers. Further, we are unable to determine the extent to which adverse mental health outcomes reported in the current study reflect pandemic-related distress. Further follow-up is needed to elucidate novel COVID-induced stressors and the exacerbation of existing stressors.

Conclusion

Despite Western Australia’s unique protection from COVID-19 for the first 2 years of the global pandemic, healthcare workers reported moderate symptom levels for PTSS, depression and anxiety. The current findings highlight the significant role of workplace stressors, younger age, nursing roles, and sleep difficulties in healthcare workers’ mental health. Importantly, most healthcare workers reported robust mental health, and social support and workplace supports played protective roles. Ongoing monitoring of healthcare workers’ mental health and wellbeing throughout the pandemic is needed, and initiatives to increase transparency in decision making, clear communication, and peer-based psychological support are vital. Organizational practices and mental health supports must be established prior to the onset of mass trauma events to ensure psychological resilience.

Ethics Statement

The studies involving human participants were reviewed and approved by Western Australian Department of Health North Metropolitan Area Mental Health Services Human Research Ethics Committee. The participants provided their written informed consent to participate in this study.

Author Contributions

The study was designed by EN, JT, and EM, with input from all authors on survey design. EN, EM, SS, JT, HK, TS, AC, GD, SH led data collection, and EM conducted data analyses. EN and EM wrote the first draft and revision. All authors contributed to the article and approved the submitted version.

Funding

We wish to acknowledge funding from the Western Australian Government Department of Jobs, Tourism, Science and Innovation and the Western Australian Government Department of Health that supported this project. EN was supported by a Curtin Research Fellowship. The funding bodies played no role in the design of the project, collection of data, analysis, interpretation of results or decision to publish.

Conflict of Interest

Author EM was employed by company EnBerg Analytics.

The remaining authors declare that they do not have any conflicts of interest.

Acknowledgments

We are grateful to the healthcare staff that participated in the study, for providing their time and insights.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.ssph-journal.org/articles/10.3389/ijph.2023.1606102/full#supplementary-material

References

1. Western Australian Government Department of Health. WA COVID-19 Data Update: 18 March 2022 (2022). Available From: https://ww2.health.wa.gov.au/∼/media/Corp/Documents/Health-for/Infectious-disease/COVID19/COVID-19-Weekly-Statistics.pdf (Accessed March 18, 2022).

Google Scholar

2. Macali, A. COVID Live Online Database (2022). Available From: https://covidlive.com.au (Accessed May 1, 2022).

Google Scholar

3. Saragih, ID, Tonapa, SI, Saragih, IS, Advani, S, Batubara, SO, Suarilah, I, et al. Global Prevalence of Mental Health Problems Among Healthcare Workers During the Covid-19 Pandemic: A Systematic Review and Meta-Analysis. Int J Nurs Stud (2021) 121:104002. doi:10.1016/j.ijnurstu.2021.104002

PubMed Abstract | CrossRef Full Text | Google Scholar

4. De Kock, JH, Latham, HA, Leslie, SJ, Grindle, M, Munoz, S-A, Ellis, L, et al. A Rapid Review of the Impact of COVID-19 on the Mental Health of Healthcare Workers: Implications for Supporting Psychological Well-Being. BMC public health (2021) 21(1):104–18. doi:10.1186/s12889-020-10070-3

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lai, J, Ma, S, Wang, Y, Cai, Z, Hu, J, Wei, N, et al. Factors Associated With Mental Health Outcomes Among Health Care Workers Exposed to Coronavirus Disease 2019. JAMA Netw Open (2020) 3(3):e203976. doi:10.1001/jamanetworkopen.2020.3976

PubMed Abstract | CrossRef Full Text | Google Scholar

6. García-Fernández, L, Romero-Ferreiro, V, López-Roldán, PD, Padilla, S, Calero-Sierra, I, Monzó-García, M, et al. Mental Health Impact of COVID-19 Pandemic on Spanish Healthcare Workers. Psychol Med (2022) 52(1):195–7. doi:10.1017/S0033291720002019

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Li, TM, Pien, LC, Kao, CC, Kubo, T, and Cheng, WJ. Effects of Work Conditions and Organisational Strategies on Nurses' Mental Health during the COVID-19 Pandemic. Journal of Nurs Manage (2022) 30(1):71–8. doi:10.1111/jonm.13485

CrossRef Full Text | Google Scholar

8. Van Wert, MJ, Gandhi, S, Gupta, I, Singh, A, Eid, SM, Haroon Burhanullah, M, et al. Healthcare Worker Mental Health After the Initial Peak of the COVID-19 Pandemic: A US Medical Center Cross-Sectional Survey. J Gen Intern Med (2022) 37:1169–76. doi:10.1007/s11606-021-07251-0

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Cai, H, Tu, B, Ma, J, Chen, L, Fu, L, Jiang, Y, et al. Psychological Impact and Coping Strategies of Frontline Medical Staff in Hunan Between January and March 2020 During the Outbreak of Coronavirus Disease 2019 (COVID-19) in Hubei, China. Med Sci Monitor: Int Med J Exp Clin Res (2020) 26:e924171–1. doi:10.12659/MSM.924171

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Smallwood, N, Karimi, L, Bismark, M, Putland, M, Johnson, D, Dharmage, SC, et al. High Levels of Psychosocial Distress Among Australian Frontline Healthcare Workers During the COVID-19 Pandemic: A Cross-Sectional Survey. Gen Psychiatry (2021) 34(5):e100577. doi:10.1136/gpsych-2021-100577

CrossRef Full Text | Google Scholar

11. Digby, R, Winton-Brown, T, Finlayson, F, Dobson, H, and Bucknall, T. Hospital Staff Well-Being During the First Wave of COVID-19: Staff Perspectives. Int J Ment Health Nurs (2021) 30(2):440–50. doi:10.1111/inm.12804

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Xia, L, Chen, C, Liu, Z, Luo, X, Guo, C, Liu, Z, et al. Prevalence of Sleep Disturbances and Sleep Quality in Chinese Healthcare Workers During the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Front Psychiatry (2021) 12:646342. doi:10.3389/fpsyt.2021.646342

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Alhroob, T, Abu Alya, W, Maraqa, BN, Khalil, CJ, Shalash, A, Abu-Rmeileh, NM, et al. The Mental Health Impact of the COVID-19 Pandemic on Healthcare Workers in the Eastern Mediterranean Region: A Scoping Review. Int J Public Health (2023) 67:304. doi:10.3389/ijph.2022.1604814

CrossRef Full Text | Google Scholar

14. Newnham, EA, Mergelsberg, ELP, Chen, Y, Kim, Y, Gibbs, L, Dzidic, P, et al. Long Term Mental Health Trajectories After Disasters and Pandemics: A Multilingual Systematic Review of Prevalence, Risk and Protective Factors. Clin Psychol Rev (2022) 97:102203. doi:10.1016/j.cpr.2022.102203

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Sani, G, Janiri, D, Moccia, L, Albert, U, Carrà, G, Carmassi, C, et al. Psychopathological Burden and Coping Strategies Among Frontline and Second-Line Italian Healthcare Workers Facing the COVID-19 Emergency: Findings From the COMET Collaborative Network. J Affective Disord (2022) 311:78–83. doi:10.1016/j.jad.2022.05.006

CrossRef Full Text | Google Scholar

16. Salman, M, Mustafa, ZU, Raza, MH, Khan, TM, Asif, N, Tahir, H, et al. Psychological Effects of COVID-19 Among Health Care Workers, and How They Are Coping: A Web-Based, Cross-Sectional Study During the First Wave of COVID-19 in Pakistan. Disaster Med Public Health Preparedness (2023) 17:e104. doi:10.1017/dmp.2022.4

CrossRef Full Text | Google Scholar

17. Frenkel, MO, Pollak, KM, Schilling, O, Voigt, L, Fritzsching, B, Wrzus, C, et al. Stressors Faced by Healthcare Professionals and Coping Strategies During the Early Stage of the COVID-19 Pandemic in Germany. PLoS One (2022) 17(1):e0261502. doi:10.1371/journal.pone.0261502

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Ortiz-Calvo, E, Martínez-Alés, G, Mediavilla, R, González-Gómez, E, Fernández-Jiménez, E, Bravo-Ortiz, M-F, et al. The Role of Social Support and Resilience in the Mental Health Impact of the COVID-19 Pandemic Among Healthcare Workers in Spain. J Psychiatr Res (2022) 148:181–7. doi:10.1016/j.jpsychires.2021.12.030

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Hines, SE, Chin, KH, Glick, DR, and Wickwire, EM. Trends in Moral Injury, Distress, and Resilience Factors Among Healthcare Workers at the Beginning of the COVID-19 Pandemic. Int J Environ Res Public Health (2021) 18(2):488. doi:10.3390/ijerph18020488

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Litton, E, Bucci, T, Chavan, S, Ho, YY, Holley, A, Howard, G, et al. Surge Capacity of Intensive Care Units in Case of Acute Increase in Demand Caused by COVID-19 in Australia. Med J Aust (2020) 212(10):463–7. doi:10.5694/mja2.50596

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Ramsey, M. Virus-Free WA's Hospitals Under Strain. The New Daily (2021).

Google Scholar

22. Qualtrics. Provo City Experience Program With Qualtrics. Provo, Utah, USA: Qualtrics (2022).

Google Scholar

23. Sinclair, VG, and Wallston, KA. The Development and Psychometric Evaluation of the Brief Resilient Coping Scale. Assessment (2004) 11(1):94–101. doi:10.1177/1073191103258144

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Dalgard, OS, Bjork, S, and Tambs, K. Social Support, Negative Life Events and Mental Health. Br J Psychiatry (1995) 166(1):29–34. doi:10.1192/bjp.166.1.29

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Espie, CA, Kyle, SD, Hames, P, Gardani, M, Fleming, L, and Cape, J. The Sleep Condition Indicator: A Clinical Screening Tool to Evaluate Insomnia Disorder. BMJ open (2014) 4(3):e004183. doi:10.1136/bmjopen-2013-004183

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Prins, A, Bovin, MJ, Smolenski, DJ, Marx, BP, Kimerling, R, Jenkins-Guarnieri, MA, et al. The Primary Care PTSD Screen for DSM-5 (PC-PTSD-5): Development and Evaluation Within a Veteran Primary Care Sample. J Gen Intern Med (2016) 31(10):1206–11. doi:10.1007/s11606-016-3703-5

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Williamson, ML, Stickley, MM, Armstrong, TW, Jackson, K, and Console, K. Diagnostic Accuracy of the Primary Care PTSD Screen for DSM-5 (PC-PTSD-5) Within a Civilian Primary Care Sample. J Clin Psychol (2022) 78(11):2299–308. doi:10.1002/jclp.23405

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Kroenke, K, Spitzer, RL, and Williams, JB. The PHQ-9: Validity of a Brief Depression Severity Measure. J Gen Intern Med (2001) 16(9):606–13. doi:10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Spitzer, RL, Kroenke, K, Williams, JB, and Löwe, B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Arch Intern Med (2006) 166(10):1092–7. doi:10.1001/archinte.166.10.1092

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Swinson, RP. The GAD-7 Scale was Accurate for Diagnosing Generalised Anxiety Disorder. Evid Based Med (2006) 11(6):184. doi:10.1136/ebm.11.6.184

PubMed Abstract | CrossRef Full Text | Google Scholar

31. R Core Team. A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing (2018).

Google Scholar

32. Little, RJ. A Test of Missing Completely at Random for Multivariate Data With Missing Values. J Am Stat Assoc (1988) 83(404):1198–202. doi:10.1080/01621459.1988.10478722

CrossRef Full Text | Google Scholar

33. Zou, H, and Hastie, T. Regularization and Variable Selection via the Elastic Net. J R Stat Soc Ser B (statistical methodology) (2005) 67(2):301–20. doi:10.1111/j.1467-9868.2005.00503.x

CrossRef Full Text | Google Scholar

34. Newman, D. Missing Data: Five Practical Guidelines. Organizational Res Methods (2014) 17(4):372–411. doi:10.1177/1094428114548590

CrossRef Full Text | Google Scholar

35. Dobson, H, Malpas, CB, Burrell, AJ, Gurvich, C, Chen, L, Kulkarni, J, et al. Burnout and Psychological Distress Amongst Australian Healthcare Workers During the COVID-19 Pandemic. Australas Psychiatry (2021) 29(1):26–30. doi:10.1177/1039856220965045

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Holton, S, Wynter, K, Trueman, M, Bruce, S, Sweeney, S, Crowe, S, et al. Psychological Well-Being of Australian Hospital Clinical Staff During the COVID-19 Pandemic. Aust Health Rev (2020) 45(3):297–305. doi:10.1071/AH20203

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Marvaldi, M, Mallet, J, Dubertret, C, Moro, MR, and Guessoum, SB. Anxiety, Depression, Trauma-Related, and Sleep Disorders Among Healthcare Workers During the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Neurosci Biobehavioral Rev (2021) 126:252–64. doi:10.1016/j.neubiorev.2021.03.024

CrossRef Full Text | Google Scholar

38. Willis, K, Ezer, P, Lewis, S, Bismark, M, and Smallwood, N. Covid Just Amplified the Cracks of the System: Working as a Frontline Health Worker During the COVID-19 Pandemic. Int J Environ Res Public Health (2021) 18(19):10178. doi:10.3390/ijerph181910178

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Riedel, P-L, Kreh, A, Kulcar, V, Lieber, A, and Juen, B. A Scoping Review of Moral Stressors, Moral Distress and Moral Injury in Healthcare Workers During COVID-19. Int J Environ Res Public Health (2022) 19(3):1666. doi:10.3390/ijerph19031666

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Varghese, A, George, G, Kondaguli, SV, Naser, AY, Khakha, DC, and Chatterji, R. Decline in the Mental Health of Nurses across the globe During COVID-19: A Systematic Review and Meta-Analysis. J Glob Health (2021) 11:05009. doi:10.7189/jogh.11.05009

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Maharaj, S, Lees, T, and Lal, S. Prevalence and Risk Factors of Depression, Anxiety, and Stress in a Cohort of Australian Nurses. Int J Environ Res Public Health (2019) 16(1):61. doi:10.3390/ijerph16010061

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Somani, R, Muntaner, C, Hillan, E, Velonis, AJ, and Smith, P. A Systematic Review: Effectiveness of Interventions to De-Escalate Workplace Violence Against Nurses in Healthcare Settings. Saf Health Work (2021) 12(3):289–95. doi:10.1016/j.shaw.2021.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Magnavita, N, Soave, PM, Ricciardi, W, and Antonelli, M. Occupational Stress and Mental Health Among Anesthetists During the COVID-19 Pandemic. Int J Environ Res Public Health (2020) 17(21):8245. doi:10.3390/ijerph17218245

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Ganesan, S, Magee, M, Stone, JE, Mulhall, MD, Collins, A, Howard, ME, et al. The Impact of Shift Work on Sleep, Alertness and Performance in Healthcare Workers. Scientific Rep (2019) 9(1):4635–13. doi:10.1038/s41598-019-40914-x

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Giménez Lozano, JM, Martínez Ramón, JP, and Morales Rodríguez, FM. Doctors and Nurses: A Systematic Review of the Risk and Protective Factors in Workplace Violence and Burnout. Int J Environ Res Public Health (2021) 18(6):3280. doi:10.3390/ijerph18063280

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Muller, AE, Hafstad, EV, Himmels, JPW, Smedslund, G, Flottorp, S, Stensland, SØ, et al. The Mental Health Impact of the Covid-19 Pandemic on Healthcare Workers, and Interventions to Help Them: A Rapid Systematic Review. Psychiatry Res (2020) 293:113441. doi:10.1016/j.psychres.2020.113441

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Frajerman, A, Morvan, Y, Krebs, MO, Gorwood, P, and Chaumette, B. Burnout in Medical Students Before Residency: A Systematic Review and Meta-Analysis. Eur Psychiatry (2019) 55:36–42. doi:10.1016/j.eurpsy.2018.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Chen, Q, Liang, M, Li, Y, Guo, J, Fei, D, Wang, L, et al. Mental Health Care for Medical Staff in China During the COVID-19 Outbreak. The Lancet Psychiatry (2020) 7(4):e15–e6. doi:10.1016/S2215-0366(20)30078-X

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Hung, KK, Mashino, S, Chan, EY, MacDermot, MK, Balsari, S, Ciottone, GR, et al. Health Workforce Development in Health Emergency and Disaster Risk Management: The Need for Evidence-Based Recommendations. Int J Environ Res Public Health (2021) 18(7):3382. doi:10.3390/ijerph18073382

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Newnham, EA, Dzidic, P, Mergelsberg, E, Guragain, B, Chan, EYY, Kim, Y, et al. The Asia Pacific Disaster Mental Health Network: Setting a Mental Health Agenda for the Region. Int J Environ Res Public Health (2020) 17:6144–53. doi:10.3390/ijerph17176144

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Peters, SE, Dennerlein, JT, Wagner, GR, and Sorensen, G. Work and Worker Health in the Post-Pandemic World: A Public Health Perspective. The Lancet Public Health (2022) 7(2):e188–e194. doi:10.1016/S2468-2667(21)00259-0

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Quinn, BG, O’Donnell, S, and Thompson, D. Gender Diversity in Nursing: Time to Think Again. Nurs Manage (2022) 29(2):20–4. doi:10.7748/nm.2021.e2010

CrossRef Full Text | Google Scholar

53. Scott, HR, Stevelink, SA, Gafoor, R, Lamb, D, Carr, E, Bakolis, I, et al. Prevalence of Post-Traumatic Stress Disorder and Common Mental Disorders in Health-Care Workers in England During the COVID-19 Pandemic: A Two-Phase Cross-Sectional Study. The Lancet Psychiatry (2023) 10(1):40–9. doi:10.1016/S2215-0366(22)00375-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: COVID-19, healthcare workers, PTSD, depression, anxiety, Health EDRM, Australia

Citation: Newnham EA, Mergelsberg ELP, Tearne J, McEvoy P, Stanley S, Celenza A, Kavanagh H, Stevenson T, Mavaddat N, Demore G and Hood S (2023) Mental Health Status, Risk and Protective Factors for Healthcare Staff Prior to the First Major COVID-19 Outbreak in Western Australia. Int J Public Health 68:1606102. doi: 10.3389/ijph.2023.1606102

Received: 19 April 2023; Accepted: 16 August 2023;
Published: 05 September 2023.

Edited by:

Bojana Knezevic, University Hospital Centre Zagreb, Croatia

Reviewed by:

Roberto Mediavilla, Autonomous University of Madrid, Spain

Copyright © 2023 Newnham, Mergelsberg, Tearne, McEvoy, Stanley, Celenza, Kavanagh, Stevenson, Mavaddat, Demore and Hood. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Elizabeth A. Newnham, elizabeth.newnham@curtin.edu.au

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.