Abstract
Health has a significant influence on the quality of life of a society. The COVID-19 pandemic has forced many countries to implement restrictive measures to prevent its wider spread, including, inter alia, the introduction of remote healthcare in the form of teleconsultations. Therefore, there is the question of how such a change affects the quality of treatment and the primary healthcare of patients during the COVID-19 pandemic. The article aims to examine patient satisfaction with the access to primary healthcare and the effectiveness of treatment in a condition of remote medical care caused by the COVID-19 pandemic. We also analyse the impact of access to primary healthcare on the treatment effectiveness. Patient satisfaction was measured using a questionnaire assessing the quality of primary medical care. Of the 36 items studied, seven were related to the accessibility dimension and four were related to the treatment effectiveness dimension. Our results suggest that the treatment effectiveness and the access to primary healthcare services during the COVID-19 pandemic through telemedicine are quite highly rated by patients. Hence, further implementation of telemedicine in primary healthcare should improve the quality of lives of the wide society. We have also identified the access to primary healthcare has a considerable impact on the treatment effectiveness. Therefore, we recommend increasing the contact between patients and GPs via telemedicine under lockdown conditions.
Keywords: primary healthcare, COVID-19, access to healthcare, treatment effectiveness
1. Introduction
Quality of life (QOL) can be defined as an individual’s perception of his or her life status in terms of the cultural systems and values of life, and concerning personal goals, expectations, standards, and concerns [1]. Quality of life became established as a significant concept and target for research and practice in the fields of health and medicine. Understanding QOL is important for improving symptom relief, care and rehabilitation of patients. QOL is also used for identifying the range of problems that can affect patients. This kind of information can be communicated to future patients to help them anticipate and understand the consequences of their illness and its treatment. QOL is also important for medical decision-making because it is a predictor of treatment success and is therefore useful in diagnostics [2]. The studies carried out so far show that medical care significantly contributes to the improvement of patients’ QOL [3,4].
QOL indicators, aimed at measuring progress in a society, should reflect its multidimensionality and cover aspects contributing to life satisfaction. One of the indicated aspects is health. Health has already been defined by the World Health Organization (WHO) as “a state of complete physical, mental and social well-being, and not merely the absence of disease or infirmity” [5,6]. Poor health not only has the potential to shorten people’s life expectancy, but it can also worsen their quality of life. At the collective level, it hampers economic and social development, reducing the so-called “human capital” available to a society and generating additional costs. Thus, long and healthy life is an indicator of social prosperity and success and a QOL factor. This means that the improvement of the quality of life is very often seen as a desirable result of the provision of primary healthcare (PHC) [7].
Traditionally, the quality of life in the field of health sciences is also used as an outcome variable to evaluate treatment effectiveness [8]. Health-related indicators are also used in various studies to measure the quality of life, e.g., health and access to healthcare [9], deaths from cardiovascular diseases and government spending on healthcare [7]. On the other hand, some have suggested that the impact of health and medical care on the overall quality of life is rather small [10].
Health and well-being often depend on the quality of healthcare, which is defined as the degree to which health services for individuals and the population increase the likelihood of achieving desired health outcomes and are consistent with current professional knowledge [1]. The quality of healthcare is also defined as “the degree to which health services meet the needs, expectations and standards of medical care for patients, their families and other care recipients” [11]. These aspects are very often examined in patient satisfaction surveys [12,13,14]. Several terms are functioning interchangeably in the literature regarding healthcare quality, including health status, quality of life, quality of care and health-related quality of life (HRQoL) [5,15]. Most of the QOL research in medicine and healthcare is related to health, and HRQOL is becoming increasingly important in healthcare and clinical research [16].
The WHO suggests that quality of life covers several key areas known as “domains”. In the domain defined as “environment”, there is an area related to Health and social care, including the accessibility and quality dimension related to, inter alia, with effectiveness [17]. Overall, the goal of quality in healthcare is the continual improvement of the patient’s condition. To decipher whether best practice on healthcare quality has been achieved, the concepts of access and effectiveness are systematically discussed in every healthcare environment [18,19]. For instance the studies that analyzed the impact of quality of care on patients’ QoL have measured health and well-being in terms of access to health care, effective treatment and social care [20].
Health-related quality of life maximisation and to the pursuit to provide high-quality medical services are among the most important goals in the work of a family doctor and challenges for primary care organisations, especially in the context of limited treatment options during the COVID pandemic, where telemedicine is often the only possible form of patient care. The need to improve the quality of medical services also results from the legal and ethical obligations of the GP [1].
The scope of this study was deliberately narrowed to the primary healthcare. This was done due to the primary healthcare’s fundamental role in many healthcare systems around the world [21] and in the Polish healthcare system [22]. It was already postulated that countries with developed primary healthcare enjoy fewer hospital admissions, better outcomes of patient treatments and, consequently, lower overall healthcare expenditure [23]. As a result, many scholars claim that the main objective of any governmental health policy should be the improvement of the primary healthcare quality [24]. The role of the primary healthcare is especially critical for the Polish healthcare system, mainly because of the following: ageing Polish society, substantial shortages in medical personnel (doctors and nurses) and lower expenditure compared to other EU countries on average.
Studies on the quality of primary healthcare during the COVID-19 pandemic in Poland are limited. On the other hand, researchers were dealing with this issue in the field of selected specialist services. This particularly included studies on access to medical care during pregnancy [25], bariatric care [26], cancer patients care [27], medical and non-medical services for the elderly [28]. Researchers agree that the COVID-19 pandemic situation leads to a growing problem of limited or complete lack of access to treatment for specific groups of patients who are in need of special care [29,30,31]. The perception of medical services during the COVID-19 pandemic was also studied in the context of cancer care [27]. However, no studies on patient satisfaction on the access to primary healthcare and treatment effectiveness in Poland could be found.
The core value of primary healthcare is that a well-organised and effective system of PHC is able to respond to the vast majority (even as much as 80%) of health needs with relatively small funds. Appreciation of the role of primary healthcare was the aftermath of analyses determining the impact of individual factors on healthy societies [32]. Barbara Starfield [33] has proven beyond any doubt that the quality of the entire healthcare system depends much more on the level of primary healthcare development than on the overall expenditure for the healthcare system.
Quality in primary healthcare is defined as the combination of access to healthcare, treatment effectiveness, while the improvement of the population’s health and the access to medical care are considered as two important objectives related to the core activities of health systems [34,35]. QOL assessments related to primary healthcare access and effectiveness can benefit patients, clinicians, researchers, administrators, health organizations, and policymakers. As the effects of the COVID-19 pandemic are likely to persist, research into the accessibility and effectiveness of primary healthcare is becoming extremely important, particularly in the context of telemedicine and QOL [36]. To check if best practice on primary healthcare quality has been achieved, the concepts of access and effectiveness should be systematically discussed in every primary healthcare entity [18, 19].
Access is critical to the functioning of primary healthcare systems around the world. However, access to primary healthcare remains a complex concept as exemplified by the concept’s interpretations diversity by authors. In primary healthcare, access is often defined as access of a service, provider or institution, and is thus defined as the possibility or ease with which patients can use adequate medical services relative to their needs [37]. Some researchers tend to equate access to a delivery system (for example, distribution and volume regarding the medical workforce and medical facilities, availability of providers and health facilities). Others argue that access can best be assessed using performance indicators for a patient’s passage through the system, such as utilisation rates or satisfaction scores [24,38,39].
In terms of remote medical appointments, access (accessibility) is considered as the patient’s ability to receive primary healthcare [40]. Accessibility is also defined as a way of organising primary care resources to accommodate a wide range of patient opportunities to contact physicians and access to primary healthcare services. This includes the doctors’ working hours, consultation times, telephone services and a flexible system enabling having an appointment for medical consultation [41].
Effectiveness was recognised as an important dimension of primary healthcare quality, but the literature emphasises the difficulty of characterising the definition of effectiveness for the primary healthcare sector. For example, in a 2004 study using the Delphi method to establish operational definitions for different dimensions of primary healthcare quality, despite repeated efforts, it was impossible to find a concise operational definition of effectiveness to which all experts could agree [41].
In real life, the concept of effectiveness is used interchangeably with the terms efficacy and efficiency, which is not correct from a scientific point of view. These three concepts have been originally distinguished by Drucker in management sciences [42] in which they bear the following meanings:
efficacy—the ability to produce the desired amount of the desired effect, i.e., success in achieving a specific goal;
effectiveness—the degree to which the planned results, objectives or tasks are achieved as a result of an action, intervention or initiative aimed at achieving the desired effect, in ordinary, uncontrolled circumstances;
efficiency—doing things in the most economical way. It is the ratio of performance to the inputs of any system [43].
In the healthcare sector, efficacy is defined as the possibility of a beneficial change (or the therapeutic effect) as result of an intervention (e.g., drug, medical treatment, surgery, or public health intervention) under ideal or controlled conditions. Effectiveness is the ability of a [44] medical intervention (e.g., teleconsultation) to have a significant effect on patients under normal clinical conditions. In turn, efficiency must also clearly identify the inputs that are used to obtain the effect of interest (for example, hours of medical care, days when drugs are supplied or medical expenses) [45] Some authors define efficiency as achieving the desired results with the most profitable use of resources [41]. According to Głodziński, efficiency is the achievement of the highest level of satisfaction possible with the given inputs and technologies [46].
The dimensions of medical service effectiveness and efficacy were announced as quality dimensions in the PHC by the WHO Eastern Mediterranean Regional Office (EMRO) [47]. In turn, the efficiency and effectiveness dimensions were proposed by the US Agency for Healthcare Research and Quality (AHRQ) [48]. Effectiveness and efficiency were also used in the tools for quality assessment in Iran’s PHC systems [44].
However, effectiveness is the most popular dimension among the tools for assessing the quality of primary healthcare. For instance, in the Iranian primary healthcare quality assessment framework, (QAF) out of 40 Quality Indicators (QIs), 33.5% were related to the effectiveness dimension. This dimension had the highest share among the quality dimensions [44]. The effectiveness dimension was also in common with the QAF of such countries as Australia, Canada and the United States in terms of the classification of dimensions and QIs [49,50].
Effectiveness plays an essential role in the tools for quality assessments designed for patient opinion surveys. The effectiveness of primary healthcare in regards to obtaining achievable health benefits based on an objective or subjective assessment stating that primary healthcare helped to improve the patient’s health or well-being [51]. Effectiveness in primary healthcare facilities is a set of coordinated actions taken at various levels of reference, improving the patients’ health through prevention and the provision of primary healthcare [52].
Testa and Simonson argue that any area of health can be measured objectively and subjectively [53]. There are therefore two main trends in the literature regarding the measurement of HRQoL. The first one concerns the measurement based on objective indicators, and the second one is based on subjective indicators. While the objective dimension is used to determine the patient’s health status, the patient’s subjective assessment is used to translate this condition into the patient’s actual HRQoL. Hence, two patients with identical health status may have very different HRQoL depending on their subjective experiences, expectations and perceptions of health [5].
Today, most HRQoL tools are based on patient assessments and have a wide range of applications. A key distinguishing feature of HRQoL is the consideration of the patient’s values, judgments and preferences [15,54]. Therefore, literature suggests the construction of social indicators to assess the quality of primary healthcare in a subjective manner [55].
A literature review clearly demonstrated that primary healthcare accessibility and treatment effectiveness are multidimensional constructs. They were taken into consideration in terms of many variables and indicators used to measure them.
In many studies, accessibility has been measured using quantitative indicators that can be objective measures of the availability of primary healthcare. Such objective indicators selected to measure the availability of primary healthcare concern, for instance, the waiting time for an appointment with a specific family doctor, with any family doctor, and for the initiation of consultations [34], the share of people who had or didn’t have contact with the provider at a certain time, or the total number of services provided after contact. Such objective indicators also include the travel time, waiting time in the waiting room, the actual patient consultation time at the medical facility and the weighted sum of the difference between the ideal and the actual number of services, personnel and equipment in the community. In the scale of the entire primary healthcare system, patients’ access to the system can also be measured by the number and availability of primary care physicians (the number of medical personnel, medical facilities per unit of population and per unit of geographic area) [56,57].
As already mentioned, literature suggests the construction of social indicators to assess the quality of medical care in a subjective manner [55]. Subjective accessibility indicators concern the patients’ assessments of various aspects of their experience of being provided with care. Due to the fact that patients play a unique and important role as evaluators of quality of care, it can be concluded that the patients’ opinions should also be taken into account by primary healthcare managers.
Therefore, our tested model provides an accessibility measurement that covers only more subjective indicators related to patients’ opinions regarding access to a primary teleconsultation with a General Practitioner (GP), possibility of contacting a primary healthcare facility via telephone/Internet, possibility of obtaining help in emergency situations, convenient opening hours, punctuality of consultations. Such variable were also used in other studies [34,58,59]. This study did not take into account the accessibility dimensions adapted in terms of residential care, such as the location of the healthcare facility and the person’s ability to access the facility [60], the ease and convenience of reaching a doctor, the availability of services at the place needed [56]. This study also ignores the more detailed accessibility dimensions adopted by Levesque et al. [61], which do not apply to the Polish conditions and the accessibility definition adopted for the purpose of the study. According to these authors, access to healthcare is affected by individual and environmental factors of the healthcare supply-side factors (e.g., approachability; accommodation; affordability) as well as demand-side factors (ability to perceive; ability to seek; ability to reach; ability to pay ability to engage).
The effectiveness is measured most often with indicators based on an objective or subjective assessment of whether primary healthcare has helped to improve the patient’s health or well-being [51]. The most common measures of effectiveness are related to the quality of life, changes in health status, measures of health or well-being, the results reported by the patient, and the patient’s knowledge [51]. Some authors recommend measuring effectiveness based on the skills and competencies of the medical personnel (physician’s ability to make a proper diagnosis and treatment) [62].
The assessment of the treatment effectiveness of can be considered in three dimensions: (1) the health dimension assessed by the mortality and morbidity rates, (2) the satisfaction dimension, defined as the level of meeting the patient’s expectations regarding primary healthcare, (3) the economic dimension regarding the cost of the services provided [63].
The paper is focused on the satisfaction dimension and examines the effectiveness of treatment as measured by patient satisfaction with improving health, solving a health problem and met expectations towards the treatment plan applied. It was assumed in the study that an effective GP helps to solve a health problem and improves the patient’s health condition, and the treatment plan proposed by him or her meets the patient’s expectations and does not require additional appointments with other specialists [62,64].
The study aims to describe patient satisfaction with the access to primary healthcare and treatment effectiveness in the conditions of remote medical care caused by the COVID-19 pandemic. The study is dealing with the subjective assessment of patient satisfaction in two dimensions: access to primary healthcare and treatment effectiveness. 98 patients of primary healthcare facilities participated in the survey. The other part of this paper is structured as follows. Section 2 includes the specification of the applied research methods. The Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) are used to define the remote healthcare quality factors. Section 3 provides the results obtained in the study on patient satisfaction from access to primary healthcare and treatment effectiveness during the COVID-19 pandemic in Poland. It also includes comments on the impact of access to teleconsultations on the treatment effectiveness. Section 4 includes a discussion about the limitations of this study. Finally, the paper also provides conclusions and practical implications.
2. Materials and Methods
2.1. Methodology
The research methods used in this study included a subject literature analysis and an analysis of the results of own research carried out in Polish healthcare facilities in 2021. The analysis featured the use of descriptive statistics, the Exploratory Factor Analysis (EFA) and the Confirmatory Factor Analysis (CFA) for the development of the relationship between accessibility and effectiveness of telephone consultations. The extracted factors were used to perform a regression analysis to check the impact of accessibility to telehealth consultations on the treatment effectiveness.
According to Hair et al., the number of observations should be ten times higher than the number of variables in the factor analysis model. The minimum acceptable ratio of observations to variables is 5:1. Some researchers accept the ratio of 3:1. The absolute minimum number of observations in the factor model is 50 [65]. In this study, the number of observations is 98. Due to the fact that the 3:1 ratio requirement was met, an EFA analysis was conducted to indicate the variables loading onto two expected latent factors and indicate the initial structure of the factor model. The objective of the analysis was to prepare a questionnaire for a full-scale survey. After the initial EFA analysis, only eight variables were left since the 5:1 sample per item ratio has been satisfied. In addition, a regression analysis was used to evaluate the impact of accessibility on effectiveness.
2.1.1. Population and Data Collection
The study featured a survey conducted on the patients of the CortenMedic primary healthcare facilities. This preliminary study was aimed at preparing and checking the remote healthcare quality research tool—the structured questionnaire. It was important to explore the data structure and prepare a questionnaire for population studies [66]. The response rate meets all survey standards of at least 60% [67]. The questionnaire was assessed in terms of question comprehensibility and difficulty, clarity and ambiguity, length, completion time, and data collection manner [68].
The research was carried out in four primary healthcare facilities in Poland considering the limitations introduced during the pandemic. One of the facilities is located in Radom, a large district city in Poland. The remaining three (Warsaw 1, Warsaw 2, Warsaw 3) are located in Warsaw, the capital city of Poland. The total number of basic care patients registered in these facilities amounts to 46,700.
The data was collected during two sessions: on 25 February 2021–26 February 2021 and 11 March 2021–12 March 2021 through an anonymous survey with closed-ended questions. The randomly selected adult patients, who used telephone consultations during the pandemic, were surveyed using the computer-assisted telephone interviewing (CATI) method; an interviewer presented survey questions to the patients and collected their answers. All patients who agreed to take part in the survey were included in the study. Completed questionnaires were returned to the researchers who conducted the survey. One hundred five patients participated in the study, six patients declined and did not complete the questionnaire. One record was deleted due to more than 20% of missing data. Ninety-eight complete records were included in the study, representing a response rate of 93%. The survey structure presenting the place and date of data collection is shown in Table 1.
Table 1.
Date and Type of the Survey | Total | |||
---|---|---|---|---|
February 2021 CATI |
March 2021 Paper-Based Survey |
|||
Number of Responses | ||||
Facility | Warsaw 1 | 0 | 21 | 21 |
Warsaw 2 | 19 | 0 | 19 | |
Warsaw 3 | 22 | 19 | 41 | |
Radom | 24 | 0 | 24 | |
Total | 65 | 40 | 105 |
2.1.2. Patient Satisfaction Questionnaire
A research tool for patients’ satisfaction survey was developed based on the previous research [69,70,71,72,73]. The survey instrument focused on relationships between variables consisting of two parts: biographical and methodological. The first part contained information about age, gender, marital status, education, place of residence, current occupation and professional activity, including the place and facility in which the survey was conducted. The methodological part consisted of 47 close-end questions pre-assigned to 7 categories. Each question was rated on the five-point Likert scale. The grade of each question scale was described verbally and numerically as follows: 1—I strongly disagree, 2—I disagree, 3—I am undecided, 4—I agree, 5—I strongly agree. The study only presents the accessibility and treatment effectiveness dimensions.
Accessibility variables were established based on the Haggerty et al. paper. The Authors define accessibility as the ease with which patients can obtain the needed care, support and advice from a selected (variable D2) or any (variable D3) primary care physician at a time (variables D4, D5) appropriate for the urgency of the problem (variable D1) [41].
Effectiveness is considered as a subjective assessment of whether primary care physician contributed to improving the patient’s health. Variables E1 to E4 were selected based on the subject literature [35,52,74,75,76,77]. E1 is responsible for the well-being, E2 describes the doctor’s ability to make an appropriate diagnosis, E4 states that this diagnosis could be made without additional consultations with specialists, E3 takes into account the patients’ expectations (E4). The questions regarding both accessibility and treatment effectiveness are shown in Table 2.
Table 2.
Variable Name | Question | |
---|---|---|
Accessibility | D1 | I can get medical help when I need it, even in case of emergency |
D2 | I can easily make a telehealth consultation with a General Practitioner (GP) of my choice | |
D3 | I can easily make an appointment with a GP at the healthcare facility | |
D4 | The healthcare facility’s working hours are convenient | |
D5 | Telehealth consultations take place at an agreed time | |
D6 | I can easily contact the healthcare facility via phone / Internet | |
D7 | I can easily ask questions after the telehealth consultation | |
Effectiveness | E1 | The treatment helped me improve my health |
E2 | The health problem with which I turned to the GP was solved | |
E3 | The treatment plan proposed by the GP meets my expectations | |
E4 | The health problem with which I turned to the doctor did not require additional medical consultations with other specialists |
2.1.3. Ethics
The survey instrument was constructed based on the literature review. Literature-driven questions were slightly changed for this study. All questions were confirmed by the research team and by two experts from CortenMedic—a healthcare service provider. Detailed information on the purpose of the research and its course was prepared for respondents. During the first stage of the survey, an interviewer read the study rules out to the respondents. The survey was voluntary and completely anonymous. Only adult respondents took part in the survey. Each patient could withdraw from the study at any time or choose not answer all the questions. The completion of a single questionnaire required 20 min on average. The interviewer read all the questions and answers and marked the patients’ responses in the database form one by one. The questionnaire form was anonymous. Patients completed the questionnaire voluntarily. The questionnaire was assessed from an ethical perspective by the Warsaw University of Technology Senate Committee for Professional Ethics.
3. Results
3.1. Data Analysis
The analysis was conducted using the SPSS v. 27 statistical package (Predictive Solution, Krakow, Poland) and Microsoft Excel 365 (Microsoft, Redmond, WA, USA). Prior to the questionnaires’ statistical analysis, a database of responses was created. Data from the paper-based questionnaires were transferred to a spreadsheet. In the survey, the questions were not deliberately divided into dimensions. The next step was to sort the statements according to the dimensions: accessibility, coordination, comprehensiveness, effectiveness, continuity, communication and experience with the system; the analysis for the purpose of this study covered only two dimensions: accessibility and effectiveness.
The respondents were divided into six age groups (Figure 1): aged up to 25 (5 people, i.e., 5.1%), 25 to 34 years of age (12 people, i.e., 12.1%), 35 to 44 years of age (13 people, i.e., 13.1%), 45 to 54 years of age (14 people, i.e., 14.1%), 55 to 64 years of age (15 people, i.e., 15.2%) and aged above 65 (39 people, i.e., 39.4%). One person did not disclose his or her age (i.e., 1%). Eventually, this record was deleted due to many missing data.
The most numerous group included married people (38 people; 38.4%); single persons constituted 28.3% of the respondents (28 persons). There were 20 (20.2%) widowed people and 13 (13.1%) were divorced. In addition, more than half of the respondents were people living in a very large city (with over 250,000 inhabitants)—72 people, i.e., 72.7%, residents of large cities (from 100,000 to 250,000 inhabitants) constituted 19.2% (19 people), medium-sized cities (from 20,000 to 100,000 inhabitants), 3.03% (three persons), rural areas—3.03% (three persons) and small towns (less than 20,000 inhabitants)—2.02% (two persons).
The biggest group included people with higher education—51 people (51.5%), then people with secondary education—26 people (26.3%), the minor groups included people with vocational education—15 people (15.2%) and primary or lower secondary school education—seven people (7.1%). Working people accounted for 44.4% of the population (44 people), retirees and pensioners, also 44.4% (44 people), five people were unemployed (5.1%), also three students were surveyed (3%). Two patients ran their own business (2%), while one person indicated a different economic activity (1%).
Patients who went to a given facility for the first visit (12 people) most often declared that their health condition required occasional visits (seven people); three people felt the need for rare visits, and two people—frequent visits. Control and periodic visits due to treatment continuation or chronic treatment took place once a quarter (10 people), once a month (nine people) or once a year (eight people). At the same time, remote consultations were used several times a month by three persons. The need to consult a GP for prevention and health promotion purposes (including vaccination) was revealed rarely (eight people), sporadically (five people) and often (three people). Twenty three patients asked for a prescription, referral to a specialist doctor or sick leave. The remaining patients met a doctor once a year (seven people), several times a month (six people) and once a month (four people). The surveyed patients most frequently visited the doctor once a quarter (45 people) and once a year (27 people), while the least numerous—once a month (18 people) and several times a month (nine people). During the COVID-19 pandemic, patients do not want to consult doctors unless they have urgent reasons [24].
Ninety four people consulted a doctor via telephone. Most patients were waiting for telephone consultation for more than 48 h (43 people); 28 people consulted a doctor the next day and 23 people—on the same day (including quick visits—11 people and waiting time exceeding 4 h—12 people). Two people used video calls via WhatsApp and Skype, their waiting time for consultation exceeded two days. Two people used Microsoft Teams and Zoom. The waiting time for a telephone consultation exceeding two days resulted in a poor evaluation of the healthcare facility.
3.1.1. Accessibility
The D1–D7 variables presented in Table 2 were used in the assessment of accessibility. The descriptive statistics of these dimension variables are shown in Table 3.
Table 3.
Variable | Mean | Skewness | Kurtosis | |||||
---|---|---|---|---|---|---|---|---|
Statistic | Std. Error |
Std. Deviation |
Variance | Statistic | Std. Error |
Statistic | Std. Error |
|
D1 | 3.8571 | 0.12049 | 1.19276 | 1.423 | −0.983 | 0.244 | 0.202 | 0.483 |
D2 | 3.5816 | 0.13601 | 1.34642 | 1.813 | −0.565 | 0.244 | −0.966 | 0.483 |
D3 | 4.0306 | 0.11554 | 1.14382 | 1.308 | −0.989 | 0.244 | −0.023 | 0.483 |
D4 | 4.6735 | 0.08676 | 0.85886 | 0.738 | −3.098 | 0.244 | 9.634 | 0.483 |
D5 | 4.3878 | 0.09359 | 0.92650 | 0.858 | −1.807 | 0.244 | 3.223 | 0.483 |
D6 | 3.1122 | 0.17032 | 1.68610 | 2.843 | −0.127 | 0.244 | −1.703 | 0.483 |
D7 | 3.8469 | 0.11992 | 1.18715 | 1.409 | −0.603 | 0.244 | −0.505 | 0.483 |
Patients are most satisfied with the HC facility’s working hours (D4: = 4.68). 91.9% of the respondents claim that the facility’s working hours (from 8:00 to 20:00) are convenient for them. 87.9% of patients are also satisfied with the punctuality of the visits (D5: = 4.38). Unfortunately, 27.3% of respondents have a problem with making an appointment with a GP of their choice (D2: = 3.57) and 13.1%—with booking an appointment with any GP (D3: = 4.03). As many as 42.4% of patients reported that they had a problem with contacting the HC facility via telephone or Internet (D6: = 3.12). 54.5% of the respondents believe that they can easily ask questions after the visit (D7: = 3.85). 35.4% of respondents did not know how to answer question D7 because they have never used this form of contact after the consultation. If they had doubts or wanted to ask the GP additional questions, they made another appointment. 69.7% of the respondents stated that they could obtain medical aid whenever needed, even in an emergency (D1: = 3.86). The distribution of answers is presented in Figure 2.
3.1.2. Effectiveness
The E1–E4 variables presented in Table 2 were used in the assessment of effectiveness. The descriptive statistics of these dimension variables are shown in Table 4.
Table 4.
Variable | Mean | Skewness | Kurtosis | |||||
---|---|---|---|---|---|---|---|---|
Statistic | Std. Error |
Std. Deviation |
Variance | Statistic | Std. Error |
Statistic | Std. Error |
|
E1 | 4.1633 | 0.10225 | 1.01223 | 1.025 | −1.249 | 0.244 | 1.276 | 0.483 |
E2 | 4.1429 | 0.10560 | 1.04536 | 1.093 | −1.066 | 0.244 | 0.148 | 0.483 |
E3 | 4.4490 | 0.08718 | 0.86301 | 0.745 | −1.902 | 0.244 | 4.127 | 0.483 |
E4 | 3.0612 | 0.18106 | 1.79240 | 3.213 | −0.072 | 0.244 | −1.817 | 0.483 |
The overall positive assessment of medical teleconsultations resulted from its high effectiveness. The applied treatment helped (29.3%) and definitely helped (47.47%) improve the respondents’ health. The health problem addressed by 29.3% of patients was partially solved and solved for 48.5% of the respondents. The mean assessment of these variables was similar: (E1: = 4.15) and (E2: = 4.14). The treatment plan proposed by the doctor met the expectations of 26.3% of the patients and complied with the wishes of 61.6% of the respondents. The indications of primary care physicians largely took into account the expectations of patients—this was the best-assessed variable examining the effectiveness of remote consultations (E3: = 4.44). In the patients’ opinion, their health problem did not require (9.1%) and definitely did not require (38.4%) additional medical consultations with other specialists. However, many patients believed otherwise—7.01% disagreed and 37.4% strongly disagreed with this statement. Hence, the health problems reported by half of the patients could be resolved during teleconsultation with a general practitioner (E4: = 3.04). Question E4 was assessed as average by all patients. The distribution of answers is presented in Figure 2.
3.2. Factor Analysis
3.2.1. Exploratory Factor Analysis
Exploratory factor analysis was conducted based on 98 observations for two dimensions: accessibility and effectiveness. Variables D4 and D5 did not meet the normality assumption. They were therefore removed from the EFA model. Variable D1 did not load correctly on the expected factors—accessibility. Eventually, eight variables: D2, D3, D6, D7, E1, E2, E3, and E4 were left. The principal component analysis (PCA) and promax rotation with Kaiser normalisation were used to extract two components (Table 5). The Kaiser-Meyer-Olkin measure of sampling adequacy (KMO) equalled 0.73 > 0.6. The KMO value considered as correct is 0.6. Bartlett’s test of sphericity provided a significant result (χ2 = 201.125; df = 28, p < 0.0001). The probability p should be smaller than 0.05, thereby indicating that the values are correct and the sample size is sufficient for the factor analysis.
Table 5.
Variable | Component | |
---|---|---|
Accessibility | Effectiveness | |
D3 | 0.804 | |
D6 | 0.795 | |
D2 | 0.777 | |
D7 | 0.686 | |
E2 | 0.837 | |
E1 | 0.795 | |
E3 | 0.645 | |
E4 | 0.638 |
Extraction Method: Principal Component Analysis. Rotation Method: Promax with Kaiser Normalization, a. Rotation converged in 3 iterations.
PCA retained two factors with eigenvalues greater than 1. The total variance explained by the EFA model was equal to 56% (Table 6), which should be greater than 50% [78]. For eight variables, the factor loadings ranged from 0.638 to 0.837 and are greater than the recommended 0.35 cut-off point [79]. A reliability analysis showed that the extracted model was acceptable since the Cronbach’s alpha coefficients for accessibility (0.666) and effectiveness (0.663) were greater than 0.6 [80]. Those values (Table 6) allowed for further factor analysis [65,81].
Table 6.
Component | Initial Eigenvalues | Extraction Sums of Squared Loadings | Rotation Sums of Squared Loadings | ||||
---|---|---|---|---|---|---|---|
Total | % of Variance |
Cumulative % |
Total | % of Variance |
Cumulative % | Total | |
1 | 3.185 | 39.809 | 39.809 | 3.185 | 39.809 | 39.809 | 2.711 |
2 | 1.374 | 17.178 | 56.987 | 1.374 | 17.178 | 56.987 | 2.551 |
3 | 0.841 | 10.512 | 67.499 | ||||
4 | 0.725 | 9.069 | 76.568 | ||||
5 | 0.564 | 7.055 | 83.623 | ||||
6 | 0.527 | 6.594 | 90.216 | ||||
7 | 0.474 | 5.921 | 96.137 | ||||
8 | 0.309 | 3.863 | 100.000 |
Extraction Method: Principal Component Analysis.
3.2.2. Confirmatory Factor Analysis
The CFA confirmed the EFA model with eight variables. Standardised and non-standardised solutions are presented respectively in Figure 3 and Figure 4. A convergent validity—the strength of relationships of the model’s factor variables is not supported by the average variance extracted (AVE), which has to be greater than 0.5. The AVE for accessibility equals 0.461 and AVE for effectiveness equals 0,401. This confirmed the low values of the Cronbach’s alpha coefficients calculated during the EFA. Nevertheless, the convergent validity might be confirmed using the composite reliability (CR) index, which should be higher than 0.7. CR values for accessibility and effectiveness equal 0.771 and 0.722, respectively, which means that the convergent validity of the model is confirmed.
The model’s discriminant validity is also confirmed using the Fornell Larker criterion, since the square root of the AVE for each factor is higher than the correlation between factors (Table 7). Also, the hetero trait − mono trait method points to a correlation between factors of 0.539, which should be smaller than 0.85. Taking into account the above results, it is possible to confirm the model’s reliability and validity.
Table 7.
Correlations | ||||
---|---|---|---|---|
D_Accessibility | E_Effectiveness | AVE | ||
D_Accessibility | Pearson Correlation | 1 | 0.390 ** | 0.461 |
Sig. (2-tailed) | 0.000 | |||
N | 98 | 98 | ||
E_Effectiveness | Pearson Correlation | 0.390 ** | 1 | 0.401 |
Sig. (2-tailed) | 0.000 | |||
N | 98 | 98 |
**. Correlation is significant at the 0.01 level (2-tailed).
The model fit measures indicate that the model is correct. CMIN = 20.918; DF = 19.000. CMIN/DF = 1.101 (>1; <3), CFI = 0.989 (>0.95); SRMR = 0.054 (<0.08); RMSEA = 0.032 (<0.06); p-value = 0.605 (>0.05).
3.2.3. Regression Analysis
Aside from the CFA model, a regression analysis was also conducted. Two variables for effectiveness and accessibility were calculated based on the CFA model. Two hypotheses were formulated: null hypothesis H0 stating that there is no statistical relationship between effectiveness and accessibility variables and H1 hypothesis assuming that accessibility affects effectiveness.
Hypothesis H0.
Accessibility does not affect effectiveness (null hypothesis).
Hypothesis H1.
Accessibility affects effectiveness (alternative hypothesis).
The correlation analysis pointed to a relationship between the two variables. The Pearson Correlation equals 0.39 and is significant (Table 7), thereby allowing for regression analysis.
The ANOVA analysis showed that F coefficient equals is significant, F (1; 96) = 17.23; p < 0.001 (Table 8). The regression model points to the explanation of 14.3% of the variance, i.e., adjusted R-square equals 0.143 (Table 9). In the regression equation (Equation (1)), the constant is insignificant since the relationship between the variables can be described as follows:
Accessibility (±0.93) = 0.39 × Effectiveness (±0.094) | (1) |
Table 8.
ANOVA a | ||||||
---|---|---|---|---|---|---|
Model | Sum of Squares | df | Mean Square | F | Sig. | |
1 | Regression | 14.762 | 1 | 14.762 | 17.233 | 0.000 b |
Residual | 82.238 | 96 | 0.857 | |||
Total | 97.000 | 97 |
a Dependent Variable: E_Effectiveness. b Predictors: (Constant), D_Accessibility.
Table 9.
Model Summary b | ||||
---|---|---|---|---|
Model | R | R Square | Adjusted R Square | Std. Error of the Estimate |
1 | 0.390 a | 0.152 | 0.143 | 0.92554997 |
a Predictors: (Constant), D. b Dependent Variable: E.
Based on the above regression analysis H0 hypothesis was rejected in favor of the alternative hypothesis H1.
4. Discussion
The quality of care in primary healthcare is a very important element of QOL and represents a combination of many dimensions, including access to healthcare and treatment effectiveness. Papers examining the full spectrum of dimensions of the quality of primary healthcare constitute important diagnostic tools in a health policy. As already mentioned, a well-organised and effective primary healthcare is able to respond to 80% of health needs, that is why it is so significant to medical care.
The first aim of the study was to identify variables for measuring access to primary healthcare and treatment effectiveness in primary healthcare units. The conducted literature analysis was aimed at suggesting appropriate initial sets of indicators for the assessment of access to primary healthcare and treatment effectiveness in remote conditions. The conducted statistical analyses were aimed at reducing and improving the critical empirical indicators used to measure the analysed constructs. Using various data reduction methodologies, the paper’s objective was to identify a basic set of variables that could effectively measure the dimensions of remote primary healthcare accessibility and treatment effectiveness. The objective was achieved in the study. Referring to previous studies, seven variables were originally selected to measure the access do teleconsultations [34,41,58,59] and four variables to measure the treatment effectiveness [35,52,74,75,76,77]. As a result of a factor analysis, the number of variables to measure the access was reduced to four. The Exploratory Factor Analysis showed that the final model adopted for further research was correct.
The second aim was to study patients’ satisfaction with these two dimensions of quality of primary healthcare and to analyse the impact of access to primary healthcare on the treatment effectiveness during the COVID-19 pandemic in Poland.
Most of the patients in this study positively assessed the access to primary healthcare and treatment effectiveness in the conditions of teleconsultation in primary healthcare facilities during the COVID-19 pandemic in Poland. This was the case even though telemedicine was never used in the Polish primary healthcare institutions before. 55.5% of the respondents believe that the medical care they received during teleconsultation was as good as meeting their GP face to face [82] The previous studies confirmed that, for some patients, telehealth can be as good as or even better than personal care, especially for those faced with problems concerning physical appointments, e.g., people living in rural areas [83].
According to the results, patients are rather satisfied with the access to remote primary healthcare. The vast majority of patients agree or strongly agree with all positive aspects of the care accessibility dimension. They are the least satisfied with the possibility of contacting the clinic via telephone/Internet (D6: = 3.12) and the possibility of making an appointment with the GP of their choice (D2: = 3.57). On the other hand, the clinic’s working hours are rated the highest (D4: = 4.68). Majority of respondents stated that they could obtain medical help whenever needed, even in an emergency (D1: = 3.86). Quick access to GP appointments was assessed more positively in previous studies in which quick emergency care accessibility was rated the highest [84,85].
Systematic studies have shown that telemedicine has already been successfully used in other countries to provide routine and specialist medical services and has led to greater access to medical care. Moreover, telemedicine has shown similar, and in selected circumstances better, health effects compared to the conventional models of care [83,86], while demonstrating the ability to reduce unnecessary hospitalisations and costs [87].
In general, an analysis of other studies shows that telemedicine is actually pursuing its primary goal of improving access to care and it does so through innovative and constantly evolving tools. For instance, in Great Britain and Denmark, in order to ensure access to primary healthcare, teleconsultations take place in most primary care facilities as a standard procedure [88,89,90]. It is treated as “a strategic alternative to decentralisation and improving access to medical care, allowing to reduce costs and travel time for patients” [88].
Looking at the benefits, teleconsultations can reduce the patients’ indirect costs in terms of time and money, and increase access to primary healthcare, especially if telehealth can be used to support routine or stable patient health problems [91]. The other benefits include less need for face-to-face consultations, the ability to manage physician workloads and allowing systems to be reorganised [88]. In addition, teleconsultation enable overcoming the distance barriers in a flexible and convenient way for patients, with the ability to contribute to the continuity of care, patient autonomy and resource savings. Other qualitative studies examining satisfaction with teleconsultation show that the main benefits commonly reported by patients are convenience, reduced travel time and precisely greater access to specialist care, as well as better appointment flexibility, enabling minimal disruption of everyday life [92,93].
Teleconsultations cannot replace personal medical care in all cases. Several studies have shown that patients were satisfied with the remote consultations, but would also like to be able to have face-to-face appointments [83]. The teleconsultations should not be used in rare or unstable conditions, or when a physical examination is needed. Some patients are more appreciative of direct contact with a physician (with direct examination if necessary) compared to the convenience of telehealth, which was also confirmed by previous studies [94,95,96]. Such direct contact is also necessary in the case of seriously ill patients. Unfortunately, this pilot study did not allow for the assessment of the quality of teleconsultation from the point of view of chronically ill people. Most of the respondents (40.4%) contacted a doctor for non-urgent reasons (administrative matters: prescription, referral to a specialist, sick leave) or for control reasons (30.3%). Only 12.1% of the respondents held a teleconsultation due to chronic treatment. The other studies show that it is important for the patients to have the choice and flexibility to use health services in the most appropriate way [97]. However, it should be remembered to enable personal appointments for people with more complex health needs [98].
The overall positive assessment of the quality of remote primary healthcare was also due to its high treatment effectiveness. Most patients participating in this study rated the treatment effectiveness quite high. The treatment applied helped or definitely helped most patients, as most of them have had their health problems solved (E1: = 4.15). The patients’ expectations were taken into account by the GPs in the majority of cases (E3: = 4.44). Therefore, teleconsultations seem to be a safe and effective way of assessing and dealing with various clinical situations.
Also, other studies confirm that telemedicine maximises primary healthcare and offers the possibility of improving the treatment effectiveness [99]. The support for new communication technologies in the healthcare service provision is an important determinant of quality sought by all participants. Technological advances that are transforming traditional treatments and modern methods of care and diagnostics lead to positive changes in the form of better treatment outcomes for patients living in developing, rural areas or areas with limited healthcare options [100,101].
The correlation analysis and ANNOVA analysis conducted in this study pointed to a relationship between access to healthcare and treatment effectiveness in the primary healthcare. The regression model indicated that 14.3% of the variance is explained. The literature also consistently indicates that in the case of some diseases, telemedicine leads to the improvement of health outcomes. In areas such as type 2 diabetes, research shows that telemedicine intervention is comparable to the standards of traditional medical care and does not cause unnecessary risk or harm to patients [102]. Also, neurological and cardiological signs and simple ophthalmic symptoms such as strabismus can be safely diagnosed and treated through teleconsultation [83,88]. However, this study is the first one to show the impact of medical care accessibility on treatment effectiveness in primary healthcare in a crisis situation, such as the COVID pandemic.
There are some limitations to this study that need considering. Firstly, the indicators for measuring medical care accessibility and treatment effectiveness, despite their validation, have not been used in other populations, and therefore their external validity has not yet been confirmed. The same limitation can be attributed to the study population, which despite a large size is derived solely from four entities located in one region and therefore must be generalised conservatively. Although the sample size of the patients studied was varied, the extent to which they are representative of patients in other clinics is unknown. It would be interesting to repeat the study in other healthcare entities or organisations to see if these variables do indeed still determine the ultimate quality of care based on access to healthcare and treatment effectiveness. Otherwise, the studies conducted among primary care patients in Europe suggest that interpersonal aspects (e.g., communication with a physician, trust and respect [34] are more important dimensions of healthcare quality than accessibility and effectiveness, thereby making it necessary to include them in future studies. It is fair to say that research into these relationships requires further attention. However, the deliberations are limited solely to primary healthcare. Patients with severe diagnoses, e.g., cancer or unstable chronic diseases, would probably assess healthcare services differently than patients requiring stable follow-up appointments, thereby requiring more attention to be paid to groups of patients with unstable health conditions.
5. Conclusions
The COVID-19 pandemic has disrupted the provision of healthcare services, resulting in a considerable deterioration in patients’ overall health, especially those with chronic diseases. Broad access to telemedicine could significantly reduce disruptions in the provision of healthcare services during the pandemic and prevent, at least to some extent, a deterioration in the patients’ quality of life and careers. While remote healthcare solutions cannot completely replace face-to-face medical assessment, they can ensure the continuity of healthcare services and help protect patients, their families and healthcare professionals from disease transmission. The accessibility and effectiveness of medical care are considered key features of the care processes required to ensure high-quality outcomes. Sufficient documentation of the relationship between the accessibility and effectiveness of patient care is essential to support efforts to improve the outcomes of all types of disease treatment, especially chronic disease, and finally to improve the patients’ quality of life. The purpose of this study was to examine patient satisfaction with the access to primary healthcare and the effectiveness of treatment in a condition of remote medical care caused by the COVID-19 pandemic. The model proposed in this study identified a positive and weak, but statistically significant, relationship between these factors. Although a better access to primary care has a positive effect on treatment effectiveness, there are undoubtedly other factors that affect this effectiveness to a greater extent and it would be worth investigating them in further studies.
Taking into account patients’ views on the quality of medical services can help to improve overall healthcare delivery in the primary healthcare that is responsible for most health needs. Improving the quality of this care is of great clinical importance. It can positively impact the early detection of chronic diseases, rapid, effective and patient-centered delivery of medical care, adherence to treatment protocols and thus clinical outcomes. As a result, it can also lead to a better quality of life for patients. In addition, tools in the field of telemedicine, implemented at the primary healthcare level, can support clinical decision-making and thus improve the effectiveness of care by providing healthcare professionals with information and knowledge about a specific patient at the right time during interaction with the patient. According to the WHO, this can promote effective decision-making and enable different healthcare providers to understand and deal with the broad and complex health problems encountered in primary care.
To our knowledge, this is the first study in which access to this healthcare was examined on a sample of Polish primary care patients in the conditions of remote work caused by the COVID-19 pandemic. An analysis of the data from this study showed that patients positively assessed the accessibility of remote services and the treatment effectiveness in teleconsultation conditions. Future research should therefore be focused on patients with chronic diseases requiring coordinated healthcare and should also be extended to outpatient healthcare facilities. Health variables should also be considered as moderating variables in future studies.
Author Contributions
Conceptualization, M.K.-A. and L.H.; methodology, R.W., M.K.-A. and L.H.; validation, R.W.; formal analysis, R.W.; investigation, R.W., M.K.-A. and L.H.; resources, P.K.; data curation, R.W.; writing—original draft preparation, R.W., M.K.-A. and L.H.; writing—review and editing, R.W., M.K.-A., L.H. and P.K. visualization, R.W.; supervision, M.K.-A. and P.K.; project administration, M.K.-A. All authors have read and agreed to the published version of the manuscript. contributed substantially to the work reported.
Funding
This research was funded/by IDUB against the COVID-19 project granted by Warsaw University of Technology under the program Excellence Initiative: Research University (IDUB).
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Ethics Committee of Warsaw University of Technology (Certificate of Ethics approval—approved 15 Janaury 2021).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
Data is contained within the article.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Kanecki K., Nitsch-Osuch A., Tyszko P. Health-Related Quality of Life or Quality of Medical Service? Current challenges for family doctors. Fam. Med. Prim. Care Rev. 2016;18:382–386. doi: 10.5114/fmpcr/63247. [DOI] [Google Scholar]
- 2.Haraldstad K., Wahl A., Andenæs R., Andersen J., Andersen M., Beisland E., Borge C., Engebretsen E., Eisemann M., Halvorsrud L., et al. A systematic review of quality of life research in medicine and health sciences. Qual. Life Res. 2019;28:2641–2650. doi: 10.1007/s11136-019-02214-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Van den Berg J.P., Kalmijn S., Lindeman E., Veldink J.H., de Visser M., Van der Graaff M.M., Wokke J.H.J., Van den Berg L.H. Multidisciplinary ALS care improves quality of life in patients with ALS. Neurology. 2005;65:1264–1267. doi: 10.1212/01.wnl.0000180717.29273.12. [DOI] [PubMed] [Google Scholar]
- 4.Glimelius B., Hoffman K., Sjödén P.O., Jacobsson G., Sellström H., Enander L.K., Linné T., Svensson C. Chemotherapy improves survival and quality of life in advanced pancreatic and biliary cancer. Ann. Oncol. 1996;7:593–600. doi: 10.1093/oxfordjournals.annonc.a010676. [DOI] [PubMed] [Google Scholar]
- 5.Crosby R.D., Kolotkin R.L., Williams G.R. Defining clinically meaningful change in health-related quality of life. J. Clin. Epidemiol. 2003;56:395–407. doi: 10.1016/S0895-4356(03)00044-1. [DOI] [PubMed] [Google Scholar]
- 6.Constitution of the World Health Organization . Chron. World Health Organ. Volume 1 Constitution of the World Health Organization; Geneva, Switzerland: 1947. [Google Scholar]
- 7.Raphael D., Renwick R., Brown I., Rootman I. Quality of life indicators and health: Current status and emerging conceptions. Soc. Indic. Res. 1996;39:65–88. doi: 10.1007/BF00300833. [DOI] [Google Scholar]
- 8.Hollandsworth J.G. Evaluating the impact of medical treatment on the quality of life: A 5-year update. Soc. Sci. Med. 1988;26:425–434. doi: 10.1016/0277-9536(88)90311-5. [DOI] [PubMed] [Google Scholar]
- 9.Erikson R. The Quality of Life. Oxford University Press; Oxford, UK: 1993. Description of inequality: The Swedish approach to welfare research. [Google Scholar]
- 10.Adler N.E., Boyce W.T., Chesney M.A., Folkman S., Syme S.L. Socioeconomic Inequalities in Health: No Easy Solution. JAMA J. Am. Med. Assoc. 1993;269:3140–3145. doi: 10.1001/jama.1993.03500240084031. [DOI] [PubMed] [Google Scholar]
- 11.Donabedian A. Twenty years of research on the quality of medical care: 1964–1984. Eval. Health Prof. 1985;8:243–265. doi: 10.1177/016327878500800301. [DOI] [PubMed] [Google Scholar]
- 12.Pascoe G.C. Patient satisfaction in primary health care: A literature review and analysis. Eval. Program Plann. 1983;6:185–210. doi: 10.1016/0149-7189(83)90002-2. [DOI] [PubMed] [Google Scholar]
- 13.Van Campen C., Sixma H., Friele R.D., Kerssens J.J., Peters L. Quality of Care and Patient Satisfaction: A Review of Measuring Instruments. Med. Care Res. Rev. 1995;52:109–133. doi: 10.1177/107755879505200107. [DOI] [PubMed] [Google Scholar]
- 14.Strasser S., Aharony L., Greenberger D. The Patient Satisfaction Process: Moving Toward a Comprehensive Model. Med. Care Res. Rev. 1993;50:219–248. doi: 10.1177/107755879305000205. [DOI] [PubMed] [Google Scholar]
- 15.Revicki D.A., Osoba D., Fairclough D., Barofsky I., Berzon R., Leidy N.K., Rothman M. Recommendations on health-related quality of life research to support labeling and promotional claims in the United States. Qual. Life Res. 2000;9:887–900. doi: 10.1023/A:1008996223999. [DOI] [PubMed] [Google Scholar]
- 16.Lin X.J., Lin I.M., Fan S.Y. Methodological issues in measuring health-related quality of life. Tzu Chi Med. J. 2013;25:8–12. doi: 10.1016/j.tcmj.2012.09.002. [DOI] [Google Scholar]
- 17.The World Health Organization . WHOQOL-Measuring Quality of Life. WHO; Geneva, Switzerland: 2012. [Google Scholar]
- 18.Campbell S.M., Roland M.O., Buetow S.A. Defining quality of care. Soc. Sci. Med. 2000;51:1611–1625. doi: 10.1016/S0277-9536(00)00057-5. [DOI] [PubMed] [Google Scholar]
- 19.Maxwell R.J. Quality assessment in health. Br. Med. J. 1984;288:1470–1472. doi: 10.1136/bmj.288.6428.1470. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Alonazi W.B., Thomas S.A. Quality of Care and Quality of Life: Convergence or Divergence? Health Serv. Insights. 2014;7:13283. doi: 10.4137/HSI.S13283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.L’Esperance V., Sutton M., Schofield P., Round T., Malik U., White P., Ashworth M. Impact of primary care funding on secondary care utilisation and patient outcomes: A retrospective cross-sectional study of English general practice. Br. J. Gen. Pract. 2017;67:792–799. doi: 10.3399/bjgp17X693101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Chmiel M. Quality Attributes of Primary Health Care Services. Sci. Pap. Silesian Univ. Technol. Organ. Manag. Ser. 2019;2019:7–16. doi: 10.29119/1641-3466.2018.134.1. [DOI] [Google Scholar]
- 23.Korneta P. Stakeholders and Performance Management Systems of Small and Medium-Sized Outpatient Clinics. Found. Manag. 2020;12:211–222. doi: 10.2478/fman-2020-0016. [DOI] [Google Scholar]
- 24.Korneta P., Kludacz-Alessandri M., Walczak R. The impact of COVID-19 on the performance of primary health care service providers in a capitation payment system: A case study from Poland. Int. J. Environ. Res. Public Health. 2021;18:1407. doi: 10.3390/ijerph18041407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Jakubowski D., Sys D., Kajdy A., Lewandowska R., Kwiatkowska E., Cymbaluk-Płoska A., Rabijewski M., Torbé A., Kwiatkowski S. Application of Telehealth in Prenatal Care during the COVID-19 Pandemic—A Cross-Sectional Survey of Polish Women. J. Clin. Med. 2021;10:2570. doi: 10.3390/jcm10122570. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Major P., Stefura T., Wysocki M., Małczak P., Rzepa A., Proczko-Stepaniak M., Szeliga J., Pędziwiatr M. Impact of SARS-CoV-2 pandemic on bariatric care in Poland: Results of national survey. BMC Surg. 2020;20:314. doi: 10.1186/s12893-020-00990-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Konieczny M., Cipora E., Sawicka J., Fal A. Patient satisfaction with oncological care during the SARS-CoV-2 virus pandemic. Int. J. Environ. Res. Public Health. 2021;18:4122. doi: 10.3390/ijerph18084122. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Mazurek J., Biernat K., Kuciel N., Hap K., Sutkowska E. The use of medical and non-medical services by the elderly during the SARS-CoV-2 pandemic differs between general and specialist practice: A one-center study in Poland. Healthcare. 2021;9:8. doi: 10.3390/healthcare9010008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Wysocki P.J., Kwinta Ł., Potocki P., Konopka K., Streb J., Wojtukiewicz M.Z., Radecka B., Tomczak P., Jarząb M., Kawecki A., et al. Systemic treatment of patients with solid tumors during the COVID-19 (SARS-CoV-2) pandemic-comprehensive recommendations of the Polish Society of Clinical Oncology. Oncol. Clin. Pract. 2020;16:41–52. doi: 10.5603/OCP.2020.0012. [DOI] [Google Scholar]
- 30.Malicki J., Martenka P., Dyzmann-Sroka A., Paczkowska K., Leporowska E., Suchorska W., Lamperska K., Pieńkowski P., Chicheł A., Mocydlarz-Adamcewicz M., et al. Impact of COVID-19 on the performance of a radiation oncology department at a major comprehensive cancer centre in Poland during the first ten weeks of the epidemic. Rep. Pract. Oncol. Radiother. 2020;25:820–827. doi: 10.1016/j.rpor.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Maluchnik M., Podwójcic K., Więckowska B. Decreasing access to cancer diagnosis and treatment during the COVID-19 pandemic in Poland. Acta Oncol. 2021;60:28–31. doi: 10.1080/0284186X.2020.1837392. [DOI] [PubMed] [Google Scholar]
- 32.Zduńczyk A.J., Jakubiak A., Łuczak J. Raport Podstawowa Opieka Zdrowotna w Polsce-Diagnoza i Projekty Zmian. Instytut Medycyny Wsi im; Lublin, Poland: 2018. [Google Scholar]
- 33.Starfield B., Shi L., Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83:457–502. doi: 10.1111/j.1468-0009.2005.00409.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Bower P., Roland M., Campbell J., Mead N. Setting standards based on patients’ views on access and continuity: Secondary analysis of data from the general practice assessment survey. Br. Med. J. 2003;326:258–260. doi: 10.1136/bmj.326.7383.258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Campbell S.M., Hann M., Hacker J., Burns C., Oliver D., Thapar A., Mead N., Gelb Safran D., Roland M.O. Identifying predictors of high quality care in English general practice: Observational study. Br. Med. J. 2001;323:784–787. doi: 10.1136/bmj.323.7316.784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Cankurtaran D., Tezel N., Yildiz S.Y., Celik G., Unlu Akyuz E. Evaluation of the effects of the COVID-19 pandemic on children with cerebral palsy, caregivers’ quality of life, and caregivers’ fear of COVID-19 with telemedicine. Ir. J. Med. Sci. 2021:1–8. doi: 10.1007/s11845-021-02622-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Whitehead M. The concepts and principles of equity and health. Int. J. Health Serv. 1992;22:429–445. doi: 10.2190/986L-LHQ6-2VTE-YRRN. [DOI] [PubMed] [Google Scholar]
- 38.Andersen R.M., McCutcheon A., Aday L.A., Chiu G.Y., Bell R. Exploring dimensions of access to medical care. Health Serv. Res. 1983;18:49–74. [PMC free article] [PubMed] [Google Scholar]
- 39.Hawrysz L., Gierszewska G., Bitkowska A. The research on patient satisfaction with remote healthcare prior to and during the COVID-19 pandemic. Int. J. Environ. Res. Public Health. 2021;18:5338. doi: 10.3390/ijerph18105338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Gordon T., Booysen F., Mbonigaba J. Socio-economic inequalities in the multiple dimensions of access to healthcare: The case of South Africa. BMC Public Health. 2020;20:289. doi: 10.1186/s12889-020-8368-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Haggerty J., Burge F., Lévesque J.F., Gass D., Pineault R., Beaulieu M.D., Santor D. Operational definitions of attributes of primary health care: Consensus among Canadian experts. Ann. Fam. Med. 2007;5:336–344. doi: 10.1370/afm.682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Drucker P.F. The Effective Executive. Harper & Row; New York, NY, USA: 1967. [Google Scholar]
- 43.Palmer S., Torgerson D.J. Economics notes: Definitions of efficiency. BMJ Br. Med. J. 1999;318:1136. doi: 10.1136/bmj.318.7191.1136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Rezapour R., Tabrizi J.S., Farahbakhsh M., Saadati M., Abdolahi H.M. Developing Iranian primary health care quality framework: A national study. BMC Public Health. 2019;19:1–10. doi: 10.1186/s12889-019-7237-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Burches E., Burches M. Efficacy, Effectiveness and Efficiency in the Health Care: The Need for an Agreement to Clarify its Meaning. Int. Arch. Public Health Community Med. 2020;4:35. doi: 10.23937/2643-4512/1710035. [DOI] [Google Scholar]
- 46.Głodziński E. Efektywność Ekonomiczna—Dylematy Definiowania i Pomiaru Economic Efficiency—Dilemmas in Definition and Measurement; Zeszyty Naukowe. Organizacja i Zarządzanie/Politechnika Śląska. 2014; z. 73. [(accessed on 15 June 2021)];:155–167. Available online: https://yadda.icm.edu.pl/baztech/element/bwmeta1.element.baztech-9f73d895-2539-49fc-a3f4-5ccb3d7be1be.
- 47.World Health Organization . Quality in Primary Health Care. World Health Organization; Geneva, Switzerland: 2018. [Google Scholar]
- 48.Agency for Healthcare Research and Quality . National Healthcare Quality and Disparities Reports. Agency for Healthcare Research and Quality; Rockville, MD, USA: 2018. [Google Scholar]
- 49.(CIHI) Canadian Institute for Health Information [(accessed on 15 June 2021)];Pan-Canadian Primary Health Care Indicator Update Report. 2012 :186. Available online: https://secure.cihi.ca/estore/productFamily.htm?locale=en&pf=PFC2000.
- 50.Australian Commission on Safety and Quality in Health Care . Practice-Level Indicators of Safety and Quality for Primary Health Care. Australian Commission on Safety and Quality in Health Care; Australia: 2012. [(accessed on 15 June 2021)]. Available online: https://www.safetyandquality.gov.au/publications-and-resources/resource-library/practice-level-indicators-safety-and-quality-primary-health-care-synthesis-submission-consultation-paper-and-recommended-national-indicator-set. [Google Scholar]
- 51.Langbecker D., Caffery L.J., Gillespie N., Smith A.C. Using survey methods in telehealth research: A practical guide. J. Telemed. Telecare. 2017;23:770–779. doi: 10.1177/1357633X17721814. [DOI] [PubMed] [Google Scholar]
- 52.Raczyńska E. Efektywność w ochronie zdrowaia jako wyzwanie dla zarządzania. Przegląd Organ. 2020;5:27–34. doi: 10.33141/po.2020.05.04. [DOI] [Google Scholar]
- 53.Testa M.A., Simonson D.C. Assessment of Quality-of-Life Outcomes. N. Engl. J. Med. 1996;334:835–840. doi: 10.1056/NEJM199603283341306. [DOI] [PubMed] [Google Scholar]
- 54.Gill T.M., Feinstein A.R. A Critical Appraisal of the Quality of Quality-of-Life Measurements. JAMA J. Am. Med. Assoc. 1994;272:619–626. doi: 10.1001/jama.1994.03520080061045. [DOI] [PubMed] [Google Scholar]
- 55.Wilcox L.D., Brooks R.M., Beal G.M., Klonglan G.E. Social Indicators and Societal Monitoring: An Annotated Bibliography. Jossey-Bass Inc. Publishers; San Francisco, CA, USA: 1972. [Google Scholar]
- 56.Aday L.A., Andersen R. A framework for the study of access to medical care. Health Serv. Res. 1974;9:208–220. [PMC free article] [PubMed] [Google Scholar]
- 57.Gene-Badia J., Ascaso C., Escaramis-Babiano G., Sampietro-Colom L., Catalan-Ramos A., Sans-Corrales M., Pujol-Ribera E. Personalised care, access, quality and team coordination are the main dimensions of family medicine output. Fam. Pract. 2006;24:41–47. doi: 10.1093/fampra/cml056. [DOI] [PubMed] [Google Scholar]
- 58.Corscadden L., Levesque J.-F., Lewis V., Breton M., Sutherland K., Weenink J.-W., Haggerty J., Russell G. Barriers to accessing primary health care: Comparing Australian experiences internationally. Aust. J. Prim. Health. 2017;23:223. doi: 10.1071/PY16093. [DOI] [PubMed] [Google Scholar]
- 59.Engels Y. Developing a framework of, and quality indicators for, general practice management in Europe. Fam. Pract. 2005;22:215–222. doi: 10.1093/fampra/cmi002. [DOI] [PubMed] [Google Scholar]
- 60.McIntyre D., Thiede M., Birch S. Access as a policy-relevant concept in low- and middle-income countries. Health Econ. Policy Law. 2009;4:179–193. doi: 10.1017/S1744133109004836. [DOI] [PubMed] [Google Scholar]
- 61.Levesque J.F., Harris M.F., Russell G. Patient-centred access to health care: Conceptualising access at the interface of health systems and populations. Int. J. Equity Health. 2013;12:18. doi: 10.1186/1475-9276-12-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Hanson K., Yip W.C., Hsiao W. The impact of quality on the demand for outpatient services in Cyprus. Health Econ. 2004;13:1167–1180. doi: 10.1002/hec.898. [DOI] [PubMed] [Google Scholar]
- 63.Sans-Corrales M. Family medicine attributes related to satisfaction, health and costs. Fam. Pract. 2006;23:308–316. doi: 10.1093/fampra/cmi112. [DOI] [PubMed] [Google Scholar]
- 64.Zimmerman B.S., Seidman D., Berger N., Cascetta K.P., Nezolosky M., Trlica K., Ryncarz A., Keeton C., Moshier E., Tiersten A. Patient perception of telehealth services for breast and gynecologic oncology care during the COVID-19 pandemic: A single center survey-based study. J. Breast Cancer. 2020;23:542–552. doi: 10.4048/jbc.2020.23.e56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Hair J.F., Jr., Black W.C., Babin B.J., Anderson R.E. Multivariate Data Analysis. Pearson Education, Limited; London, UK: 2013. [Google Scholar]
- 66.Sapsford R. Survey Research. SAGE Publications; New York, NY, USA: 2006. [Google Scholar]
- 67.Johnson T.P. Handbook of Health Survey Methods. John Wiley & Sons, Incorporated; Hoboken, NJ, USA: 2014. [Google Scholar]
- 68.Punch K.F. Survey Research: The Basics. Sage Publications; New York, NY, USA: 2003. [Google Scholar]
- 69.Davies H., Powell A., Rushmer R. Healthcare Professionals’ Views on Clinician Engagement in Quality Improvement: A Literature Review. 2007. [(accessed on 15 June 2021)]. Available online: https://www.health.org.uk/publications/healthcare-professionals%E2%80%99-views-on-clinician-engagement-in-quality-improvement.
- 70.Caccia-Bava M.C., Guimaraes V.C.K., Guimaraes T. Important factors for success in hospital BPR project phases. Int. J. Health Care Qual. Assur. 2013;26:729–745. doi: 10.1108/IJHCQA-01-2012-0007. [DOI] [PubMed] [Google Scholar]
- 71.Hennington A., Janz B., Poston R. I’m just burned out: Understanding information system compatibility with personal values and role-based stress in a nursing context. Comput. Hum. Behav. 2011;27:1238–1248. doi: 10.1016/j.chb.2011.01.004. [DOI] [Google Scholar]
- 72.De Ryck E., Willems S. Erratum: Measures of quality, costs and equity in primary healthcare: Instruments developed to analyse and compare primary healthcare in 35 countries (Quality in Primary Care (2013) 21:2 (67–79)) Qual. Prim. Care. 2013;21:205. [PubMed] [Google Scholar]
- 73.Lai H., Gemming L. Approaches to patient satisfaction measurement of the healthcare food services: A systematic review. Clin. Nutr. ESPEN. 2021;42:61–72. doi: 10.1016/j.clnesp.2020.12.019. [DOI] [PubMed] [Google Scholar]
- 74.European Patients Forum Patients’ Perceptions of Quality in Healthcare: Report of a survey conducted by EPF in 2016. Report in a Survey. [(accessed on 15 June 2021)];2017 :40. Available online: https://www.eu-patient.eu/globalassets/policy/quality-of-care/quality-survey-report.pdf.
- 75.Bargawi A.A., Rea D.M. Quality in Primary Health Care. Health Policy Plan. [(accessed on 15 June 2021)];2015 :37–40. Available online: https://www.who.int/docs/default-source/primary-health-care-conference/quality.pdf.
- 76.Shield T., Campbell S., Rogers A., Worrall A., Chew-Graham C., Gask L. Quality indicators for primary care mental health services. Qual. Saf. Health Care. 2003;12:100–106. doi: 10.1136/qhc.12.2.100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Busse R., Klazinga N., Panteli D., Quentin W. Improving Healthcare Quality in Europe. WHO; Geneva, Switzerland: 2019. [PubMed] [Google Scholar]
- 78.Tabachnick B., Fidell L. Using Multivariate Statistics. Pearson Education; Upper Saddle River, NJ, USA: 2018. [Google Scholar]
- 79.Horn J.L. Factors in Factor Analysis. Psychometrika. 1965;30:179–185. doi: 10.1007/BF02289447. [DOI] [PubMed] [Google Scholar]
- 80.Zhang X., Xiang S. Learn About Reliability Analysis and Factor Analysis in SPSS With Online Shopping Data. SAGE Publications; New York, NY, USA: 2019. [DOI] [Google Scholar]
- 81.Williams B., Onsman A., Brown T. Exploratory factor analysis: A five-step guide for novices. J. Emerg. Prim. Health Care. 2010;8:225–236. doi: 10.33151/ajp.8.3.93. [DOI] [Google Scholar]
- 82.Kludacz-Alessandri M., Hawrysz L., Korneta P., Gierszewska G., Pomaranik W., Walczak R. The impact of medical teleconsultations on general practitioner-patient communication during COVID- 19: A case study from Poland. PLoS ONE. 2021;16:e0254960. doi: 10.1371/journal.pone.0254960. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Barbosa W., Zhou K., Waddell E., Myers T., Dorsey E.R. Annual Review of Public Health. Volume 42. Annual Reviews Inc.; Palo Alto, CA, USA: 2020. Improving Access to Care: Telemedicine across Medical Domains; pp. 463–481. [DOI] [PubMed] [Google Scholar]
- 84.Grol R., Wensing M. Patients Evaluate General/Family Practice: The EUROPEP Instrument; 2000. [(accessed on 15 June 2021)]; Available online: https://equip.woncaeurope.org/sites/equip/files/documents/publications/resources/grolwensing2000theeuropepinstrumentequipwonca.pdf.
- 85.Smith C.H., Armstrong D. Comparison of criteria derived by government and patients for evaluating general practitioner services. Br. Med. J. 1989;299:494–496. doi: 10.1136/bmj.299.6697.494. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Ekeland A.G., Bowes A., Flottorp S. Effectiveness of telemedicine: A systematic review of reviews. Int. J. Med. Inform. 2010;79:736–771. doi: 10.1016/j.ijmedinf.2010.08.006. [DOI] [PubMed] [Google Scholar]
- 87.Champagne-Langabeer T., Langabeer J.R., Roberts K.E., Gross J.S., Gleisberg G.R., Gonzalez M.G., Persse D. Telehealth Impact on Primary Care Related Ambulance Transports. Prehospital Emerg. Care. 2019;23:712–717. doi: 10.1080/10903127.2019.1568650. [DOI] [PubMed] [Google Scholar]
- 88.de Catapan S.C., Calvo M.C.M. Teleconsultation: An Integrative Review of the Doctor-Patient Interaction Mediated by Technology. Rev. Bras. Educ. Med. 2020;44 doi: 10.1590/1981-5271v44.1-20190224.ing. [DOI] [Google Scholar]
- 89.Newbould J., Abel G., Ball S., Corbett J., Elliott M., Exley J., Martin A., Saunders C., Wilson E., Winpenny E., et al. Evaluation of telephone first approach to demand management in English general practice: Observational study. BMJ. 2017;358:4197. doi: 10.1136/bmj.j4197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Moth G., Huibers L., Christensen M.B., Vedsted P. Drug prescription by telephone consultation in Danish out-of-hours primary care: A population-based study of frequency and associations with clinical severity and diagnosis. BMC Fam. Pract. 2014;15:142. doi: 10.1186/1471-2296-15-142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Dawson A.Z., Walker R.J., Campbell J.A., Davidson T.M., Egede L.E. Telehealth and indigenous populations around the world: A systematic review on current modalities for physical and mental health. mHealth. 2020;6:30. doi: 10.21037/mhealth.2019.12.03. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Morris J., Campbell-Richards D., Wherton J., Sudra R., Vijayaraghavan S., Greenhalgh T., Collard A., Byrne E., O’Shea T. Webcam consultations for diabetes: Findings from four years of experience in Newham. Pract. Diabetes. 2017;34:45–50. doi: 10.1002/pdi.2078. [DOI] [Google Scholar]
- 93.Haig-Ferguson A., Loades M., Whittle C., Read R., Higson-Sweeney N., Beasant L., Starbuck J., Crawley E. “It’s not one size fits all”; the use of videoconferencing for delivering therapy in a Specialist Paediatric Chronic Fatigue Service. Internet Interv. 2019;15:43–51. doi: 10.1016/j.invent.2018.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Chwistek M. “are You Wearing Your White Coat?”: Telemedicine in the Time of Pandemic. JAMA J. Am. Med. Assoc. 2020;324:149–150. doi: 10.1001/jama.2020.10619. [DOI] [PubMed] [Google Scholar]
- 95.Sutherland A.E., Stickland J., Wee B. Can video consultations replace face-to-face interviews? Palliative medicine and the COVID-19 pandemic: Rapid review. BMJ Support Palliat. Care. 2020;26:26. doi: 10.1136/bmjspcare-2020-002326. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Wade V.A., Karnon J., Elshaug A.G., Hiller J.E. A systematic review of economic analyses of telehealth services using real time video communication. BMC Health Serv. Res. 2010;10:233. doi: 10.1186/1472-6963-10-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Imlach F., McKinlay E., Middleton L., Kennedy J., Pledger M., Russell L., Churchward M., Cumming J., McBride-Henry K. Telehealth consultations in general practice during a pandemic lockdown: Survey and interviews on patient experiences and preferences. BMC Fam. Pract. 2020;21:269. doi: 10.1186/s12875-020-01336-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Thornton J. COVID-19: How coronavirus will change the face of general practice forever. BMJ. 2020;368:m1279. doi: 10.1136/bmj.m1279. [DOI] [PubMed] [Google Scholar]
- 99.Raczkiewicz D., Kister A., Rzemek C., Tarkowski K., Dybciak P., Owoc A., Bojar I. Telemedicine in the opinion of primary health care physicians. Eur. J. Med. Technol. 2018;2:43. [Google Scholar]
- 100.Ackerman M.J., Filart R., Burgess L.P., Lee I., Poropatich R.K. Telemedicine and e-Health. Volume 16. NCBI; Bethesda, MD, USA: 2010. Developing next-generation telehealth tools and technologies: Patients, systems, and data perspectives; pp. 93–95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Zanaboni P., Wootton R. Adoption of telemedicine: From pilot stage to routine delivery. BMC Med. Inform. Decis. Mak. 2012;12:1. doi: 10.1186/1472-6947-12-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Gomes Rodrigues D.L., Belber G.S., de Queiroz Padilha F.V., Spinel L.F., Moreira F.R., Maeyama M.A., Marques Pinho A.P.N., Júnior Á.A. Impact of teleconsultation on patients with type 2 diabetes in the Brazilian public health system: Protocol for a randomized controlled trial (TELEconsulta diabetes trial) JMIR Res. Protoc. 2021;10:e23679. doi: 10.2196/23679. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data is contained within the article.