Machine learning empowered COVID-19 patient monitoring using non-contact sensing:An extensive review

Umer See,Sye Yseen Shh,Jw Ahm,Muhmm Ali Imrn,Qmmer H.Asi,Sye Aziz Shh

aResearch Centre for Intelligent Healthcare,Coventry University,Coventry,CV1 5FB,UK

bSchool of Computing,Engineering and Built Environment,Glasgow Caledonian University,Glasgow,G4 0BA,UK

cSchool of Computing,Edinburgh Napier University,Edinburgh,EH11 4BN,UK

dJames Watt School of Engineering,University of Glasgow,Glasgow,G12 8QQ,UK

Keywords:

Artificial intelligence

Non-invasive healthcare

Machine learning

Non-contact sensing

COVID-19

A B S T R A C T

The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2),which caused the coronavirus disease 2019(COVID-19)pandemic,has affected more than 400 million people worldwide.With the recent rise of new Delta and Omicron variants,the efficacy of the vaccines has become an important question.The goal of various studies has been to limit the spread of the virus by utilizing wireless sensing technologies to prevent human-to-human interactions,particularly for healthcare workers.In this paper,we discuss the current literature on invasive/contact and non-invasive/noncontact technologies(including Wi-Fi,radar,and software-defined radio)that have been effectively used to detect,diagnose,and monitor human activities and COVID-19 related symptoms,such as irregular respiration.In addition,we focused on cutting-edge machine learning algorithms(such as generative adversarial networks,random forest,multilayer perceptron,support vector machine,extremely randomized trees,and k-nearest neighbors)and their essential role in intelligent healthcare systems.Furthermore,this study highlights the limitations related to non-invasive techniques and prospective research directions.

1.Introduction

A coronavirus is a large group of viruses that includes the Middle East respiratory syndrome coronavirus(MERS-CoV),the severe acute respiratory syndrome coronavirus(SARS-CoV),and the most recent one,SARS-CoV-2,also known as coronavirus disease 2019(COVID-19).In early December 2019,SARS-CoV-2 occurred and eventually affected more than 250 million people globally.According to a recent figure by the World Health Organization(WHO),more than 5 million deaths from SARS-CoV-2 have been reported[1].The distinct variants of COVID-19 are targeting lungs,consequently resulting severe damage towards breathing[2-5].The virus spreads through human-to-human or human-to-surface interactions and mainly triggers flu,fever,cough,ageusia,and respiratory problems[6-10].Governments around the globe are trying to prevent the spread of the virus through constant lockdowns,which highly affect the economy and small/big businesses[11-13].To stop the spread of the virus,self-quarantine is imposed on normal people in their residences,which limits their activities,whereas people affected by the virus are quarantined in hospitals until fully recovered.

New discoveries are made daily about the virus and its prevention[14,15].However,while we are writing this paper,the genuine cause of the virus and the effects of vaccination have become significant issues[16-20].Elderly people are highly susceptible to the effects of SARS-CoV-2,and many have already lost their lives[21,22].This is due to the fact that the immune systems of such people are insufficient to fight against the virus.The virus spreads easily when individuals are physically close,and droplets are expelled by infected people through coughing or sneezing,which primarily endangers the life of healthcare workers[23,24].Although the WHO has suggested infected persons and healthcare workers wear face masks and other mouth coverings,the complete effectiveness of face masks is still debatable[25-27].

At this stage,with the trials having ended,developed nations around the world have started vaccinations for elderly people;however,the number of cases is increasing[28].This raises a question regarding the efficiency of the vaccine[29-31].However,until a recovery occurs,governments are imposing sets of rules on people,such as social distancing and mask wearing[32,33].Furthermore,the detection and monitoring of SARS-CoV-2 is challenging owing to certain limitations,such as shortage of equipment,facilities,and trained staff.In addition,there is a fear of exposing healthcare staff to diseased patients[34-36].

The United Kingdom's National Health Service and other health services around the globe are in high demand by healthcare workers as they come into contract with the virus through infected patients[37-39].Non-invasive healthcare is the only possible solution to effectively reducing the spread of the virus.Technologies are rapidly developing in the current era,and noninvasive healthcare has attracted the attention of many researchers around the globe,which may ease the workload on health workers[40-43].Moreover,the development of healthcare technologies will significantly reduce the number of valuable clinical resources.

In this paper,we discuss and compare the state-of-art healthcare technologies and machine learning algorithms that can be effectively utilized for the detection and monitoring of COVID-19 symptoms.Camera-based technology and wearable sensors are decent solutions;however,wearable sensors may cause discomfort and risk of transferring the virus from one individual to another.On the other hand,camera-based monitoring raises privacy concerns and is limited to light and requires high computational power for further processing[44-46].Non-contact wireless sensing technology is a promising solution that can effectively be used in healthcare and for the detection and monitoring of SARS-CoV-2 affected patients[47-49].

2.Intelligent healthcare technology

In recent years,enormous studies have been conducted on healthcare technologies[50,51].These technologies are associated with either invasive or non-invasive healthcare.In terms of healthcare,non-invasive(or non-contact)technology can be used for monitoring patients without any physical contact with the body,whereas invasive(or contact)technology requires direct physical bodily contact[52-56].

In Fig.1,an illustration of the monitoring system is shown,where wearable sensors are connected to the patient's body and data are transmitted to the care providers wirelessly.Wearable sensors gather data about a patient's physiological and movement status[57-60].For instance,the respiratory rate of patients with chronic obstructive pulmonary disease and the heart rate of patients with congestive heart failure are monitored using attached sensors.Currently,smart watches have the ability to monitor the heart rate and convey information in real time to the care provider[61-63].All wearable devices must be in physical contact with the body to convey information.This situation causes discomfort and limitations in the case of monitoring SARS-CoV-2 affected patients because the virus can be transmitted through wearable devices.In addition,wearable devices require battery power and must be detached from the patient's body for charging.For home-based monitoring,cultural stigma associated with the use of medical devices attached to the body might occur.

Fig.1.Coronavirus 2019(COVID-19)symptom monitoring system through wireless sensing.Distinct sensors are connected to the body and information is transmitted through a gateway such as a cell phone.Actions are applied by caretakers according to the conveyed information through sensors.

To overcome the limitations of wearable sensing technology,non-contact healthcare has been proposed by researchers[64-66].As the name suggests,non-contact technology requires no direct contact with the body to monitor the patient status.Owing to the COVID-19 pandemic,non-contact healthcare has recently gained immense importance.Although wearable devices can be effectively used to monitor SARS-CoV-2 affected patients,they are at the cost of potential exposure to the virus.Healthcare workers,particularly nurses,may easily be affected when attaching,changing,or removing wearable devices[67].All possible precautions such as wearing masks or gloves,when taken by the healthcare providers,will reduce the risk of contracting the virus;nevertheless,using non-contact technology will successfully eliminate all possibilities through which the virus can be transmitted.

Healthcare technology(invasive/non-invasive)merged with artificial intelligence(AI)can significantly reduce the work pressure on hospital staff[68-71].For instance,radio frequency(RF)sensing technology is able to collect information from a patient's body,and the passing of this information through AI algorithms will yield valuable results without any direct involvement of hospital workers[72,73].Remote non-contact sensing technologies integrated with smart machine learning algorithms are capable of providing correct outcomes in real time,which can easily be used by the clinician to monitor and diagnose a disease[74].Non-contact sensing can assist healthcare staff in detecting and monitoring SARS-CoV-2 affected individuals.This will enable healthcare workers to rapidly diagnose the disease and make the right decisions on time.

To fight against SARS-CoV-2,the monitoring of crucial signs is of significant importance.These signs include respiratory problems,cough,fever,and in some cases,the affected cardiovascular system[75-78].Shortness of breath is a vital sign when a patient experiences serious difficulty.To detect abnormal respiration,noncontact techniques can be used for monitoring diseased patients.In addition,non-contact methods can also be used to monitor the heart rate of patients suffering from the affected cardiovascular system[79,80].All major non-contact techniques that can be effectively used for the detection and monitoring of COVID-19 symptoms are described in this paper.Moreover,Table 1[81-93]summarizes studies in which different non-contact sensing technologies are effectively used to monitor an abnormal breathing rate,which is the primary sign of COVID-19.Fig.2 illustrates a general system based on non-contact sensing techniques and smart AI algorithms for detecting and monitoring of COVID-19 symptoms.

Table 1Summary of invasive/non-invasive technologies used to detect and monitor abnormal respiratory rate.

Fig.2.COVID-19 symptom detection and monitoring system through distinct invasive/non-invasive technologies merged with intelligent AI techniques.X-ray:X-radiation;CT:computerized tomography;RF:radio-frequency.

2.1.Camera-based technologies

Camera-based technologies can be effectively utilized[81-85].One of the key symptoms of COVID-19 is shortness of breath(or respiratory problems),which affects chest movement.Camerabased technologies such as smartphones and thermal or depth cameras capture the video footage of the chest movements,which can then be analyzed by intelligent machine learning algorithms to detect any abnormalities in the breathing pattern(Fig.3)[82].

Fig.3.Camera-based breathing rate monitoring approach(reprinted from Ref.[82]with permission).ROI:region of interest.

2.2.Ultrasound-based technology

Ultrasound-based technology utilizes high-frequency sound waves to capture the body motion.To detect abnormal respiration,an ultrasound machine generates sound waves that,upon bouncing off from distinct sections of the body,generate echoes that are identified by the probe and are exploited to produce a stirring image[94-96].To reduce the risk of infection from COVID-19 patients,non-contact ultrasound-based technology can be utilized by monitoring abnormal respiratory activity in the lungs(Fig.4)[97-99].

Fig.4.Experimental setup to monitor abnormal respiratory using ultrasound signals(reprinted from Ref.[99]with permission).

2.3.X-radiation(X-ray)imaging

X-ray images can be used to detect and monitor the symptoms of patients with COVID-19(Fig.5)[100].For instance,X-ray images of the lungs are used to detect abnormal respiration.In the past,X-ray imaging has been used to detect pneumonia.However,pneumonia and COVID-19,both as diseases,affect the respiratory system,and to detect any anomalies in the respiratory system,X-ray imaging processed through AI algorithms can be effectively used to monitor COVID-19 symptoms[101-103].As limitations of X-ray imaging,it requires a professional analysis,and the equipment is costly.

2.4.Computerized tomography(CT)scanning

CT scanning technology involves generating X-ray imaging of a patient's chest to produce a 3D image of the lungs[104].The final outcome of the images reveals any types of abnormalities that can eventually be utilized to detect symptoms of COVID-19(Fig.5)[100,105-107].Research has shown that CT scanning has an exposure sensitivity of 86%-98% and can hence monitor any activity of SARS-CoV-2 infection in the lungs[108].

Fig.5.Sample images of normal person and patients with COVID-19(left)and histograms of the images(right).CT scanning of(A)patients with COVID-19 and(B)normal person.X-ray of(C)patients with COVID-19 and(D)normal person.(Reprint from Ref.[100]with permission).

2.5.RF sensing

RF sensing primarily consists of Wi-Fi and radar-based technologies.Radar-based technology uses a frequency-modulated continuous wave to observe the Doppler effect when the whole body or part of the body moves[109-112].This technology can be effectively used to monitor respiratory abnormalities.Images taken by the radar system can be processed using intelligent machine learning algorithms.

Once trained,these algorithms can detect anomalies in images[113-117].Moreover,Wi-Fi-based technology comprises wireless channel information.Wireless channel information is used to define the propagation properties of the RF signal,including the abnormalities generated by the human body parts.Wi-Fi-based sensing technology used to monitor patients with COVID-19 has opened new doors for research in terms of healthcare(Fig.6)[42].The received signal strength indicator obtained from Wi-Fi signals can be utilized to monitor distinct human activities.

Fig.6.Abnormal respiratory monitoring system using Wi-Fi sensing technology(reprinted from Ref.[42]with permission).

3.Machine learning for detection of COVID-19 symptoms

In recent years,a large number of real-world applications have shifted from manual systems to automated systems based on data-driven approaches[118-122].As the name suggests,a datadriven approach requires some amount of data be integrated with an intelligent AI algorithm.Three general steps used to describe a data-driven approach are as follows.First,data are collected for different applications.Second,the data are cleaned by extracting the important features.Third,machine learning algorithms are trained based on the features extracted from the data.In supervised machine learning,classification is a technique that categorizes the data into a distinct set of classes based on the diversity in the features[123-125].In this section,some state-of-art machine learning classification algorithms,which are successfully used in modern healthcare systems,are described.In Table 2[126-148],existing contributions of classification algorithms utilized for healthcare are listed.Moreover,Fig.7 shows a general framework based on data wrangling and machine learning for abnormality classification.Feature extraction and pooling is an important step toward classification,assisting in a dimensionality reduction and thereby reducing the computational complexity.In the case of digital signal processing,the extracted features are primarily in the form of time and frequency domains,as listed in Tables 3 and 4,respectively.Furthermore,Fig.8 reveals six distinct machine learning classification algorithms,which are described as follows.

Table 2List of existing contributions in human activity monitoring and COVID-19 symptoms detection through invasive/non-invasive technology.

Table 3Time-domain features.

Table 4Frequency-domain features.

Fig.7.Generic framework toward COVID-19 symptom detection.

Fig.8.Distinct effective machine learning classifiers used to detect and monitor symptoms of COVID-19.G:generator;D:discriminatror.

3.1.Generative adversarial networks(GANs)

GANs have recently been employed for numerous healthcarerelated applications,particularly SARS-CoV-2[149-151].A GAN is an approach based on a deep learning technique that consists of two models:a generator and a discriminator[152].A GAN is used primarily to discover and learn hidden patterns in the data in such a way that the model can be utilized to create new replicated data samples.By treating the problem as supervised,a GAN is an intelligent method for training a generator model.Fundamentally,the generator model is trained to produce new data samples,and the discriminator model can classify those samples as either real or fake.Both models are trained in a zero-sum game process until the discriminator model is deceived.The GAN is extremely effective for problems in which the number of training data samples is insufficient[153].For instance,when dealing with multi-class classification problems,there might be unbalanced classes,and hence,the GAN can be utilized to generate new samples and balance the classes.

The step-by-step training process of a GAN is described as follows.First,noise is added to the generator(G)from a random distribution to generate the fakey(labelz=0)→(y,z)input label pair.Second,the real pairy(labelz=1)and fake pair are alternatively supplied to the discriminator(D).Third,theDas a neural network binary classifier calculates the final lossDlossby combining the loss for both the realyand fakey.Fourth,because each model has distinct objective functions,theGcalculates the loss from its noise asGloss.Fifth,both modelsGandDlearn from the loss and thus adjust the parameters.Sixth,the optimization algorithm is applied.Seventh,step 6 is repeated for a specific number of epochs.

3.2.Random forest(RFo)

RFo is an ensemble learning-based algorithm that is primarily used for classification and regression tasks.During RFo training,several decision trees are generated,and a final class is produced,which is the mean prediction of individual trees.For classification tasks,the RFo can classify the data using the rules generated for the test features and each randomly formulated decision tree.First,for each targeted value,the numbers of votes created by the decision trees are calculated.Second,for the final RFo result,the majority voted prediction target is considered[154-156].

3.3.Multi-layer perceptron(MLP)

The MLP is a class of feedforward artificial neural networks and comprises at least three layers of nodes,that is,input,hidden,and output.A supervised machine learning technique called backpropagation is used by the MLP for the training process.In addition,each neuron uses a non-linear activation function,except for the input neurons.Furthermore,the number of neurons or the number of hidden layers in the MLP is determined during the training process.Problems of over-fitting or under-fitting of the model may occur if the optimal numbers of neurons or hidden layers are not achieved during training[157-159].

3.4.Support vector machine(SVM)

The SVM algorithm works based on the concept of statistical learning theory,and in multi-class classification problems,an SVM is one of the best performing machine learning algorithms.Many researchers have utilized and suggested SVMs for distinct real-life applications such as a system fault diagnosis or abnormality detection and the monitoring of patients[160-163].The SVM algorithm generates a hyperplane or linear line as a decision boundary to separate different types of data points for classification tasks.The data points close to the hyperplane imparting structure of the hyperplane are known as support vectors.An optimal hyperplane can be expressed as

wherewis the vector of the weights,brepresents the bias,andxis an input vector.The equations for the support vectors of each class are as follows:

wheredicorresponds to the respective class,such as+1 for class A and-1 for class B.

3.5.Extremely randomized trees(ERTs)

An ERT is an ensemble learning-based algorithm that has recently attracted the attention of many researchers.An ERT is a modified form of an RFo algorithm,which can be used for classification and regression tasks.As the name suggests,an ERT is an extremely random training technique based on decision trees.The random nature of an ERT makes it perfectly suitable for the training of a large number of datasets,where each feature in the data is highly repetitive and hence makes the training process computationally expensive.Many studies have recently revealed the efficacy of an ERT and how it can be utilized for a large number of real-world applications,including healthcare[164-167].

3.6.K-nearest neighbors(KNNs)

A KNN is a commonly used algorithm,particularly for classification tasks,when the size of the data is not large.Based on the nearest neighbor algorithm,the KNN selectsknearest neighbors instead of selecting only the first nearest neighbor,whilekis the number of nearest neighbors to an object identified by the model.Some of the important parameters to be considered while training the KNN classifier are the number of neighbors,distance metric,leaf size,and weights[168-170].

4.Limitations

In this paper,we discussed the details of modern healthcare techniques merged with AI and how they can be used effectively to prevent the spread of SARS-CoV-2 through the timely detection and monitoring of symptoms.However,there are still limitations associated with non-contact sensing technology,which require further exploration.

4.1.Privacy

Although RF sensing is a promising technology when it comes to monitoring SARS-CoV-2 affected individuals,nevertheless,it may cause privacy and security concerns.For instance,Wi-Fi sensing can intervene with other potential users,and a hacker may be able to monitor the activities of a targeted subject.In some cases,even false alarms can be generated.In addition,camera-based technology may cause discomfort and privacy concerns for the subject being monitored.

4.2.Location

In RF sensing-based systems,the subject's location and orientation have vital consequences on the performance.The disparities between location and orientation information may cause distinct variations in the wireless channel state information.Although some studies have examined different locations and orientations,there is still a need for further research to overcome this challenge.

4.3.Environmental impact

In real-time monitoring systems,the environment plays a vital role because it continuously interacts with RF-based technologies such as Wi-Fi sensing.Environments can cause a disruption in the form of moving doors,windows,furniture,and electronic devices.These disruptions in the environment can significantly affect the performance of wireless channels.Even though supervised machine learning classifiers can detect human activities with maximum accuracy,they cannot adopt a new environment by themselves.It is essential to utilize techniques such as reinforcement learning,which can be altered with changes in the environment.

4.4.Multiple subjects

To detect and monitor SARS-CoV-2 affected individuals using RF sensing technologies,most of the current studies have conducted experiments with either a single or limited number of subjects.Although RF sensing can effectively monitor a single subject once quarantined,it can be difficult to monitor several subjects simultaneously.Disruptions can be caused by the movement of several subjects.

4.5.Experiment constraints

To conduct any type of experiments,the accuracy of the data acquisition part must be significant.In health-related experiments,it is complicated to conduct tests on real patients.The data used by the researchers to conduct experiments are primarily generated by volunteers and not real subjects.This causes certain limitations because an actually affected patient might reveal distinct actions in comparison to the volunteers.Moreover,with the new variants of SARS-CoV-2,the symptoms may vary from subject to subject.

5.Future directions

In this paper,we discussed all the possible technologies(contact/non-contact)that can be effectively used to detect and monitor the symptoms of COVID-19.The most promising technology among all is based on RF sensing,which does not require any contact with the subject to be monitored.However,there are still some challenges associated with contact and non-contact techniques that need to be addressed in the future.

1)Camera-based technologies can detect the symptoms of COVID-19 by monitoring irregular respiratory rates.However,there are certain limitations associated with this approach,such as light dependency,privacy concerns,and a high computational power.In addition,camera-based technologies cannot categorically determine SARS-CoV-2 as a cause for individuals.In the future,it is recommended to design and develop a real-time model based on extensive experiments that can overcome the limitations caused by camera-based technology.

2)Ultrasound-based technology can be made portable by utilizing mobile devices.To identify the symptoms of COVID-19,ultrasound-based images of the lungs can be inspected using machine learning classifiers.For a future study,it is recommended to establish mobile device applications that can capture a lung ultrasound.This technique enables users to utilize mobile devices to detect and monitor abnormal symptoms.

3)X-ray and CT scanning technologies have revealed fine results for the detection of COVID-19.However,the major limitations of these technologies are portability and the risk of exposure to radiation.Thus,they cannot be widely used for screening patients with COVID-19.Although both of these technologies are highly precise,they still require the subject to be in a certain location where X-ray and CT scan technologies are available.The advantage of these technologies is that they provide highresolution images,and once trained by intelligent machine learning algorithms,they will be able to produce highly accurate results.It is recommended to conduct comprehensive experiments with large data sizes,which can eventually result in a more robust model.This will allow for the accurate and rapid detection of COVID-19 symptoms.

4)RF-based systems such as Wi-Fi sensing are inexpensive and reliable techniques for detecting,diagnosing,and monitoring the symptoms of COVID-19,such as abnormal respiratory and heart rates.The Wi-Fi-based sensing technology can be implemented using existing Wi-Fi devices available within hospitals and homes.RF-based technology has the potential to monitor subjects without any external human interaction,which is needed in the case of COVID-19.It is highly recommended to utilize RF sensing-based technologies in future research.

5)Most of the current research related to non-invasive healthcare for COVID-19 is based on supervised and semi-supervised machine learning techniques.With these techniques,the majority of research has shown promising results.Nevertheless,to develop an automated system with adaptability to the environment,techniques such as reinforcement learning must be considered in the future.

6)It is recommended to explore and conduct experiments on genuine multi-patient data in a real environment,rather than using data from healthy volunteers in the laboratory.

6.Conclusions

At the current stage,more than five million fatalities have been reported owing to SARS-CoV-2,and with the recently discovered novel SARS-CoV-2 Delta and Omicron variants,the mortality rate is expected to increase because existing vaccinations are not entirely effective against these variants.Wireless or non-contact technology is important,particularly during the COVID-19 pandemic,as they demand the least amount of participation from infected individuals and healthcare workers.In this paper,we presented a detailed review of COVID-19 and its prevention through contact/non-contact healthcare technologies,such as radio-frequency sensing.The non-contact technologies have the ability to terminate human-tohuman interaction,which is necessary to contain SARS-CoV-2 infections.Radio-frequency-based systems such as software-defined radio,radar,and Wi-Fi sensing are promising non-contact solutions that can be effectively utilized to detect,diagnose,and monitor COVID-19 symptoms,for example,unusual respiration in the form of shortness of breath.Moreover,we discussed state-of-art machine learning algorithms,including generative adversarial networks,and how they are exploited in healthcare-related applications.In addition,this study highlighted the limitations associated with non-contact technologies as well as potential future research directions.

CRediT author statement

Umer Saeed:Conceptualization,Methodology,Software,Validation,Formal analysis,Investigation,Data curation,Writing-Original draft preparation,Reviewing and Editing,Visualization;Syed Yaseen Shah:Validation,Formal analysis,Investigation;Jawad Ahmad:Validation,Formal analysis,Investigation;Muhammad Ali Imran:Validation,Formal analysis,Investigation;Qammer H.Abbasi:Conceptualization,Formal analysis,Resources;Syed Aziz Shah:Conceptualization,Methodology,Formal analysis,Investigation,Resources,Supervision.

Declaration of competing interest

The authors declare that there are no conflicts of interest.