Skip to main content
Sensors (Basel, Switzerland) logoLink to Sensors (Basel, Switzerland)
. 2020 Mar 6;20(5):1446. doi: 10.3390/s20051446

Thermal Model and Countermeasures for Future Smart Glasses

Kodai Matsuhashi 1, Toshiki Kanamoto 1, Atsushi Kurokawa 1,*
PMCID: PMC7085683  PMID: 32155820

Abstract

The market for wearable devices such as smart watches and smart glasses continues to grow rapidly. Smart glasses are attracting particular attention because they offer convenient features such as hands-free augmented reality (AR). Since smart glasses directly touch the face and head, the device with high temperature has a detrimental effect on human physical health. This paper presents a thermal network model in a steady state condition and thermal countermeasure methods for thermal management of future smart glasses. It is accomplished by disassembling the state by wearing smart glasses into some parts, creating the equivalent thermal resistance circuit for each part, approximating heat-generating components such as integrated circuits (ICs) to simple physical structures, setting power consumption to the heat sources, and providing heat transfer coefficients of natural convection in air. The average temperature difference between the thermal network model and a commercial thermal solver is 0.9 °C when the maximum temperature is 62 °C. Results of an experiment using the model show that the temperature of the part near the ear that directly touches the skin can be reduced by 51.4% by distributing heat sources into both sides, 11.1% by placing higher heat-generating components farther from the ear, and 65.3% in comparison with all high conductivity materials by using a combination of low thermal conductivity materials for temples and temple tips and high conductivity materials for rims.

Keywords: thermal management, wearable device, thermal modeling, smart glasses, thermal analysis

1. Introduction

Wearable devices have become popular as state-of-the-art electronic devices, such as smart watches, smart glasses, smart clothing, and fitness trackers, have been made commercially available for consumer and industrial uses. Currently, smart watches are the wearable device with the largest market size. However, smart glasses have also been released by many companies [1,2,3,4,5,6,7] and can be used for various purposes such as medical care, health, learning/education, and entertainment. Differences in the uses between the smart glasses and the wrist-worn wearables such as smart watches and fitness trackers come from the differences between wrists and eyes. Smart glasses have advantages that users can look at various things such as maps (e.g., current location) and movies with augmented reality (AR) through a display, and their eye and facial movements can be recognized for medical care, health monitoring, and dozing prevention. In the future, heat issues will become more serious because smart glasses will require faster central processing unit (CPU) and larger memory to deal with enormous amounts of data. Therefore, thermal design is becoming one of the key technologies for future wearable devices.

Various techniques for utilizing smart glasses have been developed by many researchers. For medical uses, techniques have been presented for clinical and surgical applications [8], medical emergency situations [9], and disaster medicine [10]. For recognition and interface, techniques have been presented for head gestures [11], face detection [12], eye movements [13], user authentication [14], estimation of respiration rate [15], speech interaction with eye blinking detection [16], context-aware lightning control [17], distance learning [18], and indoor localization [19], drowsiness and fatigue detection to increase road safety [20], countermeasures to phishing attacks [21], gait aid for Parkinson’s disease patients [22], contextually-aware learning in physics experiments [23], and guiding for visually impaired users [24]. Some techniques regarding thermals have been presented such as 3D thermal model reconstruction based on image-based modeling using smartphone sensors [25], design of an oven utilizing radiative heat transfer for smart phone panels [26], thermal management systems for civil aircraft engines [27], and thermal properties of glasses [28]. A system for low-power smart glasses has been presented [29]. However, there have been only a few technical reports about the heat of smart glasses [30,31]. Smart glasses directly touch human skin. The heat of the smart glasses is capable of causing burns of the skin. Thermal management of smart glasses is essential for physical health safety and comfortable use. Current smart glasses consume 1 to 3 W under various workloads [30]. We presented thermal countermeasures of smart glasses [31] and discussed only the maximum temperature in the integrated circuits that generate heat. Only a heat generating component was used and was placed on a limited space. Moreover, the temperature of the device surface touching skin that may cause a low-temperature burn even at 43 °C [32] was not analyzed. In Reference [33], we presented a thermal network model for thermal designs of future smart glasses. In this paper, we provide more detailed resistance models for all parts of devices, thermal properties that were used in the analysis, a difference in temperatures due to the position on the temple, more detailed explanations for each figure, motivations for this work, and discussions.

Smart glasses mainly comprise the electronic device body, and display a liquid crystal on the silicon (LCOS) device [34] and battery. The device body consists of many heat generating electronic components, including processors, memory, wireless modules, and power management integrated circuits (ICs). In accordance with a design concept, the device body is mounted to various places [35]. We simplify the device body as follows: IC packages are reconstructed by using three layers (heat generating, upper, and lower) in the vertical direction, and several packages are arranged horizontally on a printed circuit board (PCB). Thereby, the simplified device body can be re-sized and consume power in a non-uniform manner. By making a thermal resistance model of the state wearing smart glasses, temperatures at each part can be calculated. The thermal model can be used for various types of smart glasses such as glasses’ structures, materials, heat sources, and layouts of the components.

Smart glasses include various functions such as a camera, video, map, translation, weather information, and search in real-world environments, augmented reality, and virtual reality (VR). As the demand for higher precision and higher speed increases, power consumption also increases. Moreover, power density increases with higher integration (including 3D ICs). Therefore, thermal management is very important for future smart glasses. Systems and design methodologies of smart glasses have been proposed [29,36,37,38,39]. Among them, thermal management has become one of the crucial issues in AR and VR processing [30,31] where image screens as well as image sensors have been equipped. Even the current high definition (HD) smart glasses consume 1 to 3 W [30]. Upcoming advanced features including 4K/8K resolution processing are expected to need additional power to render the images [40,41,42,43,44,45]. This will require more organized thermal management with overviewing packages, boards, and systems as well as heating processor chips [46]. Motion detection is another power consuming factor. Even the current artificial intelligence (AI)-based moving object identification from the sensor images also requires up to 3W of power. Additionally, the expected features in the near future such as human detection will impose an extra power expense. Furthermore, promising smart glasses need to communicate with external networks and transfer large amounts of the processed data. The leading 5G communications technologies reduce transmission power in exchange for consuming additional circuit power due to the required hardware expansions including signal processing to establish low-power mmWave communications at extremely high frequencies [47].

In the viewpoint of the safety and comfort of smart glasses, there are several issues such as weight [48,49], battery [50,51], AR/VR [52,53,54], and heat [31,33]. In Reference [48], regarding weight issues, the effect of weight balance for shutter glasses in terms of subjective discomfort and physical load on the nose has been investigated [48] and a user discomfort on the different wearing mode glasses with different support points has been presented [49]. With respect to battery safety, an extremely safe and wearable solid-state zinc ion battery has been fabricated [50] and a quasi-solid-state aqueous rechargeable lithium-ion battery with outstanding stability, flexibility, safety, and breathability toward various wearable electronics has been reported [51]. AR/VR include many problems such as display size, resolution, computing capability, negative effects in some people with autism spectrum disorder, and architecture/server/network issues [52,53,54]. Moreover, it is necessary to ensure the safety and comfort due to heat generation [31,33] since smart glasses are worn on the face/head of the human body for use.

The main sources of heat generation of smart glasses come from power consumptions of ICs. Thermal countermeasures within IC chips must be mainly low power designs and have a limit. For smart glasses, the temperature not only in chips for circuit operation but also on the device surface touching the skin is important for preventing low temperature burns. Thermal management of smart glasses is required to determine various conditions such as arrangements of heat generating components and materials of parts. Although a commercial thermal solver can obtain high accuracy results, it has the disadvantages of a complex structure input, long processing time, and unsuitability for parameter optimization. Therefore, we have developed a thermal network model to improve design efficiency. The model has been devised for not only current products but also future products. To deal with as wide a variety of smart glasses as possible, the entire thermal network is divided into several parts and is expressed by a block diagram (as described in Section 3.1). In addition, each block is removable and replaceable. We use virtual smart glasses composed of some parts but not real smart glasses so that the entire thermal network can be applied to various types of smart glasses.

Additionally, using the proposed model, we present thermal countermeasures of smart glasses for ensuring the health safety and comfortable use. We clarify the following facts: (1) If high thermal conductivity materials like Al are used for a grasses frame, the whole temperature can be reduced, but a low temperature burn may be caused near an ear. (2) If low conductivity materials like cellulose acetate (CA) plastic are used, temperature near an ear can be reduced, but the surface temperature of the device body rises. (3) When Al is used, by locating higher power density, ICs near the lens, temperature at the ear decreases but not sufficiently. (4) When the device body is divided and placed on both sides, temperatures decrease as a whole. From these results, we found that the best solution is to use plastic for the temples and temple tips for hanging on the ears and Al for the other parts of the frame in order to locate the device body to the lens side and divide it into both sides as much as possible.

The rest of the paper is organized as follows. Section 2 describes the details of smart glasses assumed in this work. Section 3 presents thermal network models for the smart glasses. Section 4 shows experimental results for thermal countermeasures. Section 5 presents discussions of this work. Section 6 concludes this paper.

2. Physical Structural Model of Smart Glasses

In this section, the smart glasses assumed in this work are described. First, an overview of the smart glasses is shown. Next, a physical structural model with dimensions is presented. Lastly, the heat generating components are discussed.

2.1. Overview of Smart Glasses

Figure 1 shows an overview of a basic structure of the smart glasses used in this study. In the basic structure of smart glasses, batteries are connected to device bodies. Device body cases are mounted on the temples of both sides. Electronic components are installed in the right device body, and displays are set in front of lenses.

Figure 1.

Figure 1

Overview of smart glasses used in this paper.

2.2. Structure of Smart Glasses

Table 1 lists thermal properties of the smart glasses used in our basic analysis. Figure 2 shows dimensions of a face/head model. For a face model, we referred to a model of human thermoregulation [55] and used a simpler model. The skin thickness was 2 mm. The core and ambient temperatures were set to 36.6 and 25 °C, respectively. Figure 3 shows dimensions of the smart glasses.

Table 1.

Thermal properties of smart glasses.

Parts Material Abbreviation Thermal Conductivity (W/mK)
Frame Aluminum Al 236
Cellulose acetate CA 0.2
Display Polycarbonate PC 0.19
Lens Polycarbonate PC 0.19
Nose pad Cellulose propionate CP 6
Battery --- --- 15

Figure 2.

Figure 2

Overview of smart glasses used in this paper: (a) front view and (b) top view.

Figure 3.

Figure 3

Dimensions (in mm) of smart glasses: (a) front view, (b) side view, and (c) top view.

2.3. Heat Generating Components

In general, heat generating components of smart glasses include processors, memories (e.g., DDR4 SDRAM, and NAND flash), audio ICs, wireless modules, power management ICs, and LCOS devices. Figure 4 illustrates an example of a cross-sectional structure of an IC package with the flip-chip technology. Table 2 lists an example of the thermal property and thickness of each layer. Figure 5 illustrates an example of a cross-sectional structure of an LCOS device. Table 3 lists an example of the thermal property and size. The heat generating components are composed of various structures and thermal properties.

Figure 4.

Figure 4

IC package (flip-chip package).

Table 2.

Thermal properties and size of IC package.

Component Thermal Conductivity (W/mK) Thickness (mm)
Mold 0.88 ---
Metal layer 98 0.003
Device layer 149 0.001
Si substrate 149 0.1
Bumps 60 0.08
Package substrate 149 0.2
Balls 33 0.35
PCB 13 0.8
Copper plane 401 0.03

Figure 5.

Figure 5

Liquid crystal on the silicon (LCOS) device.

Table 3.

Thermal properties and size of liquid crystal on the silicon (LCOS) device.

Component Thermal Conductivity (W/mK) x, y, z (mm)
Glass substrate 0.8 8, 8, 0.5
Liquid crystal layer 0.15 8, 8, 0.005
Copper plane 401 14, 13, 0.03
PCB 13 14, 13, 0.8

In this scenario, we model the heat generating components by applying them to various types of smart glasses. The simple physical model for an equivalent circuit of one heat generating component is approximated with upper and lower layers, as shown in Figure 6.

Figure 6.

Figure 6

Simple model of the heat generating component.

In this work, in the device body at one side, we assumed the use of four IC packages shown in Figure 4 with conditions in Table 2 and one LCOS device shown in Figure 5 with conditions in Table 3. Figure 7 shows the arrangement of five heat generating components. A thermal resistance network for the device body with their components is constructed by using the simple physical model in Figure 6.

Figure 7.

Figure 7

Layout of heat generating components.

2.4. Structures and Materials of Components

In the future, smart glasses with various shapes, size, materials, and arrangements of components must be produced. Size and materials are basically modifiable because they can be applied by changing thermal resistance values.

Although this paper uses rectangular lithium polymer (LiPo) batteries, the shapes and materials of batteries are not greatly restricted because a battery is modeled simply. In this case, thermal resistance circuits for a cylindrical battery are discussed. Figure 8a shows a cross section of a cylindrical battery. A cylinder is expressed with three thermal resistances [56,57]. The inner liquid fluid in a battery is covered by a frame. The heat conduction resistance value for the internal cylinder (inner liquid fluid) can be calculated from the equation below.

R1=ln(r1)2πkl (1)

where r1 is the internal radius, k is the thermal conductivity of the material, and l is the length of a cylinder. The heat conduction resistance value for an outer frame can be calculated from the equation below.

R2=ln(r2/r1)2πkl (2)

where r2 is the outer radius. The heat convection resistance value from a frame surface can be calculated from Equation (3) below.

Rc=1hc2πr2l (3)

where hc is the heat transfer coefficient. In this way, all the necessary resistances can be obtained. By assigning them the model of rectangular batteries (i.e., by converting a circle into a rectangle as shown in Figure 8b), a cylindrical battery is also applicable.

Figure 8.

Figure 8

Thermal modeling in cross sections for cylindrical battery: (a) thermal resistance circuit and (b) conversion of the circle to rectangle.

For modeling heat generating components, we used the PCB with a flip chip-ball grid array (FC-BGA) package shown in Figure 4 as an example. However, types of packages (e.g., wafer level package (WLP)) and boards are not greatly restricted because a heat generating component is modelled very simply as a structure shown in Figure 6. The idea of the thermal modeling presented in this paper can use not only rigid boards but also flexible substrates [58,59,60] such as polyimide and polyethylene terephthalate (PET). However, if such flexible circuits are used, the model of device body parts should be replaced with a more appropriate thermal model.

3. Thermal Network Model

In this section, we present a thermal network model for smart glasses in a steady state condition. Based on a block diagram for an entire thermal network, thermal models for each block are presented.

3.1. Block Diagram for Entire Thermal Network

A block diagram for the entire thermal network of smart glasses is shown in Figure 9. By representing each block by the equivalent thermal resistance circuit, our model can be applied to various types of smart glasses. Designers can remove or replace blocks when necessary. In this paper, a thermal model of each block is constructed by a representative example. By changing the thermal model of each block, smart glasses under various conditions can be expressed.

Figure 9.

Figure 9

Block diagram for entire thermal network of smart glasses.

3.2. Basic Thermal Resistance Model

For a thermal resistance model for heat conduction of one cell (called a thermal cell), we basically use the three-dimensional (3D) equivalent resistance model shown in Figure 10a. The heat conduction resistance value in each segment can be calculated from the equation below.

R=lkS (4)

where l is the length of a heat transfer path, k is the thermal conductivity of the material, and S is the cross-sectional area. The natural convection heat transfer coefficient value for air can be calculated from the equation below.

hc=(k4×g×β×Prη2)0.25×K×(ΔTL)0.25 (5)

where g is the acceleration of gravity, β is the air thermal expansion coefficient, Pr is the Prandtl number, η is the air kinematic viscosity, K is the coefficient in the vertical or horizontal direction, ΔT is the temperature difference, and L is the characteristic length [61]. The heat convection resistance value can be calculated from the equation below.

Rc=1hcS (6)

where S is the heat dissipation area. The convection heat transfer coefficients for the top, bottom, and side are distinguished, as shown in Figure 10b. The thermal resistance model for each part is created by setting thermal cells in heat transfer paths. The number of thermal cells depends on heat flow rates on the heat transfer path. The heat convection resistances are connected to the thermal cells in contact with ambient air. The ambient temperature is connected to a circuit ground.

Figure 10.

Figure 10

Thermal resistance circuits: (a) 3D heat conduction resistance model for one thermal cell, and (b) heat convection resistance model with convection heat transfer coefficients.

3.3. Thermal Model of the Temple

A temple of the glasses is divided into four cells to enable the connections with four heat generating components of a device body (see Figure 11). In this case, the method to derive resistance values of the thermal model is described in detail. Figure 12 shows thermal resistance circuits with the structure of a glasses’ temple. The temple is divided into four thermal cells. A thermal cell consists of the 3D heat conduction resistance model in Figure 10a, which has six resistances in three dimensions from the center of the thermal cell. For simplification, series resistance is expressed by one resistance. Heat conduction resistance values are calculated by substituting the length, thermal conductivity of the material, and area into Equation (4). For example, R3 in the vertical direction of one cell is 0.25 K/W from l = 2.5 mm, k = 236 W/mK, and S = 85/4 × 2 mm2. Table 4 summarizes the heat conduction resistance values for a temple.

Figure 11.

Figure 11

Thermal model of temple (at right side).

Figure 12.

Figure 12

Thermal resistance circuits with a physical structure of the temple.

Table 4.

Heat conduction resistance values of the temple.

Variable l (mm) S (mm2) Thermal Conductivity (W/mK) Thermal Resistance (K/W)
R1, R7 10.625 10 236 4.50
R 2 1 106.25 236 0.04
R 3 2.5 42.5 236 0.25
R4, R5, R6 21.25 10 236 9.00

The heat dissipations are set to three points at the back, top, and bottom of each cell of a temple. Heat convection resistance values are calculated by using Equations (5) and (6). The thermal profile for air shown in Table 5 is used for Equation (5). The characteristic lengths for heat dissipation areas use the short side for the horizontal surface and height for the vertical surface. The temperature difference is obtained by iterating the temperature calculation. The number of iterations used in this paper is three. As a concrete example to calculate the resistance in the vertical direction in one cell of a temple, the characteristic length is 2 mm, the heat dissipation area is 21.25 mm × 2 mm, and K is 0.52. When the temperature difference is 10 °C, the heat convection resistance becomes Rc = 2.14 × 103 K/W. Table 6 summarizes the heat convection resistance values of a temple. The top and bottom of a temple are connected with the bottom of a temple tip and with the rim, respectively.

Table 5.

Thermal profile for air.

Parameter of Air Value
Thermal conductivity (W/mK) 2.625 × 10−2
Acceleration of gravity (m/s2) 9.80665
Thermal expansion coefficient (1/K) 3.247 × 10−3
Prandtl number 7.268 × 10−1
Kinematic viscosity (m2/s) 1.655 × 10−5
K in the vertical direction 0.56
K in the lower horizontal direction 0.26
K in the upper horizontal direction 0.52

Table 6.

Heat convection resistance values of the temple.

Variable l (mm) S (mm2) K Thermal Resistance (K/W)
R8, R11, R14, R17 5 106 0.56 1.0 × 103
R9, R12, R15, R18 2 42.5 0.26 4.29 × 103
R10, R13, R16, R19 2 42.5 0.52 2.14 × 103

3.4. Thermal Model of Electronic Device Body

Figure 13 shows a thermal model around a heating component, which is composed of thermal resistances for each layer in the vertical direction and a heat source connected in the center of a heat generation layer. The heat source is given by power dissipated by a heat generating component. A power consumption value (in Watt) is given to the heat source. A thermal model of an electronic device body that incorporates five heat generating components is shown in Figure 11. It is a model for the device body of the right side. The device body is composed of heat generating components, PCBs, copper planes, device body cases, and a projector. Their parts are replaced by thermal cells. For example, a PCB is replaced with four thermal cells. The thermal resistance values in each thermal cell are calculated from the length, thermal conductivity, and cross-sectional area of a cell, as shown in Equation (4). The heat dissipations are set to four points at the front, back, top, and bottom of each heat generating component. A heat generating component represented in Figure 6 is modelled to the equivalent thermal resistance circuit in Figure 14. The heat source is located in the center with a current source symbol. Five heat generating components are arranged in the body case.

Figure 13.

Figure 13

Thermal model around the heating component.

Figure 14.

Figure 14

Thermal model of the device body (on the right side).

3.5. Thermal Model of Temple Tip

A temple tip of the glasses is modelled as one thermal cell. Figure 15 shows a thermal model for a temple tip of the right side. The temple tip is expressed by the 3D equivalent resistance model shown in Figure 10a. The heat dissipations to an air are set to three points at the top, bottom, and back of a temple tip.

Figure 15.

Figure 15

Thermal model of temple tip (on the right side).

3.6. Thermal Model of Battery

For a battery model, the inner liquid fluid and outer frame are represented by thermal resistances. Figure 16 shows thermal resistance circuits of a battery structure. R1 is the resistance to connect with a device body, R2 to R8 are the resistances of a frame, R9 to R11 are the resistances of the inner parts, and R12 to R15 are the heat convection resistances. Figure 17 shows the thermal model of the battery on the right side. The number of thermal cells used for a battery in this paper is seven. The heat dissipations are set to five points at the front, back, top, bottom, and tip of each cell of a battery.

Figure 16.

Figure 16

Thermal resistance circuits with a physical structure of the battery: (a) zy direction, (b) zx direction, and (c) xy direction.

Figure 17.

Figure 17

Thermal model of the battery (on the right side).

3.7. Thermal Model of Lens and Rim

A lens is represented by a two-dimensional thermal resistance model, and the rim of the lens frame is represented by a one-dimensional thermal resistance model. The lens and rim are divided into three parts: lens, upper rim, and lower rim. Three thermal cells are used. Figure 18 shows the model of the lens and rim of the right side. The heat dissipations are set to eight points at the front and back of a lens and the upper front, back, and top and the lower front, back, and bottom of a rim. The temperature of a nose pad on the nose is represented by T109. The node (T109) is connected with a face part.

Figure 18.

Figure 18

Thermal model of the lens and rim (on the right side).

3.8. Thermal Model of the Face Part

Figure 19 shows a thermal model of a face for smart glasses. The face part is expressed by one thermal cell. The center node is set to 36.6 °C. R1 and R2 represent the thermal resistances of the face skin. The side and bottom of the face part are connected with the temple tip nose pads, respectively.

Figure 19.

Figure 19

Thermal model of the face part.

4. Experimental Results

We first verify the validity of our thermal model. Figure 20 shows a histogram in temperature differences between results obtained by our model and a thermal solver [62]. The absolute errors were almost within a few degrees. This is the result under the conditions that five heat generating components are placed at one side only and the power consumptions are uniform and 5 W in the total.

Figure 20.

Figure 20

Error distribution for all nodes of the thermal network model.

Next, we perform thermal analysis using the proposed model. Some countermeasures to reduce temperatures are shown in this section. It is important to reduce the surface temperature of smart glasses for more physical health safety and comfortable use.

Figure 21 illustrates that heat sources (a) were placed on one side only and (b) were divided into both sides. Those are examples of conditions in which the total power consumption is 5 W and the power consumption is uniform. Figure 22 shows differences in temperatures when the device body was set to (a) one side only and to (b) both sides. In the figure, “HG” means the highest temperature in heat generating components, “DB” means the temperature on the surface of the device body, “Temple” means the temperature in the center of the temple frame, “Ear” means the temperature of the frame surface where the glasses frame is on the ear, and “Nose” means the temperature of a nose pad. In their parts, the temperature of the “Ear” and “Nose” are very important since they directly touch the skin. For example, under the condition of the total power consumption of 5 W, when the device body was set to one side only, the temperatures on the back side of the temple and the ear are 60.6 and 51.0 °C, respectively. On the other hand, when the device body was set to both sides, the temple and ear temperatures were 48.6 and 43.6 °C, respectively. By distributing the device body (heat generating components), the temperature rising to the ambient temperature of 25 °C can be reduced by 33.6% and 29.4%. The difference of the ear temperature from the core temperature of 36.6 °C is reduced by 51.4%. As seen from Figure 22, the temperature growths can be significantly suppressed by distributing heat sources regardless of total power consumption.

Figure 21.

Figure 21

Illustration of heat sources: (a) one side and (b) both sides (example of total power of 5 W).

Figure 22.

Figure 22

Temperature differences of heat sources: (a) one side and (b) both sides.

Figure 23 illustrates the conditions in which power consumptions are not uniform and heat sources were placed at one side only. Figure 24 shows temperature results at each part when power consumptions are uniform, in descending order, and in ascending order. The temperatures of “Ear” were 51.0, 49.4, and 52.7 °C (temperature differences from the core temperature of 36.6 °C were 14.4, 12.8, and 16.1 °C) for uniform, descending order, and ascending order. The descending order can reduce a temperature rise by 11.1% compared with uniform power consumptions. Therefore, the temperature of the part near the ear that directly touches the skin can be reduced when power consumptions of heat generating components are placed in descending order.

Figure 23.

Figure 23

Device body with power consumptions in descending order at one side.

Figure 24.

Figure 24

Effect of frame materials on temperature.

Figure 25 illustrates the position on the temple in the x direction. Figure 26 shows the temperatures at each position when power consumptions are uniform in descending order and in ascending order. For example, at 55.8 mm, temperatures for a uniform, descending order, and an ascending order are 58.6, 56.1, and 61.4 °C. The descending order is superior in that it can reduce the temperature near the ear.

Figure 25.

Figure 25

Illustration of the position on the temple.

Figure 26.

Figure 26

Difference in temperatures due to a position on the temple.

Figure 27 illustrates differences in the frame materials, where (a) is the all-Al frame, (b) is the all-CA frame, and (c) is the CA temples and temple tips and Al rims. Figure 28 depicts that Al greatly reduces temperatures of “HG,” “DB,” and “Temple,” whereas CA extremely raises the temperatures. The reason is thermal conductivity of Al is much higher than that of CA. However, the temperature of “Ear” is highest (51.0 °C) when Al was used but lowest (41.6 °C) when Al and CA were used. The temperature differences from the core temperature of 36.6 °C were 14.4 and 5.0 °C. The combination can suppress a temperature rise by 65.3% compared with Al only. For parts directly contacting the body, we found that a combination of CA temples and temple tips and Al rims is the best. The result obtained by a combination of Al and CA can satisfy the limit temperature (43 °C), which does not cause a low temperature burn [32]. Therefore, the method will be effective for the physical health safety and comfortable use of future smart glasses.

Figure 27.

Figure 27

Illustration of frame materials: (a) Al, (b) CA, and (c) CA for the temple and temple tip and Al for others.

Figure 28.

Figure 28

Effect of frame materials on temperature.

5. Discussions

5.1. Validity of Thermal Network Model

The accuracy of the proposed thermal network model was verified by a finite element method (FEM)-based 3D thermal solver. Figure 20 in Section 4 shows the result of errors at all nodes when power consumption was 5 W. Figure 29 shows temperature distributions obtained by a solver when power consumption varied. Figure 30 compares the model and a commercial solver in the temperature at the main nodes when power consumptions were 1, 5, and 10 W. We can see that differences in temperature between the model and solver hardly occur.

Figure 29.

Figure 29

Temperature distributions when power consumptions are (a) 1 W, (b) 5 W, and (c) 10 W.

Figure 30.

Figure 30

Comparison of results by the model with results given by the solver.

Simulation-based design and optimization of an accelerometer subject to thermal loads has been presented [63]. As verification of thermal simulations, comparisons of simulations and measurements in smartphones, a power semiconductor device, and a tablet device have been reported [60,64,65,66,67]. The simulation results agree with the measurement results. This means that if data to be inputted into a solver are near real data, the model corresponding to simulation results can reproduce temperature characteristics of real products. Thus, the verification of the proposed model by measurements is our future plan.

This paper presents a thermal network model in a steady-state condition for the entire thermal network of smart glasses. There are two types of thermal analysis: steady-state (or static) and transient (or dynamic). In this work, we are interested in the temperatures in the steady state rather than ones in transient time since smart glasses are designed to be worn for a long time. Steady-state thermal simulation results have been presented [60,64,65,66,67].

In general, advanced systems operate in the range of the ns to μs-order because of circuit frequencies of MHz to GHz-order. Power consumptions also change within the same range. On the other hand, time until the temperature of each node of smart glasses used in this work is stabilized in in the range of the ms to min-order. In steady-state thermal analysis, a constant power (e.g., average power) can be used [60,66,67].

5.2. Advantages of Thermal Network Model

The previous works related to this paper and the advantages of the proposed thermal network model are discussed in this sub-section. There have been several technical reports of thermal modeling for electrical and electric equipment [62,65,67]. These methods can be used for thermal simulations. The thermal resistance network is commonly composed of thermal cells with thermal conduction resistances, convection heat transfer coefficients, and heat sources. However, the thermal resistance network is specialized for smart glasses and is very simple because the number of elements is reduced. To the best of our knowledge, no technical report of thermal models and countermeasures for smart glasses exists. Moreover, thermal simulations of smart glasses have hardly been reported.

The thermal network model was implemented in Microsoft Visual Basic. The advantages of using the thermal network model are speed and convenience. The former speed is, for an example, that the runtime taken by using the thermal network model was about 11 sec, whereas that taken by using a thermal solver was about 337 sec. The model is, thus, more than 30 times faster. All experiments were run on an Intel Xeon CPU X5687 with 3.6 GHz. The latter (convenience) is that the model can easily estimate effects of structures and materials of parts on temperature. Moreover, by using the model, designers can optimize various parameters of future smart glasses.

6. Conclusions

In this paper, we have presented a thermal network model for thermal designs of future smart glasses. Thermal countermeasures for ensuring more safety and comfort have also been presented. Thermal analysis using the model demonstrates that plastic should be used for a part of the temples and temple tips for hanging on the ear. Al should be used for the other parts of the frame, and the device body should be located on the lens side and divided into both sides as much as possible.

Acknowledgments

The JSPS KAKENHI Grant Number JP17K00070 supported this work.

Author Contributions

Investigation and data curation, K.M., A.K., and T.K. Validation and methodology, K.M. and A.K. Writing—review and editing, A.K., K.M., and T.K. Supervision, A.K. and T.K. Project administration, A.K. All authors have read and agreed to the published version of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Lee L.-H., Hui P. Interaction methods for smart glasses: A survey. IEEE Access. 2018;6:28712–28732. doi: 10.1109/ACCESS.2018.2831081. [DOI] [Google Scholar]
  • 2.Syberfeldt A., Danielsson O., Gustavsson P. Augmented reality smart glasses in the smart factory: Product evaluation guidelines and review of available products. IEEE Access. 2017;5:9118–9130. doi: 10.1109/ACCESS.2017.2703952. [DOI] [Google Scholar]
  • 3.Amft O., Wahl F., Ishimaru S., Kunze K. Making regular eyeglasses smart. Pervasive Comput. 2015;14:32–43. doi: 10.1109/MPRV.2015.60. [DOI] [Google Scholar]
  • 4.Rallapalli S., Ganesan A., Chintalapudi K., Padmanabhan V.N., Qiu L. Enabling physical analytics in retail stores using smart glasses; Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom’14); Maui, HI, USA. 7–11 September 2014; pp. 115–126. [Google Scholar]
  • 5.Niemöller C., Metzger D., Fellmann M., Thomas D. Shaping the future of mobile service support systems—Ex-ante evaluation of smart glasses in technical customer service processes; Proceedings of the INFORMATIC 2016; Klagenfurt, Austria. 26–30 September 2016; pp. 753–767. [Google Scholar]
  • 6.Klinker K., Berkemeier L., Zobel B., Wüller H., Huck-Fries V., Wiesche M., Remmers H., Thomas O., Krcmar H. Structure for innovations: A use case taxonomy for smart glasses in service processes; Proceedings of the Multikonferenz Wirtschaftsinformatik 2018; Luneburg, Germany. 6–9 March 2018; pp. 1599–1610. [Google Scholar]
  • 7.Due B.L. The future of smart glasses: An essay about challenges and possibilities with smart glasses. Work. Pap. Interact. Commun. 2014;1:1–21. [Google Scholar]
  • 8.Mitrasinovic S., Camacho E., Trivedi N., Logan J., Campbel C., Zilinyi R., Lieber B., Bruce E., Taylor B., Martineau D., et al. Clinical and surgical applications of smart glasses. Technol. Health Care. 2015;23:381–401. doi: 10.3233/THC-150910. [DOI] [PubMed] [Google Scholar]
  • 9.Schaer R., Melly T., Muller H., Widmer A. Using smart glasses in medical emergency situations, a qualitative pilot study; Proceedings of the 2016 IEEE Wireless Health (WH); Bethesda, MD, USA. 25–27 October 2016; pp. 54–58. [Google Scholar]
  • 10.Follmann A., Ohligs M., Hochhausen N., Beckers S.K. Technical support by smart glasses during a mass casualty incident: A randomized controlled simulation trial on technically assisted triage and telemedical app use in disaster medicine. J. Med. Internet Res. 2019;21:1–10. doi: 10.2196/11939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Yi S., Qin Z., Novak E., Yin Y., Li Q. GlassGesture: Exploring head gesture interface of smart glasses; Proceedings of the 35th Annual IEEE International Conference on Computer Communications (INFOCOM); San Francisco, CA, USA. 10–14 April 2016; pp. 1–9. [Google Scholar]
  • 12.Casado C.A., López M.B., Holappa J., Pietikaïnen M. Face detection and recognition for smart glasses; Proceedings of the 2015 International Symposium on Consumer Electronics (ISCE); Madrid, Spain. 24–26 June 2015; pp. 1–2. [Google Scholar]
  • 13.Kim Y., Kaongoen N., Jo S. Hybrid-BCI smart glasses for controlling electrical devices; Proceedings of the 54th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE); Hangzhou, China. 28–30 July 2015; pp. 1162–1166. [Google Scholar]
  • 14.Peng G., Zhou G., Nguyen D.T., Qi X., Yang Q., Wang S. Continuous authentication with touch behavioral biometrics and voice on wearable glasses. IEEE Trans. Hum. Mach. Syst. 2017;47:404–416. doi: 10.1109/THMS.2016.2623562. [DOI] [Google Scholar]
  • 15.Ruminski J., Bujnowski A., Czuszynski K., Kocejko T. Estimation of respiration rate using an accelerometer and thermal camera in eGlasses; Proceedings of the 2016 Federated Conference on Computer Science and Information Systems (FedCSIS); Gdansk, Poland. 11–14 September 2016; pp. 1431–1434. [Google Scholar]
  • 16.Firouzian A., Kashimoto Y., Asghar Z., Keranen N., Yamamoto G., Pulli P. Speech interface dialog with smart glasses; Proceedings of the 2017 15th International Conference on Emerging eLearning Technologies and Applications (ICETA); Stary Smokovec, Slovakia. 26–27 October 2017; pp. 1–6. [Google Scholar]
  • 17.Zhao N., Aldrich M., Reinhart C.F., Paradiso J.A. A multidimensional continuous contextual lighting control system using Google Glass; Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built Environments (BuildSys’15); Seoul, Korea. 4–5 November 2015; pp. 235–244. [Google Scholar]
  • 18.Spitzer M., Nanic I., Ebner M. Distance learning and assistance using smart glasses. Educ. Sci. 2018;8:21. doi: 10.3390/educsci8010021. [DOI] [Google Scholar]
  • 19.Zhang Y., Hu W., Xu W., Wen H., Chou C. NaviGlass: Indoor localisation using smart glasses; Proceedings of the 2016 International Conference on Embedded Wireless Systems and Networks (EWSN); Graz, Austria. 15–17 February 2016; pp. 205–216. [Google Scholar]
  • 20.Chang W.-J., Chen L.-B., Chiou Y.-Z. Design and implementation of a drowsiness-fatigue-detection system based on wearable smart glasses to increase road safety. IEEE Trans. Consum. Electron. 2018;64:461–469. doi: 10.1109/TCE.2018.2872162. [DOI] [Google Scholar]
  • 21.Ndibwile J.D., Luhanga E.T., Fall D., Miyamoto D., Blanc G., Kadobashi Y. An empirical approach to phishing countermeasures through smart glasses and validation agents. IEEE Access. 2019;7:130758–130771. doi: 10.1109/ACCESS.2019.2940669. [DOI] [Google Scholar]
  • 22.Ahn D.H., Chung H., Lee H.-W., Kang K., Ko P.-W., Kim N.S., Park T. Smart gait-aid glasses for parkinson’s disease patients. IEEE Trans. Biomed. Eng. 2017;64:2394–2402. doi: 10.1109/TBME.2017.2655344. [DOI] [PubMed] [Google Scholar]
  • 23.Kuhn J., Lukowicz P., Hirth M., Poxrucker A., Weppner J., Younas J. gPhysics—Using smart glasses for head-centered, context-aware learning in physics experiments. IEEE Trans. Learn. Technol. 2016;9:304–317. doi: 10.1109/TLT.2016.2554115. [DOI] [Google Scholar]
  • 24.Bai J., Lian S., Liu Z., Wang K., Liu D. Smart guiding glasses for visually impaired people in indoor environment. IEEE Trans. Consum. Electron. 2017;63:258–266. doi: 10.1109/TCE.2017.014980. [DOI] [Google Scholar]
  • 25.Yang M.-D., Su T.-C., Lin H.-Y. Fusion of infrared thermal image and visible image for 3D thermal model reconstruction using smartphone sensors. Sensors. 2018;18:2003. doi: 10.3390/s18072003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Gu M.-J., Yang S., Wu Y.-C., Chiu C.-J., Chen Y.-B. Designing a thermal radiation oven for smart phone panels. Inventions. 2018;3:36. doi: 10.3390/inventions3020036. [DOI] [Google Scholar]
  • 27.Jafari S., Nikolaidis T. Thermal management systems for civil aircraft engines: Review, challenges and exploring the future. Appl. Sci. 2018;8:2044. doi: 10.3390/app8112044. [DOI] [Google Scholar]
  • 28.Zhang M., Wen H., Pan X., Yu J., Shao H., Ai F., Yu H., Tang M., Gai L. Study on upconversion and thermal properties of Tm3+/Yb3+co-doped La2O3-Nb2O5-Ta2O5 glasses. Materials. 2018;11:1352. doi: 10.3390/ma11081352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hong I., Bong K., Shin D., Park S., Lee K.J., Kim Y., Yoo H.-J. A 2.71 nJ/pixel gaze-activated object recognition system for low-power mobile smart glasses. IEEE J. Solid-State Circuits. 2016;51:45–55. doi: 10.1109/JSSC.2015.2476786. [DOI] [Google Scholar]
  • 30.LiKamWa R., Wang Z., Carroll A., Lin F.X., Zhong L. Draining our glass: An energy and heat characterization of Google Glass; Proceedings of the 5th Asia-Pacific Workshop on Systems (APSys’14); Beijing, China. 25–26 June 2014; pp. 1–7. [Google Scholar]
  • 31.Matsuhashi K., Kurokawa A. Thermal countermeasures of glass wearable devices; Proceedings of the IEEE International Conference on Consumer Electronics-Taiwan (IEEE 2019 ICCE-TW); Yilan, Taiwan. 20–22 May 2019. [Google Scholar]
  • 32.Han A.Q. Thermal management and safety regulation of smart watches; Proceedings of the 2016 15th IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm); Las Vegas, NV, USA. 31 May–3 June 2016; pp. 939–944. [Google Scholar]
  • 33.Matsuhashi K., Kurokawa A. Thermal resistance model and analysis for future smart glasses; Proceedings of the 14th International Microsystems, Packaging, Assembly and Circuits Technology Conference (IMPACT 2019); Taipei, Taiwan. 23–25 October 2019. [Google Scholar]
  • 34.Zhang Z., You Z., Chu D. Fundamentals of phase-only liquid crystal on silicon, LCOS devices. Light Sci. Appl. 2014;3:1–10. doi: 10.1038/lsa.2014.94. [DOI] [Google Scholar]
  • 35.Hakkila J., Vahabpour F., Colley A., Vayrynen J., Koskela T. Design probes study on user perceptions of a smart glasses concept; Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia (MUM’15); Linz, Austria. 30 November–2 December 2015; pp. 223–233. [Google Scholar]
  • 36.Klose E.M., Schmidt L. A user-based comparison of two augmented reality glasses; Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR); Reutlingen, Germany. 18–22 March 2018; pp. 1–2. [Google Scholar]
  • 37.Teng Z., Hanwu H., Yueming W., He’en C., Yongbin C. Mixed reality application: A framework of markerless assembly guidance system with HoloLens Glass; Proceedings of the 2017 International Conference on Virtual Reality and Visualization (ICVRV); Zhengzhou, China. 21–23 October 2017; pp. 433–434. [Google Scholar]
  • 38.Liu Y., Dong H., Zhang L., Saddik A.E. Technical evaluation of HoloLens for multimedia: A first look. IEEE MultiMedia. 2018;25:8–18. doi: 10.1109/MMUL.2018.2873473. [DOI] [Google Scholar]
  • 39.Hololens 2 Hardware. [(accessed on 17 January 2020)]; Available online: https://docs.microsoft.com/en-us/hololens/hololens2-hardware/
  • 40.Kim S., Park Y., Kim J., Kim M., Lee W., Lee S. Flexible video processing platform for 8K UHD TV; Proceedings of the 2015 IEEE Hot Chips 27 Symposium (HCS); Cupertino, CA, USA. 22–25 August 2015. [Google Scholar]
  • 41.Apple’s New Patents Mark More Territory in AR Hardware and Software. [(accessed on 17 January 2020)]; Available online: https://www.roadtovr.com/apples-latest-patents-mark-territory-ar-headset-hardware-software/
  • 42.Apple AR Glasses Could Land in 2022-According to New Report. [(accessed on 17 January 2020)]; Available online: https://www.wareable.com/ar/apple-augmented-reality-ar-smartglasses-3501.
  • 43.Meier P., Severin T. Wearable Information System Having at Least One Camera. 9,560,273B2. U.S. Patent. 2017 Jan 31
  • 44.Reichert C. Apple Files for Patent for Mixed-Reality Headset. [(accessed on 17 January 2020)]; Available online: https://www.cnet.com/news/apple-files-patent-for-mixed-reality-headset/
  • 45.Motta R.J., Miller B.D., Rick T., Srikanth M.B. Display System Having Sensors. 2019,0221,044A1. U.S. Patent. 2019 Jul 18
  • 46.IEEE . Approved Draft Standard Format for LSI-Package-Board Interoperable Design. IEEE; Piscataway, NJ, USA: 2019. pp. 1–301. [Google Scholar]
  • 47.Wu Q., Li G.Y., Chen W., Ng D.W.K., Schober R. An overview of sustainable green 5G networks. IEEE Wirel. Commun. 2017;24:72–80. doi: 10.1109/MWC.2017.1600343. [DOI] [Google Scholar]
  • 48.Chang J., Jung K., Kim W., Moon S.K., Freivalds A., Simpson W.T.W., Baik S.P. Effects of weight balance on a 3D TV shutter type glasses: Subjective discomfort and physical contact load on the nose. Int. J. Ind. Ergon. 2014;44:801–809. doi: 10.1016/j.ergon.2014.10.005. [DOI] [Google Scholar]
  • 49.Zhang J., Liu Y., Jia Y., Huang Y. User discomfort evaluation research on the weight and wearing mode of head-wearable device; Proceedings of the International Conference on Applied Human Factors and Ergonomics—Advances in Human Factors in Wearable Technologies and Game Design; Washington, DC, USA. 24–28 July 2019; pp. 98–110. [DOI] [Google Scholar]
  • 50.Li H., Han C., Huang Y., Huang Y., Zhu M., Pei Z., Xue Q., Wang Z., Liu Z., Tang Z., et al. An extremely safe and wearable solid-state zinc ion battery based on a hierarchical structured polymer electrolyte. Energy Environ. Sci. 2018;11:941–951. doi: 10.1039/C7EE03232C. [DOI] [Google Scholar]
  • 51.Liu Z., Li H., Zhu M., Huang Y., Tang Z., Pei Z., Wang Z., Shi Z., Liu J., Huang Y., et al. Towards wearable electronic devices: A quasi-solid-state aqueous lithium ion battery with outstanding stability, flexibility, safety and breathability. Nano Energy. 2018;44:164–173. doi: 10.1016/j.nanoen.2017.12.006. [DOI] [Google Scholar]
  • 52.Kumar N.M., Pande A.S., Rejoice P.R. Optical head mounted displays (OHMD’s) in visual inspection of solar and wind power systems; Proceedings of the International Conference on Green Computing and Internet of Things (ICGCIoT); Bangalore, India. 16–18 August 2018; pp. 133–138. [Google Scholar]
  • 53.Sahin N.T., Keshav N.U., Salisbury J.P., Vahabzadeh A. Safety and lack of negative effects of wearable augmented-reality social communication aid for children and adults with autism. J. Clin. Med. 2018;7:188. doi: 10.3390/jcm7080188. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Rokhsaritalemi S., Sadeghi-Niaraki A., Choi S.-M. A review on mixed reality: Current trends. Appl. Sci. 2020;10:636. doi: 10.3390/app10020636. [DOI] [Google Scholar]
  • 55.Fiala D., Lomas K.J., Stohrer M. A computer model of human thermoregulation for a wide range of environmental conditions: The passive system. J. Appl. Physiol. 1999;87:1957–1972. doi: 10.1152/jappl.1999.87.5.1957. [DOI] [PubMed] [Google Scholar]
  • 56.Incropera F.P., DeWitt D.P., Bergman T.L., Lavine A.S. Principles of Heat and Mass Transfer. 7th ed. John Wiley; New York, NY, USA: 2018. ISBN-13: 978-8126542734. [Google Scholar]
  • 57.Loveridge F.A., Powrie W. Temperature response functions (G-functions) for single pile heat exchangers. Energy. 2013;57:554–564. doi: 10.1016/j.energy.2013.04.060. [DOI] [Google Scholar]
  • 58.Khan S., Ali S., Bermak A. Recent developments in printing flexible and wearable sensing electronics for healthcare applications. Sensors. 2019;19:1230. doi: 10.3390/s19051230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Liu Y., Wang H., Zhao W., Zhang M., Qin H., Xie Y. Flexible, stretchable sensors for wearable health monitoring: Sensing mechanisms, materials, fabrication strategies and features. Sensors. 2018;18:645. doi: 10.3390/s18020645. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Chen L.C., Lehtiniemi R., Vandevelde B., Arslan A. Steady state and transient thermal characterization for flip chip interconnection on flexible substrate; Proceedings of the 7th International Conference on Thermal, Mechanical and Multiphysics Simulation and Experiments in Micro-Electronics and Micro-Systems; Como, Italy. 24–26 April 2006. [Google Scholar]
  • 61.Hamadi M.M., Mohsein Z.H. Variation of heat transfer coefficient for inside and outside closed space with respect to temperature gradient for three different metals. Eng. Technol. J. 2017;35:537–545. [Google Scholar]
  • 62.Femtet® 2019.0 Murata Software Co., Ltd. [(accessed on 14 November 2019)]; Available online: http://www.muratasoftware.com/en.
  • 63.Li J., Tian Y., Dan J., Bi Z., Zheng J., Li B. Simulation-based design and optimization of accelerometers subject to high-temperature and high-impact loads. Sensors. 2019;19:3759. doi: 10.3390/s19173759. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Shahed A.M., Saito Y., Takahashi M. High performance ultra thin heat pipe cooling module for mobile hand held electronic devices. Fujikura Techn. Rev. 2017;47:40–46. [Google Scholar]
  • 65.Xie Q., Dousti M.J., Pedram M. Therminator: A thermal simulator for smartphones producing accurate chip and skin temperature maps; Proceedings of the 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED); La Jolla, CA, USA. 11–13 August 2014. [Google Scholar]
  • 66.Plesca A. Thermal analysis of power semiconductor device in steady-state conditions. Energies. 2019;13:103. doi: 10.3390/en13010103. [DOI] [Google Scholar]
  • 67.Nishi K., Hatakeyama T., Nakagawa S., Ishizuka M. Transient heat transfer of the microprocessor system investigation regarding natural convection with slate style chassis. Trans. Jpn. Inst. Electron. Packag. 2013;6:70–77. doi: 10.5104/jiepeng.6.70. [DOI] [Google Scholar]

Articles from Sensors (Basel, Switzerland) are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES