Skip to main content
Journal of the Royal Society Interface logoLink to Journal of the Royal Society Interface
. 2016 Jun;13(119):20160212. doi: 10.1098/rsif.2016.0212

Control at stability's edge minimizes energetic costs: expert stick balancing

John Milton 1,, Ryan Meyer 2, Max Zhvanetsky 3, Sarah Ridge 4, Tamás Insperger 5
PMCID: PMC4938085  PMID: 27278361

Abstract

Stick balancing on the fingertip is a complex voluntary motor task that requires the stabilization of an unstable system. For seated expert stick balancers, the time delay is 0.23 s, the shortest stick that can be balanced for 240 s is 0.32 m and there is a Inline graphic° dead zone for the estimation of the vertical displacement angle in the saggital plane. These observations motivate a switching-type, pendulum–cart model for balance control which uses an internal model to compensate for the time delay by predicting the sensory consequences of the stick's movements. Numerical simulations using the semi-discretization method suggest that the feedback gains are tuned near the edge of stability. For these choices of the feedback gains, the cost function which takes into account the position of the fingertip and the corrective forces is minimized. Thus, expert stick balancers optimize control with a combination of quick manoeuvrability and minimum energy expenditures.

Keywords: stick balancing, time delay, predictor feedback, sensory dead zone, microchaos

1. Introduction

The importance of balance control for the elderly is underscored by the high mortality and morbidity associated with falls. Often the falls cannot be attributed to a slip or a trip, but are related to issues associated with weight transfer [1] and the ‘fear of falling’ syndrome [2]. Consequently, it has been suggested that losses of balance in the elderly may be related to failures to properly integrate information provided by sensory feedback with cortical internal models that have been refined through decades of balancing experiences [3,4].

The role of an internal model, or predictor feedback (PF), is to predict the sensory consequences of movements [5,6]. In doing so, the internal model makes it possible to make corrective movements faster than the feedback delay [7,8] and to possibly sense when an adverse event such as a fall is about to occur. Investigations into the development of an accurate and robust internal model which underlies expertise are made difficult, because typically years of practice are required. Consequently, current research has focused on a variety of voluntary eye–hand coordination tasks in which certain individuals are able to rapidly acquire exceptional skill [9,10]. As expertise develops, the accuracy and uniformity of task performance increases, but muscular activations [11] and overall brain activation decrease, except in those brain regions most essential for task performance [12,13].

Control theoretic studies for human balancing tasks, including slacklining [14] and stick balancing on the fingertip [15], associate expert balancing with states that minimize energy expenditure. However, a number of observations suggest that feedback for stick balancing is tuned towards the edge of instability [1519] including the presence of power-law behaviours [15,2024], and Weibull-type stick balancing survival statistics [25,26]. Recently, a similar conclusion has been reached from an analysis of stability radii for a model of human balance control during quiet standing [27].

Here, we provide the first evidence to show that control at the edge of stability minimizes energetic costs for stick balancing. Thus, expert stick balancers optimize control with a combination of quick manoeuvrability and minimum energy expenditures. These observations emphasize the importance of investigations into dynamical phenomena which occur at the edge of stability for understanding both the causes of falls and the development of strategies to minimize their occurrence.

2. Background

During stick balancing, the fingertip is continually moving and hence mathematical models take the form of a pendulum–cart system (figure 1) governed by

2. 2.1

where θ is the vertical displacement angle of the stick, m and m0 are, respectively, the mass of the stick and cart, Inline graphic is the acceleration of the cart (fingertip) and f(t) describes the control force. If the control force is zero (f(t) = 0), then elimination of the cyclic coordinate x and linearization around the upper fixed point yields

2. 2.2

where Inline graphic is the angular natural frequency of the pendulum hung downward.

Figure 1.

Figure 1.

(a) Subject balancing stick on fingertip. (b) Slider crank model of the arm used to estimate the equivalent mass of the cart for the pendulum–cart model. (c) Pendulum–cart model for stick balancing with equivalent mass.

The parameter Inline graphic is equal to 1 when Inline graphic and 4 when Inline graphic. During expert stick balancing, the wrist and fingers are held rigid and the movements of the arm occur at the elbow and shoulder [15,20,28]. The equivalence between the human arm mechanism and the pendulum–cart model can be established by relating the mass m0 of the cart to the inertia of the arm segments for an average human arm [29]. We estimated that m0 = 1.2 kg and hence c = 4 (see the electronic supplementary material for details).

The linearized equations of motion for the control of a pendulum–cart model are

2. 2.3

where x is the displacement of the fingertip from the typical starting point for stick balancing located Inline graphic in front of the subject (L being the total length of the arm). When the subject is seated with their back against the chair (this study), the displacements in x cannot be longer than the subject's arm, which yields Inline graphic for an average arm length of L = 0.67 m [29].

A dependence of f(t) on x makes it possible to investigate the role of sensory uncertainties and postural effects on arm movements [21,28,30] for stabilizing an inverted pendulum. The maximum control force is limited by Inline graphic where Inline graphic is the maximum acceleration of the fingertip, while the rate of change of the control force is limited by Inline graphic where Inline graphic is the maximum jerk. Experimental observations suggest that Inline graphic of the fingertip is Inline graphic and Inline graphic [31,32].

We considered two candidate choices of f(t).

2.1. Delayed state feedback

First, it is possible that the feedback is directly related to the delayed values of the position, velocity and acceleration. In control theory, this concept is called delayed-state feedback. An obvious choice is to use the most recently available values of Inline graphic, Inline graphic, Inline graphic and Inline graphic, Inline graphic, Inline graphic. Thus, we consider a proportional–derivative (PD) controller

2.1. 2.4

and a proportional–derivative–acceleration (PDA) controller

2.1.

where Inline graphic, Inline graphic, Inline graphic, Inline graphic, Inline graphic and Inline graphic are, respectively, the proportional, derivative and acceleration control gains for the angular position θ of the stick and for the location x of the cart.

2.2. Predictor feedback

Second, we can assume that f(t) is involved in making a prediction of the actual state variables and hence we have PF [33]. It should be noted that PF corresponds to an internal model in the neuroscience literature [34] and is often associated with finite spectrum assignment in the engineering control literature [33].

In order to give the control force, it is most convenient to write (2.3) in the first-order form

2.2. 2.6

where

2.2. 2.7

with

2.2. 2.8

being the mass matrix and the stiffness matrix, respectively. We assume that the control force Inline graphic is readily provided by the efferent copies, and matrices A and B and the delay τ are also available for the nervous system with high accuracy as a result of a long-enough learning process. We anticipate that this is true for expert stick balancers. The state is predicted by the solution of (2.6) over the interval Inline graphic as

2.2. 2.9

Note that this prediction uses the most recent available states Inline graphic and the control force Inline graphic issued over the interval Inline graphic, which is readily provided by the efferent copies. The PF force reads

2.2. 2.10

with

2.2. 2.11

Thus, the control force can be written as

2.2.

where Inline graphic, Inline graphic, Inline graphic, Inline graphic are the elements of Inline graphic and Inline graphic. The first four terms represent the delayed state feedback, while the last term is associated with the weighted integral of the issued control force over the interval Inline graphic.

3. Methods

3.1. Stick balancing

Data were collected from 66 healthy undergraduate students (34 females and 32 males) between the ages of 18 and 24 who were free from balance disorders. The stick is an oak dowel with diameter 6.35 mm and lengths ranging from 0.2 to 0.91 m. The training protocol was designed to identify subjects with exceptional stick balancing abilities and included financial incentives [26]. Subjects were seated in a chair and were required to keep their back against the back of the chair at all times while facing a blank black screen. All subjects began by balancing a 0.56 m stick. Subjects were required to stick balance each day in the laboratory for as long as it took to accumulate 10–15 min of total balance time (BT), referred to herein as a practice session. Since the increase in the mean BT between two practice sessions performed on consecutive days was typically greater than the increase in mean BT between two practice sessions performed on the same day, we describe skill acquisition in terms of days of practice rather than total accumulated BT. After 2 days of unsupervised practice, subjects whose mean BT for 25 consecutive supervised stick balancing trials (day 3) was less than 10 s were dropped from the study. The remaining 40 subjects (21 females and 19 males) had daily supervised practice sessions in the laboratory. Fourteen subjects (14/66) were able to balance the stick longer than 240 s for at least one out of five trials by day 7 and by day 16 an additional 10 subjects had reached this milestone (24/66). Once a subject was able to balance a 0.56 m stick for 240 s, they began balancing sticks of different lengths. Six of the subjects from this group (6/24) are the experts reported in this study (see Results): three males: E1 (85 days), E2 (30 days), E4 (25 days) and three females: E3 (40 days), E5 (10 days), E6 (13 days). Typically, these subjects could balance sticks longer than 0.56 m for 240 s without additional practice. Sticks shorter than 0.56 m required additional days of practice: the shorter the stick the greater the number of days of practice required to achieve BT > 240 s.

3.2. Motion capture

A high-speed motion capture system (3 Qualisys Oqus 300 cameras, 500–1024 Hz) was used to measure the position of the reflective markers attached to each end of the stick (total mass of stick with markers is 6.3–20.5 g). Typically, data were low-pass filtered with a cut-off frequency of 50 Hz and then downsampled to 125 Hz. The vertical displacement angles were calculated as Inline graphic and Inline graphic where Inline graphic and Inline graphic are the displacement angle in the AP (anterior–posterior) and the ML (medial–lateral) direction, respectively, the subscripts b, t indicate the bottom and top markers attached to the stick and Inline graphic is the distance between the two markers. The power spectral density (PSD) of the fluctuations in Inline graphic and Inline graphic was determined using Matlab.

3.3. Time delay measurement

The time delay for stick balancing was measured from the responses to a sensory blank out [34]. Subjects were required to balance a 0.91 m stick on the surface of a table tennis racket while wearing liquid crystal (LC) glasses (figure 2a). The purpose of the table tennis racket is to minimize sensory inputs from cutaneous mechanoreceptors located in the fingertip. The LC glasses are equipped with LC optical beam shutters: two LC shutters (VX series, Inline graphic, Boulder Nonlinear Systems, Boulder, CO, USA) were crossed and taped over each lens of the safety glasses (4 LC shutters in total). The remainder of the viewing area of the laboratory glasses was covered by black electrical tape and the experiment was performed in a dimly lit room to ensure that during a visual blank out the subject could not see the position of the stick. A signal generator (Grass S-8800) sent a square-wave timing signal to each lens so that visual blank outs lasting 0.5–0.8 s are produced synchronously for both eyes (transparent → opaque LC shutter latency is less than 0.001 s; opaque → transparent latency is less than 0.005 s). During a visual blank out, the subject is instructed to ‘keep balancing’. Provided that the length of the blank out is longer than τ, but not so long that the subject cannot recover balance after the blank out is over, τ can be estimated as the time between the offset of the blank out and the first corrective movement. Trials in which eye blinks occurred were not used for the determination of τ. In order to minimize the effects of changes in the position of the table tennis racket which are uncorrelated to the blank out, we averaged trials (see the electronic supplementary material). The first corrective movement after the blank out is identified from the changes in the velocity Inline graphic of the fingertip (figure 2b).

Figure 2.

Figure 2.

Stick balancing in response to a sensory blank out. (a) The stick balancer's view of the tip of the balanced stick is controlled by LC optical shutters. (b) The time delay, measured as the time between the offset of the blank out and the first detectable corrective change in velocity of the bottom marker. The solid lines show the average of 25 consecutive trials (E1, E3) and 24 consecutive trials (E4). Data available at https://datadryad.org/resource/doi:10.5061/dryad.73q8s.

3.4. Numerical simulations

Numerical simulations were written in Matlab using the semi-discretization technique [35], where Inline graphic with Inline graphic being the discrete time step and r being an integer. As the control problems for stick balancing mainly arise in the AP plane (see Results), we identified θ in the model with Inline graphic. Stick falls were identified when either θ exceeded Inline graphic° or x exceeded Inline graphic. The discrete-time version of (2.12) with sampling period Inline graphic, Inline graphic given by

3.4.

with

3.4. 3.2

corresponds to the tapped delay-line control proposed by Mehta & Schaal [34].

4. Results

Here we describe the experimental observations that support the model for stick balancing described in §2.

4.1. Time delay

Figure 2b shows that for a 0.5 s blank out we obtain Inline graphic (range 0.22–0.24 s for subjects E1, E3, E4). When the blank out was longer than 0.5 s, two of these subjects (E3, E4) could not re-establish stick balancing after the visual blank out. Subject E1 was able to keep the stick balanced even when the blank out lasted as long as 0.8 s. For this stick balancer, τ determined using blank outs in the range of 0.5–0.8 s was approximately the same. The time delay of 0.23 s is equal to that for the response of stick balancing to mechanical perturbations [34].

4.2. Sensory dead zone

Three observations indicate that the major control problems for stick balancing on the fingertip are in the saggital (AP) plane: (i) BT <5 s when expert stick balancers place an eye patch over one eye, (ii) the standard deviation for Inline graphic is larger than for Inline graphic (figure 3a) and this difference increases as decreases (figure 3b) and (iii) for novice stick balancers with mean BT ≈ 40–60 s, 72% of 246 stick falls while balancing a 0.56 m stick occur in the AP direction and for experts, 84% of 51 stick falls while balancing a 0.26 m stick occur in the AP direction.

Figure 3.

Figure 3.

(a) Comparison of the amplitude of the fluctuations of θ in the AP (black) and ML (red) directions for subject E1 balancing a 0.56 m stick. (b) The standard deviation (s.d.) for the fluctuations in the AP and ML direction as a function of for subjects E1–E4. (c) Estimation of Π when Inline graphic for E1–E4 using the sweeping window method (see text). (d) The PSD for Inline graphic (black line) and Inline graphic (red line) for E3. The data and computer program for estimating the dead zone are available at https://datadryad.org/resource/doi:10.5061/dryad.73q8s.

We interpreted these observations in terms of a sensory dead zone, Inline graphic, for the detection of Inline graphic, where Π is the sensory threshold. Our estimation procedure for Π is motivated by the observation that the time history of Inline graphic shows irregular peaks at irregular time instances. We assumed that these peaks were the result of a free fall for time period τ after leaving the dead zone. The solution over the free-fall period can be given as Inline graphic, where Inline graphic is the time instant when the stick is on the edge of the dead zone, i.e. Inline graphic. Substitution of the parameters into the system matrix A according to (2.7) using Inline graphic gives the ratio Inline graphic. Thus, before starting corrective motions, θ increases by a factor of 1.78 after leaving the dead zone.

A sweeping window of length Inline graphic over the history of Inline graphic was used to check for the maximum peaks in each interval Inline graphic, where Inline graphic goes from Inline graphic to Inline graphic with Inline graphic being the length of the data. The minimum value of these maximum values is taken as an upper estimate for Inline graphic. Figure 3c shows the estimated Inline graphic for different window sizes Inline graphic For subjects E1–E4, there is a plateau between Inline graphic and 6 s. The more skilled expert stick balancers had the lower Π, 0.8° and 1°, respectively, for E1 and E2. We used the corresponding values of Inline graphic as an estimate of Π for these subjects.

The presence of the dead zone means that there is switching feedback, namely the feedback is turned on or off depending on whether Inline graphic is larger or smaller than Π. This means that the angular position perceived by the neural system is

4.2. 4.1

where Inline graphic is the stick's actual angle and Π is the functional sensory threshold. We assume that information related to Inline graphic and Inline graphic remains available [36].

4.3. Power spectral density

A consequence of switching feedback is that it generates oscillations [3740]. Figure 3d shows that there is a peak in the PSD for the fluctuations in Inline graphic between Inline graphic (figure 3d). This peak was observed for subjects E1–E6 and could also be readily observed for less skilled subjects. A peak in this frequency range can also be seen for Inline graphic; however, it is less prominent.

4.4. Feedback identification

A necessary condition for the stabilization of the upright position of an inverted pendulum by time-delayed feedback is that the length of the pendulum must be longer than a critical length, Inline graphic [41]. When τ is known, Inline graphic corresponds to the shortest pendulum that can be stabilized by the given feedback. Thus, by measuring Inline graphic it is possible to experimentally exclude some of the control concepts.

Figure 4 compares BT determined from five consecutive stick balancing trials as a function of for subjects E1–E6. If BT exceeded 240 s, the balancing trial was terminated and the subject was then asked to balance a shorter stick. All of these subjects could balance sticks when Inline graphic and no subject could accomplish this task when Inline graphic: subjects E1 and E2 could balance sticks as short as 0.32 m for 240 s. A sharp drop off of BT for Inline graphic has also been observed for pole balancing in one dimension [42]. Although we cannot determine with precision Inline graphic it is certainly no longer than 0.32 m and no smaller than 0.2 m.

Figure 4.

Figure 4.

Comparison of the maximum BT (filled circles) obtained for five consecutive balancing trials as a function of for E1–E6 to Inline graphic (dashed vertical lines) predicted for PD, PDA and PF control. Balance trials were stopped when BT = 240 s. The diamond markers show the mean BTs when an eye shield is placed over one eye. Data available at https://datadryad.org/resource/doi:10.5061/dryad.73q8s.

The vertical dashed lines in figure 4 show Inline graphic determined using (2.3) with (4.1) when f(t) for PD, PDA and PF is given, respectively, by (2.4), (2.5) and (2.12). The Inline graphic were estimated using numerical simulations with five initial conditions: Inline graphic, Inline graphic for Inline graphic) over a Inline graphic (four-dimensional) grid of the control gains Inline graphic, Inline graphic, Inline graphic, Inline graphic. For the PDA control, the acceleration gains were fixed as Inline graphic, Inline graphic. If at least one simulations out of Inline graphic lasted for 240 s without falling, then the balancing task was assessed to be successful, and the length of the stick was decreased. The critical length was selected to be the one for which the balancing task was successful, but for a stick 0.01 m shorter falling was observed for all the possible combinations of the control gains and for all initial conditions.

The measured Inline graphic appears to agree best with the Inline graphic determined for PDA control (figure 4). However, the human visual system is not very sensitive for detecting changes in acceleration [43]. This uncertainty will certainly shift the estimate of Inline graphic very much to the right [41]. Thus, it is more likely that the nervous system uses PF. For PF the difference between the estimated and measured values of Inline graphic is in large part due to uncertainties in the internal model and the unmodelled uncertainties in the sensory inputs (likely of the order of 5% [41]).

5. Model

The experimental observations suggest that the model for stick balancing is given by (2.3) where f(t) is given by (2.12), and Inline graphic is given by (4.1) subject to the constraints imposed on x, Inline graphic, Inline graphic and Inline graphic. Here, we illustrate the cardinal features of this model when Inline graphic, Inline graphic° and choices of Inline graphic of the form

5.

where Inline graphic is an initial angle (a more complete description will be given elsewhere). These choices of Inline graphic reflect two observations: (i) all stick balancing trials begin with the stick held stationary for a few seconds and (ii) the subject cannot reproduce a given Inline graphic because of the presence of the sensory dead zone.

There are four control gains: two for the control of Inline graphic, Inline graphic and two for the control of the position x of the fingertip, Inline graphic. If Inline graphic° and there are no constraints on x, Inline graphic, Inline graphic and Inline graphic, then the corresponding linear stability region in the plane Inline graphic has a roughly rectangular shape (see dashed red curve in figure 5a). The longer BT for the nonlinear model with movement constraints and sensory threshold Inline graphic° occur in the left portion of the linear stability region. The position of the dominant peak in the PSD depends on the values chosen for the gains (figure 5b). Peaks in the range of 0.6–0.8 Hz (figure 3d) are associated with values of the gains located in the lower left corner of the linear stability region. For the choices of the gains indicated by the point A, the time series (figure 5c) and the PSD (figure 5d) generated by the model are qualitatively similar to those observed experimentally for E1 (respectively, figure 5e,f).

Figure 5.

Figure 5.

(a) Red dashed curve shows the linear stability boundary for the model as a function of Inline graphic with Inline graphic and Inline graphic for a 0.56 m stick when Inline graphic°. The grey scale shows the maximum BT for the nonlinear model with movement constraints and Inline graphic (values longer than 240 s are recorded as 240 s). (b) The same as (a) except that the grey scale shows the peak in the PSD at the parameter points, where BT = 240 s. Panels (c,e) and (d,f) show, respectively, the fluctuations in θ and the PSD for the model with Inline graphic and Inline graphic (point A in panel a) and for subject E1. The data and computer program for the model are available at https://datadryad.org/resource/doi:10.5061/dryad.73q8s.

The solutions of the model are microchaotic and exhibit a sensitivity to initial conditions (not shown). Microchoas is a phenomenon produced by deterministic time-delayed dynamical systems with a switching feedback [44,45] and hence is not observed when Inline graphic°. It is remarkable that a deterministic model generates a time series and PSD that qualitatively resembles those generated by a human stick balancer (see Discussion).

Figure 6 shows a set of stability diagrams representing the dynamic behaviour of balancing a 0.56 m stick in the four-dimensional parameter space of the control gains. It is observed that high BT can be achieved outside of the linearly stable region. This property is attributed to the intriguing interplay between the sensory dead zone, the movement constraints and the time delay as suggested previously by a simplified scalar discrete map model of balancing [38].

Figure 6.

Figure 6.

Comparison of the control gains, BT (grey scale) and the control cost (yellow dots) determined for the model when Inline graphic. Grey shading indicates the BTs for the switched system. The size of the yellow dots is directly proportional to the control cost when BT = 240 s. The light blue circle indicates the points when the model reproduces the peak in the PSD for E1. The computer program that generates this figure is available at https://datadryad.org/resource/doi:10.5061/dryad.73q8s.

The yellow dots in figure 6 indicate the parameter points where the BT was 240 s. The size of the yellow dots shows the control cost [46]

5. 5.1

where the first term measures the variance of the cart displacement, the second term measures the variance of the control effort, Inline graphic, Inline graphic and Inline graphic and Inline graphic are the corresponding weights. The weight Inline graphic was set to 1 and the weight Inline graphic was adjusted such that, at the parameter point where the control cost is minimum, the contributions of the two terms in (5.1) are equal, i.e. Inline graphic. This condition gives Inline graphic. The smaller the size of the yellow dots, the smaller the control cost.

Comparison to experiments is performed based on three factors: the peak of the PSD of θ, the standard deviation of θ and the standard deviation of x. Light blue circles indicate the parameter points, where these three factors are close to the measured ones within ±10% deviation. Figure 6 shows that these points coincide with the points where the cost C is minimal. This suggests that the nervous system minimizes both the control effort and the fingertip displacement by tuning control at the edge of stability.

6. Discussion

The most important control problems for stick balancing on the fingertip in three dimensions are related to the long-time delay, the presence of a sensory dead zone for the estimation of Inline graphic and the capabilities of the fingertip to make sufficiently quick movements. The dead zone arises because the human visual system is not able to measure the depth of a moving target to the same accuracy that it can measure its azimuth and elevation [47,48]. Consequently, there are errors in the estimation of Inline graphic whose magnitude continually changes as the movements of the stick changes. The state-dependent nature of the Inline graphic errors arises, in part, because the accommodative reflex has a long latency, a slow response time and uses a dual mode type of feedback which combines both open- and closed-loop components [49]. In our model, we assumed that Π was constant. The advantage of this approximation is that the resulting model for stick balancing captures many of the experimental observations while remaining tractable. Thus, it is possible to compare observations with predictions.

It is likely that all sensory receptors possess a dead zone, namely a threshold below which changes in input are not reflected by changes in output [50]. Usually, the dead zone is very small and hence the presence of low-amplitude oscillations and microchaos is buried within the intrinsic noisy variability. However, for stick balancing the size of the dead zone is of the order of the magnitude of the observed fluctuations and hence its effects on balance control must be taken into account. The existence of sensory thresholds for balance control is supported by the beneficial effects of perturbations on stick balancing [51], postural sway [52] and gait stability [53,54]. From a mathematical point of view, the most important effect of the dead zone is that it eliminates the possibility of an equilibrium solution of (2.3). Thus, successful stick balancing is related to a complex bounded time-dependent state [51] which in our model is manifested as microchaos. Because the position of the fingetrip cannot be stabilized, physical constraints such as the length of the arm and the maximum acceleration and jerk of its movements become important determinants of the success of stick balancing. Indeed stick balancing is more easily performed while standing than sitting for many subjects [21]. The increase in BT with standing is likely related to the increase in the arm's reach, but may also arise because this posture enables control mechanisms related to the arm's torque to be implemented [28,55,56].

There are two sources of uncertainty in our model. First, as the internal model is continually refined with practice, it always contains some inaccuracies. As we mentioned in §4.4, the result of uncertainties in the internal model is to increase Inline graphic. The second source of uncertainty arises because of uncertainties in the perception of the angular displacement of the stick. A beneficial effect of the sensory dead zone is that it operates as a ‘noise gate’ to reduce the effects of the noise [57].

The small amplitude and complex noise-like dynamics generated by the model are due to microchaos and arise even though the model contains no noisy inputs. It is generated by interactions between the long-time delay and the sensory dead zone [38,44,45] and is observed whether the feedback is PD, PDA or PF. The sensitive dependence of microchaos on initial conditions may play a role in stick falling [58]. By contrast, there is a large literature on the effects of noise on balance and motor control (e.g. [6,15,18,24,46,59]). Is noise of deterministic chaotic or stochastic origin? This question cannot be answered experimentally since it is well established that deterministic chaotic dynamical systems can generate the same statistical properties that are typically associated with stochastic dynamical systems [6062]. Thus, it should not be surprising that our conclusions obtained with a deterministic model of balance control can also be inferred from stochastic models of balance control [15,24]. However, our observations go one step further and suggest that variability in motor control may simply be the consequence of the presence of a time delay and a sensory dead zone. In other words, it is not necessary to hypothesize the existence of stochastic forces.

Our observations shed no light onto the nature of the control mechanisms used by less skilled stick balancers. The power-law behaviours described previously [15,20,21,23] are not observed when an expert (E1, E2) balances a 0.58 m stick (data not shown). However, we have observed that when the same experts balance a 0.28 m stick the distribution of accelerative movements made by the fingertip exhibits ‘broad shoulders’. Thus, it is possible that subjects use other types of control strategies to provide some control for stick balancing while an internal model is being learned, such as delayed state feedback [63], clock-driven switched feedback [55], noise-assisted control [15,24] or nonlinear types of controllers [16,17,23].

The search for optimality principles that either maximize or minimize some quantity related to sensorimotor control has a long history (for a review, see [59]). Our observations strongly support the concept that organisms are able to minimize energy expenditures and maximize manoeuvrability by moving about an unstable position. The surprising observation is that this control is achieved by tuning the internal model towards instability. We anticipate that our findings will have many implications for balancing control including the nature of falling in the elderly.

Supplementary Material

m_0_and_ensemble_averaging; https://datadryad.org/resource/doi:10.5061/dryad.73q8s
rsif20160212supp1.pdf (165.4KB, pdf)

Acknowledgements

We thank G. Csernak, S. Gielen, B. D. Hatfield and G. Stepan for useful discussions, W. Cook and Boulder Nonlinear Systems for their assistance in constructing the visual blank out apparatus and S. Davis, E. Lopez, V. Kim, K. Mendoza-Ochoa and H. Wilson for technical assistance.

Ethics

This study was approved by the institutional review board at Claremont McKenna College in accordance with the currently applicable US Public Health Service Guidelines. All participants provided informed consent for all research testing.

Data accessibility

The derivation of m0 for the arm and information concerning the need for averaging in the time delay estimation are provided in the electronic supplementary material. The computer programs and stick balancing data used in this study are available at Dryad (https://datadryad.org/resource/doi:10.5061/dryad.73q8s).

Authors' contributions

J.M. conceived, designed and coordinated the study and helped draft the manuscript; R.M. performed the time-delay measurements; M.Z. performed the estimation of the sensory dead zones; S.R. performed the estimation of the critical stick lengths; T.I. derived the mathematical model for stick balancing, wrote the computer programs and helped draft the manuscript. All authors gave final approval for publication.

Competing interests

We declare we have no competing interests.

Funding

This research was supported by the Hungarian National Science Foundation (T.I.) (OTKA-K105433) and National Science Foundation (J.M.) (NSF-0617072 and NSF-1028970). J.M. acknowledges support from the William R. Kenan, Jr Charitable Trust and the Invitation Award to Distinguished Scientists by the Hungarian Academy of Sciences.

References

  • 1.Robinovitch SN, Feldman F, Yang Y, Schonnop R, Leung PM, Sarraf T, Sims-Gould J, Loughin M. 2013. Video capture of the circumstances of falls in elderly people residing in long-term care: an observational study. Lancet 381, 47–54. ( 10.1016/S0140-6736(12)61263-X) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Scheffer AC, Schuurmans MJ, van Dijk N, van der Hooft T, de Rooij SE. 2008. Fear of falling: measurement strategy, prevalance, risk factors and consequences among older persons. Age Ageing 37, 19–24. ( 10.1093/ageing/afm169) [DOI] [PubMed] [Google Scholar]
  • 3.Loram ID, Lakie M, Gawthrop PJ. 2009. Visual control of stable and unstable loads: what is the feedback delay and extent of linear time-invariant control? J. Physiol. 587, 1343–1365. ( 10.1113/jphysiol.2008.166173) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Sipp AR, Gwin JT, Makieg S, Ferris DP. 2013. Loss of balance during balance beam walking elicits a multifocal theta band electrocortical response. J. Neurophysiol. 110, 2050–2060. ( 10.1152/jn.00744.2012) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Kawato M. 1999. Internal model for motor control and trajectory planning. Curr. Opin. Neurobiol. 9, 718–727. ( 10.1016/S0959-4388(99)00028-8) [DOI] [PubMed] [Google Scholar]
  • 6.Shadmehr R, Smith MA, Krakauer JW. 2010. Error correction, sensory prediction, and adaptation in motor control. Annu. Rev. Neurosci. 33, 89–108. ( 10.1146/annurev-neuro-060909-153135) [DOI] [PubMed] [Google Scholar]
  • 7.Nijhawan R. 2008. Visual prediction: psychophysics and neurophysiology of compensation for time delay. Behav. Brain Sci. 31, 179–198. ( 10.1017/S0140525X08003804) [DOI] [PubMed] [Google Scholar]
  • 8.Nijhawan R, Wu S. 2009. Compensating time delays with neural predictions: are predictions sensory or motor? Phil. Trans. R. Soc. A 367, 1063–1078. ( 10.1098/rsta.2008.0270) [DOI] [PubMed] [Google Scholar]
  • 9.Kerick SE, Douglass LW, Hatfield BD. 2004. Cerebral cortical adaptations associated with visuomotor practice. Med. Sci. Sports Exer. 36, 118–129. ( 10.1249/01.MSS.0000106176.31784.D4) [DOI] [PubMed] [Google Scholar]
  • 10.Sternad D, Huber ME, Kuznetsov N. 2014. Acquisition of novel and complex motor skills: stable solutions where intrinsic noise matters less. Adv. Exp. Med. Biol. 826, 101–124. ( 10.1007/978-1-4939-1338-1_8) [DOI] [PubMed] [Google Scholar]
  • 11.Lay BS, Sparrow WA, Hughes KM, O'Dwyer NJ. 2002. Practice effects on coordination and control, metabolic energy expenditure and muscle activation. Hum. Mov. Sci. 21, 807–830. ( 10.1016/S0167-9457(02)00166-5) [DOI] [PubMed] [Google Scholar]
  • 12.Milton J, Solodkin A, Hlustik P, Small SL. 2007. The mind of expert motor performance is cool and focused. NeuroImage 35, 804–813. ( 10.1016/j.neuroimage.2007.01.003) [DOI] [PubMed] [Google Scholar]
  • 13.Puttemans V, Wenderoth N, Swinnen SP. 2005. Changes in brain activation during the acquisition of a multifrequency bimanual coordination task: from the cognitive stage to advanced levels of automaticity. J. Neurosci. 25, 4270–4278. ( 10.1523/JNEUROSCI.3866-04.2005) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Paoletti P, Mahadevan L. 2012. Balancing on tightropes and slacklines. J. R. Soc. Interface 9, 2097–2108. ( 10.1098/rsif.2012.0077) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Cabrera JL, Milton JG. 2002. On-off intermittency in a human balancing task. Phys. Rev. Lett. 89, 158702 ( 10.1103/PhysRevLett.89.158702) [DOI] [PubMed] [Google Scholar]
  • 16.Asai Y, Tasaka Y, Nomura K, Nomura T, Casadio M, Morasso P. 2009. A model of postural control in quiet standing: robust compensation of delay-induced instability using intermittent activation of feedback control. PLoS ONE 4, e6169 ( 10.1371/journal.pone.0006169) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Bottaro A, Yasutake Y, Nomura T, Casadio M, Morasso P. 2008. Bounded stability of the quiet standing posture: an intermittent control model. Hum. Mov. Sci. 27, 473–495. ( 10.1016/j.humov.2007.11.005) [DOI] [PubMed] [Google Scholar]
  • 18.Cabrera JL. 2005. Controlling instability with delayed and antagonistic stochastic dynamics. Physica A 356, 25–30. ( 10.1016/j.physa.2005.05.007) [DOI] [Google Scholar]
  • 19.Moreau L, Sontag E. 2003. Balancing at the border of instability. Phys. Rev. E 68, 020901 ( 10.1103/PhysRevE.68.020901) [DOI] [PubMed] [Google Scholar]
  • 20.Cabrera JL, Milton JG. 2004. Human stick balancing: tuning Lévy flights to improve balance control. Chaos 14, 691–698. ( 10.1063/1.1785453) [DOI] [PubMed] [Google Scholar]
  • 21.Cluff T, Balasubramaniam R. 2009. Motor learning characterized by changing Lévy distributions. PLoS ONE 4, e5998 ( 10.1371/journal.pone.0005998) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Patzelt F, Pawelzik L. 2011. Criticality of adaptive control dynamics. Phys. Rev. Lett. 107, 238103 ( 10.1103/PhysRevLett.107.238103) [DOI] [PubMed] [Google Scholar]
  • 23.Yoshikawa N, Suzuki Y, Kiyono K, Nomura T. 2016. Intermittent feedback-control strategy for stabilizing inverted pendulum on manually controlled cart as analogy to human stick balancing. Front. Comp. Neurosci. 10, 34 ( 10.3389/fncom.2016.00034) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Zgonnikov A, Lubashevsky I, Kanemoto S, Miyazawa T, Suzuki T. 2015. To react or not to react? Intrinsic stochasticity of human control in virtual stick balancing. J. R. Soc. Interface 11, 20140636 ( 10.1098/rsif.2014.0636) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Cabrera JL, Milton JG. 2004. Stick balancing: on-off intermittency and survival curves. Nonlinear Stud. 11, 305–317. [Google Scholar]
  • 26.Cabrera JL, Milton JG. 2012. Stick balancing, falls and Dragon-Kings. Eur. Phys. J. Spec. Top. 205, 231–241. ( 10.1140/epjst/e2012-01573-7) [DOI] [Google Scholar]
  • 27.Hajdu D, Milton J, Insperger T. In press. Extension of stability radius to neuromechanical systems with structured real perturbations. IEEE Trans. Neural Syst. Rehab. Eng. ( 10.1109/TNSRE.2016.2541083) [DOI] [PubMed] [Google Scholar]
  • 28.Lee K-Y, O'Dwyer N, Halaki M, Smith R. 2015. Perceptual and motor learning underlie human stick balancing skill. J. Neurophysiol. 113, 156–171. ( 10.1152/jn.00538.2013) [DOI] [PubMed] [Google Scholar]
  • 29.de Leva P. 1996. Adjustments to Zatsiorsky-Seluyanov's segment inertia parameters. J. Biomech. 29, 1223–1230. ( 10.1016/0021-9290(95)00178-6) [DOI] [PubMed] [Google Scholar]
  • 30.Cluff T, Boulet J, Balasubramaniam R. 2011. Learning a stick balancing task involves task-specific coupling between posture and hand displacements. Exp. Brain Res. 213, 15–25. ( 10.1007/s00221-011-2768-y) [DOI] [PubMed] [Google Scholar]
  • 31.Laczko J, Jaric S, Tihanyi J, Zatsiorsky VM, Latash ML. 2000. Components of the end-effector jerk during voluntary arm movements. J. Appl. Biomech. 16, 14–25. [Google Scholar]
  • 32.Sha D, Patton J, Mussa-Ivaldi FA. 2006. Minimum jerk reaching movements of human arm with mechanical constraints at endpoint. Int. J. Comp. Sys. Sig. 7, 41–50. [Google Scholar]
  • 33.Krstic M. 2009. Delay compensation for nonlinear, adaptive, and PDE systems. Boston, MA: Birkhäuser. [Google Scholar]
  • 34.Mehta B, Schaal S. 2002. Forward models in visuomotor control. J. Neurophysiol. 88, 942–953. [DOI] [PubMed] [Google Scholar]
  • 35.Insperger T, Stepan G. 2011. Semi-discretization for time-delay systems. New York, NY: Springer. [Google Scholar]
  • 36.Thiel A, Greschner M, Eurich CW, Ammermüller J, Kretzberg J. 2007. Contribution of individual retinal ganglion cell responses to velocity and acceleration encoding. J. Neurophysiol. 98, 2285–2296. ( 10.1152/jn.01342.2006) [DOI] [PubMed] [Google Scholar]
  • 37.Eurich CW, Milton JG. 1996. Noise-induced transitions in human postural sway. Phys. Rev. E 54, 6681–6684. ( 10.1103/PhysRevE.54.6681) [DOI] [PubMed] [Google Scholar]
  • 38.Insperger T, Milton J, Stepan G. 2015. Semi-discretization for time-delayed neural balance control. SIAM J. Appl. Dyn. Sys. 14, 1258–1277. ( 10.1137/140975632) [DOI] [Google Scholar]
  • 39.Kowalcyzk P, Glendinning G, Brown M, Medrano-Cerda G, Dallali H, Shapiro J. 2012. Modelling human balance using switched systems with linear feedback control. J. R. Soc. Interface 9, 234–245. ( 10.1098/rsif.2011.0212) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Milton JG, Longtin A. 1990. Evaluation of pupil constriction and dilation from cycling measurements. Vision Res. 30, 515–525. ( 10.1016/0042-6989(90)90063-Q) [DOI] [PubMed] [Google Scholar]
  • 41.Insperger T, Milton J. 2014. Sensory uncertainty and stick balancing at the fingertip. Biol. Cybern. 108, 85–101. ( 10.1007/s00422-013-0582-2) [DOI] [PubMed] [Google Scholar]
  • 42.Reeves NP, Pathak P, Popovich JM Jr, Vijayanagar V. 2013. Limits in motor control bandwidth during stick balancing. J. Neurophysiol. 109, 2523–2527. ( 10.1152/jn.00429.2012) [DOI] [PubMed] [Google Scholar]
  • 43.Dessing JC, Craig CM. 2010. Bending it like Beckham: how to visually fool the goalkeeper. PLoS ONE 5, e13161 ( 10.1371/journal.pone.0013161) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Csernak G, Stepan G. 2010. Digital control as source of chaotic behaviour. Int. J. Bifurc. Chaos 20, 1365–1378. ( 10.1142/S0218127410026538) [DOI] [Google Scholar]
  • 45.Haller G, Stepan G. 1996. Micro-chaos in digital control. J. Nonlinear Sci. 6, 415–448. ( 10.1007/BF02440161) [DOI] [Google Scholar]
  • 46.Harris CM, Wolpert DM. 1998. Signal-dependent noise determines motor planning. Nature 394, 780–784. ( 10.1038/29528) [DOI] [PubMed] [Google Scholar]
  • 47.Admiraal MA, Keijsers NLW, Gielen CCAM. 2004. Gaze affects pointing toward remembered visual targets after a self-initiated stop. J. Neurophysiol. 92, 2380–2392. ( 10.1152/jn.01046.2003) [DOI] [PubMed] [Google Scholar]
  • 48.Green DG, Powers MK, Banks MS. 1980. Depth of focus, eye size and visual acuity. Vis. Res. 20, 827–835. ( 10.1016/0042-6989(80)90063-2) [DOI] [PubMed] [Google Scholar]
  • 49.Khosroyani M, Hung GK. 2002. A dual-mode dynamic model of the human accommodative system. Bull. Math. Biol. 64, 285–299. ( 10.1006/bulm.2001.0274) [DOI] [PubMed] [Google Scholar]
  • 50.Milton J, Insperger T, Stepan G. 2015. Human balance control: dead zones, intermittency and micro-chaos. In Mathematical approaches to biological systems (eds Ohira T, Uzawa Y), pp. 1–28. New York, NY: Springer; ( 10.1007/978-4-431-55444-8_1) [DOI] [Google Scholar]
  • 51.Milton JG  et al. . 2009. Balancing with vibration: a prelude for ‘drift and act’ balance control. PLoS ONE 4, e7427 ( 10.1371/journal.pone.0007427) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Priplata A, Niemi J, Salen M, Harry J, Lipsitz LA, Collins JJ. 2002. Noise-enhanced human balance control. Phys. Rev. Lett. 89, 238101 ( 10.1103/PhysRevLett.89.238101) [DOI] [PubMed] [Google Scholar]
  • 53.Lipsitz L, Lough M, Niemi J, Travison T, Howlett H, Manor B. 2015. A shoe insole delivery subsensory vibration noise improves balance and gait in healthy elderly people. Arch. Phys. Med. Rehabil. 96, 432–439. ( 10.1016/j.apmr.2014.10.004) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Mulavara A, Kofman I, DeBois Y, Miller C, Peters BT, Goel R, Galvan R, Bloomberg J. 2015. Using low levels of stochastic vestibular stimulation to improve locomotor stability. Front. Syst. Neurosci. 9, 117 ( 10.3389/fnsys.2015.00117) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Gawthrop P, Lee KY, Halaki M, O'Dwyer N. 2013. Human stick balancing: an intermittent control explanation. Biol. Cybern. 107, 637–652. ( 10.1007/s00422-013-0564-4) [DOI] [PubMed] [Google Scholar]
  • 56.Lee K-Y, O'Dwyer N, Halaki M, Smith R. 2012. A new paradigm for human stick balancing: a suspended not an inverted pendulum. Exp. Brain Res. 221, 309–328. ( 10.1007/s00221-012-3174-9) [DOI] [PubMed] [Google Scholar]
  • 57.Marcellin MW, Lepley MA, Bilgin A, Flohr TJ, Chinen TT, Kasner JH. 2002. An overview of quantization in JPEG 2000. Signal Proc. Image Commun. 17, 73–84. ( 10.1016/S0923-5965(01)00027-3) [DOI] [Google Scholar]
  • 58.Milton, et al. In preparation.
  • 59.Todorov E. 2004. Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907–915. ( 10.1038/nn1309) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Lasota A, Mackey MC. 1994. Chaos, fractals, and noise: stochastic aspects of dynamics. New York, NY: Springer. [Google Scholar]
  • 61.Mackey MC, Milton JG. 1990. A deterministic approach to survival statistics. J. Math. Biol. 28, 33–48. ( 10.1007/BF00171517) [DOI] [PubMed] [Google Scholar]
  • 62.Milton J. 1996. Dynamics of small neural populations. Providence, RI: American Mathematical Society. [Google Scholar]
  • 63.Insperger T, Milton J, Stepan G. 2013. Acceleration feedback improves balancing against reflex delay. J. R. Soc. Interface 10, 20120763 ( 10.1098/rsif.2012.0763) [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

m_0_and_ensemble_averaging; https://datadryad.org/resource/doi:10.5061/dryad.73q8s
rsif20160212supp1.pdf (165.4KB, pdf)

Data Availability Statement

The derivation of m0 for the arm and information concerning the need for averaging in the time delay estimation are provided in the electronic supplementary material. The computer programs and stick balancing data used in this study are available at Dryad (https://datadryad.org/resource/doi:10.5061/dryad.73q8s).


Articles from Journal of the Royal Society Interface are provided here courtesy of The Royal Society

RESOURCES