Abstract
Many animals visualize and track small moving targets at long distances—be they prey, approaching predators or conspecifics. Insects are an excellent model system for investigating the neural mechanisms that have evolved for this challenging task. Specialized small target motion detector (STMD) neurons in the optic lobes of the insect brain respond strongly even when the target size is below the resolution limit of the eye. Many STMDs also respond robustly to small targets against complex stationary or moving backgrounds. We hypothesized that this requires a complex mechanism to avoid breakthrough responses by background features, and yet to adequately amplify the weak signal of tiny targets. We compared responses of dragonfly STMD neurons to small targets that begin moving within the receptive field with responses to targets that approach the same location along longer trajectories. We find that responses along longer trajectories are strongly facilitated by a mechanism that builds up slowly over several hundred milliseconds. This allows the neurons to give sustained responses to continuous target motion, thus providing a possible explanation for their extraordinary sensitivity.
Keywords: target detection, motion vision, hypercomplex, response onset, spatial facilitation, response decay
1. Introduction
We know from behaviour (e.g. [1–3]) that flying insects have sophisticated mechanisms for rapid detection of targets such as prey, predators and conspecifics, which they track and pursue aerobatically against textured backgrounds. The complex task of tracking small moving targets amidst visual clutter is assisted by specializations of the eye and brain in many animals. These include the fovea of mammals, raptors and jumping spiders, and the acute zone of insect compound eyes (e.g. [4,5]). Subserved by these optical mechanisms, higher order visual neurons, such as cortical hypercomplex (end-stopped) cells, and insect small target motion detectors (STMDs), respond selectively to small moving targets, with little response to larger objects or to wide-field motion [6–8].
The hoverfly Eristalis has an optical resolution limit of approximately 1° [9], meaning that each ommatidium (facet) of the compound eye views a patch of space 1° across. Predatory dragonflies have among the highest spatial resolution reported for insects, about 0.25–0.5° in the acute zone [10,11], but this is still far below the fine resolution of the vertebrate single lens eye. Despite these optical limitations, hoverfly STMDs still respond strongly to very small dark targets—just 0.18° square [6]. Targets this small are well below the nominal resolution limit of the compound eye and would thus be blurred by the optics to a very low contrast image (effective contrast below 2%). Similarly, dragonfly STMDs also display high gain to low contrast targets [12]. Furthermore, despite the optical limitations, insect STMDs display similar selectivity to cortical hypercomplex neurons of much larger mammals [13,14]. The underlying neural pathway must thus employ enormous amplification to boost the tiny signals that such small targets generate.
How do insect STMDs achieve massive signal amplification, yet are able to respond so robustly only to small targets, even in complex clutter [6]? Lateral inhibition at several levels of visual processing probably plays a role [15,16], by inhibiting responses to features that do not fit the unique spatial profile of an optimal target. A distinguishing trait of natural target stimuli—be they conspecifics or prey—is that they are likely to fly along continuous paths. This provides the potential for neural mechanisms that enhance target detection by integrating spatially adjacent local motion detector receptive fields. Here, we test this hypothesis using intracellular recordings from the dragonfly centrifugal STMD1 (CSTMD1). We compared the time course of responses with targets commencing within the receptive field, with responses to targets approaching the same location along longer trajectories, and reveal a slow facilitation mechanism to motion onset.
2. Material and methods
We recorded intracellularly from CSTMD1 in wild-caught dragonflies (Hemicordulia tau) while they were viewing VisionEgg [17] generated small 0.9° targets moving at 55° s−1 on a 200 Hz CRT monitor (complete methods in the electronic supplementary material). The targets appeared and instantly started their trajectories within the receptive field. After a position-aligned normalization, we fitted the response onset with a logistic curve:
where t describes the time, t50 the time for 50 per cent maximum response and m the slope. We fitted the response decay with a one-phase exponential decay:
where k is the rate constant and t the time.
3. Results
(a). Response time course
When a target drifts upwards across the receptive field at 10° azimuth, CSTMD1 responses build up slowly over 400–500 ms to a peak of 150 spikes s−1 (figure 1a(i)). The second peak corresponds to a hotspot in the receptive field (figure 1a(i); electronic supplementary material, figure S1C) associated with the dorsal acute zone [10]. Following the cessation of motion, the neuron shows pronounced post-excitatory inhibition, lasting several seconds.
Following stimulus onset (dashed box, figure 1a(i)) we see similar activity to pre-stimulus rates (white bars, figure 1a(ii)) for the first 40 ms (grey bars). Consistent with earlier modelling of CSTMD1, suggesting neural delay filters with a short time-constant [12], response rates then increase from 40 ms, and remain significantly above spontaneous rate after 140 ms (black bars, figure 1a(ii); two-way ANOVA, p < 0.05).
After shifting the display vertically to three elevations (electronic supplementary material, figure S1) the resulting receptive field maps partly reflect the neuron's underlying spatial structure (e.g. the hotspot is located at 60° elevation in all three cases), but the firing rate at the bottom of the display is always low, suggesting a slow response build-up. If we fix the monitor elevation (as for electronic supplementary material, figure S1C), and start the target trajectory within the receptive field, 33° above the display base, the response (outlined, figure 1b(i)) rises for ca 300 ms before closely matching the spike frequency of its position-aligned control (grey, figure 1b(i)). The response onset is very similar to the one for targets traversing the whole screen: initial responses are close to spontaneous rates, and then rise near-linearly for ca 400 ms (figure 1b(ii)). This slow response onset is not localized to a particular region of the visual field: if we use targets that start closer to the hotspot (figure 1c–f(i)(ii)), all responses build up slowly for 300–500 ms.
When the target starts nearer the hotspot, the slope of the response build-up is steeper, as the control sensitivity (the underlying receptive field) is higher (e.g. figure 1c(ii)). Additionally, in comparisons with shorter target trajectories, the temporal effects differ, since accumulation of post-excitatory inhibition is activity dependent (compare figure 1a(i) with f(i)). This inhibition is apparent following all trajectories, except the shortest (310 ms, figure 1f(i)). During longer target trajectories, the neuron is thus subjected to two counteracting forces: response facilitation, which takes hundreds of milliseconds to build to full effect, and an activity-dependent inhibitory depression.
We can normalize for the receptive field's underlying spatial structure by dividing the response to targets commencing within the receptive field (outlined, figure 1b–f(i)) with their position aligned controls (grey, figure 1b–f(i)). The control represents the response to targets that start their trajectory at the base of the visual display (as seen in figure 1a). Our analysis reveals a slow progressive response increase that plateaus after 300–500 ms (figure 1(iii)). The confounding influence of inhibitory build-up during the control (long trajectory) is likely, if anything, to speed up the rate at which responses to stimuli commencing within the receptive field approach ‘control’ levels. The time course revealed by our normalization thus, if anything, underestimates the underlying response build-up.
To confirm that the slow onset is not unique to vertical target motion (the average across start positions is shown in figure 2a), we use a similar analysis for horizontally drifting targets (figure 2b). We recently revealed a strong interaction between CSTMD1 and its contralateral counterpart [15]. This interaction probably affects responses to horizontal target drifts, as these have drifted through the receptive field of the contralateral CSTMD1 before reaching the recorded neuron. Nevertheless, the response to horizontal target trajectories also shows a slow build-up, lasting at least 300–400 ms (figure 2b). To confirm that slow response onset is not unique to a particular recording, we pooled data across neurons, and find slow response build-ups to vertical (figure 2c) and horizontal target motion (figure 2d). We conclude that the slow response facilitation is position and direction invariant.
(b). Response decay
We previously showed that the velocity tuning of CSTMD1 is well modelled by motion detectors using a relatively brief delay time constant (approx. 40 ms, [12]). Is the slow response build-up simply the result of slow dynamics in the underlying response operating after motion detection (i.e. additional low-pass filtering)? To investigate this, we quantified the response decay when vertically drifting targets cease motion within the receptive field. After fitting a one-phase decay function to the normalized data (figure 2e), we find a half-time of 46 ms, considerably shorter than for onset facilitation. This strong asymmetry in response offset compared with onset argues strongly against a simple low pass filter mechanism.
4. Discussion
(a). Mechanisms underlying facilitation
CSTMD1 is a higher order neuron that does not receive its input directly from elementary STMDs, but indirectly through other STMDs synapsing with its inputs in the lateral mid-brain [15]. Additional synaptic delays on this complex input pathway will increase the initial target detection time and may explain the relatively long absolute latency (figure 1(ii)), but are unlikely to account for the subsequent prolonged response facilitation.
A key finding is that when target motion ceases (figure 2e), response offset is dramatically faster than the build-up at response onset. This argues strongly against the most parsimonious explanation for slow onset: that it reflects a simple low-pass filter mechanism operating in higher order neurons that integrate local motion detector outputs, as this would impart sluggishness to both onset and offset, and independent of the contrast of the feature.
An alternative possibility, suggested by the asymmetry in the onset versus offset time course, is that the STMD pathway uses a second order motion detector network (e.g. [18]). Here, a first layer would mediate initial detection of small targets between neighbouring ommatidia (e.g. the elementary small target motion detection scheme [16]). Local target signals would then be processed by a second layer of motion detectors, operating on a larger spatial baseline and with longer neural delays, allowing responses to facilitate to continuous target motion, while preserving small-size selectivity and sensitivity to relatively fast-moving targets. It would also reject noise in local motion detector outputs (since this would not be correlated in space and time), permitting very high amplification. Such a scheme would generate sensitivity to second order motion, even though the stimuli we used here are all first order. Behavioural evidence for second order motion detection, with long response delays (several hundred milliseconds), has been found in Drosophila [19].
(b). Behavioural significance
In dragonflies, behavioural delays to target stimuli are only 25–30 ms [20]. This is very fast compared with the slow response facilitation we have shown here. Nevertheless, CSTMD1 is a higher order neuron that projects to the contralateral lobula [12]. Other dragonfly [14] and hoverfly [21] STMDs have small receptive fields and probably project directly to descending neurons. Barnett et al. [21] found that apparent slip in positional information for different target directions was less than 1° at a speed of 50° s−1, suggesting effective latency of less than 20 ms, more consistent with behavioural observations [20]. The role of CSTMD1 could potentially be to modulate the gain of small-field-STMDs, or other interneurons, through its contralateral projection. Continuous target trajectories are more likely to represent behaviourally relevant stimuli, ensuring that gain modulation is not initiated by random background scene features. Careful analysis of the absolute response delays of other STMDs and their dependence on parameters such as contrast and size is required in further physiological and behavioural analyses.
Acknowledgements
We thank the staff of the Botanical Gardens of Adelaide, and the reviewers for providing helpful suggestions. This work was funded by AFOSR (FA2386-09-1-4058), ARC (DP0880983) and VR (2008-2933).
References
- 1.Collett T. S. 1980. Angular tracking and the optomotor response. An analysis of visual reflex interaction in a hoverfly. J. Comp. Physiol. A 140, 145–158 10.1007/BF00606306 (doi:10.1007/BF00606306) [DOI] [Google Scholar]
- 2.Olberg R. M., Worthington A. H., Venator K. R. 2000. Prey pursuit and interception in dragonflies. J. Comp. Physiol. A 186, 155–162 10.1007/s003590050015 (doi:10.1007/s003590050015) [DOI] [PubMed] [Google Scholar]
- 3.Wehrhahn C., Poggio T., Bülthof H. 1982. Tracking and chasing in houseflies (Musca). Biol. Cybern. 45, 123–130 10.1007/BF00335239 (doi:10.1007/BF00335239) [DOI] [Google Scholar]
- 4.Land M. F. 1981. Optics and vision in invertebrates. In Handbook of sensory biology, vol. VII/6B (ed. Autrum H.), pp. 471–592 Berlin, Germany: Springer [Google Scholar]
- 5.Land M. F., Nilsson E. 2002. Animal eyes. Oxford animal biology series. Oxford, UK: Oxford University Press [Google Scholar]
- 6.Nordström K., Barnett P. D., O'Carroll D. C. 2006. Insect detection of small targets moving in visual clutter. PLoS Biol. 4, 378–386 10.1371/journal.pbio.0040378 (doi:10.1371/journal.pbio.0040378) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Olberg R. M. 1981. Object- and self-movement detectors in the ventral nerve cord of the dragonfly. J. Comp. Physiol. A 141, 327–334 10.1007/BF00609935 (doi:10.1007/BF00609935) [DOI] [Google Scholar]
- 8.Orban G. A., Kato H., Bishop P. O. 1979. End-zone region in receptive fields of hypercomplex and other striate neurons in the cat. J. Neurophysiol. 42, 818–832 [DOI] [PubMed] [Google Scholar]
- 9.Straw A. D., Warrant E. J., O'Carroll D. C. 2006. A ‘bright zone’ in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity. J. Exp. Biol. 209, 4339–4354 10.1242/jeb.02517 (doi:10.1242/jeb.02517) [DOI] [PubMed] [Google Scholar]
- 10.Horridge G. A. 1978. The separation of visual axes in apposition compound eyes. Phil. Trans. R. Soc. Lond. B 285, 1–59 10.1098/rstb.1978.0093 (doi:10.1098/rstb.1978.0093) [DOI] [PubMed] [Google Scholar]
- 11.Land M. F. 1997. Visual acuity in insects. Annu. Rev. Entomol. 42, 147–177 10.1146/annurev.ento.42.1.147 (doi:10.1146/annurev.ento.42.1.147) [DOI] [PubMed] [Google Scholar]
- 12.Geurten B. R. H., Nordström K., Sprayberry J. D. H., Bolzon D. M., O'Carroll D. C. 2007. Neural mechanisms underlying target detection in a dragonfly centrifugal neuron. J. Exp. Biol. 210, 3277–3284 10.1242/jeb.008425 (doi:10.1242/jeb.008425) [DOI] [PubMed] [Google Scholar]
- 13.Nordström K., O'Carroll D. C. 2009. Feature detection and the hypercomplex property in insects. Trends Neurosci. 32, 383–391 10.1016/j.tins.2009.03.004 (doi:10.1016/j.tins.2009.03.004) [DOI] [PubMed] [Google Scholar]
- 14.O'Carroll D. 1993. Feature-detecting neurons in dragonflies. Nature 362, 541–543 10.1038/362541a0 (doi:10.1038/362541a0) [DOI] [Google Scholar]
- 15.Bolzon D. M., Nordström K., O'Carroll D. C. 2009. Local and large-range inhibition in feature detection. J. Neurosci. 29, 14 143–14 150 10.1523/JNEUROSCI.2857-09.2009 (doi:10.1523/JNEUROSCI.2857-09.2009) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Wiederman S. D., Shoemaker P. A., O'Carroll D. C. 2008. A model for the detection of moving targets in visual clutter inspired by insect physiology. PLoS ONE 3, e2784. 10.1371/journal.pone.0002784 (doi:10.1371/journal.pone.0002784) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Straw A. D. 2008. VisionEgg: an open-source library for realtime visual stimulus generation. Front Neuroinf. 2, 4. 10.3389/neuro.01.016.2008 (doi:10.3389/neuro.01.016.2008) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Zanker J. 1994. Modelling human motion perception. II. Beyond Fourier motion stimuli. Naturwissenschaften 81, 200–209 10.1007/BF01138544 (doi:10.1007/BF01138544) [DOI] [PubMed] [Google Scholar]
- 19.Theobald J. C., Duistermars B. J., Ringach D. L., Frye M. A. 2008. Flies see second-order motion. Curr. Biol. 18, R464–R465 10.1016/j.cub.2008.03.050 (doi:10.1016/j.cub.2008.03.050) [DOI] [PubMed] [Google Scholar]
- 20.Olberg R. M., Seaman R. C., Coats M. I., Henry A. F. 2007. Eye movements and target fixation during dragonfly prey-interception flights. J. Comp. Physiol. A 193, 685–693 10.1007/s00359-007-0223-0 (doi:10.1007/s00359-007-0223-0) [DOI] [PubMed] [Google Scholar]
- 21.Barnett P. D., Nordström K., O'Carroll D. C. 2007. Retinotopic organization of small-field-target-detecting neurons in the insect visual system. Curr. Biol. 17, 569–578 10.1016/j.cub.2007.02.039 (doi:10.1016/j.cub.2007.02.039) [DOI] [PubMed] [Google Scholar]