JEB desktop wallpaper calendar 2016

JEB desktop wallpaper calendar 2016

Beyond the Jamming Avoidance Response: weakly electric fish respond to the envelope of social electrosensory signals
Sarah A. Stamper, Manu S. Madhav, Noah J. Cowan, Eric S. Fortune


Recent studies have shown that central nervous system neurons in weakly electric fish respond to artificially constructed electrosensory envelopes, but the behavioral relevance of such stimuli is unclear. Here we investigate the possibility that social context creates envelopes that drive behavior. When Eigenmannia virescens are in groups of three or more, the interactions between their pseudo-sinusoidal electric fields can generate ‘social envelopes’. We developed a simple mathematical prediction for how fish might respond to such social envelopes. To test this prediction, we measured the responses of E. virescens to stimuli consisting of two sinusoids, each outside the range of the Jamming Avoidance Response (JAR), that when added to the fish's own electric field produced low-frequency (below 10 Hz) social envelopes. Fish changed their electric organ discharge (EOD) frequency in response to these envelopes, which we have termed the Social Envelope Response (SER). In 99% of trials, the direction of the SER was consistent with the mathematical prediction. The SER was strongest in response to the lowest initial envelope frequency tested (2 Hz) and depended on stimulus amplitude. The SER generally resulted in an increase of the envelope frequency during the course of a trial, suggesting that this behavior may be a mechanism for avoiding low-frequency social envelopes. Importantly, the direction of the SER was not predicted by the superposition of two JAR responses: the SER was insensitive to the amplitude ratio between the sinusoids used to generate the envelope, but was instead predicted by the sign of the difference of difference frequencies.


Weakly electric fish generate an electric organ discharge (EOD) that results in an electric field that surrounds the fish's body. In Eigenmannia, the EOD is quasi-sinusoidal and when fish are in close proximity (~1 m or less) their EODs interact. In the case of two nearby conspecifics, the combined EOD signal has a modulation, termed the amplitude modulation (AM). If there are more than two nearby conspecifics or relative movements between conspecifics, the combined EOD signal contains modulations of the AM, which has been termed the electrosensory envelope (Middleton et al., 2006).

The interactions of two EODs have been well studied in relation to the Jamming Avoidance Response (JAR). When two nearby conspecifics have EOD signals S1 and S2 at frequencies of f1 and f2, respectively, the combined signal, S1+S2, has an emergent AM. The AM frequency is at the frequency difference, |df|, where df=f2f1. When two neighboring Eigenmannia have EODs of similar frequency (e.g. 500 and 505 Hz, with |df|=5 Hz) they perform the JAR, during which each fish will raise or lower their individual EOD frequency to increase |df|, and thus the AM frequency.

When there are three or more EOD signals it is possible that fish are responding not only to the AM but also to the emergent envelope. Here we define a ‘social envelope’ as the modulation of the AM that occurs when at least three EODs are added. For example, if there are three EOD signals, S1, S2 and S3, at frequencies f1, f2 and f3, respectively, the combined signal S1+S2+S3 can have an AM; the magnitude of this AM also fluctuates over time, referred to here as the envelope of the AM (Fig. 1A) (see Appendix, Definition of envelopes). Thus, it is possible that even with high |df| values there could be a low-frequency envelope (as shown in Fig. 1).

Understanding the behavioral relevance and sensory processing of envelope information has proven challenging in part because the extraction of envelope information requires nonlinear processing (Fig. 1B; see Appendix, Methods for envelope extraction). However, recent neurophysiological studies have already identified envelope-related neural activity at each level from the receptor afferents to the midbrain in weakly electric fish (Middleton et al., 2006; Middleton et al., 2007; Longtin et al., 2008; Savard et al., 2011; McGillivray et al., 2012), suggesting that not only can the fish extract envelope information but there might also be behavioral relevance of these signals for the animals.

Model-based prediction of the Social Envelope Response

The beauty of the JAR is that the behavioral response can be predicted based on a simple algorithm (Heiligenberg, 1991). For the fish to shift its EOD frequency in the ‘correct’ direction (e.g. the direction that increases |df|), the fish must be able to compute the sign of the df. The fish does this without an efference copy of its own EOD (Bullock et al., 1972) using amplitude and phase modulation information measured across the body (e.g. multiple electroreceptors) (Metzner, 1999).

Fig. 1.

Social electrosensory envelopes. (A) A signal composed of three sinusoids added together (blue) at frequencies of 505 (S1), 450 (S2) and 550 Hz (S3). The interactions of these stimuli create an amplitude modulation (AM; black), which can be extracted from the signal using a Hilbert transform. Because the S1 amplitude is larger than the amplitude of S2 and S3, a well-defined envelope emerges (red) that can be extracted from the AM using a Hilbert transform. (B) Power spectra of the signal (blue), the AM (black) and the envelope (red). The two peaks of the AM correspond to the |df| values at 45 and 55 Hz and the peak of the envelope corresponds to the |ddf| at 10 Hz.

The JAR computation is diagrammatically represented as a Lissajous figure in the amplitude-phase plane (Fig. 2A), which was pioneered by Heiligenberg and Bastian (Heiligenberg and Bastian, 1980) and has been verified through electrophysiological recordings (Bastian and Heiligenberg, 1980). The plot is the magnitude (x-axis) versus the phase (y-axis) of the complex representation of the combined signal (see Appendix, The amplitude-phase Lissajous). The Lissajous trajectory will rotate clockwise for negative df and counter-clockwise for positive df at a frequency of |df|. The direction of rotation of the Lissajous predicts the direction that the fish will shift its EOD during the JAR.

When three sinusoids (or EODs) interact, AMs emerge at each of the |df| values, and the Lissajous is more complicated (Fig. 2B). For example, if there are three EOD signals, S1, S2 and S3, at frequencies f1, f2 and f3, there will be AMs at the magnitudes of the following df values: df2=f2f1, df3=f3f1 and df1=f3f2. However, the signal measured by each fish is typically dominated by its own EOD. So, for fish 1 the signal S1 dominates the others (S2 and S3) and correspondingly, the AMs at |df2| and |df3| dominate the AM at |df1|. In this case, the AM at |df1| can be considered negligible, and the dominant envelope frequency emerges at ddf=|df3|−|df2| (see Eqn A18). Note that ddf is a signed quantity, which is important to the predictions stated below.

In this paper, we hypothesize that the JAR circuit can be extended to predict a behavioral response to signals outside the range of the JAR that nevertheless generate low-frequency envelopes. In some cases, two conspecific signals (S2 and S3) when added to S1 produce a low-frequency envelope (see Appendix, Caveats of the analytic signal method). Two such cases are depicted in Fig. 2B – positive and negative ddf. At first glance, the ‘floral’ pattern of the Lissajous seems to lack a consistent rotation. However, each of the ‘petals’ precesses in a direction corresponding to the sign of the ddf, at frequency |ddf| (see Appendix, The amplitude-phase Lissajous). Upon low-pass filtering of both the amplitude and phase signals, the petals are filtered out and the general, slow precession emerges (Fig. 2C).

Fig. 2.

Amplitude-phase Lissajous of two or three sinusoidal signals. (A) The sum of two signals S1 and S2 produces a circular graph that rotates counter-clockwise for positive df (top) and clockwise for negative df (bottom), at frequency |df|. (B) The sum of three signals S1, S2 and S3 results in a more complex Lissajous figure, for positive ddf (top) and negative ddf (bottom). The Lissajous has a local rotation (arrows on petals) and also a general precession (external arrow and increasing color gradient on petals) (C) The amplitude and phase from B were low-pass filtered (Butterworth, sixth-order, 20 Hz normalized cut-off). This shows that there is a low-frequency precession of the graph in the counter-clockwise direction for positive ddf (top) and clockwise for negative ddf (bottom). The precession is at frequency |ddf|.

Fig. 3.

The fish's EOD is recorded via head–tail electrodes (red circles) and amplified (A). Stimuli to the fish are applied via transverse electrodes (black circles). Stimuli consist of a single sinusoid (S2) or a sum of two sinusoids (S2+S3). The frequency of the recorded EOD is extracted (f1), and a controller adds the stimulus values of df2 and df3 to f1 to produce output frequencies f2 and f3, respectively. The signal generator produces sinusoids S2 and S3 at frequencies f2 and f3. S2 and S3 are added, and applied to the tank through a stimulus isolation unit (SIU). A dipole (small yellow circles) was used to measure the local electric field.

Interestingly, as the amplitude ratio between the signals is inverted, the direction of rotation of individual petals flips, but the direction of the precession remains unchanged. Does the fish respond to the direction of the petals (df values and amplitude ratio) or the precession (ddf)? When the df values are within the JAR range the response of the fish follows the petals (Partridge and Heiligenberg, 1980). But what happens when the df values are outside the JAR range? We hypothesize that fish respond to the emergent envelope at the |ddf|, governed by the precession as revealed by the low-pass filtered model (see Appendix, The amplitude-phase Lissajous). If, as our model predicts, the fish uses a downstream low-pass filter from the JAR circuit to extract envelope information, it could drive a behavioral Social Envelope Response (SER), much like the JAR to AM stimuli.


Adult Eigenmannia virescens (Valenciennes 1836) (10–15 cm in length) were obtained through a commercial vendor and housed in aquarium tanks with a water temperature of ~27°C and conductivity in the range of 150–300 μS cm−1 (Hitschfeld et al., 2009). All fish used in these experiments were housed in social tanks that contained two to five individuals. These experiments were conducted at the Johns Hopkins University between 2009 and 2012. All experimental procedures were approved by the Johns Hopkins Animal Care and Use Committee and followed guidelines established by the National Research Council and the Society for Neuroscience.

Experimental procedure

Each individual fish (N=4) was transferred to the testing tank (27±1°C and 175±25 μS cm−1) and allowed to acclimate for 2–12 h before experiments began. During the acclimation period a second fish was also in the testing tank, to provide recent social experience, but was removed before the start of the experiment. For testing, the experimental fish was restricted in a chirp chamber to prevent movement. Experiments were started when the EOD frequency did not change by more than ±1 Hz for at least 25 consecutive minutes, which typically took 1–3 h.

Fig. 4.

Eigenmannia virescens do not show a change in EOD frequency (Δf1) when stimulated with a single sinusoid with |df| >50 Hz (control; gray). The fish respond to sums of two sinusoids that contain a low-frequency envelope. Two trial types are shown, where df2=−50 and df3=+52 (+2 Hz envelope; blue lines) and where df2=−52 and df3=+50 (−2 Hz envelope; red lines). The fish shift their frequency down for positive envelopes (blue trials) and up for negative envelopes (red trials).

Trials were presented across multiple testing blocks that lasted 1–3 h and were completed on different days. Between testing sessions the fish was returned to its home tank to reduce changes in response due to motivation, fatigue or other unknown factors. If the EOD responses of the fish deteriorated over the course of testing the fish was placed back in the home tank for 1–5 days and then re-tested.

Experimental setup

The chirp chamber was positioned such that the fish was located in the middle of two electrodes (head-to-tail) separated by 25 cm (Fig. 3, red electrodes), used to record the EOD. All stimuli were applied into the tank via transverse electrodes separated by 25 cm with the fish located in the middle (Fig. 3, black electrodes). A 1 cm transverse dipole (Fig. 3, yellow electrodes) adjacent to the head of the fish measured the local electric field, which was used to estimate stimulus amplitude.

At the start of each trial the initial EOD frequency of the fish (f1i) was extracted. All trials within a testing block were presented randomly for each fish. Each trial lasted 200 s with an inter-trial interval of 200 s. For each trial, the fish was presented with a stimulus that was either a single sinusoid (control trials; S2) or a sum of two sinusoids (envelope trials; S2+S3).

For the envelope trials, the frequencies of the individual sinusoids (f2 and f3) were calculated by adding a specified initial frequency difference (dfi) to f1i, i.e. f2=f1i+df2i and f3=f1i+df3i. For control trials, only f2 was calculated and applied. The frequencies f2 and f3 were held constant, i.e. not clamped to f1, so changes in the fish's EOD frequency results in changes in the value of each df and the ddf.

Fig. 5.

The Social Envelope Response (SER) is dependent on ddf and not df. In each panel, the initial ddf was varied from −8 to +8 Hz in 2 Hz intervals (excluding 0). (A) df2=±50 Hz, (B) df2=±70 Hz and (C) df2=±90 Hz. The strength and direction of SER responses was dependent on the ddf. In contrast, fish show no systematic differences in responses to ddf values as a function of the range of df2 and df3 values used.

Experimental stimuli

Control trials

All fish completed trials (N=20) with a single sinusoid stimulus (S2) at a specified high |df| (>40 Hz). The initial df values used were ±52, 58, 72, 78, 92 and 98 Hz, which are outside the range of frequencies known to elicit the JAR. These df values were a subset of those used to create the envelope stimuli in other trials (see below). For all control trials the stimulus amplitude was 0.74 mV cm−1 and the stimulus amplitude ramp time was 20 s.

Amplitude trials

All fish completed trials (N=10), with a sum of two sinusoids (S2+S3) that produced a ddfi of ±4 Hz. The initial df values used were ±48 and ±52, such that there were two trial types: df2i=−48 and df3i=+52 or df2i=−52 and df3i=+48, which resulted in a +4 Hz and a −4 Hz envelope, respectively. These trials were repeated at five different stimulus amplitudes (0.15, 0.45, 0.74, 1.05 and 1.34 mV cm−1) with a ramp time of 20 s.

Envelope trials

All fish completed trials (N=48) with a sum of two sinusoids (S2+S3) that produced a specified ddfi. Trials were completed with df2i=±50, ±70 or ±90 with df3i sweeping from −df2i−8 to −df2i+8 at intervals of 2 Hz. For example, for df2i=50, df3i was set at each of the following values for individual trials: −58, −56, −54 or −52 (resulting in initial ddf values of −8, −6, −4 and −2 Hz) or −48, −46, −44 and −42 (resulting in initial |ddf| values of 2, 4, 6 and 8 Hz). For trials where df2i=−50, the df3i values were the same as the above example, except with a positive sign. This was repeated for df2i=±70 and ±90, resulting in trials with ddfi values from −8 to +8 in increments of 2 Hz (excluding 0), produced by df values of varying frequencies. All trials were completed with combined stimulus amplitude of 0.74 mV cm−1 and a ramp time of 20 s.

Ramp-time trials

One fish completed trials (N=30) with a sum of two sinusoids (S1+S2), where three amplitude ramp times were tested (1, 20 and 100 s). Each ramp time was repeated for two envelope frequencies (+4 Hz: df2i=−48, df3i=+52; and −4 Hz: df2i=−52, df3i=+48) and five stimulus amplitudes (0.15, 0.45, 0.74, 1.05 and 1.34 mV cm−1).

Ratio trials

One fish completed trials (N=10) with a sum of two sinusoids (S2+S3), where the relative amplitudes of each individual component were varied at a ratio of 1:1, 1:3, 2:3, 3:2 and 3:1 for envelopes of +4 Hz (df2i=−48, df3i=+52) and −4 Hz (df2i=−52, df3i=+48).

Data analysis

For each trial the recorded EOD was used to compute the EOD frequency as a function of time, f1(t). This was achieved via post-processing with a custom script in MATLAB (MathWorks, Natick MA, USA) that computed the spectrogram of the recorded signal and determined f1(t) as the frequency with the highest power near the fish's baseline EOD frequency. The baseline f1i was measured at the start of each trial using a frequency-to-voltage (F2V) converter (FV-1400, Ono-Sokki, Yokohama, Japan). For 60 trials the output of the F2V converter was verified against post-experiment Fourier analysis. The error between the two measurements was negligible (mean ± s.d.=0.0008±0.054 Hz). f1 stabilized by the last 60 s of each trial; f1f is the mean frequency measured over this period. The change in frequency was calculated as Δf1=f1ff1i.

For each trial, Δf1 was normalized to the individual fish's maximum response, |Δf1max|, to allow responses to be compared across fish. Because fish could raise or lower their EOD frequency, some measures are normalized as |Δf1|/|Δf1max|. Dependent measures were analyzed using one-way repeated-measures ANOVA. For significant main effects, effect size (ηp2) is given to allow comparison between measures. Additionally, post hoc Tukey's honestly significant difference (HSD) tests were run on each significant main effect. We indicate the critical value (Qcrit) for each test and provide the obtained values (Qobt) only for those that were statistically significant (i.e. greater than the critical value).


EOD frequency changes were not elicited by high |df| values

To ensure that observed responses were not due to the individual df values, we conducted control trials where fish were presented with a single sinusoid stimulus that had a high |df|. We measured Δf1 during the last 60 s of the inter-trial interval and found that the EOD frequency was stable without stimulation (mean ±s.e.m.=0.05±0.006 Hz). In addition, Δf1 across the first 10 s (0.23±0.03=Hz) and the last 60 s (0.52±0.04 Hz) of control stimulus presentation produced only nominal changes to the EOD frequency. Responses to all control trials by a single fish are shown in Fig. 4A. Thus, it is unlikely that the observed Δf1 to the sum of sinusoid stimuli (which has an emergent envelope) was due to a response to any individual component alone.

Fish exhibited an SER

The sum of two sinusoid stimuli (S2+S3) elicited changes in EOD frequency. Fig. 4 shows a characteristic SER of a single fish to two replicates of a +2 Hz envelope (df2=−50, df3=+52; blue) and two replicates of a −2 Hz envelope (df2=−52, df3=+50; red). The figure shows that the envelope response differs from the response observed to control stimuli (gray).

Across all fish, responses to control stimuli were minimal (range=0.05 to 0.74 Hz) compared with the SERs (range=1 to 4 Hz). Moreover, the time course of EOD change during control trials was much larger than the time course of the SER, which corresponded to the stimulus ramp time (20 s). In addition, responses to control trials were biased downward, while the SERs were bidirectional. The direction of the SER shows that the fish shifts its EOD frequency down when the envelope frequency (ddf) is positive and up when the envelope frequency is negative. The direction of the SER was typically opposite the sign of the ddf, resulting in the EOD shifting towards the closer df (although the final |df| values were 40 Hz or above).

SER was stronger for lower-frequency envelopes

Fish changed f1 in response to sum-of-sinusoid stimuli that created initial envelopes in the frequency range of |ddfi|=2 to 8 Hz as illustrated for a single fish in Fig. 5. The figure also illustrates that Δf1 is qualitatively similar across all df values used. However, the strength of the SER (the change in EOD frequency during a trial) is dependent upon on |ddfi| (Fig. 6A). The effect of the initial absolute envelope frequency, |ddfi|, on the normalized absolute EOD frequency change, |Δf1|/|Δf1max|, was significant (F3,9=6.45, P=0.04, ηp2=0.68). Normalized |Δf1| is generally smaller as a function of larger initial ddf: mean ± s.e.m.=0.59±0.04 for 2 Hz, 0.52±0.03 for 4 Hz, 0.34±0.03 for 6 Hz and 0.39±0.04 for 8 Hz. The only significant pairwise differences (Tukey's HSD, Qcrit=4.41) were between the lowest envelope frequency (2 Hz) and those higher than 6 Hz (2 Hz versus 6 Hz: Qobt=4.45; 2 Hz versus 8 Hz: Qobt=5.51; Fig. 6A, asterisks). The rest of the pairwise comparisons were not significant (Qobt<4.41).

SER increased the envelope frequency

Fish change f1 in response to initial envelope stimuli, which resulted in a change in the envelope frequency (Fig. 6B). In general, the final absolute envelope frequency settles in the range of 5–15 Hz (mean ± s.e.m.=8.87±0.20 Hz). The change in envelope frequency (Δddf=|ddff|−|ddfi|) as a function of ddfi is shown in Fig. 6C. We found a significant effect of the initial envelope frequency (|ddfi|) on the Δddf (F3,9=6.32, P=0.01, ηp2=0.68) such that the change in envelope frequency, |Δddf|, was smaller as a function of larger |ddfi|: mean ± s.e.m.=4.78±0.68 for 2 Hz, 4.57±0.51 for 4 Hz, 2.86±0.36 for 6 Hz and 3.29±0.59 for 8 Hz. The only significant pairwise differences (Tukey's HSD, Qcrit=4.41) were between 2 and 6 Hz (Qobt=5.05) and between 4 and 6 Hz (Qobt=4.50), where the change in envelope frequency was greater for the lower initial envelope frequency in each pair.

SER depended on stimulus amplitude and not the rate of amplitude change

The strength of the SER, measured by the magnitude |Δf1|, increased as a function of stimulus amplitude (shown for one fish in Fig. 7A). The effect of stimulus amplitude on the normalized |Δf1| was significant (F4,12=7.16, P=0.02, ηp2=0.71; Fig. 7B). The change in frequency, |Δf1|, was generally larger for larger stimulus amplitudes: mean ± s.e.m.=0.32±0.07 for 0.15 mV cm−1, 0.49±0.09 for 0.45 mV cm−1, 0.68±0.11 for 0.74 mV cm−1, 0.63±0.09 for 1.05 mV cm−1 and 0.83±0.06 for 1.34 mV cm−1. There were significant pairwise differences (Tukey's HSD, Qcrit=4.21) between the lowest stimulus amplitude (0.15 mV cm−1) and those higher than 0.74 mV cm−1 (0.15 versus 0.74: Qobt=5.16; 0.15 versus 1.05: Qobt=4.49 and 0.15 versus 1.34: Qobt=7.20) and between the second lowest stimulus amplitude (0.45 mV cm−1) and the highest stimulus amplitude (0.45 versus 1.34: Qobt=4.73; Fig. 7B, asterisks). Other pairwise comparisons were not significant (Qobt<4.20).

Fig. 6.

SER strength as a function of initial ddf. (A) Normalized |Δf1| (1 indicates greatest response, 0 indicates lowest response) was significantly greater when the initial |ddf| was lower. (B) The f1 generally shifted in the predicted direction for all fish (colored circles). For most responses, the final envelope frequency was greater than the initial envelope frequency. This is visualized on the plot when the magnitude of the data point is greater than the unity (dashed line). In the three trials that did not go in the predicted direction (purple circles, bottom right), the fish nevertheless increased the envelope by having a stronger response but in the opposite direction. Final |ddf| values were typically between 5 and 15 Hz (shaded band). (C) The change in envelope frequency (Δddf=|ddff|–|ddfi|) as a function of ddfi. The |Δddf| was generally decreased for initial envelopes that were higher in frequency.

The effect of stimulus amplitude on final |ddff| was significant (F4,12=7.99, P=0.04, ηp2=0.73; Fig. 7C). There was a significant pairwise difference (Tukey's HSD, Qcrit=4.20) between the lowest stimulus amplitude (0.15 mV cm−1) and those higher than 0.74 mV cm−1 (0.15 versus 0.74: Qobt=5.25; 0.15 versus 1.05: Qobt=4.71; and 0.15 versus 1.34: Qobt=7.65) and between the second lowest stimulus amplitude (0.45 mV cm−1) and the highest stimulus amplitude (0.45 versus 1.34: Qobt=4.83). Other pairwise comparisons were not significant (Qobt<4.20).

Fig. 7.

SER as a function of stimulus amplitude. (A) EOD frequency traces showing that the strength of the Δf1 increases as the stimulus amplitude was increased from 0.15 to 1.34 mV cm−1. The light blue box indicates the period (ramp time) over which the stimulus amplitude was increased from zero to its final value. (B) There was a significant effect of the stimulus amplitude on the strength of the EOD frequency change where stronger responses were observed for higher stimulus amplitudes. (C) The final |ddf| was significantly higher in frequency for larger stimulus amplitudes, across individuals (color-coded).

In data from one fish, differences in ramp time did not effect the strength of the SER, |ゔf1| (Fig. 8). Thus, the SER strength depended on the amplitude of the stimulus, but not on the rate of change of amplitude.

SER did not switch direction with changes in amplitude ratio

For a given df2 and df3 pair, the relative amplitudes of S2 and S3 determine the rotation of the ‘petals’ of the Lissajous but not the general precession. As can be seen for ddf=−4Hz, the petals rotate counter-clockwise for ratios 1:3 and 2:3, and clockwise for 1:1, 3:1 and 3:2, but the graph precesses clockwise in all cases (Fig. 9, top). Similarly, for ddf=+4 Hz the petals rotate clockwise for ratios 3:1 and 3:2 and counter-clockwise for 1:1, 1:3 and 2:3, but the graph precesses counter-clockwise in all cases (Fig. 9, bottom).

We examined the sign of SER, measured by the sign of Δf1 in response to different stimulus amplitude ratios S2:S3 (1:1, 1:3, 2:3, 3:2 and 3:1) for ddf=±4 Hz (Fig. 9). We found that the direction of the SER depended only on the sign of ddf, not the amplitude ratio; i.e. f1 shifts up when ddf is negative, and f1 shifts down when ddf is positive (Fig. 9, middle). This supports our hypothesis that the SER is driven by the precession of the Lissajous rather than the local rotation of the petals when the df values are outside the JAR range.


Forty years of analysis of the JAR (Watanabe and Takeda, 1963; Bullock et al., 1972) have focused on mapping a well-defined computation (Heiligenberg, 1991) through all stages of neural processing, from sensory receptors to motor units (Metzner, 1999). This work was successful mainly due to a sharp focus on the specific parameters that were necessary and sufficient to drive the behavior, thereby putting aside potentially complex temporal features – such as social and movement envelopes – that are likely to be ubiquitous in a fish's electrosensory milieu (Tan et al., 2005; Stamper et al., 2010). Recent neurophysiological studies have identified neurons that respond to such electrosensory envelopes (Middleton et al., 2006; Middleton et al., 2007; Longtin et al., 2008; Savard et al., 2011; McGillivray et al., 2012), but the function of this brain activity was unknown.

Here we show the behavioral relevance of one category of electrosensory envelopes. We measured the EOD responses of E. virescens to envelope stimuli like those that would arise from the electrical interactions of three or more motionless conspecifics. We call this behavior the SER. We also proposed a simple extension of the algorithm for the JAR, a low-pass filter of the instantaneous amplitude and phase of the combined signal, which accurately predicts SER behavior.

In the SER, E. virescens raised or lowered their EOD frequency, which resulted in an increase in frequency of the envelope by approximately 2–6 Hz, with final envelope frequencies between 5 and 15 Hz. The strength of the SER depended on the initial envelope frequency and the stimulus amplitude: low initial frequencies and high stimulus amplitudes elicited the largest changes in EOD frequency. The SER direction was insensitive to the relative amplitude ratio between stimulus signals, indicating dependence on the slow precession of the Lissajous, as opposed to fast local rotations of the petals, as predicted by our model (see Fig. 9).

Mechanisms for the SER

We extended the widely known model for the control of the JAR with the addition of a low-pass filter that eliminates responses to the local rotations of the Lissajous while retaining its precession. The model does not predict where and how this computation may be implemented in the brain. Part of this computation could be implemented as a saturation nonlinearity of amplitude-coding P-receptors, which would cause them to encode envelopes (Savard et al., 2011). When combined with a rectification circuit in the electrosensory lateral line lobe (ELL) (Middleton et al., 2006; Middleton et al., 2007; Longtin et al., 2008), the amplitude axis of the Lissajous would oscillate at the envelope frequency (Eqn A27). In this case, the phase axis would be filtered independently in downstream circuits to yield the circular Lissajous that precesses at the |ddf|. Alternatively, amplitude and phase filtering may both occur in downstream circuits. In this case, the higher response thresholds (as compared with the JAR) may be necessary to overcome the attenuation caused by the filter.

Fig. 8.

The strength of the SER was determined by the final stimulus amplitude value and not the rate of change of amplitude. This was observed by comparing data for one individual fish across multiple stimulus amplitude ramp times (1, 20 and 100 s). The initial time course of the behavior increased as the ramp time increased, but the final change in EOD frequency is equivalent across all ramp times.

Possible functional relevance of the SER

In their natural habitat, weakly electric fish are commonly found in groups of three or more conspecifics (Tan et al., 2005; Stamper et al., 2010), which is a necessary condition for the SER. We showed that fish exhibited SERs that increased the frequency of envelopes to higher frequencies (up to 15 Hz). The SER appears to be analogous to the JAR, in which fish also shift their EOD frequency, effecting an increase in the frequency of the AM (Heiligenberg, 1991). It has been shown that low-frequency AMs impair aspects of electrolocation and that the JAR may allow fish to avoid this detrimental interference (Heiligenberg, 1973; Bastian, 1987). In addition to the behavioral impairment, it has also been shown that neural responses to moving objects are impaired by low-frequency jamming (Ramcharitar et al., 2005). If the SER functions analogously to the JAR, one would predict that low-frequency envelopes might also degrade electrosensory performance and impair the underlying neural responses to moving objects.

Movement envelopes

Fish are rarely completely motionless; therefore, we expect that movement-related envelopes commonly emerge in groups of two or more fish. These envelopes can encode the relative velocity between fish and possibly provide reliable cues about distance (Yu et al., 2012). We suspect that fish may also exhibit a ‘movement envelope response’ that can be driven by modulations due to the relative movement between individuals. These movement-based envelopes indeed arise in a social context, but for clarity we distinguish them from ‘social envelopes’ as defined in this paper. This distinction is important because social envelopes constitute a special class of signals that arises solely due to the details of the interactions between electric fields of three or more wave-type weakly electric fish. Movement-related envelopes, however, can arise in a variety of contexts, including from non-social sources such as the interaction of fish with objects in their environment.

In the natural habitat, a cacophony of stimuli contribute to modulations of the EOD in Eigenmannia, including simple moving objects (Carlson and Kawasaki, 2007), summations of multiple electric signals (as examined in this paper) and movements of nearby electrogenic animals (Metzen et al., 2012). In addition, amplitude and phase modulations influence each other, creating cross interactions, which also have behavioral implications (Carlson, 2008). These and related behaviors appear to be mediated by sets of simple computational rules that are instantiated in the ascending electrosensory pathways of Eigenmannia and other closely related species of weakly electric fishes. The behavioral results in this paper provide yet another platform for the analysis and re-analysis of a well-described neural circuit that is used in the control of multiple behaviors.

Fig. 9.

EOD frequency traces (middle plot) to envelope stimuli (±4 Hz) with different amplitude ratios (S2:S2=1:3, 2:3, 1:1, 3:2 and 3:1). The EOD frequency shifts up for negative ddf (red spectrum plots) and shifts down for positive ddf (blue spectrum plots). The Lissajous figures are representative angular sections of the plots at each of the tested ddf values for each amplitude ratio. As the amplitude ratio is varied the direction of the local rotation of the petals can differ from that of the general precession of the Lissajous. The individual ‘petals’ of amplitude ratios 1:3 and 2:3 (negative ddf; top) and 3:1 and 3:2 (positive ddf; bottom) rotate opposite to the precession (gray arrows). The EOD responses follow the precession and not the local rotations, indicating that they are dependent on ddf and not the stimulus amplitude ratio.


This Appendix focuses on social envelopes arising from multiple interacting motionless wave-type weakly electric fish. We address the following questions: (1) what are amplitude modulations and envelopes in the context of interacting EODs; (2) how do AMs and envelopes emerge from sums of sinusoids; and (3) what are the constraints on biological mechanisms for the extraction of AMs and envelopes?

Definition of envelopes

Interactions of the electric fields of two motionless fish with different EOD frequencies give rise to a ‘beat’ pattern at the |df| of the two EOD signals. The sum of two sinusoids can be mathematically decomposed into an amplitude- and phase-modulated signal: Embedded Image (A1) However, the structure of M(t) and ψ(t) is complicated: Embedded Image (A2) When a1>>a2>0, these signals can simplified to an intuitive expression: Embedded Image (A3) This holds for electric fish because the self-generated EOD for a fish generally dominates the EODs of conspecifics.

Mathematically, the ‘modulator’ M(t) above is referred to as the envelope of the signal. However, this quantity is termed an AM by the electric fish community, because envelope coding in electric fish is observed in the afferents of P-type electroreceptors, which code EOD amplitude increases. Thus the source signal for envelope extraction is the AM of the EOD, not the underlying EOD signal itself. We will refer to the envelope of the EOD as the AM, and the envelope of the envelope of the EOD as, simply, the envelope.

For three interacting, motionless EODs (modeled as sinusoids), M(t) and ψ(t) are more complicated. The interactions can produce a combined signal that has higher-order features, such as ‘beats of beats’ (primarily at the |ddf|), which are termed social envelopes.

The AM M(t) of a signal s(t) is the signal such that, when multiplied by a carrier signal, cosψ(t), reproduces s(t), namely s(t)=M(t)cosψ(t). Under appropriate assumptions, M(t) is a smooth curve that approximately traces the local maxima of s(t), and −M(t) its minima, and these local extrema approximately correspond to the peaks and troughs of cosψ(t). Thus, for an AM to be ‘well defined’ (in a sense formalized below), the extrema should oscillate at slower frequencies than the carrier. In the case of two sinusoids, the expression for M(t) in Eqn A2 represents a pure AM only if it is in a lower frequency band than the carrier signal cosψ(t), i.e. the signals are spectrally separated. In fact the Hilbert transform can be used to decompose such a signal into a product of its amplitude and carrier if those signals are spectrally separated (Bedrosian, 1963; Rihaczek and Bedrosian, 1966). M(t) and cosψ(t) resulting from mixing of two sinusoids as in Eqn A2 generally results in infinite harmonics; however, when a1>>a2>0 and |ω2–ω1|<ω1, the majority of the spectral content of the M(t) and cosψ(t) is band-separated, so they form well-defined AMs (Lerner, 1960; Rihaczek and Bedrosian, 1966). These restrictions can also be explained in the context of a signal, initially constructed as Embedded Image. The AM and carrier extracted by the Hilbert transform, M(t) and cosψ(t), will generally not be equal to Embedded Image and Embedded Image unless Embedded Image and Embedded Image are themselves band-separated. For three or more sinusoidal EODs, there are analogous constraints on amplitudes and frequencies of the individual EODs in order that their sum produces a well-defined envelope of the AM (see Fig. A1).

Consider a group of N weakly electric fish, assumed to be motionless, with approximated sinusoidal EODs. The EOD of fish k, where kϵ{1,2,…,N}, is perceived at an electroreceptor of fish 1 as akck, where ak is the amplitude, and ωk=2πfk is in radians, where fk is the frequency of fish k in Hz. ak is a function of the relative distance and orientation between fish 1 and fish k for k≠1, and a1 would depend on body bending of fish 1. The total signal at the electroreceptor is: Embedded Image (A4) where cos(ωktk)=cos(θk)=ck. Because s(t) is assumed to be the signal at a receptor of fish 1, the amplitude of fish 1 will generally be greatest, i.e. a1>>ak, k=2,3,…,N.

Fig. A1.

A sum of three sinusoids (blue), S1, S2 and S3, along with the AM (black) and envelope (red), as calculated from the magnitude of the analytic signal. The AM (green) and envelope (magenta) as calculated from full-wave rectification and filtering are inverted and shifted to the bottom of the combined signal. Enlarged sections of both the top and bottom profiles are shown in each of the plots. f1 is 500 Hz in all cases. (A) For df at −52 and 48 Hz (with S1:S2:S3 amplitude ratio 10:1:1), the signal has a meaningful envelope at the |ddf| at 4 Hz. (B) This is not the case when df values are −48 and 100 Hz, and there is no spectral separation with the |ddf| of 52 Hz. The analytic envelope does not follow the amplitude profile of the AMs; here the low-frequency profile is created by a secondary interaction between the |df| at 48 Hz and the |ddf| at 52 Hz. The rectification envelope with a low-pass cut-off set at 10 Hz captures this envelope. (C) When the amplitude of S1 does not dominate (S1:S2:S3 amplitude ratio 5:5:2), the analytic envelope deviates from the extrema of the AM, while the rectified signal produces an ‘envelope’ in the sense that it tracks some overall structure of the EOD, although the carrier signal is not well defined. It should be noted that the rectification envelope (magenta) in B and C have been amplified; thus this method has the penalty of reduced gain.

We have stated that amplitudes and envelopes contain frequencies at the |df| and |ddf| values, but it is clear from Eqn A4 that the signal at the electroreceptor has only components at ωk. Thus, a nonlinear method is required to extract AMs and envelopes.

Methods for envelope extraction

Magnitude of the analytic signal

A common definition of AMs is as the magnitude of the analytic signal. For a given real input signal s(t), its complex analytic signal is defined as Embedded Image, where ŝ is obtained by the Hilbert transform: Embedded Image (A5) where P denotes the Cauchy principal value and * denotes the convolution operator.

There are two key properties of the Hilbert transform used extensively below. First, the Hilbert transform is linear: Embedded Image (A6) Second, the Hilbert transform of sinusoids is given by: Embedded Image (A7)

We can express the analytic signal in polar form as Embedded Image. The AM is Embedded Image and the phase function is Embedded Image. The nonlinearity in this form of AM extraction arises not from the Hilbert transform or analytic signal construction – which are both linear – but rather from the magnitude operation.

To apply this to the sum of sinusoids signal, let Embedded Image be the complex analytic signal corresponding to akck, namely Embedded Image. Then: Embedded Image (A8) is the analytic signal of s(t) in Eqn A4. Graphical representation of this decomposition is shown in Fig. A2, for the three-sinusoid case. The real part of the analytic signal is the real signal s(t)=M(t)cosψ(t). The magnitude is calculated via: Embedded Image (A9) where Embedded Image, and the summation notation kj refers to the Embedded Image combinations of k,jϵ{1,…,N}, kj. Hence, we obain the following: Embedded Image (A10) The Taylor series expansion can be first-order approximated as: Embedded Image (A11) when |x| is small. To apply this first-order approximation to Eqn A10, note that: Embedded Image (A12) When a1 dominates, the upper bound is approximately 4(a2+…+aN)/a1, which for sufficiently large a1 is small, and the approximation in Eqn A11 is justified. Thus: Embedded Image (A13) Subtracting DC, we obtain a ‘Hilbert approximation’, MH, of the AM: Embedded Image (A14) where bkj=akaj/α. The AM is approximately a sum of (Embedded Image) cosines at the |df| values |ωk−ωj|.

Fig. A2.

Analytic representation of sum of cosines signal at time t. Each of the three short vectors represents an analytic signal; the original signals are shown on the ‘Real’ axis, and their Hilbert transforms on the ‘Imaginary’ axis. Over time, each vector rotates, tracing a circular path at its angular velocity ωk. However, because they rotate around the tip of the previous vector, the combined signal (orange vector) traces out a complex Lissajous figure such as in Fig. 2B. This combined signal can be parameterized by the magnitude, M(t), and phase, ψ(t), of the analytic signal.

The envelope of this AM is obtained as the magnitude of the analytic signal of the expression in Eqn A14. Repeating steps in Eqns A9, A10, A11, A12, A13 and A14, we obtain: Embedded Image (A15) where the summation is over the set of all [N(N2−1)(N−2)]/8 combinations of {{k,j},{p,q}} such that k,j,p,qϵ{1,…,N}, kj, pq, {k,j}≠{p,q} and: Embedded Image (A16) The envelope can be approximated as the sum of sinusoids at |ddf| values of the frequencies contained in the original sum of sinusoids. In the context of this paper (mixing of three EODs), from Eqn A15: Embedded Image (A17) where Δθ12=(ω1−ω2)t+(ϕ1−ϕ2)=2π(df1)t+(ϕ1−ϕ2). Similarly, Δθ13=2π(df2)t+(ϕ1−ϕ3) and Δθ23=2π(df3)t+(ϕ2−ϕ3). If we assume that a1>>a2 and a2>>a3, we can further approximate this as: Embedded Image (A18) where ddf=|df1|−|df2| and Φ=(|ϕ1−ϕ2|−|ϕ1−ϕ3|). Thus the envelope is primarily composed of the ddf, namely the difference of difference frequencies between fish 1 and other conspecifics.

Fig. A3.

Envelope extraction methods comparison. The input (top) is the sum of three sinusoids, S1, S2 and S3, at f1=500, f2=452 and f3=552 Hz. S2 and S3 had amplitude 0.5, while S1 had amplitude 1. The first plot in each row is the spectrum of the output of a particular method of envelope extraction, and the second column is the output when the method is used twice in succession. The methods are mnemonically depicted by a sequence of filters, H depicts extraction via the analytic signal, |·| depicts full-wave rectification and the diode depicts half-wave rectification. High-pass and band-pass filters are depicted by frequency response gain functions. It can be seen that all resulting signals from one application of each method have maximum amplitude at the |df| frequencies (48 and 52 Hz), with an additional component at the ddf (5 Hz). Applying the method twice extracts out the |ddf| component alone. When used twice, each method extracts out the ddf component alone, but with varying amplitudes.

Caveats of the analytic signal method

Real-time envelope extraction using the analytic signal is not biologically plausible, as the Hilbert transform is a noncausal operator. The analytic envelope of a narrow-band Gaussian white noise, as discussed in Middleton et al. (Middleton et al., 2006), is generally well defined. However, this breaks down as the number of sinusoidal components is reduced (unless one of the amplitudes is dominant), as shown in the case of three EODs in Fig. A1C. The approximation in Eqn A18 is not applicable for a wide range of parameters, e.g. any conspecific amplitude is non-negligible relative to a1, or insufficient band separation between f, df and ddf. These limitations do not apply to our experimental setup because: (1) the combined signal perceived by the fish is dominated by its own EOD and (2) the ddf and df values used were sufficiently separated.

Envelope extraction via rectification and low-pass filtering

A commonly used method of envelope extraction is rectification of the signal followed by filtering. A similar mechanism may be used in electric fish via rectification by having the firing threshold of a neuron close to the mean of the input, and then filtering through a slow synapse (Middleton et al., 2007; Longtin et al., 2008).

Full-wave rectification of a zero-mean signal is the absolute value of the signal. For the sum of sines from Eqn A4: Embedded Image (A19) Using the first-order Taylor approximation from Eqn A11, we obtain the following: Embedded Image (A20)

If the band of difference frequencies |ωk−ωj| is spectrally separate from that of the sum frequencies |ωkj|, an appropriate filter can extract the df values only, which form the AM. Let L(·) be such a filter, which high-passes DC and low-passes sum frequencies; applying this filter to the rectified signal yields: Embedded Image (A21) One more rectification and low-pass filtering step provides us with the envelope, at the |ddf|: Embedded Image (A22) Envelopes extracted by both methods thus have similar spectral content, and the difference frequency components are separated only by scale. Envelopes can also be extracted by half-wave rectification, with qualitatively similar results (see Fig. A3).

The amplitude-phase Lissajous

Here, we explain why the Lissajous figure as described in the paper rotates according to the df values, and why the low-pass filtered version of the Lissajous precesses according to the ddf. Consider the summed signal Eqn A4. The phase function ψ(t) is: Embedded Image (A23) Using tan−1z=(i/2){ln[(1−iz)/(1+iz)]} (where z is a complex number), we have: Embedded Image (A24) The analytic phase relative to that of fish 1 is: Embedded Image (A25) This is the phase of the sum of cosines at the |df| values, Embedded Image. The analytic signal magnitude (Eqn A14), when a1 dominates, can be further simplified to: Embedded Image (A26) The Lissajous (ML versus PL) consists primarily of df components, which is why the graph rotates according to the df values. However, ML is a first-order Taylor approximation. If, instead, we approximate to the second order, we obtain the following: Embedded Image (A27) The squared term, when expanded, will contain product terms of the form ckjcpq, which can be written as follows: Embedded Image (A28) This shows that the amplitude of the analytic signal contains ddf terms [(akajapaq)/4α3]c|kj|−|pq| (Fig. A3, top). Hence a low-pass filtered version of the Lissajous also serves as a means to extract out components at ddf, albeit with reduced magnitudes. Fig. A3 (middle, bottom) shows that a ddf component is also present in the full-wave and half-wave rectified signals. Interestingly, when we apply each extraction method twice in succession, it affects the ddf component differently. It turns out that the half-wave rectified signal contains a stronger component at the ddf than the half-wave rectified AM.


  • These authors contributed equally to this work


    This material is based on work supported by the National Science Foundation (NSF) [grants IOS-0817918 to E.S.F and N.J.C.; CMMI-0941674 to N.J.C. and E.S.F.; and CISE-0845749 to N.J.C.] and the Office of Naval Research [grant N000140910531 to N.J.C. and E.S.F.]. S.A.S. was supported by an NSF Graduate Research Fellowship.


amplitude of the kth sinusoid
amplitude modulation
ck, sk
cos(θk), sin(θk)
ckj, ck+j
cos(θk−θj), cos(θkj)
difference of df values, e.g. |df3|−|df2|
frequency difference
df1, df2, df3
f3f2, f2f1, f3f1
envelope of the combined signal
electric organ discharge
f1, f2, f3
frequencies of S1, S2 and S3, respectively
f1f, df2f, df3f, ddff
final values of f1, df2, df3 and ddf
f1i, df2i, df3i, ddfi
initial values of f1, df2, df3 and ddf
Jamming Avoidance Response
AM of the combined signal
EOD signal (measured)
S2, S3
applied sinusoid signals
Social Envelope Response
angle (rad) of the kth sinusoid, i.e. (ωktk)
phase (rad) of the kth sinusoid
phase modulation of the combined signal
frequency (rad s−1) of the kth sinusoid


View Abstract