SES Toolbox webpage



Home               FAQ               
Download               Discussion group               Contact us


You can also download the offline pdf version of this FAQ.

Section 1 - General Information

Section 2 - Installation

Section 3 - Getting started


General Information

back to the top

What is SES Toolbox made for?
What is a point process?
What is a similarity measure?
What is a spike train?
What is a Morris-Lecar neuron?
What is EEG?
What are steady-state visually evoked potentials?
What are auditory evoked potentials (AEP)?

What is a time-frequency map?
What is a bump?
What is Hilbert-Huang transform?
What is empirical mode decomposition?
What is cell migration?
 

What is SES Toolbox made for?

The SES Toolbox contains Matlab scripts for computing SES similarity measures. SES stands for Stochastic Event Synchrony, and is a family of similarity measure for point processes. SES can be applied to one-dimensional (e.g., spike trains) and multi-dimensional point processes (e.g., sparse time-frequency representations of electrophysiological signals such as matching-pursuit representations, chirplets, Hilbert-Huang transforms, and bump models).

SES tries to align events in the point processes; the better the alignment, the more similar the point processes are considered to be. More precisely, the similarity is quantified by the following parameters: time delay, variance of the timing jitter, fraction of "non-aligned'' events, and average similarity of the aligned events.

The SES measures may be viewed as extensions of the cost-based metrics of Victor et al. SES gives a statistical interpretation of those metrics, and therefore, it is able to automatically infer the unit costs, in contrast to the cost-based metrics. The latter are so far only applicable to one-dimensional point processes, whereas SES is applicable to multi-dimensional point processes as well.

We have used SES to:

·         quantify the firing reliability of Morris-Lecar neurons,

·         detect loss of EEG synchrony in Mild Cognitive Impairment patients,

·         analyze steady-state visually evoked potentials and EEG responses to auditory stimuli,

·         investigate the causal relation between morphological and molecular signaling events in cell migration.

 

What is a point process?

In mathematics, a point process is a random element whose values are "point patterns" on a set S. While in the exact mathematical definition a point pattern is specified as a locally finite counting measure, it is sufficient for more applied purposes to think of a point pattern as a countable subset of S that has no limit points.

Point processes are well studied objects in probability theory and a powerful tool in statistics for modeling and analyzing spatial data, which is of interest in such diverse disciplines as forestry, plant ecology, epidemiology, geography, seismology, materials science, astronomy, and others. Point processes on the real line form an important special case that is particularly amenable to study, because the different points are ordered in a natural way, and the whole point process can be described completely by the (random) intervals between the points. These point processes are frequently used as models for random events in time, such as the arrival of customers in a queue (queueing theory), of impulses in a neuron, referred to as "spike trains" (computational neuroscience), particles in a Geiger counter, or of searches on the world-wide web.

Source: http://en.wikipedia.org/wiki/Point_process

SES (Stochastic Event Synchrony) is a family of similarity measures for point processes. It may be applied to one-dimensional and multi-dimensional point processes.

What is a similarity measure?

Similarity is some degree of symmetry in either analogy and resemblance between two or more concepts or objects. The notion of similarity rests either on exact or approximate repetitions of patterns in the compared items. In the case of approximate repetitions we talk about statistical similarity as found in a fractal and its parts. Finding similarities or distinguishing between dissimilarities depends on the faculties of pattern recognition and disambiguation, respectively.

Source: http://en.wikipedia.org/wiki/Similarity

A similarity measure is a function that associates a numeric value with sequences such that a higher value indicates greater similarity.

SES (Stochastic Event Synchrony) is a family of similarity measures for point processes. It may be applied to one-dimensional and multi-dimensional point processes.

 

What is a spike train?

Neurons are remarkable among the cells (biology) of the body in their ability to propagate signals rapidly over large distances. They do this by generating characteristic electrical pulses called action potentials or, more simply, spikes that can travel down nerve fibers. Sensory neurons change their activities by firing sequences of action potentials in various temporal patterns, with the presence of external sensory stimuli, such as light, sound, taste, smell and touch. It is known that information about the stimulus is encoded in this pattern of action potentials and transmitted into and around the brain. It is also discovered that muscles are activated by action potentials and that motor neurons serve to convert action potentials generated by the brain into muscle movements that allow animals to interact with the environment, often in response to sensory stimuli they receive from it.

Although action potentials can vary somewhat in duration, amplitude and shape, they are typically treated as identical stereotyped events in neural coding studies. If the brief duration of an action potential (about 1ms) is ignored, an action potential sequence, or spike train, can be characterized simply by a series of all-or-none point events in time.

Spike trains

Sources: http://en.wikipedia.org/wiki/Neural_encoding and www.kyb.tuebingen.mpg.de

 

We have applied SES to spike trains generated by Morris-Lecar neurons, with the aim of quantifying the firing reliability of those neurons.

 

What is a Morris-Lecar neuron?

The Morris-Lecar neuron model is two-dimensional "reduced" dynamical model for the membrane potential of a neuron; it exhibits properties of type I and II neurons [Gutkin and Ermentrout].
The spiking behavior differs in both neuron types. To illustrate this, we show the membrane potential for 5 trials (left: type I neuron; right: type II neuron), where the input current consists of a baseline, a sinusoidal component, and additive Gaussian noise [Robinson, Dauwels et al.]:

ML Type IML Type II

The sinusoidal component forces the neuron to spikes regularly, however, the precise timing varies from trial to trial due to the additive Gaussian noise.
This can be seen more clearly from the corresponding rasterplots (50 trials), obtained by thresholding the membrane potential:

ML_1_rasterML_2_raster


In type II neurons, the timing jitter is small, but spikes tend to drop out. In type I neurons, on the other hand, fewer spikes drop out, but the dispersion of spike times is larger. In other words, type II neurons prefer to stay coherent or to be silent, on the other hand, type I neurons follow the middle course between those two extremes [Robinson].

This difference in spiking behavior is due to the way periodic firing is established. In type I neurons, periodic firing results from a saddle-node bifurcation of equilibrium points. Such neurons show a continuous transition from zero frequency to arbitrary low frequency of firing. Pyramidal cells are believed to be type I neurons. On the other hand, in type II neurons, periodic firing occurs by a sub-critical Hopf-bifurcation. Such neurons show an abrupt onset of repetitive firing at a higher firing frequency, they cannot support regular low-frequency firing. Squid giant axons and the Hodgkin-Huxley model are type II [Gutkin and Ermentrout, Robinson].

For more detailed information on Morris-Lecar neurons, click here.

References:

·         B. S. Gutkin  and G. B. Ermentrout,
Dynamics of membrane excitability determine interspike interval variability: a link between spike generation mechanisms and cortical spike train statistics.
Neural Computation 10, 1047–1065, 1998.

·         H. P. C. Robinson,
The biophysical basis of firing variability in cortical neurons,
Chapter 6 in Computational Neuroscience: A Comprehensive Approach, Mathematical Biology & Medicine Series, Edited By Jianfeng Feng, Chapman & Hall/CRC, 2003.

·         J. Dauwels, F. Vialatte, T.Weber, and A. Cichocki,
Quantifying Statistical Interdependence by Message Passing on Graphs PART I: One-Dimensional Point Processes, Neural Computation,
PDF file, 1512 KB.


In the last paper in the above list, we apply SES to spike trains generated by Morris-Lecar neurons (type I and II), with the aim of quantifying the firing reliability of those neurons.
We observed that the event reliability is significantly smaller in type I than  in type II neurons, in contrast, the timing dispersion is vastly larger.
This agrees with our intuition: since in type II neurons spikes tend to drop out, the event reliability should be larger. On the other hand, since the timing dispersion of the spikes in type I is larger, we expect the timing dispersion to be larger in those neurons.

 

What is EEG?

Electroencephalography (EEG), in the broadest sense of the term, refers to the measurement of the electrical activity produced by the brain. In clinical contexts, EEG refers to the recording of the brain's spontaneous electrical activity in the time-domain as recorded from multiple electrodes placed on the scalp. In neurology, the main diagnostic application of EEG is in the case of epilepsy, as epileptic activity can create clear abnormalities on a standard EEG study. A secondary clinical use of EEG is in the diagnosis of coma and encephalopathies. EEG used to be a first-line method for the diagnosis of tumors, stroke and other focal brain disorders, but this use has decreased with the advent of anatomical imaging modalities, such as MRI and CT.

Derivatives of the EEG technique include evoked potentials (EP), which involves averaging the EEG activity time-locked to the presentation of a stimulus of some sort (visual, somatosensory, or auditory). Event-related potentials refer to averaged EEG responses that are time-locked to more complex processing of stimuli; this technique is used in cognitive science, cognitive psychology, and psychophysiological research.

EEG traces

Sources: http://en.wikipedia.org/wiki/Electroencephalography and http://www.drzekin.hit.bg

We have applied SES to the EEG of Mild Cognitive Impairment patients, under resting conditions: 

·         J. Dauwels, F. Vialatte, T.Weber, T. Musha and A. Cichocki,
Quantifying Statistical Interdependence by Message Passing on Graphs PART II: Multi-Dimensional Point Processes, Neural Computation.
PDF file, 857 KB.

·         J. Dauwels, T. Weber, F. Vialatte, and A. Cichocki,
Quantifying the Similarity of Multiple Multi-Dimensional Point Processes by Integer Programming with Application to Early Diagnosis of Alzheimer’s Disease from EEG,
Proc. 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC08).
PDF file, 219 KB.

·         J. Dauwels, F. Vialatte, M. Vialatte, and A. Cichocki,
A Comparative Study of Synchrony Measures for the Early Diagnosis of Alzheimer’s Disease Based on EEG, NeuroImage, under revision.


 We also have analyzed the EEG responses to visual and auditory stimuli, using SES.

 

What are steady-state visually evoked potentials?

Steady State Visually Evoked Potentials (SSVEP) are signals that are natural responses to visual stimulation at specific frequencies. When the retina is excited by a visual stimulus ranging from 3.5 Hz to 75 Hz, the brain generates electrical activity at the same (or multiples of) frequency of the visual stimulus.

SSVEP

This technique is used widely with electroencephalographic research regarding vision. SSVEP's are useful in research because of the excellent signal-to-noise ratio and relative immunity to artifacts. SSVEP's also provide a means to characterize preferred frequencies of neocortical dynamic processes. SSVEP is generated by stationary localized sources and distributed sources that exhibit characteristics of wave phenomena.

Sources: http://en.wikipedia.org/wiki/Steady_state_visually_evoked_potential and www.virtualmedicalcentre.com


We have analyzed Steady State Visually Evoked Potentials, using SES:

·         J. Dauwels, T. Rutkowski, F. Vialatte, and A. Cichocki,
On the Synchrony of Empirical Mode Decompositions with Application to EEG,
Proc. IEEE Int. Conf. on Acoustics and Signal Processing (ICASSP), 2008.

·         F. Vialatte, J. Dauwels, T. Rutkowski, and A. Cichocki,
Oscillatory Event Synchrony during Steady State Visually Evoked Potentials, Advances in Cognitive Neurodynamics, Springer, October 2008.

·         F. Vialatte, J. Dauwels, M. Maurice, and A. Cichocki,
Steady-state visually evoked potentials: time-frequency analysis and oscillatory event synchrony, submitted to Cognitive Neurodynamics.

 

What are auditory evoked potentials?

Auditory evoked potential can be used to trace the signal generated by a sound, from the cochlear nerve, through the lateral lemniscus, to the medial geniculate nucleus, and to the cortex.

AEP

Auditory evoked potentials (AEPs) are a subclass of event-related potentials (ERP)s. ERPs are brain responses that are time-locked to some “event”, such as a sensory stimulus, a mental event (such as recognition of a target stimulus), or the omission of a stimulus. For AEPs, the “event” is a sound. AEPs (and ERPs) are very small electrical voltage potentials originating from the brain recorded from the scalp in response to an auditory stimulus, such as different tones, speech sounds, etc.

Source: http://en.wikipedia.org/wiki/Evoked_potential#Auditory_evoked_potential and http://www.iurc.montp.inserm.fr


We have analyzed auditory evoked potentials, using SES:

·         T. Rutkowski, J. Dauwels, F. Vialatte, and A. Cichocki,
Time-Frequency and Synchrony Analysis of Responses to Steady-state Auditory and Musical Stimuli from Multichannel EEG,
NIPS Workshop on Music, Brain and Cognition, 2007.
PDF file, 173 KB.

 

What is a time-frequency map?

A time-frequency map conveniently represents simultaneously time and frequency information. The Fourier spectrum of a signal represents the frequency content of the signal, the signal itself is in the time domain. In time-frequency maps, the frequency spectum is given for each time step so that one can see the evolution of the frequencies. Time-frequency maps can for example be computed using windowed multitaper methods or wavelets.

Wavelet transform

 

We have applied SES to sparse time-frequency representations (Morlet wavelets) of EEG signals, referred to as "bump models":

·         J. Dauwels, F. Vialatte, T.Weber, T. Musha and A. Cichocki,
Quantifying Statistical Interdependence by Message Passing on Graphs PART II: Multi-Dimensional Point Processes, Neural Computation.
PDF file, 857 KB.

·         J. Dauwels, T. Weber, F. Vialatte, and A. Cichocki,
Quantifying the Similarity of Multiple Multi-Dimensional Point Processes by Integer Programming with Application to Early Diagnosis of Alzheimer’s Disease from EEG,
Proc. 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC08).
PDF file, 219 KB.

·         J. Dauwels, F. Vialatte, M. Vialatte, and A. Cichocki,
A Comparative Study of Synchrony Measures for the Early Diagnosis of Alzheimer’s Disease Based on EEG, NeuroImage, under revision.

 

What is a bump?

In our context, we loosely define a bump as a parametric function used for atomic decomposition of the time-frequency map. Usually, half-ellipsoid bumps are used. See Vialatte et al. 2007 and bump toolbox website.

http://www.bsp.brain.riken.jp/%7Efvialatte/bumptoolbox/bump.JPG



We have applied SES to bump models of EEG signals:

·         J. Dauwels, F. Vialatte, T.Weber, T. Musha and A. Cichocki,
Quantifying Statistical Interdependence by Message Passing on Graphs PART II: Multi-Dimensional Point Processes, Neural Computation.
PDF file, 857 KB.

·         J. Dauwels, T. Weber, F. Vialatte, and A. Cichocki,
Quantifying the Similarity of Multiple Multi-Dimensional Point Processes by Integer Programming with Application to Early Diagnosis of Alzheimer’s Disease from EEG,
Proc. 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC08).
PDF file, 219 KB.

·         J. Dauwels, F. Vialatte, M. Vialatte, and A. Cichocki,
A Comparative Study of Synchrony Measures for the Early Diagnosis of Alzheimer’s Disease Based on EEG, NeuroImage, under revision.

 

 

What is Hilbert-Huang transform?

The Hilbert-Huang Transform (HHT) is a way to decompose a signal into so-called intrinsic mode functions (IMF), and obtain instantaneous frequency data. It is designed to work well for data that are nonstationary and nonlinear. In contrast to other common transforms like the Fourier Transform, the HHT is more like an algorithm (an empirical approach) that can be applied to a data set, rather than a theoretical tool. Almost all the case studies reveal that the HHT gives results much sharper than any of the traditional analysis methods in time-frequency-energy representation. Additionally, it reveals true physical meanings in many of the data examined.

The Hilbert-Huang transform (HHT) is the result of the empirical mode decomposition (EMD) and the Hilbert spectral analysis (HSA). The HHT uses the EMD method to decompose a signal into so-called intrinsic mode function, and uses the HSA method to obtain instantaneous frequency data. The HHT provides a new method of analyzing nonstationary and nonlinear time series data.

The fundamental part of the HHT is the empirical mode decomposition (EMD) method. Using the EMD method, any complicated data set can be decomposed into a finite and often small number of components, which is a collection of intrinsic mode functions (IMF). An IMF represents a generally simple oscillatory mode as a counterpart to the simple harmonic function. By definition, an IMF is any function with the same number of extrema and zero crossings, with its envelopes being symmetric with respect to zero. The definition of an IMF guarantees a well-behaved Hilbert transform of the IMF. This decomposition method operating in the time domain is adaptive and highly efficient. Since the decomposition is based on the local characteristic time scale of the data, it can be applied to nonlinear and nonstationary processes.

IMF
       Three IMFs extracted from a given signal (top); also shown is the residue (bottom)



The Hilbert spectral analysis (HSA) provides a method for examining the IMF's instantaneous frequency data as functions of time that give sharp identifications of imbedded structures. The final presentation of the results is an energy-frequency-time distribution, designated as the Hilbert spectrum.

HHS
    The HHS (bottom) of a 20Hz SSVEP signal (top).

 

Source: http://en.wikipedia.org/wiki/Hilbert-Huang_Transform

 

We have used SES to analyze the synchrony of Hilbert-Huang transforms:

·         T. Rutkowski, J. Dauwels, F. Vialatte, and A. Cichocki,
Time-Frequency and Synchrony Analysis of Responses to Steady-state Auditory and Musical Stimuli from Multichannel EEG,
NIPS Workshop on Music, Brain and Cognition, 2007.
PDF file, 173 KB.

·         J. Dauwels, T. Rutkowski, F. Vialatte, and A. Cichocki,
On the Synchrony of Empirical Mode Decompositions with Application to EEG,
Proc. IEEE Int. Conf. on Acoustics and Signal Processing (ICASSP), 2008.

 

What is empirical mode decomposition?

See Hilbert-Huang transform

 

What is cell migration?

Cell migration is a central process in the development and maintenance of multicellular organisms. Tissue formation during embryonic development, wound healing and immune responses all require the orchestrated movement of cells in a particular direction to a specific location. Errors during this process have serious consequences, including mental retardation, vascular disease, tumor formation and metastasis. An understanding of the mechanism by which cells migrate may lead to the development of novel therapeutic strategies for controlling , for example, invasive tumour cells. Cells in animal tissues often migrate in response to, and towards, specific external signals, a process called chemotaxis.

cell migration

Source: http://en.wikipedia.org/wiki/Cell_migration and http://ocw.mit.edu

 

Using SES, we investigated some aspects of the dynamics of cell migration. More specifically, we analyzed time-lapse fluorescence resonance energy transfer (FRET) images of Rac1 in motile HT1080 cells, which are human fibrosarcoma cells [Dauwels et al.]. The protein Rac1 is well known to induce filamentous structures that enable cells to migrate. We analyzed the statistical relation between Rac1 activity events and morphological events. For this purpose, we developed a novel computational method for quantifying those interdependencies. This method consists of two steps:

·         We first determine the morphological and molecular activity events from the time-lapse microscopy images. To this end, we apply edge evolution tracking (EET) [Tsukada et al.]: it identifies cellular-morphological events and molecular-activity events, and determines the distance in space between those events, taking the evolution of the cell morphology into account.

·         Next we quantify the interdependence between those morphological and activity events by means of SES: using the EET distance measure [Tsukada et al.], SES  tries to align cellular morphological with molecular activity events; the better this alignment can be carried out, the more similar the event sequences are considered to be. In addition, the method is able to determine delays between both event sequences.

We found that the delay between morphological events and activity events is negative; in other words, on average the morphological events occur first, followed by activity events: first the cell expands, then there is an  influx of Rac1.

 

References:

·         J. Dauwels, Y. Tsukada, Y. Sakumura, S. Ishii, F. Vialatte, and A. Cichocki,
On the synchrony of morphological and molecular signaling events in cell migration,
International Conference on Neural Information Processing, November 25–28, 2008, Auckland, New Zealand 2008.
PDF file, 506 KB.

·         Tsukada, Y., Aoki, K., Nakamura, T., Sakumura, Y., Matsuda, M., and Ishii, S.
Quantification of local morphodynamics and local GTPase activity by edge evolution tracking
PLoS Computational Biology 4(11): e1000223. doi:10.1371/journal.pcbi.1000223

 


Installation

back to the top
 

Downloading the toolbox
Installing the packages

Downloading the toolbox

Go to the [Download] section.

Click on the links and save the file on your local hard disk. Unzip the zip file.
If you do not have Winzip or similar software, click
here to download the latest Winzip.

The "Toolbox" directory contains the core m-files of the toolbox.  That directory is further divided into the directories "Pair_one_dim" and "Pair_multi_dim", which contain scripts of the SES measures for pairs of one-dimensional and multi-dimensional point processes respectively.

The "Demo" directory contains sample m-files used to run the toolbox. It is also divided into the directories "Pair_one_dim" and "Pair_multi_dim", which contain demos for one-dimensional and multi-dimensional point processes respectively.

In later versions, we will also include SES measures for collections of one-dimensional or multi-dimensional point processes.
 

Installing the packages

xxxxxxxxxxxxxxxxxxxxxxxxx

 


Getting started

back to the top

How must I proceed to do an experiment with the toolbox?
How can I use my own signals with the toolbox?

How must I proceed to do an experiment with the toolbox?

xxxxxxxxxxxxxxxxxxxxxxxxx

How can I use my own signals with the toolbox?

xxxxxxxxxxxxxxxxxxxxxxxxx