(Enter summary)
Abstract: This paper presents a new algorithm for the independent
components analysis (ICA) problem based on efficient spacings
estimates of entropy. Like many previous methods,
we minimize a standard measure of the departure from independence,
the estimated Kullback-Leibler divergence between
a joint distribution and the product of its marginals.
To do this, we use a consistent and rapidly converging entropy
estimator due to Vasicek. The resulting algorithm is
simple, computationally efficient,... (Update)
Context of citations to this paper: More
...closed form entropy calculation from the parametric density (e.g. Gaussian. Empirical estimators based on order statistics and spacings [91] o#er a direct path for deriving entropies from a set of data. Better methods are needed for the proper interpretation of the...
Cited by: More
Corpus-Based Unit Selection for Natural-Sounding Speech Synthesis - Yi (2003)
(Correct)
Active bibliography (related documents): More All
0.8: A New Class Of Entropy Estimators For Multi-Dimensional.. - Erik Miller Eecs
(Correct)
0.6: The Kernel Mutual Information - Gretton, Herbrich, Smola (2003)
(Correct)
0.4: Independent Components Analysis by - Direct Entropy Minimization
(Correct)
Similar documents based on text: More All
0.3: ICA Using Spacings Estimates of Entropy - Learned-Miller, III (2003)
(Correct)
0.1: Solving Updated Systems of Linear Equations in Parallel - Blaznik, Tasic (1995)
(Correct)
0.1: Parallel Updating Techniques in Image Restoration - Blaznik Evans
(Correct)
Related documents from co-citation: More All
2: Perception of speech: the human listener as a cognitive interface (context) - Manous, Pisoni et al. - 1985
2: Natural-Sounding Speech Synthesis using Variable-Length Units
- Yi, Glass - 1998
BibTeX entry: (Update)
E. G. Miller and J. W. Fisher, "ICA using spacing estimates of entropy," in Proc. Fourth International Symposium on Independent Component Analysis and Blind Signal Separation, Nara, Japan, Apr. 2003, pp. 1047--1052. http://citeseer.comp.nus.edu.sg/683503.html More
@misc{ miller03ica,
author = "E. Miller and J. Fisher",
title = "ICA using spacing estimates of entropy",
text = "E. G. Miller and J. W. Fisher, ICA using spacing estimates of entropy,
in Proc. Fourth International Symposium on Independent Component Analysis
and Blind Signal Separation, Nara, Japan, Apr. 2003, pp. 1047--1052.",
year = "2003",
url = "citeseer.comp.nus.edu.sg/683503.html" }
Citations (may not include all citations):
2319
Elements of Information Theory (context) - Cover, Thomas - 1991
317
Independent component analysis - a new concept (context) - Comon - 1994
295
A new learning algorithm for blind signal separation
- Amari, Cichocki et al. - 1996
80
Independent Component Analysis (context) - arinen, Karhunen et al. - 2001
60
Independent component analysis using an extended Infomax alg..
- Lee, Girolami et al. - 1999
59
Robust identification of a nonminimum phase system: blind ad.. (context) - Benveniste, Goursat et al. - 1980
59
MD: Johns Hopkins University Press (context) - Golub, Van Loan et al. - 1996
53
Blind separation of instantaneous mixture of sources based o..
- Pham - 2000
51
Kernel independent component analysis
- Bach, Jordan - 2002
44
High-order contrasts for independent component analysis (context) - Cardoso - 1999
15
Nonparametric entropy estimation: An overview (context) - Beirlant, Dudewicz et al. - 1997
14
A test for normality based on sample entropy (context) - Vasicek - 1976
11
A fast fixed point algorithm for independent component analy..
- arinen, Oja - 1997
5
Limit theorems for sums of general functions of m-spacings (context) - Hall - 1984
2
Independent components analysis by direct entropy minimizati.. (context) - Miller - 2003
2
Asymptotically optimal estimation of nonlinear functionals (context) - Levit - 1978
Documents on the same site (http://www.eecs.berkeley.edu/~egmil/): More
A New Class Of Entropy Estimators For Multi-Dimensional.. - Erik Miller Eecs
(Correct)
Color Eigenflows: Statistical Modeling of Joint Color Changes - Miller, Tieu (2001)
(Correct)
Transform-Invariant Image Decomposition With Similarity.. - Stauffer, Miller, Tieu (2001)
(Correct)
Online articles have much greater impact More about CiteSeer.IST at NUS Add search form to your site Submit documents Feedback
CiteSeer.IST at NUS - Copyright Penn State and NEC. Hosted by the School of Computing, National University of Singapore.