ICA Using Spacings Estimates of Entropy (2003)  (Make Corrections)  (1 citation)
Erik G. Miller, John W. Fisher III

 @ NUS   Home/Search   Context   Related

 
View or download:
berkeley.edu/~egmil/pape...ICA_CONF.pdf
Cached:  PS.gz  PS  PDF  Image  Update  Help

From:  berkeley.edu/~egmil/ (more)
(Enter author homepages)

Rate this article: (best)
  Comment on this article  
(Enter summary)

Abstract: This paper presents a new algorithm for the independent components analysis (ICA) problem based on efficient spacings estimates of entropy. Like many previous methods, we minimize a standard measure of the departure from independence, the estimated Kullback-Leibler divergence between a joint distribution and the product of its marginals. To do this, we use a consistent and rapidly converging entropy estimator due to Vasicek. The resulting algorithm is simple, computationally efficient,... (Update)

Context of citations to this paper:   More

...closed form entropy calculation from the parametric density (e.g. Gaussian. Empirical estimators based on order statistics and spacings [91] o#er a direct path for deriving entropies from a set of data. Better methods are needed for the proper interpretation of the...

Cited by:   More
Corpus-Based Unit Selection for Natural-Sounding Speech Synthesis - Yi (2003)   (Correct)

Active bibliography (related documents):   More   All
0.8:   A New Class Of Entropy Estimators For Multi-Dimensional.. - Erik Miller Eecs   (Correct)
0.6:   The Kernel Mutual Information - Gretton, Herbrich, Smola (2003)   (Correct)
0.4:   Independent Components Analysis by - Direct Entropy Minimization   (Correct)

Similar documents based on text:   More   All
0.3:   ICA Using Spacings Estimates of Entropy - Learned-Miller, III (2003)   (Correct)
0.1:   Solving Updated Systems of Linear Equations in Parallel - Blaznik, Tasic (1995)   (Correct)
0.1:   Parallel Updating Techniques in Image Restoration - Blaznik Evans   (Correct)

Related documents from co-citation:   More   All
2:   Perception of speech: the human listener as a cognitive interface (context) - Manous, Pisoni et al. - 1985
2:   Natural-Sounding Speech Synthesis using Variable-Length Units - Yi, Glass - 1998

BibTeX entry:   (Update)

E. G. Miller and J. W. Fisher, "ICA using spacing estimates of entropy," in Proc. Fourth International Symposium on Independent Component Analysis and Blind Signal Separation, Nara, Japan, Apr. 2003, pp. 1047--1052. http://citeseer.comp.nus.edu.sg/683503.html   More

@misc{ miller03ica,
  author = "E. Miller and J. Fisher",
  title = "ICA using spacing estimates of entropy",
  text = "E. G. Miller and J. W. Fisher, ICA using spacing estimates of entropy,
    in Proc. Fourth International Symposium on Independent Component Analysis
    and Blind Signal Separation, Nara, Japan, Apr. 2003, pp. 1047--1052.",
  year = "2003",
  url = "citeseer.comp.nus.edu.sg/683503.html" }
Citations (may not include all citations):
2319   Elements of Information Theory (context) - Cover, Thomas - 1991
317   Independent component analysis - a new concept (context) - Comon - 1994
295   A new learning algorithm for blind signal separation - Amari, Cichocki et al. - 1996
80   Independent Component Analysis (context) - arinen, Karhunen et al. - 2001
60   Independent component analysis using an extended Infomax alg.. - Lee, Girolami et al. - 1999
59   Robust identification of a nonminimum phase system: blind ad.. (context) - Benveniste, Goursat et al. - 1980
59   MD: Johns Hopkins University Press (context) - Golub, Van Loan et al. - 1996
53   Blind separation of instantaneous mixture of sources based o.. - Pham - 2000
51   Kernel independent component analysis - Bach, Jordan - 2002
44   High-order contrasts for independent component analysis (context) - Cardoso - 1999
15   Nonparametric entropy estimation: An overview (context) - Beirlant, Dudewicz et al. - 1997
14   A test for normality based on sample entropy (context) - Vasicek - 1976
11   A fast fixed point algorithm for independent component analy.. - arinen, Oja - 1997
5   Limit theorems for sums of general functions of m-spacings (context) - Hall - 1984
2   Independent components analysis by direct entropy minimizati.. (context) - Miller - 2003
2   Asymptotically optimal estimation of nonlinear functionals (context) - Levit - 1978

Documents on the same site (http://www.eecs.berkeley.edu/~egmil/):   More
A New Class Of Entropy Estimators For Multi-Dimensional.. - Erik Miller Eecs   (Correct)
Color Eigenflows: Statistical Modeling of Joint Color Changes - Miller, Tieu (2001)   (Correct)
Transform-Invariant Image Decomposition With Similarity.. - Stauffer, Miller, Tieu (2001)   (Correct)

Online articles have much greater impact   More about CiteSeer.IST at NUS   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST at NUS - Copyright Penn State and NEC. Hosted by the School of Computing, National University of Singapore.