The AstroStat Slog » ICA http://hea-www.harvard.edu/AstroStat/slog Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 09 Sep 2011 17:05:33 +0000 en-US hourly 1 http://wordpress.org/?v=3.4 [ArXiv] component separation methods http://hea-www.harvard.edu/AstroStat/slog/2009/arxiv-component-separation-methods/ http://hea-www.harvard.edu/AstroStat/slog/2009/arxiv-component-separation-methods/#comments Tue, 08 Sep 2009 15:17:34 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=3502 I happened to observe a surge of principle component analysis (PCA) and independent component analysis (ICA) applications in astronomy. The PCA and ICA is used for separating mixed components with some assumptions. For the PCA, the decomposition happens by the assumption that original sources are orthogonal (uncorrelated) and mixed observations are approximated by multivariate normal distribution. For ICA, the assumptions is sources are independent and not gaussian (it grants one source component to be gaussian, though). Such assumptions allow to set dissimilarity measures and algorithms work toward maximize them.

The need of source separation methods in astronomy has led various adaptations of decomposition methods available. It is not difficult to locate those applications from journals of various fields including astronomical journals. However, they are most likely soliciting one dimension reduction method of their choice over others to emphasize that their strategy works better. I rarely come up with a paper which gathered and summarized component separation methods applicable to astronomical data. In that regards, the following paper seems useful to overview methods of reducing dimensionality for astronomers.

[arxiv:0805.0269]
Component separation methods for the Planck mission
S.M.Leach et al.
Check its appendix for method description.

Various library/modules are available through software/data analysis system so that one can try various dimension reduction methods conveniently. The only concern I have is the challenge of interpretation after these computational/mathematical/statistical analysis, how to assign physics interpretation to images/spectra produced by decomposition. I think this is a big open question.

]]>
http://hea-www.harvard.edu/AstroStat/slog/2009/arxiv-component-separation-methods/feed/ 2
[ArXiv] Statistical Analysis of fMRI Data http://hea-www.harvard.edu/AstroStat/slog/2009/arxiv-statistical-analysis-of-fmri/ http://hea-www.harvard.edu/AstroStat/slog/2009/arxiv-statistical-analysis-of-fmri/#comments Wed, 02 Sep 2009 00:43:13 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=3304

[arxiv:0906.3662] The Statistical Analysis of fMRI Data by Martin A. Lindquist
Statistical Science, Vol. 23(4), pp. 439-464

This review paper offers some information and guidance of statistical image analysis for fMRI data that can be expanded to astronomical image data. I think that fMRI data contain similar challenges of astronomical images. As Lindquist said, collaboration helps to find shortcuts. I hope that introducing this paper helps further networking and collaboration between statisticians and astronomers.

List of similarities

  • data acquisition: data read in frequency domain and image reconstruction via inverse Fourier transform. (To my naive eyes, It looks similar to Power Spectrum Analysis for cosmic microwave background (CMB) data).
  • amplitudes or coefficients are cared and analyzed, not phase nor wavelets.
  • understanding data:brain physiology or physics like cosmological models that describe data generating mechanism.
  • limits in/trade-off between spatial and temporal resolution.
  • understanding/modeling noise and signal.

These similarities seem common for statistically analyzing images from fMRI or telescopes. Notwithstanding, no astronomers can (or want) to carry out experimental design. This can be a huge difference between medical and astronomical image analysis. My emphasis is that because of these commonalities, strategies in preprocessing and data analysis for fMRI data can be shared for astronomical observations and vise versa. Some sloggers would like to check Section 6 that covers various statistical models and methods for spatial and temporal data.

I’d rather simply end this posting with the following quotes, saying that statisticians play a critical role in scientific image analysis. :)

There are several common objectives in the analysis of fMRI data. These include localizing regions of the brain activated by a task, determining distributed networks that correspond to brain function and making predictions about psychological or disease states. Each of these objectives can be approached through the application of suitable statistical methods, and statisticians play an important role in the interdisciplinary teams that have been assembled to tackle these problems. This role can range from determining the appropriate statistical method to apply to a data set, to the development of unique statistical methods geared specifically toward the analysis of fMRI data. With the advent of more sophisticated experimental designs and imaging techniques, the role of statisticians promises to only increase in the future.

A full spatiotemporal model of the data is generally not considered feasible and a number of short cuts are taken throughout the course of the analysis. Statisticians play an important role in determining which short cuts are appropriate in the various stages of the analysis, and determining their effects on the validity and power of the statistical analysis.

]]>
http://hea-www.harvard.edu/AstroStat/slog/2009/arxiv-statistical-analysis-of-fmri/feed/ 0
[ArXiv] 1st week, June 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-june-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-june-2008/#comments Mon, 09 Jun 2008 01:45:45 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=328 Despite no statistic related discussion, a paper comparing XSPEC and ISIS, spectral analysis open source applications might bring high energy astrophysicists’ interests this week.

  • [astro-ph:0806.0650] Kimball and Ivezi\’c
    A Unified Catalog of Radio Objects Detected by NVSS, FIRST, WENSS, GB6, and SDSS (The catalog is available HERE. I’m always fascinated with the possibilities in catalog data sets which machine learning and statistics can explore. And I do hope that the measurement error columns get recognition from non astronomers.)

  • [astro-ph:0806.0820] Landau and Simeone
    A statistical analysis of the data of Delta \alpha/ alpha from quasar absorption systems (It discusses Student t-tests from which confidence intervals for unknown variances and sample size based on Type I and II errors are obtained.)

  • [stat.ML:0806.0729] R. Girard
    High dimensional gaussian classification (Model based – gaussian mixture approach – classification, although it is often mentioned as clustering in astronomy, on multi- dimensional data is very popular in astronomy)

  • [astro-ph:0806.0520] Vio and Andreani
    A Statistical Analysis of the “Internal Linear Combination” Method in Problems of Signal Separation as in CMB Observations (Independent component analysis, ICA is discussed)

  • [astro-ph:0806.0560] Nobel and Nowak
    Beyond XSPEC: Towards Highly Configurable Analysis (The flow of spectral analysis with XSPEC and Sherpa has not been accepted smoothly; instead, it has been a personal struggle. It seems the paper considers XSPEC as a black box, which I completely agree with. The main objective of the paper is comparing XSPEC and ISIS)

  • [astro-ph:0806.0113] Casandjian and Grenier
    A revised catalogue of EGRET gamma-ray sources (The maximum likelihood detection method, which I never heard from statistical literature, is utilized)
]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-june-2008/feed/ 0
[ArXiv]4th week, Mar. 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv4th-week-mar-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv4th-week-mar-2008/#comments Sun, 30 Mar 2008 23:51:42 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv4th-week-mar-2008/ The numbers of astro-ph preprints on average have been decreased so as my hours of reading abstracts…. cool!!! By the way, there is a paper about solar cycle, PCA, ICA, and Lomb-Scargle periodogram.

  • [astro-ph:0803.3154]B. G. Elmegreen
    The Stellar Initial Mass Function in 2007: A Year for Discovering Variations

  • [astro-ph:0803.3260]J.K. Lawrence, A.C. Cadavid & A. Ruzmaikin
    Rotational quasi periodicities and the Sun – heliosphere connection (I wish arxiv provides keywords. My keywords to this preprint are solar cycle, Lomb-Scargle periodogram, PCA, ICA, all interesting to CHASC folks. Particularly, I felt some similarity to one of stat310 talks about Gravity Probe B)

  • [astro-ph:0803.3775] L. Samushia, & B. Ratra
    Constraints on Dark Energy from Galaxy Cluster Gas Mass Fraction versus Redshift data (another example of Monte Carlo Markov Chain, not Markov chain Monte Carlo in the abstract but MCMC is not their research focus)
]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv4th-week-mar-2008/feed/ 0
[ArXiv] 1st week, Feb. 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-feb-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-feb-2008/#comments Sun, 10 Feb 2008 16:56:12 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-feb-2008/ Review papers on Bayesian hierarchical modeling and LAR (least angle regression) appeared in this week’s stat arXiv and in addition to interesting astro-ph papers.

A review paper on LASSO and LAR: [stat.ME:0801.0964] T. Hesterberg et.al.
   Least Angle and L1 Regression: A Review
Model checking for Bayesian hierarchical modeling: [stat.ME:0802.0743] M. J. Bayarri, M. E. Castellanos
   Bayesian Checking of the Second Levels of Hierarchical Models

  • [astro-ph:0802.0042] Y. Kubo
    Statistical Models for Solar Flare Interval Distribution in Individual Active Regions (it discusses AIC)

  • [astro-ph:0802.0131] J.Bobin, J-L Starck and R. Ottensamer
    Compressed Sensing in Astronomy

  • [astro-ph:0802.0387] J. Gaite
    Geometry and scaling of cosmic voids

  • [astro-ph:0802.0400] R. Vio & P. Andreani
    A Modified ICA Approach for Signal Separation in CMB Maps

  • [astro-ph:0802.0498] V. Balasubramanian, K. Larjo and R. Sheth
    Experimental design and model selection: The example of exoplanet detection

  • [astro-ph:0802.0537] G. Dan, Z. Yanxia, & Z. Yongheng
    Support Vector Machines and Kd-tree for Separating Quasars from Large Survey Databases

]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-1st-week-feb-2008/feed/ 0