The AstroStat Slog » high dimension http://hea-www.harvard.edu/AstroStat/slog Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 09 Sep 2011 17:05:33 +0000 en-US hourly 1 http://wordpress.org/?v=3.4 Web Seminar http://hea-www.harvard.edu/AstroStat/slog/2009/web-seminar/ http://hea-www.harvard.edu/AstroStat/slog/2009/web-seminar/#comments Thu, 19 Mar 2009 00:30:34 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=1894 I was disappointed when video, audio, or handout files were not available from the research program “Statistical Theory and Methods for Complex High-Dimensional Data” held at Isaac Newton Institute for Mathematical Sciences during the first half of last year after checking the sites several times. Wow…They are now there~

Well, not all of them. Yet, presentations by those with familiar names to astronomers, like Donoho, Bickel, Murtagh, Candes, Jin, Spiegelhalter, McLachlan, Hall, and Rice are available. More presentations by personally worshiped statisticians are also up. :) Some are astrostatistics talks topic-wise or example-wise. Some are quite off from astronomical ground because of their large p and small n problems. If you have some spare time and want to learn top notch statistics handling high dimensional data, time can be well spent with these web seminars (a link for the seminar list).

]]>
http://hea-www.harvard.edu/AstroStat/slog/2009/web-seminar/feed/ 0
[ArXiv] 3rd week, May 2008 http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-3rd-week-may-2008/ http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-3rd-week-may-2008/#comments Mon, 26 May 2008 18:59:38 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/?p=316 Not many this week, but there’s a great read.

  • [stat.ME:0805.2756] Fionn Murtagh
    The Remarkable Simplicity of Very High Dimensional Data: Application of Model-Based Clustering

  • [astro-ph:0805.2945] Martin, de Jong, & Rix
    A comprehensive Maximum Likelihood analysis of the structural properties of faint Milky Way satellites

  • [astro-ph:0805.2946] Kelly, Fan, & Vestergaard
    A Flexible Method of Estimating Luminosity Functions [my subjective comment is added at the bottom]

  • [stat.ME:0805.3220] Bayarri, Berger, Datta
    Objective Bayes testing of Poisson versus inflated Poisson models (will it be of use when one is dealing with many zero background counts, underpopulated above zero background counts, and underpopulated source counts?)

[Comment] You must read it. It can serve as a very good Bayesian tutorial for astronomers. I think there’s a typo, nothing major, plus/minus sign in the likelihood, though. Tom Loredo kindly has informed through his extensive slog comments about Schechter function and this paper made me appreciate the gamma distribution more. Schechter function and the gamma density function share the same equation although the objective of their use does not have much to be shared (Forgive my Bayesian ignorance in the extensive usage of gamma distribution except the fact it’s a conjugate of Poisson or exponential distribution).

FYI, there was another recent arxiv paper on zero-inflation [stat.ME:0805.2258] by Bhattacharya, Clarke, & Datta
A Bayesian test for excess zeros in a zero-inflated power series distribution

]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/arxiv-3rd-week-may-2008/feed/ 0
[ArXiv] Random Matrix, July 13, 2007 http://hea-www.harvard.edu/AstroStat/slog/2007/arxiv-random-matrix-july-13-2007/ http://hea-www.harvard.edu/AstroStat/slog/2007/arxiv-random-matrix-july-13-2007/#comments Mon, 16 Jul 2007 17:30:23 +0000 hlee http://hea-www.harvard.edu/AstroStat/slog/2007/arxiv-random-matrix-july-13-2007/ From arxiv/astro-ph:0707.1982v1,
Nflation: observable predictions from the random matrix mass spectrum by Kim and Liddle

To my knowledge, random matrix received statisticians’ interests fairly recently and SAMSI (Statistical and Applied Mathematical Sciences Institute) offered a semester long program on High Dimensional Inference and Random Matrices (tutorials and lecture notes can be found) during Fall 2006 . However, my knowledge is very limited to make a comment or critic on Kim and Liddle’s paper. Clearly, nonetheless, this paper is not about random matrix theory but about its straightforward application to the cosmological model viability.

A. Liddle has published papers on theoretic cosmology from a statistical model based approach (the ones I’ve seen are most likely related to statistical model selection). Personally, I like his book: An Introduction to Modern Cosmology (2nd ed. ISBN 0-470-84835-9), which might be useful to statisticians who wish to work with cosmologists.

]]>
http://hea-www.harvard.edu/AstroStat/slog/2007/arxiv-random-matrix-july-13-2007/feed/ 0