The AstroStat Slog » datasets http://hea-www.harvard.edu/AstroStat/slog Weaving together Astronomy+Statistics+Computer Science+Engineering+Intrumentation, far beyond the growing borders Fri, 09 Sep 2011 17:05:33 +0000 en-US hourly 1 http://wordpress.org/?v=3.4 DOE Petascale Data Analysis Program http://hea-www.harvard.edu/AstroStat/slog/2009/doe-petascale-data-analysis-program/ http://hea-www.harvard.edu/AstroStat/slog/2009/doe-petascale-data-analysis-program/#comments Wed, 01 Apr 2009 18:55:15 +0000 TomLoredo http://hea-www.harvard.edu/AstroStat/slog/?p=2052 Woncheol Jang pointed me to the following web site describing a proposal opportunity at DOE that may be of interest to readers of this list:

Mathematics for Analysis of Petascale Data
http://www.science.doe.gov/grants/FAPN09-10.html

The Office of Advanced Scientific Computing Research (ASCR) of the Office of Science (SC), U.S. Department of Energy (DOE), hereby announces its interest in receiving grant applications for research addressing the mathematical challenges involved in extracting insights from extremely large datasets (“petascale data”) and investigating fundamental issues in finding key features and understanding the relationships between those features.

All applications should address the potential for advances in mathematical methods or numerical algorithms and not just the application of methods and algorithms to a specific science problem, no matter how challenging.

This solicitation seeks applications for basic research in mathematical models, methods and tools for the representation, analysis, and understanding of petascale data.

They specifically mention data from physics simulations and observational data from cosmology as examples in the description.

Letters of Intent (required) are due 15 April, proposals are due 29 May. $4M is available for FY09; awards may be for up to 3 yr.

]]>
http://hea-www.harvard.edu/AstroStat/slog/2009/doe-petascale-data-analysis-program/feed/ 0
Reduced and Processed Data http://hea-www.harvard.edu/AstroStat/slog/2008/reduced-data/ http://hea-www.harvard.edu/AstroStat/slog/2008/reduced-data/#comments Tue, 15 Jul 2008 03:55:09 +0000 vlk http://hea-www.harvard.edu/AstroStat/slog/?p=364 Hyunsook recently said that she wished that there were “some astronomical data depositories where no data reduction is required but one can apply various statistical analyses to the data in the depository to learn and compare statistical methods”. With the caveat that there really is no such thing (every dataset will require case specific reduction; standard processing and reduction are inadequate in all but the simplest of cases), here is a brief list:

  1. The 2 Megasecond Chandra observations of the Southern Deep Field, which have been processed, reduced, and mosaiced. (Coincidentally, just last week Peter Freeman had asked me for a nice dataset on which to try out spatial analysis algorithms, and for which some analysis already existed for people to check their results against. These were the data I recommended.)
  2. HEASARC’s W3Browse gives direct access to archived data from various missions. The data products have been already processed in some standard way.
  3. The Penn State Center for Astrostatistics maintains training datasets of various types
  4. ADC, as pointed out by Brian

There are many more, I am sure, and if people find any particularly good ones, please point them out in the comments!

]]>
http://hea-www.harvard.edu/AstroStat/slog/2008/reduced-data/feed/ 4