|
|
 | Acesso ao texto completo restrito à biblioteca da Embrapa Meio Ambiente. Para informações adicionais entre em contato com cnpma.biblioteca@embrapa.br. |
Registro Completo |
Biblioteca(s): |
Embrapa Meio Ambiente. |
Data corrente: |
11/01/2008 |
Data da última atualização: |
24/03/2023 |
Tipo da produção científica: |
Artigo em Periódico Indexado |
Autoria: |
MAIA, A. H. N.; MEINKE, H.; LENNOX, S.; STONE, R. |
Afiliação: |
Aline de Holanda Nunes Maia, Embrapa Meio Ambiente; Holger Meinke, Queensland Departament of Primary Industries and Fisheries; Sarah Lennox, Queensland Departament of Primary Industries and Fisheries; Roger Stone, Queensland Departament of Primary Industries and Fisheries. |
Título: |
Inferential, nonparametric statistics to assess the quality of probabilistic forecast systems. |
Ano de publicação: |
2007 |
Fonte/Imprenta: |
Monthly Weather Review, Boston, v. 135, n. 2, p. 351-362, 2007. |
Idioma: |
Inglês |
Conteúdo: |
Many statistical forecast systems are available to interested users. To be useful for decision making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and its statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of ?quality.? However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what quality entails and how to measure it, leading to confusion and misinformation. A generic framework is presented that quantifies aspects of forecast quality using an inferential approach to calculate nominal significance levels (p values), which can be obtained either by directly applying nonparametric statistical tests such as Kruskal?Wallis (KW) or Kolmogorov?Smirnov (KS) or by using Monte Carlo methods (in the case of forecast skill scores). Once converted to p values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. The analysis demonstrates the importance of providing p values rather than adopting some arbitrarily chosen significance levels such as 0.05 or 0.01, which is still common practice. This is illustrated by applying nonparametric tests (such as KW and KS) and skill scoring methods [linear error in the probability space (LEPS) and ranked probability skill score (RPSS)] to the five-phase Southern Oscillation index classification system using historical rainfall data from Australia, South Africa, and India. The selection of quality measures is solely based on their common use and does not constitute endorsement. It is found that nonparametric statistical tests can be adequate proxies for skill measures such as LEPS or RPSS. The framework can be implemented anywhere, regardless of dataset, forecast system, or quality measure. Eventually such inferential evidence should be complemented by descriptive statistical methods in order to fully assist in operational risk management. MenosMany statistical forecast systems are available to interested users. To be useful for decision making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and its statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of ?quality.? However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what quality entails and how to measure it, leading to confusion and misinformation. A generic framework is presented that quantifies aspects of forecast quality using an inferential approach to calculate nominal significance levels (p values), which can be obtained either by directly applying nonparametric statistical tests such as Kruskal?Wallis (KW) or Kolmogorov?Smirnov (KS) or by using Monte Carlo methods (in the case of forecast skill scores). Once converted to p values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. The analysis demonstrates the importance of providing p values rather than adopting some arbitrarily chosen significance levels such as 0.05 or 0.01, which is still common practice. This is illustrated by applying nonparametric tests (such as KW and KS) and skill scoring methods [linea... Mostrar Tudo |
Palavras-Chave: |
Inferência; Modelo espacial. |
Thesagro: |
Análise Estatística; Estatística; Modelo Matemático; Previsão do Tempo; Qualidade. |
Categoria do assunto: |
-- |
Marc: |
LEADER 02904naa a2200241 a 4500 001 1015905 005 2023-03-24 008 2007 bl uuuu u00u1 u #d 100 1 $aMAIA, A. H. N. 245 $aInferential, nonparametric statistics to assess the quality of probabilistic forecast systems.$h[electronic resource] 260 $c2007 520 $aMany statistical forecast systems are available to interested users. To be useful for decision making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and its statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of ?quality.? However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what quality entails and how to measure it, leading to confusion and misinformation. A generic framework is presented that quantifies aspects of forecast quality using an inferential approach to calculate nominal significance levels (p values), which can be obtained either by directly applying nonparametric statistical tests such as Kruskal?Wallis (KW) or Kolmogorov?Smirnov (KS) or by using Monte Carlo methods (in the case of forecast skill scores). Once converted to p values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. The analysis demonstrates the importance of providing p values rather than adopting some arbitrarily chosen significance levels such as 0.05 or 0.01, which is still common practice. This is illustrated by applying nonparametric tests (such as KW and KS) and skill scoring methods [linear error in the probability space (LEPS) and ranked probability skill score (RPSS)] to the five-phase Southern Oscillation index classification system using historical rainfall data from Australia, South Africa, and India. The selection of quality measures is solely based on their common use and does not constitute endorsement. It is found that nonparametric statistical tests can be adequate proxies for skill measures such as LEPS or RPSS. The framework can be implemented anywhere, regardless of dataset, forecast system, or quality measure. Eventually such inferential evidence should be complemented by descriptive statistical methods in order to fully assist in operational risk management. 650 $aAnálise Estatística 650 $aEstatística 650 $aModelo Matemático 650 $aPrevisão do Tempo 650 $aQualidade 653 $aInferência 653 $aModelo espacial 700 1 $aMEINKE, H. 700 1 $aLENNOX, S. 700 1 $aSTONE, R. 773 $tMonthly Weather Review, Boston$gv. 135, n. 2, p. 351-362, 2007.
Download
Esconder MarcMostrar Marc Completo |
Registro original: |
Embrapa Meio Ambiente (CNPMA) |
|
Biblioteca |
ID |
Origem |
Tipo/Formato |
Classificação |
Cutter |
Registro |
Volume |
Status |
URL |
Voltar
|
|
Registros recuperados : 1 | |
1. |  | VLASSAK, K. M.; MERCANTE, F.; STRALIOTTO, R.; FRANCO, A. A.; VUYLSTEKE, M.; VANDERLEYDEN, J. Evaluation of the intrinsic competitiveness and saprophytic competence of Rhizobium tropici IIB strains. Biology and Fertility of Soils, Berlin, v. 24, p. 274-282, 1997.Biblioteca(s): Embrapa Agrobiologia. |
|   |
Registros recuperados : 1 | |
|
Nenhum registro encontrado para a expressão de busca informada. |
|
|