We are upgrading the repository! A content freeze is in effect until November 22nd, 2024 - no new submissions will be accepted; however, all content already published will remain publicly available. Please reach out to repository@u.library.arizona.edu with your questions, or if you are a UA affiliate who needs to make content available soon. Note that any new user accounts created after September 22, 2024 will need to be recreated by the user in November after our migration is completed.
Evaluating expert knowledge: plant species responses to cattle grazing and fire
Citation
Rodríguez Iglesias, R. M., & Kothmann, M. M. (1998). Evaluating expert knowledge: plant species responses to cattle grazing and fire. Journal of Range Management, 51(3), 332-344.Publisher
Society for Range ManagementJournal
Journal of Range ManagementDOI
10.2307/4003420Additional Links
https://rangelands.org/Abstract
Expert judgment, standardized in a meaningful format, can be used to identify research/survey needs and to characterize areas of (dis)agreement in species responses, associated traits, and factors affecting responses. Feasible methods are needed to facilitate the evaluation of expertise in a complex domain characterized by moderate to low learnability. Specific objectives for this study were 1) to evaluate agreement among experts on range plant species behavior and 2) to develop an agreement-based classification method for plant species responses. Declarative information at landscape scale was elicited from 7 role-suggested experts on expected responses to cattle grazing (none, moderate, or heavy) and fire (absent, applied in late summer or fall, or applied in late winter or spring) of 198 plant species from the Edwards Plateau (Texas). Trends were requested to be assessed in a 3-level ordinal scale (decrease, unaffected, increase). Kappa statistics (pair-wise and multi-rater versions) and log-linear models were used to evaluate agreement. A procedure based upon cumulative probability distributions of possible rating combinations was developed to classify plant species while accounting for agreement. A total of 4,584 opinions (cattle grazing: 2,959; fire: 1,625) was elicited and analyzed. Low to moderate agreement was observed. Average pair-wise kappa statistics ranged from 0.07 to 0.39; multiple-rater kappa coefficients ranged from -0.17 to 0.53. Log-linear analyses were consistent with those estimations: agreement beyond chance or baseline association between ratings (P < 0.05) was observed in 62 out of 114 possible pair-wise cases. Non-homogeneous marginal distributions of opinion were an important source of disagreement. Experts performed beyond chance expectations in all scenarios but agreement was better (and pattern of agreement more consistent) when scenarios were most familiar to the experts (e.g., heavy grazing and winter/spring burning). Almost 80% of species was classified beyond chance (P < 0.15) in grazing scenarios in contrast to only 40 to 60% in fire scenarios. This resulted from less agreement among experts but also from apparent lack of knowledge. The procedure developed to classify plant species provides an objective criterion for evaluating agreement in an ordinal scale. Graphical representations facilitate understanding of relationships between the number of expert sources and their ability to distinguish among classes for a pre-defined confidence level.Type
textArticle
Language
enISSN
0022-409Xae974a485f413a2113503eed53cd6c53
10.2307/4003420