Please use this identifier to cite or link to this item:
https://hdl.handle.net/2440/28910
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, M. | - |
dc.contributor.author | Pincombe, B. | - |
dc.contributor.author | Welsh, M. | - |
dc.contributor.editor | Bara, B. | - |
dc.contributor.editor | Barsalou, L. | - |
dc.contributor.editor | Bucciarelli, M. | - |
dc.date.issued | 2005 | - |
dc.identifier.citation | XXVII Annual Conference of the Cognitive Science Society / B. G. Bara, L. Barsalou and M. Bucciarelli (eds.), pp. 1254-1259 | - |
dc.identifier.isbn | 0976831813 | - |
dc.identifier.uri | http://hdl.handle.net/2440/28910 | - |
dc.description.abstract | Modeling the semantic similarity between text documents presents a significant theoretical challenge for cognitive science, with ready-made applications in information handling and decision support systems dealing with text. While a number of candidate models exist, they have generally not been assessed in terms of their ability to emulate human judgments of similarity. To address this problem, we conducted an experiment that collected repeated similarity measures for each pair of documents in a small corpus of short news documents. An analysis of human performance showed inter-rater correlations of about 0.6. We then considered the ability of existing models—using wordbased, n-gram and Latent Semantic Analysis (LSA) approaches—to model these human judgments. The best performed LSA model produced correlations of about 0.6, consistent with human performance, while the best performed word-based and n-gram models achieved correlations closer to 0.5. Many of the remaining models showed almost no correlation with human performance. Based on our results, we provide some discussion of the key strengths and weaknesses of the models we examined. | - |
dc.language.iso | en | - |
dc.publisher | Cognitive Science Society | - |
dc.rights | © the authors | - |
dc.title | An empirical evaluation of models of text document similarity | - |
dc.type | Conference paper | - |
dc.contributor.conference | Cognitive Science Society. Annual Conference (27th : 2005 : Stresa, Italy) | - |
dc.publisher.place | CD ROM | - |
pubs.publication-status | Published | - |
dc.identifier.orcid | Welsh, M. [0000-0002-3605-716X] | - |
Appears in Collections: | Aurora harvest 2 Australian School of Petroleum publications Environment Institute publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
hdl_28910.pdf | Published version | 687.02 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.