Examining the impact of stemming on clustering Turkish texts
International Symposium on INnovations in Intelligent SysTems and Applications, INISTA 2012, Trabzon, Türkiye, 2 - 04 Temmuz 2012, (Tam Metin Bildiri)
- Yayın Türü: Bildiri / Tam Metin Bildiri
- Doi Numarası: 10.1109/inista.2012.6246966
- Basıldığı Şehir: Trabzon
- Basıldığı Ülke: Türkiye
- Anahtar Kelimeler: data mining, document clustering, preprocessing, stemming, text mining
- Maltepe Üniversitesi Adresli: Evet
Özet
Preprocessing is an important step in information retrieval and text mining. In this study, we examined the impact of stemming on clustering Turkish texts. We used two datasets compiled from web sites of Turkish news agencies, and performed extensive experiments. We empirically show that there is no significant evidence that stemming always improves the quality of clustering for texts in Turkish. However, when stemming is used, dimensionality of the document-term matrix dramatically decreases without inversely affecting the clustering performance. As a result, it is highly recommended to apply stemming for clustering Turkish texts. © 2012 IEEE.