Determining Window Size from Plagiarism Corpus for Stylometric Features

Warning

This publication doesn't include Faculty of Economics and Administration. It includes Faculty of Informatics. Official publication website can be found on muni.cz.
Authors

SUCHOMEL Šimon BRANDEJS Michal

Year of publication 2015
Type Article in Proceedings
Conference Experimental IR Meets Multilinguality, Multimodality, and Interaction
MU Faculty or unit

Faculty of Informatics

Citation
Web Springer Link
Doi http://dx.doi.org/10.1007/978-3-319-24027-5_31
Field Informatics
Keywords plagiarism; average word frequency class; stylometry; text classification; intrinsic plagiarism
Attached files
Description The sliding window concept is a common method for computing a profile of a document with unknown structure. This paper outlines an experiment with stylometric word-based feature in order to determine an optimal size of the sliding window. It was conducted for a vocabulary richness method called ‘average word frequency class’ using the PAN 2015 source retrieval training corpus for plagiarism detection. The paper shows the pros and cons of the stop words removal for the sliding window document profiling and discusses the utilization of the selected feature for intrinsic plagiarism detection. The experiment resulted in the recommendation of setting the sliding windows to around 100 words in length for computing the text profile using the average word frequency class stylometric feature.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.