CIVILICA We Respect the Science
(ناشر تخصصی کنفرانسهای کشور / شماره مجوز انتشارات از وزارت فرهنگ و ارشاد اسلامی: ۸۹۷۱)

Outlier Detection in Test Samples using Standard Deviation and Unsupervised Training Set Selection

عنوان مقاله: Outlier Detection in Test Samples using Standard Deviation and Unsupervised Training Set Selection
شناسه ملی مقاله: JR_IJE-36-1_021
منتشر شده در در سال 1402
مشخصات نویسندگان مقاله:

N. Mohseni - Department of Computer Engineering, Babol Branch, Islamic Azad University, Babol, Iran
H. Nematzadeh - Department of Computer Engineering, Sari Branch, Islamic Azad University, Sari, Iran
E. Akbarib - Department of Computer Engineering, Sari Branch, Islamic Azad University, Sari, Iran
H. Motameni - Department of Computer Engineering, Sari Branch, Islamic Azad University, Sari, Iran

خلاصه مقاله:
Outlier detection is a technique to identify and remove significantly different data from the more correct and consistent data in a data set. Outlier data can have negative impact on classification and clustering performance; that should be identified and removed to improve the classification efficiency. Regardless of whether a classifying technique classifies an outlier correctly, the very notion of identifying a data as outlier is of great significance.   In this paper, a new approach is proposed for outlier data detection within a test data set along with unsupervised training set selection. The selected training set is used for two-step classification. After unsupervised clustering the training set, the closest cluster to a test sample is selected using the Euclidean distance measure. Then, the outlier in the test sample is identified with the concepts of standard deviation and mean value.  The results showed by evaluating the distance of each sample of the test set with the new selected data set. the accuracy of the classifiers is enhanced after detection and elimination of outlier data.

کلمات کلیدی:
outlier detection, training set selection, k-means, K-nearest neighbor, Standard Deviation

صفحه اختصاصی مقاله و دریافت فایل کامل: https://civilica.com/doc/1585932/