Class Probability Distribution Based Maximum Entropy Model for Classification of Datasets with Sparse Instances

A. Saravanan1, D. Anandhi1 and M. Srividya1

  1. Department of Computing, Coimbatore Institute of Technology
    Coimbatore, Tamil Nadu, India
    a.saravanan21@gmail.com, anandhi.cit@gmail.com, msrividya2013@gmail.com

Abstract

Due to the digital revolution, the amount of data to be processed is growing every day. One of the more common functions used to process these data is classification. However, the results obtained by most existing classifiers are not satisfactory, as they often depend on the number and type of attributes within the datasets. In this paper, a maximum entropy model based on class probability distribution is proposed for classifying data in sparse datasets with fewer attributes and instances. Moreover, a new idea of using Lagrange multipliers is suggested for estimating class probabilities in the process of class label prediction. Experimental analysis indicates that the proposed model has an average accuracy of 89.9% and 86.93% with 17 and 36 datasets. Besides, statistical analysis of the results indicates that the proposed model offers greater classification accuracy for over 50% of datasets with fewer attributes and instances than other competitors.

Key words

classification, fewer attributes and instances, Lagrange multipliers, class probability distribution, relative gain, maximum entropy

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS211030001S

Publication information

Volume 20, Issue 3 (June 2023)
Year of Publication: 2023
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Saravanan, A., Anandhi, D., Srividya, M.: Class Probability Distribution Based Maximum Entropy Model for Classification of Datasets with Sparse Instances. Computer Science and Information Systems, Vol. 20, No. 3, 949–976. (2023), https://doi.org/10.2298/CSIS211030001S