| Title |
The effective evaluation of emotions in the visual emotion images using convolutional neural networks |
| Authors |
Motiejauskas, Modestas ; Dzemyda, Gintautas |
| DOI |
10.1109/ACCESS.2025.3596484 |
| Full Text |
|
| Is Part of |
IEEE Access.. Piscataway, NJ : Institute of Electrical and Electronics Engineers (IEEE). 2025, vol. 13, p. 139174-139187.. ISSN 2169-3536 |
| Keywords [eng] |
CNN ; contrastive-center loss ; convolutional neural network ; EfficientNet ; evaluation of emotions ; Image analysis ; visual emotion images |
| Abstract [eng] |
This paper develops a model for recognizing emotions in visual images. The integration of contrastive-center loss optimization is proposed in this paper. This effectively improves the recognition of emotions when training a convolutional neural network against the baseline. The proposed contrastive-center loss function optimizes deep neural networks by enhancing feature discriminability. This loss function includes two key components: intra-class compactness and inter-class separability. We have suggested controlling the impact of the inter-class separability on the loss function. Moreover, we suggest combining cross-entropy and contrastive-center loss to calculate the total loss. In addition, we have proposed to apply the dimensionality reduction (visualization) for interactive evaluation of how the objects in the test set are arranged and how this arrangement, as well as the classification as a whole, can be improved by choosing the best combination of the strength of contrastive-center loss impact on the total loss. The efficiency of the developed model improvements is examined on three datasets: WEBEmo, FI-8, and EmoSet-118K. Our research allows us to improve the performance of visual emotion classification: for the WEBEmo dataset by 1.6%, the FI-8 dataset by 2.2%, and for the EmoSet-118K dataset by 2.52% higher accuracies than the baseline case. |
| Published |
Piscataway, NJ : Institute of Electrical and Electronics Engineers (IEEE) |
| Type |
Journal article |
| Language |
English |
| Publication date |
2025 |
| CC license |
|
