Журнал «Современная Наука»

Russian (CIS)English (United Kingdom)
 MOSCOW +7(495)-142-86-81

BERT-BILSTM-ATTENTION NEURAL NETWORKS APPLICATION METHOD TO DETERMINE THE AUTHOR’S EMOTIONAL ATTITUDE TO THE TEXT

Yin S.   (BMSTU)

Afanasyev G. I.  (Candidate of Technical Sciences, associate professor BMSTU)

Kalistratov A. P.  (teaching assistant BMSTU)

In this paper, a text sentiment analysis method based on the BERT-BiLSTM-Attention model is proposed. During preparation, the text is encoded using the BERT model to obtain a semantic representation of the text. Then, the encoded text is uploaded into the BiLSTM model to obtain deeper semantic information. Finally, the output of the BiLSTM model is weighted and averaged by the Attention mechanism to obtain the final sentiment analysis results. Experimenting on the IMDB dataset, the model proposed in this paper achieved an accuracy rate of 90%, providing better performance than other deep learning-based sentiment analysis methods.

Keywords:sentiment analysis, BERT-BiLSTM-Attention, Attention mechanism, deep learning, neural networks
 

Read the full article …

Citation link:
Yin S. , Afanasyev G. I., Kalistratov A. P. BERT-BILSTM-ATTENTION NEURAL NETWORKS APPLICATION METHOD TO DETERMINE THE AUTHOR’S EMOTIONAL ATTITUDE TO THE TEXT // Современная наука: актуальные проблемы теории и практики. Серия: Естественные и Технические Науки. -2023. -№07/2. -С. 55-58 DOI 10.37882/2223-2966.2023.7-2.13
LEGAL INFORMATION:
Reproduction of materials is permitted only for non-commercial purposes with reference to the original publication. Protected by the laws of the Russian Federation. Any violations of the law are prosecuted.
© ООО "Научные технологии"

Terms Publications

Issues of the journals (Archive)

ECONOMICS AND LAW
HUMANITIES
NATURAL AND TECHNICAL SCIENCES
COGNITION

Серия - Natural and Technical Sciences