Leveraging the BERT Model for Enhanced Sentiment Analysis in Multicontextual Social Media Content
DOI:
https://doi.org/10.35335/cit.Vol16.2024.766.pp82-89Keywords:
BERT model, Sentiment analysis, Social media content, Contextual embeddings, Deep learningAbstract
The increasing prevalence of social media platforms has led to a surge in user-generated content, necessitating advanced techniques for accurate sentiment analysis. This study investigates the application of the BERT model for sentiment analysis on multicontextual social media content, aiming to enhance sentiment classification accuracy by leveraging contextual embeddings. The research objectives include examining the effectiveness of BERT in capturing sentiments across diverse social media posts and evaluating its performance in comparison to traditional methods. The methodology involves tokenizing text content, converting tokens into contextual embeddings using BERT, and integrating multimedia features for a comprehensive sentiment analysis framework. The results from a numerical example demonstrate that the BERT model achieves a high probability of correctly classifying sentiments, with a notable improvement in accuracy and a low cross-entropy loss. These findings underscore the model's capability to understand contextual nuances and its potential to optimize social media monitoring and analysis processes. The study also highlights limitations such as the need for larger and more diverse datasets and the inclusion of multimedia content to enhance generalizability. Future research should explore hybrid models and address ethical considerations to ensure data privacy and mitigate biases. This work contributes to advancing theoretical frameworks and offers practical implications for businesses and marketers seeking to leverage sentiment analysis for informed decision-making and improved customer engagement strategies.
Downloads
References
Y. K. Dwivedi et al., “Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy,” Int. J. Inf. Manage., vol. 57, p. 101994, 2021, doi: https://doi.org/10.1016/j.ijinfomgt.2019.08.002.
M. S. Islam et al., “‘Challenges and future in deep learning for sentiment analysis: a comprehensive review and a proposed novel hybrid approach,’” Artif. Intell. Rev., vol. 57, no. 3, p. 62, 2024, doi: 10.1007/s10462-023-10651-9.
A. Sandu, I. Ioan??, C. Delcea, L.-M. Geant?, and L.-A. Cotfas, “Mapping the Landscape of Misinformation Detection: A Bibliometric Approach,” Information, vol. 15, no. 1. 2024. doi: 10.3390/info15010060.
L. Ryan and A. D’Angelo, “Changing times: Migrants’ social network analysis and the challenges of longitudinal research,” Soc. Networks, vol. 53, pp. 148–158, 2018.
Y. K. Dwivedi et al., “Climate change and COP26: Are digital technologies and information management part of the problem or the solution? An editorial reflection and call to action,” Int. J. Inf. Manage., vol. 63, p. 102456, 2022, doi: https://doi.org/10.1016/j.ijinfomgt.2021.102456.
Z. Guo, J.-H. Cho, I.-R. Chen, S. Sengupta, M. Hong, and T. Mitra, “Online Social Deception and Its Countermeasures: A Survey,” IEEE Access, vol. 9, pp. 1770–1806, 2021, doi: 10.1109/ACCESS.2020.3047337.
. A., “Exploring the Impact of Social Media on Public Opinion Formation: A Comparative Analysis,” Int. J. Res. Appl. Sci. Eng. Technol., vol. 12, no. 4, pp. 307–311, 2024, doi: 10.22214/ijraset.2024.59619.
M. Mozafari, R. Farahbakhsh, and N. Crespi, “A BERT-based transfer learning approach for hate speech detection in online social media,” in Complex Networks and Their Applications VIII: Volume 1 Proceedings of the Eighth International Conference on Complex Networks and Their Applications COMPLEX NETWORKS 2019 8, Springer, 2020, pp. 928–940.
X. Li, Y. Lei, and S. Ji, “BERT-and BiLSTM-based sentiment analysis of online Chinese buzzwords,” Futur. Internet, vol. 14, no. 11, p. 332, 2022.
C. Zhang, C. Fan, W. Yao, X. Hu, and A. Mostafavi, “Social media for intelligent public information and warning in disasters: An interdisciplinary review,” Int. J. Inf. Manage., vol. 49, pp. 190–207, 2019.
T. Chen, X. Yin, J. Yang, G. Cong, and G. Li, “Modeling Multi-Dimensional Public Opinion Process Based on Complex Network Dynamics Model in the Context of Derived Topics,” Axioms, vol. 10, no. 4. 2021. doi: 10.3390/axioms10040270.
M. K. Hayat et al., “Towards deep learning prospects: insights for social media analytics,” IEEE access, vol. 7, pp. 36958–36979, 2019.
A. Gandhi, K. Adhvaryu, S. Poria, E. Cambria, and A. Hussain, “Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions,” Inf. Fusion, vol. 91, pp. 424–444, 2023, doi: https://doi.org/10.1016/j.inffus.2022.09.025.
L. Y.-F. Su, M. A. Cacciatore, X. Liang, D. Brossard, D. A. Scheufele, and M. A. Xenos, “Analyzing public sentiments online: Combining human-and computer-based content analysis,” Information, Commun. Soc., vol. 20, no. 3, pp. 406–427, 2017.
A. H. Alamoodi et al., “Multi-perspectives systematic review on the applications of sentiment analysis for vaccine hesitancy,” Comput. Biol. Med., vol. 139, p. 104957, 2021, doi: https://doi.org/10.1016/j.compbiomed.2021.104957.
J. D. Houston-Kolnik, C. Soibatian, and M. M. Shattell, “Advocates’ Experiences With Media and the Impact of Media on Human Trafficking Advocacy,” J. Interpers. Violence, vol. 35, no. 5–6, pp. 1108–1132, Feb. 2017, doi: 10.1177/0886260517692337.
M. Kale, P. Mankame, and G. Kulkarni, “Deep learning for digital text analytics: sentiment analysis,” arXiv Prepr. arXiv1804.03673, 2018.
M. M. Samia, A. Rajee, M. R. Hasan, M. O. Faruq, and P. C. Paul, “Aspect-based Sentiment Analysis for Bengali Text using Bidirectional Encoder Representations from Transformers (BERT),” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 12, pp. 978–986, 2022, doi: 10.14569/IJACSA.2022.01312112.
R. Devika, S. Vairavasundaram, C. S. J. Mahenthar, V. Varadarajan, and K. Kotecha, “A Deep Learning Model Based on BERT and Sentence Transformer for Semantic Keyphrase Extraction on Big Social Data,” IEEE Access, vol. 9, pp. 165252–165261, 2021, doi: 10.1109/ACCESS.2021.3133651.
T. ValizadehAslani et al., “PharmBERT: a domain-specific BERT model for drug labels,” Brief. Bioinform., vol. 24, no. 4, p. bbad226, 2023.
E. ?engönül, R. Samet, Q. Abu Al-Haija, A. Alqahtani, B. Alturki, and A. A. Alsulami, “An Analysis of Artificial Intelligence Techniques in Surveillance Video Anomaly Detection: A Comprehensive Survey,” Appl. Sci., vol. 13, no. 8, 2023, doi: 10.3390/app13084956.
M. D. Deepa, “Bidirectional encoder representations from transformers (BERT) language model for sentiment analysis task,” Turkish J. Comput. Math. Educ., vol. 12, no. 7, pp. 1708–1721, 2021.
B. Ghojogh and A. Ghodsi, “Attention mechanism, transformers, BERT, and GPT: tutorial and survey,” 2020.
J. Reyna, J. Hanham, and P. Meier, “The Internet explosion, digital media principles and implications to communicate effectively in the digital space,” E-Learning Digit. Media, vol. 15, no. 1, pp. 36–52, Jan. 2018, doi: 10.1177/2042753018754361.
P. Roma and D. Aloini, “How does brand-related user-generated content differ across social media? Evidence reloaded,” J. Bus. Res., vol. 96, pp. 322–339, 2019, doi: https://doi.org/10.1016/j.jbusres.2018.11.055.
M. L. B. dos Santos, “The ‘so-called’ UGC: an updated definition of user-generated content in the age of social media,” Online Inf. Rev., vol. 46, no. 1, pp. 95–113, 2022.
K. Chakraborty, S. Bhattacharyya, and R. Bag, “A Survey of Sentiment Analysis from Social Media Data,” IEEE Trans. Comput. Soc. Syst., vol. 7, no. 2, pp. 450–464, 2020, doi: 10.1109/TCSS.2019.2956957.
K. Camacho, R. Portelli, A. Shortridge, and B. Takahashi, “Sentiment mapping: point pattern analysis of sentiment classified Twitter data,” Cartogr. Geogr. Inf. Sci., vol. 48, no. 3, pp. 241–257, May 2021, doi: 10.1080/15230406.2020.1869999.
L. Bharadwaj, “Sentiment analysis in online product reviews: mining customer opinions for sentiment classification,” Int J Multidiscip Res, vol. 5, no. 5, 2023.
X. Chen and H. Xie, “A structural topic modeling-based bibliometric study of sentiment analysis literature,” Cognit. Comput., vol. 12, pp. 1097–1129, 2020.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Hondor Saragih, Jonson Manurung
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
