AI and Human Interpretation of Multilingual Feminist Discourse: A Study of Aurat March Comments
Main Article Content
Abstract
Artificial intelligence is widely used to examine social media discourse; however, its ability to understand complex feminist discourse across various languages has been largely overlooked in the existing scholarship. Utilising AI tools, this study analyses social media discourse on Aurat March which is the most prominent feminist activist moment in Pakistan, to show how an AI-assisted discussion of different cultural frameworks, particularly in the Global South environment, can be useful. This study examines how artificial intelligence (AI) systems interpret multilingual feminist online content. It compares the AI results with human analysis. Human analysis used a framework to evaluate AI outputs against human-coded standards. This approach tracked the incorrect classification of user comments on the Aurat March in Pakistan. This research uses technofeminism and Relational Content Analysis (RCA) to study 450 comments on the Facebook, Instagram, and YouTube pages of the film. A multilingual approach was necessary because users responded to the Aurat March posts in English, Urdu, and Romanised Urdu. The research results clearly distinguish between human and AI interpretations. The AI tool (ChatGPT-5) successfully categorised comments into three different languages; however, it frequently oversimplified sentiment categories and failed to identify rhetorical devices such as sarcasm and humour, while its accuracy decreased when evaluating Roman Urdu and code-mixed content. AI tools can assess sentiment across multiple languages; however, their performance declines in multilingual contexts, especially when they need to analyse code-switching and specific cultural languages such as Roman Urdu. The research suggests that, despite AI's potential, it requires further refinement to effectively handle politically and culturally sensitive discourse in multilingual contexts.
Article Details
References
Ahmad Ghani, A. N. H., & Rahmat, H. (2023). Confirmation bias in our opinions on social media: A qualitative approach. Journal of Communication, Language and Culture, 3(1), 44–53. https://doi.org/10.33093/jclc.2023.3.1.4
Aremu, A. O. (2024). Utilising AI-powered chatbots for learning endangered Nigerian languages and considerations for their development. Journal of Communication, Language and Culture, 4(2), 41–56. https://doi.org/10.33093/jclc.2024.4.2.3
Baer, H. (2016). Redoing feminism: Digital activism, body politics, and neoliberalism. Feminist Media Studies, 16(1), 17–34. https://doi.org/10.1080/14680777.2015.1093070
Balakrishnan, K. (2022). Influence of cultural dimensions on intercultural communication styles: Ethnicity in a moderating role. Journal of Communication, Language and Culture, 2(1), 44–58. https://doi.org/10.33093/jclc.2022.2.1.4
Bender, E. M., Gebru, T., McMillan-Major, A., & Mitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610–623. https://doi.org/10.1145/3442188.3445922
Birhane, A. (2021). Algorithmic injustice: A relational ethics approach. Patterns, 2(2), 100205. https://doi.org/10.1016/j.patter.2021.100205
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020). Language (technology) is power: A critical survey of "bias" in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 5454–5476). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.485
D'Ignazio, C., & Klein, L. F. (2020). Data feminism. MIT Press. https://doi.org/10.7551/mitpress/11805.001.0001
Hassan, H., Riaz, M., & Zia, M. H. (2023). Analytical review of the slogans of Aurat March expressing the right of freedom. Pakistan Languages and Humanities Review, 7(2), 384–400. https://doi.org/10.47205/plhr.2023(7-II)33
Hovy, D., & Spruit, S. L. (2016). The social impact of natural language processing. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 591–598. https://doi.org/10.18653/v1/P16-2096
Jamali, J., Rasool, M., & Batool, H. (2022). Code-switching by multilingual Pakistanis on Twitter: A qualitative analysis. Khazar Journal of Humanities and Social Sciences, 25(2), 22–44. https://doi.org/10.5782/2223-2621.2022.25.2.22
Jia Xin, J. T., & Md. Noor, S. (2025). The effects of user-generated and influencer-generated content on beauty product purchases: Navigating scepticism in Malaysia. Journal of Communication, Language and Culture, 5(2), 254–275. https://doi.org/10.33093/jclc.2025.5.2.15
Joshi, P., Santy, S., Budhiraja, A., Bali, K., & Choudhury, M. (2020). The state and fate of linguistic diversity and inclusion in the NLP world. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 6282–6293. https://doi.org/10.18653/v1/2020.acl-main.560
Kelso, E. (2024). Women marching for solidarity: 5 years of Aurat March in the Islamic Republic of Pakistan. Dialectical Anthropology, 48(1), 113–132. https://doi.org/10.1007/s10624-024-09720-4
Khan, A. R., Karim, A., Sajjad, H., Kamiran, F., & Xu, J. (2022). A clustering framework for lexical normalization of Roman Urdu. Natural Language Engineering, 28(1), 93–123. https://doi.org/10.1017/S1351324920000285
Kshetri, N. (2024). Linguistic challenges in generative artificial intelligence: Implications for low-resource languages in the developing world. Journal of Global Information Technology Management, 27(2), 95–99. https://doi.org/10.1080/1097198X.2024.2341496
Liaqat, M. I., Awais Hassan, M., Shoaib, M., Khurshid, S. K., & Shamseldin, M. A. (2022). Sentiment analysis techniques, challenges, and opportunities: Urdu language-based analytical study. PeerJ Computer Science, 8, Article e1032. https://doi.org/10.7717/peerj-cs.1032
Mendes, K., Keller, J., & Ringrose, J. (2019). Digital feminist activism: Girls and women fight back against rape culture. Oxford University Press. https://doi.org/10.1093/oso/9780190697846.001.0001
Milios, A., & BehnamGhader, P. (2022). An analysis of social biases present in BERT variants across multiple languages. arXiv. https://doi.org/10.48550/arXiv.2211.14402
Nadeem, M., Bethke, A., & Reddy, S. (2021). StereoSet: Measuring stereotypical bias in pretrained language models. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, 5356–5371. https://doi.org/10.18653/v1/2021.acl-long.416
Nazir, M. K., Bilal, M., & Shongwe, S. C. (2026). Sentiment analysis for code-mixed low-resource languages: A systematic review of approaches, techniques, applications, challenges, and future directions. Social Network Analysis and Mining, 16, Article 47. https://doi.org/10.1007/s13278-026-01588-2
Puttick, A., Ikae, C., Rigotti, C., Fosch-Villaronga, E., Kharas, M. W., Søraa, R. A., & Kurpicz-Briki, M. (2025). A systematic review of bias detection methods for non-English word embeddings and language models. Artificial Intelligence Review, 58, Article 370. https://doi.org/10.1007/s10462-025-11375-8
Sap, M., Card, D., Gabriel, S., Choi, Y., & Smith, N. A. (2019). The risk of racial bias in hate speech detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (pp. 1668–1678). Association for Computational Linguistics. https://doi.org/10.18653/v1/P19-1163
Scott, W. A. (1955). Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly, 19(3), 321–325. https://doi.org/10.1086/266577
Shah, S. R., Irfan, H., & Akram, A. (2025). Pakistani English and cultural identity: A critical discourse analysis of English-Urdu code-mixing in social media advertisements. Social Sciences Spectrum, 4(4), 455–470. https://doi.org/10.71085/sss.04.04.427
Shahzadi, I. (2025). Negotiating social identities: The role of code-switching and code-mixing in ESL classrooms in Pakistan. South Asian Journal of Arts, Humanities and Society, 1(1), 21–29. https://journals.usa.edu.pk/sajahs/article/view/3
Srivastava, V., & Singh, M. (2021). Challenges and considerations with code-mixed NLP for multilingual societies. arXiv. https://doi.org/10.48550/arXiv.2106.07823
Wajcman, J. (2004). Technofeminism. Polity Press.
Wyer, S., & Black, S. (2025). Algorithmic bias: Sexualized violence against women in GPT-3 models. AI and Ethics, 5, 3293–3310. https://doi.org/10.1007/s43681-024-00641-0
Yi, T., & Al-Saggaf, M. A. (2025). A critical discourse analysis of immigration satire in Joe Wong's stand-up comedy. Journal of Communication, Language and Culture, 5(2), 1–12. https://doi.org/10.33093/jclc.2025.5.2.1
Zia, A. S. (2022). Feminists as cultural 'assassinators' of Pakistan. Journal of International Women's Studies, 24(2), Article 15. https://vc.bridgew.edu/jiws/vol24/iss2/15