Do ChatGPT and Other AI Chatbots Pose a Cybersecurity Risk?

Informatics

In November 2022, OpenAI launched ChatGPT, an AI chatbot that gained over 100 million users by February 2023 [...]

International Journal of Information Studies and Libraries, 2023

The study offers a comprehensive analysis of global research on Chatbot and ChatGPT from 2002 to 2023. A rapid research growth has been noted after the year 2017. The research growth, authorship analysis, keyword analysis, citation pattern, co-occurrence of keywords and thematic analysis were analysed. The USA leads in publications and citations, while the Norway achieved the highest average citations. Keyword trends highlighted "Chatbot," "Artificial intelligence" and "ChatGPT" as research domains. Thematic clusters emerged from co-occurrence analysis. Finally, this study maps the dynamic evolution of Chatbot and ChatGPT research in the first two decades of the 21 st century and offers insights for researchers, practitioners and policymakers in the AI research field.

The 2023 Dewald Roode Workshop on Information Systems Security Research, IFIP WG8.11/WG11.13

Artificial intelligence (AI) is increasingly prevalent in the cybersecurity industry, with many incident response tools utilizing AI. Machine learning and deep learning applications are very powerful in automating data triage tasks and assisting decision making. The popularity of ChatGPT and other AI-driven chatbots further bring AI to the limelight, making many individuals question the role of AI in cybersecurity. In general, AI embodiment garners a lot of attention. Some view AI as a double-edge sword that engenders both benefits and harm to cybersecurity workers, as well as threats posed by AI being employed by threat actors. To examine how AI would influence the cybersecurity industry, we take a grounded theory approach to investigate the interactivities between human cognitions and AI automation. We argue that such interactions would eventually generate an impact on human cognitions and emotions, shedding light on cybersecurity workers' mentalities towards AI. In this manuscript we present our preliminary findings from the analysis of data collected from Reddit.

Information, 2023

This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY

Journal of Human-Technology Relations

In this article, we examine whether ChatGPT is trustworthy and use our conversation with ChatGPT as a pivot for the larger conversation concerning trustworthy AI. Through the example of our conversation with ChatGPT, we argue that the development of trustworthy AI requires keeping the best interests of users at heart. In the process, we emphasize the distinction between trusting ChatGPT and trusting the information provided by it. Lastly, we highlight the role of critical inquiry and acknowledgement of functional limitations in fostering trust in AI systems.

Communications in Computer and Information Science, 2009

Many social robots in the forms of conversation agents or Chatbots have been put to practical use in recent years. Their typical roles are online help or acting as a cyber agent representing an organisation. However, there exists a new form of devious chatbots lurking in the Internet. It is effectively an interactive malware seeking to lure its prey not through vicious assault, but with seductive conversation. It talks to its prey through the same channel that is normally used for human-to-human communication. These devious chatbots are using social engineering to attack the uninformed and unprepared victims. This type of attacks is becoming more pervasive with the advent of Web 2.0. This survey paper presents results from a research on how this breed of devious Malware is spreading, and what could be done to stop it.

IEEE access, 2024

ChatGPT has been acknowledged as a powerful tool that can radically boost productivity across a wide range of industries. It reveals potential in cybersecurity-related tasks such as social engineering. Nevertheless, this possibility raises important concerns regarding the thin line separating moral use of this technology from its harmful usage. It is imperative to address the challenges of distinguishing between legitimate and malevolent use of ChatGPT. This research paper investigates the many concerns of ChatGPT in cybersecurity, privacy and enterprise settings. It covers harmful attacker uses such as injecting malicious prompts, testing brute force attacks, preparing and developing ransomware attacks, etc. Defenders' proactive activities are also addressed, highlighting ChatGPT's significance in security operations and threat intelligence. These defensive operations are classified based on the National Institute of Standards and Technology cybersecurity framework. They involve analyzing configuration files, inquiring about authoritative server, improving security in various systems, etc. Moreover, secure enterprise practices and mitigations spread through five classes are proposed, with an emphasis on clear usage standards and guidelines establishment, personally identifiable information protection, adversarial attack prevention, watermarking generated content, etc. An integrated discussion digs into the interaction of offensive and defensive applications, covering ethical and practical concerns. Future attacks are also discussed, along with potential solutions such as content filtering and collaboration. Finally, a comparative analysis with recent research on ChatGPT security concerns is directed. The paper provides a thorough framework to comprehend the range of implications associated with ChatGPT, enabling the navigation of cybersecurity and privacy challenges.

SSRN Electronic Journal, 2023

This study aimed to investigate user perceptions and privacy concerns related to using ChatGPT in conversational AI systems. The researcher conducted a survey of 500 individuals to explore users' comfortability, concerns about accuracy, transparency, and data privacy related to using ChatGPT. The study used a descriptive statistics method to analyze the data collected from the survey, which included frequencies and percentages of user attitudes towards the use of ChatGPT. The results showed that the largest age group in the sample was the 25-34 group, with 150 participants or 30% of the total sample, and the majority of the sample identified as male, with 250 participants or 50%. The study contributes to the existing literature by providing a detailed examination of the specific privacy concerns related to ChatGPT and sheds light on the extent to which users are comfortable with ChatGPT and the factors that contribute to their concerns about privacy and security. By understanding these concerns, solutions

Proceedings of the 1st Workshop on Advanced Virtual Environments and Education (WAVE2 2018)

Considering the context of Computer Science, Chatbots are computer programs that, through techniques of Artificial Intelligence, aim to simulate human behavior when at the moment of a dialogue through text messages. Despite being a relatively new area of study, the application of this concept has increased considerably, whether in academic settings or in commercial applications, such as situations involving assistants to clarify doubts on websites of manufacturers of electronic products or even in services such as telephony. Thus, this article proposes an analysis of the state of the art of research through a quantitative bibliometric analysis, supported by the Scopus database.

Journal of Embedded System Security and Intelligent Systems (JESSI), 2024

Artificial Intelligence (AI) chatbots have become widely used in various sectors, including education and business, due to their ability to provide quick and continuous responses. However, these chatbots also have limitations, such as giving inaccurate or biased answers, making it important for users to approach their responses with caution. This study aims to compare the performance of four popular AI chatbots: ChatGPT, Gemini, AI Chat, and Aichatting. The research uses empirical methods, conducting experiments by inputting various questions and analyzing the chatbots' responses based on speed, accuracy, and completeness. The results show that while each chatbot has strengths and weaknesses, Gemini (Bard) offers the most features and response variations.