Transformation of ChatGPT into Threat: The Effects of Generative AI on Data Protection and Security
DOI:
https://doi.org/10.47672/ajce.2586Keywords:
Generative AI, Genai And Cybersecurity, ChatGPT, Google Bard, Cyber Offense, Cyber Defense, Ethical Genai, Privacy, Cybersecurity, Artificial Intelligence, JailbreakingAbstract
Purpose: For 2022, GenAI models were the main digital transformation advancement. Cybersecurity is crucial when GenAI models like ChatGPT and Google Bard get more complex. Cybersecurity incidents have highlighted GenAI's offensive and defensive use, creating social, ethical, and privacy issues. GenAI's privacy and cybersecurity risks, possibilities, and constraints are covered in this paper. This study demonstrates ChatGPT's security flaws, which bad actors might utilize to steal sensitive data by violating the model's ethics. In this research, we show ChatGPT attacks using jailbreaks, reverse psychology, and quick injection. Learn how hackers utilize GenAI to launch cyberattacks.
Materials and Methods: ChatGPT is great for customer service, but Bard AI is where it's at when it comes to conversational apps. Diverse technologies have diverse developer communities and ecosystems. With over 100 million users and 1.8 billion monthly visits, ChatGPT is a popular choice among developers and academics because of its accessibility. Bard AI is still in beta and only available to a small group of people, but its APIs are available to the public. OpenAI and Google have different methods to model openness and accessibility. OpenAI makes ChatGPT accessible via APIs, whereas Bard AI, now in the experimental phase, is confined to a select user base. ChatGPT uses semi-supervised (RLHF) training data from sources such as WebText2, OpenWebText2, Common Crawl, scientific literature, and Wikipedia. In contrast, Bard AI uses the Infini set dataset, a varied online content mix, to improve discussion engagement.
Findings: Various forms of social engineering, phishing, automated hacking, malware development, attack payload production, and polymorphic malware may be accomplished using ChatGPT. The report covers defense techniques and upgrades to GenAI security. Automated cyber defenses, reporting, threat data, secure code creation and detection, attack detection, ethical standards, incident response plans, and malware detection are all among these. We will examine the social, ethical, and legal consequences of ChatGPT.
Implications to Theory, Practice and Policy: Given the potential impact on cybersecurity, the paper outlines the present situation and suggests steps the community may take moving forward to make sure this GenAI is reliable, safe, and ethical.
Downloads
References
Anon. (2021). ChatGPT Spills Secrets in Novel PoC Attack. Darkreading.com. https://www.darkreading.com/cyber-risk/researchers-develop-new-attack-for-extracting-secrets-from-chatgpt-other-genai-tools
Anon. (2023). What is Generative AI in Cybersecurity? Palo Alto Networks. https://www.paloaltonetworks.com/cyberpedia/generative-ai-in-cybersecurity
Balaban, D. (2022). Gen AI And Its Malicious Impact On The Cyber-Physical Threat Landscape. Forbes. https://www.forbes.com/sites/davidbalaban/2022/04/04/gen-ai-and-its-malicious-impact-on-the-cyber-physical-threat-landscape/
Data, B. (2023, October 28). How to Use ChatGPT Dan - Detailed Guide. What’s the Big Data? https://whatsthebigdata.com/chatgpt-dan/
Dexerto. (2022). How to jailbreak ChatGPT: Best prompts & more. Dexerto. https://www.dexerto.com/tech/how-to-jailbreak-chatgpt-2143442/
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020). Generative adversarial networks. Communications of the ACM, 63(11), 139–144. https://doi.org/10.1145/3422622
Jana. (2021, November 21). Data Innovation Summit 2025 X Edition. Hyperight. https://hyperight.com/2-years-of-chatgpt-the-evolution-of-conversational-ai/
Krishnamurthy, O. (2021). Impact of Generative AI in Cybersecurity and Privacy. In International Journal of Advances in Engineering Research. https://ijaer.com/admin/upload/04%20Oku%20Krishnamurthy%2001436.pdf
Lawlor, P., & Chang, J. (2023, February 12). The rise of generative AI: A timeline of breakthrough innovations. Www.qualcomm.com. https://www.qualcomm.com/news/onq/2023/02/the-rise-of-generative-ai-timeline-of-breakthrough-innovations
NVIDIA. (2023). What is Generative AI? NVIDIA. https://www.nvidia.com/en-us/glossary/data-science/generative-ai/
Sameh Elhakim. (2023, May 18). Playbook of the Week: Using ChatGPT in Cortex XSOAR. Palo Alto Networks Blog. https://www.paloaltonetworks.com/blog/security-operations/using-chatgpt-in-cortex-xsoar/
Shillsalot, S. (2023, April 30). Here’s how anyone can Jailbreak ChatGPT with these top 4 methods. AMBCrypto. https://ambcrypto.com/heres-how-to-jailbreak-chatgpt-with-the-top-4-methods-5/
Thompson, A. (2023, March 14). Evolution of Generative Artificial Intelligence for Text (ChatGPT). TVS Next. https://tvsnext.com/blog/evolution-of-generative-artificial-intelligence-for-text-chatgpt/
Week, I. (2021). GenAI’s Impact on Cybersecurity. Informationweek.com. https://www.informationweek.com/it-leadership/genai-s-impact-on-cybersecurity
Yosifova, A. (2023, August 14). The Evolution of ChatGPT: History and Future. 365 Data Science. https://365datascience.com/trending/the-evolution-of-chatgpt-history-and-future/
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Nishchai Jayanna Manjula, Kiran Randhi, Srinivas Reddy Bandarapu
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution (CC-BY) 4.0 License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.