Skip to main content

LUP Student Papers

LUND UNIVERSITY LIBRARIES

The Impact of Generative AI in Enhancing Cybercriminal Fraudulence

Bjelvér, Jakob LU and Welsapar, Michael (2024) SYSK16 20241
Department of Informatics
Abstract
This thesis explores the impact of generative AI on enhancing cybercriminal activities, particularly through the creation of fraudulent content that affects victim perception. A series of formal experiments (n = 15) assessed how AI-generated fraudulent materials compare to human-made frauds in influencing victims, using the elaboration likelihood model (ELM) and related cognitive research. The experimental design involved within-group comparisons, focusing on response time, authenticity, credibility, as well as individual background and self-assessment. Findings suggest that AI-generated content, while typically perceived as less credible than authentic materials, matches the persuasiveness of human-made frauds under certain conditions.... (More)
This thesis explores the impact of generative AI on enhancing cybercriminal activities, particularly through the creation of fraudulent content that affects victim perception. A series of formal experiments (n = 15) assessed how AI-generated fraudulent materials compare to human-made frauds in influencing victims, using the elaboration likelihood model (ELM) and related cognitive research. The experimental design involved within-group comparisons, focusing on response time, authenticity, credibility, as well as individual background and self-assessment. Findings suggest that AI-generated content, while typically perceived as less credible than authentic materials, matches the persuasiveness of human-made frauds under certain conditions. This highlights the concerning potential of generative AI in cybercrime, capable of emulating human deceptive tactics effectively. The thesis highlights the necessity for innovative cybersecurity strategies and an informed society to address the challenges posed by AI-enhanced cyber fraud. It advocates for continued research and updated regulatory measures to mitigate the evolving threats of AI in cybercriminal exploit. (Less)
Abstract (Swedish)
Denna avhandling utforskar inverkan av generativ AI på förstärkning av cyberkriminella aktiviteter, särskilt genom skapandet av bedrägligt innehåll och hur det påverkar offrens uppfattning. En serie formella experiment (n = 15) bedömde hur AI-genererat bedrägligt material jämför sig med mänskligt genererade bedrägerier när det gäller att påverka offer, med användning av modellen för sannolikhetsbaserad bearbetning (ELM) och relaterad kognitiv forskning. Den experimentella designen innehöll jämförelser inom grupper, med fokus på responstid, trovärdighetsskattning, samt individuell bakgrund och självbedömning. Resultaten tyder på att AI-genererat innehåll, som vanligtvis uppfattas som mindre trovärdigt än autentiska material, matchar... (More)
Denna avhandling utforskar inverkan av generativ AI på förstärkning av cyberkriminella aktiviteter, särskilt genom skapandet av bedrägligt innehåll och hur det påverkar offrens uppfattning. En serie formella experiment (n = 15) bedömde hur AI-genererat bedrägligt material jämför sig med mänskligt genererade bedrägerier när det gäller att påverka offer, med användning av modellen för sannolikhetsbaserad bearbetning (ELM) och relaterad kognitiv forskning. Den experimentella designen innehöll jämförelser inom grupper, med fokus på responstid, trovärdighetsskattning, samt individuell bakgrund och självbedömning. Resultaten tyder på att AI-genererat innehåll, som vanligtvis uppfattas som mindre trovärdigt än autentiska material, matchar övertygelsekraften hos mänskligt genererade bedrägerier under vissa förhållanden. Detta påvisar den oroande potentialen hos generativ AI inom cyberbrott, som kan likställas med mänskliga bedrägliga taktiker. Avhandlingen betonar behovet av innovativa cybersäkerhetsstrategier och ett informerat samhälle för att möta de utmaningar som AI-drivna cyberbedrägerier innebär. Den förespråkar fortsatt forskning och uppdaterade regleringsåtgärder för att mildra de växande hoten från AI i cyberkriminella utnyttjanden. (Less)
Please use this url to cite or link to this publication:
author
Bjelvér, Jakob LU and Welsapar, Michael
supervisor
organization
alternative title
A Formal Experiment on the Effectiveness of AI-Generated Frauds on Victims' Perception
course
SYSK16 20241
year
type
M2 - Bachelor Degree
subject
keywords
Cybercrime, Cyberattack, Generative AI, Online fraud, Digital deception
language
English
id
9163660
date added to LUP
2024-06-14 09:53:42
date last changed
2024-06-14 09:53:42
@misc{9163660,
  abstract     = {{This thesis explores the impact of generative AI on enhancing cybercriminal activities, particularly through the creation of fraudulent content that affects victim perception. A series of formal experiments (n = 15) assessed how AI-generated fraudulent materials compare to human-made frauds in influencing victims, using the elaboration likelihood model (ELM) and related cognitive research. The experimental design involved within-group comparisons, focusing on response time, authenticity, credibility, as well as individual background and self-assessment. Findings suggest that AI-generated content, while typically perceived as less credible than authentic materials, matches the persuasiveness of human-made frauds under certain conditions. This highlights the concerning potential of generative AI in cybercrime, capable of emulating human deceptive tactics effectively. The thesis highlights the necessity for innovative cybersecurity strategies and an informed society to address the challenges posed by AI-enhanced cyber fraud. It advocates for continued research and updated regulatory measures to mitigate the evolving threats of AI in cybercriminal exploit.}},
  author       = {{Bjelvér, Jakob and Welsapar, Michael}},
  language     = {{eng}},
  note         = {{Student Paper}},
  title        = {{The Impact of Generative AI in Enhancing Cybercriminal Fraudulence}},
  year         = {{2024}},
}