ADaSci Banner 2024

PII Detection in Emails through QLoRA Fine-tuned LLMs: A comparative analysis with BERT and GPT3.5

Author(s): Chinmay Prakash, Rishit Tyagi, Prakash Selvakumar

Abstract

Personally Identifiable Information (PII) detection is critical due to the increasing exploitation of individual data, particularly in the text analytics domain. With the rise in the application of large language models (LLMs) for Natural Language Processing (NLP) solutions, data security concerns call for effective on-premises solutions and privacy-centric methods.

This paper explores the use of LLMs fine-tuned on limited domain-specific datasets for detecting and masking PII and benchmarking this solution against existing NLP methods such as BERT and GPT3.5. Our approach includes fine-tuning the Vicuna-7B LLM using the Quantized and Low Rank Adaptation (QLoRA) technique, enabling cost-effective fine-tuning and deployment on consumer GPUs; The proposed approach offers several advantages, including improved performance and reliability compared to GPT3.5, enhanced data security by keeping data within the company’s cloud, domain adaptability through model fine-tuning, and on-premise usage benefits such as reduced dependence on proprietary models, quota limitations, and flexible scaling of model hosting infrastructure.

Overall, this paper presents an efficient and secure solution for domain specific PII detection tasks using LLMs.

Access The Research Paper:

Picture of Vaibhav Kumar

Vaibhav Kumar

The Chartered Data Scientist Designation

Achieve the highest distinction in the data science profession.

Elevate Your Team's AI Skills with our Proven Training Programs

Strengthen Critical AI Skills with Trusted Generative AI Training by Association of Data Scientists.

Our Accreditations

Get global recognition for AI skills

Chartered Data Scientist (CDS™)

The highest distinction in the data science profession. Not just earn a charter, but use it as a designation.

Certified Data Scientist - Associate Level

Global recognition of data science skills at the beginner level.

Certified Generative AI Engineer

An upskilling-linked certification initiative designed to recognize talent in generative AI and large language models

Join thousands of members and receive all benefits.

Become Our Member

We offer both Individual & Institutional Membership.