GPT Attack for Adversarial Privacy Policies

While Machine Learning (ML) is widely used in many industries, one sector that is just beginning to leverage this technology is the legal field. Efforts like the construction of the OPP-115 Privacy Policy corpus make it possible to train Natural Language Processing (NLP) and ML models for legal use, and tools such as Polisis, Claudette, etc., which utilize these models can now provide users with descriptive annotations of various types of contracts, including Privacy Policies. However, these tools remain vulnerable to adversarial attacks, specifically adversarial legal documents, which differ from typical text based adversarial attacks due to the necessity of preserving the continuity of a legal document. Therefore, focusing on the OPP-115 corpus and Polisis specifically, we propose a framework that consists of a Doc2Vec model and a variety of shallow and deep learning methods for classification, followed by adversarial attacks on Privacy Policy segments which utilize GPT 3.5, a state-of-the-art LLM, in order to create an adversarial Privacy Policy. We evaluate the effectiveness of our method by comparing attack results to those produced by current methods, including Bert Attack and Text Fooler. Our procedure reveals not just that an attack using GPT 3.5 is an effective means of producing an adversarial policy, but that it is surprisingly easy to prompt a widely used state-of-the-art LLM to perform such a task.