A collaborative investigation found that OpenAI did not adhere to Canadian privacy regulations while training its widely-used ChatGPT tool, leading to the unauthorized collection and utilization of sensitive personal data. The federal privacy commissioner and provincial counterparts from Quebec, British Columbia, and Alberta disclosed their conclusions on Wednesday regarding ChatGPT, a chatbot introduced in 2022 that generates human-like responses based on user queries.
Initiated in 2023 in response to a complaint, the privacy regulators’ inquiry revealed multiple issues that indicated OpenAI’s training of ChatGPT did not comply with federal and provincial privacy laws. They highlighted the significant amount of personal information gathered by OpenAI without adequate safeguards to prevent its utilization in model training, potentially including details on health conditions, political beliefs, and data concerning minors.
Moreover, many users were unaware that their data was being collected and utilized for ChatGPT training purposes. Privacy Commissioner Philippe Dufresne emphasized the lack of accountability from OpenAI in launching a product that disregarded Canadian law, citing statements from the company’s leadership indicating a necessity to swiftly introduce the tool despite known privacy concerns.
In response to the investigation, OpenAI contested the findings and maintained its compliance with privacy laws to a large extent. However, the company committed to enhancing its privacy measures and addressing the regulators’ concerns. OpenAI outlined in a detailed explanation the use of Canadians’ data in model training, emphasizing the utilization of freely accessible information and employing privacy filters to shield personal details in text.
While acknowledging the trust placed in ChatGPT for personal interactions, OpenAI stressed its commitment to privacy protection and risk mitigation. Privacy Commissioner Dufresne underscored the imperative to update Canada’s privacy laws to align with evolving technologies like AI, emphasizing the need for enhanced legal frameworks to safeguard individuals’ privacy rights.
The investigation predates the tragic incident in Tumbler Ridge, B.C., where OpenAI faces lawsuits alleging negligence following a mass shooting. The case has prompted discussions on implementing regulations for AI chatbots, with calls for modernizing privacy laws to ensure the safe deployment of new technologies and protect privacy rights in Canada.