Zack Giacomelli, a 31-year-old funeral director, made the decision last month to sell his 2021 BMW back to BMW Toronto after facing significant repair issues with the vehicle, which he had purchased from the same dealership in 2023.
Initially, the process of selling back the car appeared straightforward for Giacomelli. Upon making an online inquiry, he received a text message from Quinn at BMW Toronto, who was keen on assisting him. Quinn expressed empathy for Giacomelli’s car troubles and inquired about the vehicle’s status while undergoing repairs at the dealership. Subsequently, in the same text conversation, Quinn presented a definitive buy-back offer of $27,162.79.
Giacomelli felt content with the offer as it covered the remaining amount he owed on the car. However, his satisfaction was short-lived when a sales consultant from BMW Toronto contacted him shortly after to retract the offer. The consultant revealed that Quinn was not a real person but an artificial intelligence chatbot that had mistakenly extended the offer.
The dealership informed Giacomelli that the revised buy-back offer would be at most $20,000, significantly lower than the initial offer made by Quinn. Feeling devastated by the turn of events, Giacomelli voiced his disappointment, emphasizing the importance of honoring commitments made by AI systems if they are replacing human roles.
The incident raises questions about the ability of AI to enter into contracts on behalf of companies, highlighting the risks involved as businesses increasingly adopt AI tools. Legal precedents, such as a 2024 case involving Air Canada, establish that companies are accountable for AI chatbots’ actions and the information they provide to customers.
Following intervention from CBC News, BMW Toronto reinstated Quinn’s original offer, bringing relief to Giacomelli, who promptly accepted it. The dealership’s sales manager acknowledged a miscommunication that led to the confusion, emphasizing the importance of ensuring clarity and transparency in customer interactions involving AI.
As companies navigate the evolving landscape of AI integration, the incident serves as a cautionary tale, prompting a reevaluation of AI usage in customer interactions to prevent similar disputes in the future.