GPT can read your facial expressions now, which is worrying

GPT can read your facial expressions now, which is worrying
Amaar Chowdhury Updated on by

Video Gamer is reader-supported. When you buy through links on our site, we may earn an affiliate commission. Prices subject to change. Learn more

There’s a GPT powered facial expression recognition AI now, and while it’s being used in a messaging app for now, the potential is pretty scary.

There’s an app called Holler, available through Apple Test Flight, which is an experimental AI-powered messaging app. However, one of the beta features implemented into the game reads your facial expressions and converts them into emojis. While on the surface this isn’t particularly new, especially considering Apple’s emoji technology, it’s the linking to the GPT-4 model which powers ChatGPT which is the worry.

The messaging app uses OpenAI’s GPT model to automatically generate conversational responses for you, and can be used as a simple way to access GPT. However, if say for example you were messaging a friend on the app, the LLM could then to respond for you.

I gave Holler a try, and inputted a question: “What do you think about cars?” Then GPT, using Holler as a mouthpiece, responded with the classic statement, “As an AI, I don’t have personal opinions or emotions. But …” After feeling unhappy with the response, I frowned at my phone screen, and the app took my facial expression and generated a response with it. Here’s what it said:

Effectively, the AI read my facial expression, converted it into an Emoji, and then turned the Emoji into a textual response.

The app is still in its beta phase, and is not particularly worrying in itself. After all, it’s a messaging app with the potential to harbour some interesting and useful technological advancements. However, in principle, AI-powered facial recognition is a contentious subject. Google’s own approach to facial recognition emphases that these types of tech are “developed thoughtfully and responsibly,” while European lawmakers in Brussels have proposed a move to ban AI empowered facial recognition entirely.

Svenja Hanh, a German Member of Parliament for Renew said that facial recognition technology “has no place in a liberal democracy” in an interview with Politico. While there’s no indication that Holler will use facial recognition in any way, the app is integrating facial expression interpretation into a GPT-powered application, and further development of this type of software is sure to worry some.

Reddit users have taken to voice concerns, and praise, for the technology. One user claimed that this type of technology “which obviously can’t be stopped is going to be abused by police or other government forces,” while others responded that “having tech that can actually bring criminals to justice is invaluable.”

At the end of the day, Holler is innocent in nature. However, it’s the implications of similar technologies which can might evolve into something more nefarious which has people worried.

Plugins have already been developed that allows ChatGPT to take control of your PC, and the rate of AI development is astounding. Who knows what the future could hold, especially pertaining to artificial intelligence powered facial recognition software.

Cover image generated with Midjourney, edited in-house.