Can ChatGPT pass the bar exam?

Can ChatGPT pass the bar exam?
Jim Casson Updated on by

Video Gamer is reader-supported. When you buy through links on our site, we may earn an affiliate commission. Prices subject to change. Learn more

Is the increasingly-popular ChatGPT able to pass the notorious bar exam? AI has come along in leaps and bounds in the last few months, and ChatGPT continues to demonstrate its prowess.

Just last week, ChatGPT-creators OpenAI announced that ChatGPT can pass the bar exam – with flying colours, in fact. 

The new GPT-4 AI was tested with a simulated bar exam and, thanks to an update released in March, the model scored with around the top 10% of bar exam test-takers.

This signals a huge improvement in the OpenAI’s AI model, as the previous version only just scraped through

This is really impressive, considering the bar exam’s reputation of being notoriously difficult, and consisting of various forms of examination, like multiple-choice questions and essays. 

In fact, OpenAI boasts a long list of exams that the new GPT-4 passed, including lots of subjects from environmental science to art history, and from macroeconomics to physics. 

This comes after their previous model, GPT 3.5, passing not only the Turing test late last year, but also acing the SAT

The latest model improved further upon the predecessor’s score, achieving a whopping 710 out of 800 in the reading and writing section, and 700 in maths.

Incredibly, GPT-4 far surpassed the average SAT score in 2022.

EXCLUSIVE DEAL 10,000 free bonus credits

Jasper AI

On-brand AI content wherever you create. 100,000+ customers creating real content with Jasper. One AI tool, all the best models.
TRY FOR FREE

Copy AI

Experience the full power of an AI content generator that delivers premium results in seconds. 8 million users enjoy writing blogs 10x faster, effortlessly creating higher converting social media posts or writing more engaging emails. Sign up for a free trial.
ONLY $0.01 PER 100 WORDS

Originality AI detector

Originality.AI Is The Most Accurate AI Detection.Across a testing data set of 1200 data samples it achieved an accuracy of 96% while its closest competitor achieved only 35%. Useful Chrome extension. Detects across emails, Google Docs, and websites.

How was GPT-4 able to pass the bar exam?

For the last six months, OpenAI have been working and rigorously training their latest AI model. 

The result is a new model which is multimodal, meaning it accepts and responds to both textual and visual prompts

A prompt is what the user tells the AI engine to do: an example of a textual prompt may be asking it to answer a difficult question or draft a document. 

A visual prompt would involve giving the AI an image – for instance, GPT-4 was able to decipher why a meme was funny.

The AI model works by being trained on a vast amount of online data, and it then responds to prompts by generating strings of words.

The artificial intelligence then predicts which words will best answer the prompt.

It is because of this extensive training that the AI undergoes, to learn how to answer even the most difficult questions, like those of the bar exam.

Read More: Best ChatGPT Prompts for Writing

Why is the bar exam so difficult?

The bar exam is a final test for law students before they become qualified to practice law, so it’s important that it is challenging. 

Its notoriety is mainly due to it taking place over two full days, and extensively testing the student on a wide range of topics. 

The exam is designed to catch you out – for instance, there is often more than one correct answer in multiple choice questions.

This means that the student, or the AI in this case, has to try to determine not only which answer may be correct, but which is best.

With this in mind, GPT-4’s ability to fly through the exam is astounding. 

OpenAI’s ChatGPT continues to prove itself as an exceptionally powerful tool, passing exams such as the bar with ease.

Who knows what the future of AI holds? Could there be a GPT-5? We’ll keep you posted.

Frequently Asked Questions

What exams did GPT-4 pass?

A simulated bar exam, and multiple SAT, AP and GRE exams.

What can you do with GPT-4?

You can now input visual prompts into the GPT-4 API. The new model can tackle problems and commands of greater complexity than GPT-3.5. The new model can tackle the bar exam with ease.

Read More: Will There Be a GPT-5?