Posted 12/16/2023, 1:14:00 AM
ERNIE Narrows Gap With GPT-4 But Lags in Broad Knowledge and Neutrality
- ERNIE beat GPT-4 on current events questions, but GPT-4 admitted its knowledge ended in April 2023 when its database was last updated
- Both bots successfully helped write emails asking for a raise and came up with healthy meal plans
- ERNIE refused to answer questions about Tiananmen Square and Xi Jinping's term limits, while GPT-4 provided factual responses
- GPT-4 remained neutral on complex issues like racial equality and US foreign policy, while ERNIE gave strong opinions
- Experts say ERNIE has narrowed the technological gap with GPT-4, but is still inferior on benchmark tests