ChatGPT o3 Secures AIR 4 in JEE Advanced 2025

ChatGPT o3, released on April 16, 2025, has proven its capabilities in various domains. An IIT student, Anushka, conducted an experiment by having the AI attempt the JEE Advanced 2025 question paper. The results were remarkable, with ChatGPT o3 scoring 327 out of 360, which would secure an All India Rank of 4. Anushka detailed her experiment in a blog post titled "ChatGPT o3 Scores AIR 4 in JEE Advanced 2025. What Just Happened?". She chose the JEE Advanced 2025 paper, conducted on May 18, to ensure the questions were fresh for the AI. Each question was presented in a new chat session without any feedback, using the ChatGPT web version. The answers were compared against the official answer key from IIT Kanpur. The evaluation followed the same rules as the actual exam: correct answers received full marks, incorrect ones faced negative marking, and partial credit was given where applicable. ChatGPT excelled in algebra and calculus but struggled with graphical interpretation, particularly with Vernier Scale readings. Despite these challenges, its performance was significantly better than GPT-4's in 2023, which had ranked in the 10,000s. Anushka reflected on the implications of this advancement, acknowledging the humbling yet fascinating reality of AI surpassing human capabilities in domains once considered the exclusive realm of top human minds.