Promote Sign in Sign up

Paper

GPT-4 Technical Report

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to p · Authors: OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya… · Published 2023-03-15 · arXiv:2303.08774

OpenAI
Paper
Published
2023-03-15
Authors
281
arXiv
2303.08774
Category
cs.CL

Abstract

arXiv:2303.08774

OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila…

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.

Related papers

40

  • OpenAI
  • OpenAI
  • Meta Platforms
  • Anthropic
  • Center for AI Safety
  • Center for AI Standards and Innovation
  • Co-affiliated with Carnegie Mellon University
  • UK Artificial Intelligence Security Institute
  • OpenAI
  • Shanghai Jiao Tong University
  • NVIDIA
  • Google
  • AMD
  • IBM
  • Together AI
  • OpenAI
  • SEMRON
  • EnCharge AI
  • SambaNova
  • SK Hynix
  • Oracle
  • Agentrys
  • Brown University
  • California Institute of Technology
  • Carnegie Mellon University
  • Hewlett Packard Labs
  • New York University
  • Princeton University
  • Stanford University
  • University at Buffalo
  • University of California
  • University of Illinois Urbana-Champaign
  • University of Pennsylvania
  • University of Texas
  • OpenAI
  • MATS
  • New York University
  • University of Pennsylvania
  • NVIDIA
  • Google