Research | OpenAI
Josh Achiam, Researcher at OpenAI Focus areas We build our generative models using a technology called deep learning, which leverages large amounts of data to train an AI system to perform a task.
Research - OpenAI
Explore the research we're conducting to stay at the forefront of AI development and deployment.
In this paper, we explore a semi-supervised approach for language understanding tasks using a combination of unsupervised pre-training and supervised fine-tuning. Our goal is to learn a universal representation that transfers with little adaptation to a …
Video generation models as world simulators | OpenAI
2024年2月15日 · We explore large-scale training of generative models on video data. Specifically, we train text-conditional diffusion models jointly on videos and images of variable durations, resolutions and aspect ratios. We leverage a transformer architecture that operates on spacetime patches of video and image latent codes. Our largest model, Sora, is capable of generating a minute of high fidelity video ...
Weak-to-strong generalization - OpenAI
2023年12月14日 · Today, we are releasing the team’s first paper, which introduces a new research direction for empirically aligning superhuman models. Current alignment methods, such as reinforcement learning from human feedback (RLHF), rely on human supervision.
Emergent tool use from multi-agent interaction - OpenAI
2019年9月17日 · We use the same training infrastructure and algorithms used to train OpenAI Five and Dactyl . However, in our environment each agent acts independently, using its own observations and hidden memory state.
OpenAI Abstract We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated
Improving language understanding with unsupervised learning
2018年6月11日 · We’ve obtained state-of-the-art results on a suite of diverse language tasks with a scalable, task-agnostic system, which we’re also releasing. Our approach is a combination of two existing ideas: transformers and unsupervised pre-training. These results provide a convincing example that pairing supervised learning methods with unsupervised pre-training works very well; this is an idea ...
GPT-4 - OpenAI
Research GPT-4 is the latest milestone in OpenAI’s effort in scaling up deep learning. View GPT-4 research Infrastructure GPT-4 was trained on Microsoft Azure AI supercomputers. Azure’s AI-optimized infrastructure also allows us to deliver GPT-4 to users around the world.
In this white paper, we suggest a definition of agentic AI systems and the parties in the agentic AI system life-cycle, and highlight the importance of agreeing on a set of baseline responsibilities and safety best practices for each of these parties.