Intelligence, Inside and Outside.

Announcing The PyTorch Foundation: A New Era For The Cutting-Edge AI Framework

Since we partnered with the AI community to create the PyTorch framework for AI research six years ago, open collaboration has been essential to its success. With some 2,400 contributors who have built more than 150,000 projects on the framework, PyTorch has become one of the leading platforms for AI research as well as commercial production use. Today, we are excited to announce the next step for PyTorch: The project will transition to a newly launched PyTorch Foundation, which will be part of the nonprofit Linux Foundation, a technology consortium whose core mission is the collaborative development of open source software.

The PyTorch Foundation will boast a wide-ranging governing board composed of representatives from AMD, Amazon Web Services, Google Cloud, Meta, Microsoft Azure, and Nvidia, with the intention to expand further over time. The board will prioritize the continued growth of PyTorch’s vibrant community, the driving force behind the project’s success. Releases, features, and technical direction will still be driven by the maintainers, committers, and contributors to the project. The creation of the PyTorch Foundation ensures that decisions will be made in a transparent and open manner by a diverse group of members for many years to come.

A thriving community

It’s hard to overstate how quickly PyTorch has grown. In 2016, a group of Meta AI researchers embarked quietly on a couple of projects. They were determined to create a single, simple, standardized interface for their end-to-end workflow. They also harbored hopes of fixing the tedious, complicated research-to-production pipeline of the AI field. In fact, this pipeline was more of a labyrinth, involving multiple steps and tools, fragmented processes, and navigation between different frameworks that were optimized for either research or production, but not both. The Meta team experimented with machine learning (ML) frameworks such as Theano and Torch, and with advanced concepts from Lua Torch, Chainer, and HIPS Autograd, but stayed focused on one thing above all for their new framework: usability.

Read More  PyTorch/XLA 2.5: vLLM support and an improved developer experience

Just two years later, Meta announced PyTorch 1.0, a dynamic, interactive framework that allowed developers to not only experiment rapidly but also seamlessly transition to graph-based modes for deployment.

Their efforts have paid off. PyTorch has since grown into the lingua franca of AI research. Today, more than 80 percent of researchers who submit their work at major ML conferences, such as NeurIPS or ICML, harness the framework. We have built libraries that support some of the principal domains of the AI field, such as torchvision, which powers most of the world’s modern computer vision research. The framework will continue to be a part of Meta’s AI research and engineering work. PyTorch is also a foundation of the AI research and products built by Amazon Web Services, Microsoft Azure, OpenAI, and many other companies and research institutions.

Meta has worked steadily to nurture the community-driven growth that has fueled PyTorch’s success. We’ve committed hundreds of engineers to the framework and strongly supported product development and community outreach.

But the time is right for a new home for PyTorch.

Formalizing governance

PyTorch was built from the ground up with an open source, community-first philosophy, and that will not change. When researchers and developers open-source their code, others around the world can share their work, learn from one another’s advances, and then contribute back to the community.

We have always had a clear technical governance structure in place for PyTorch, with core maintainers setting the vision for the framework and the best AI researchers and engineers across industry building its modules. That will be even more important for the future of the framework, as Meta and other contributors have a three-year vision to expand its functionality, modularity, and diversity of code ownership.

Read More  Faster Together: How Dun & Bradstreet Datasets Accelerate Your Real-Time Insights

Going forward, the framework’s contributors will benefit from the robust governance, diverse leadership, and additional investments provided by the new PyTorch Foundation partners. The PyTorch Foundation will strive to adhere to four principles: remaining open, maintaining neutral branding, staying fair, and forging a strong technical identity. One of the foundation’s main priorities is to maintain a clear separation between the business and technical governance of PyTorch.

Meta stays fully committed to PyTorch. We will continue to invest in the framework, and use it as the primary framework for our AI research and production. The transition will not entail any changes to PyTorch’s code and core project, and developer operating models, including contributor guidelines and licensing, will also remain unchanged. All releases, features, and technical direction will continue to be driven by PyTorch’s community: from individual code contributors, those who review and commit changes, to the module maintainers. We’re lucky to have strong support from leadership at Meta, which is fully behind the move to take PyTorch to its next logical phase.

Meta has put open science at the core of our work in AI, whether it’s releasing code for large language modelsself-supervised computer vision systems, innovative new datasetsembodied AI platforms, and much more. We believe this approach enables the fastest progress in building and deploying new systems that will address real-world needs and answer fundamental questions about the nature of intelligence. PyTorch has been a core part of this work, and now, with the creation of the PyTorch Foundation, the entire AI community is positioned to push the field forward in countless exciting new ways.

Read More  Teaching AI Advanced Mathematical Reasoning

 

Source Meta AI


For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!
Share this article
Shareable URL
Prev Post

Charmed Kubeflow 1.6 Is Now Available From Canonical

Next Post

Microsoft Shares What’s Next In Machine Learning At NVIDIA GTC

Read next