BERT

The First High-Performance Self-Supervised Algorithm That Works For Speech, Vision, And Text
Self-supervised learning — where machines learn by directly observing the environment rather than being explicitly taught through labeled images, text, audio, and other data sources — has powered many significant recent advances in AI. But while people appear to learn in a similar way regardless of how they get information — whether they use sight …

Google Cloud Expands CCAI And DocAI Solutions To Accelerate Time To Value
Virtually all companies face two broad challenges: to marshal data for smarter decision making, and to deliver more personalized and convenient experiences for customers. Artificial intelligence (AI) can help, but the path from AI investment to business outcome can be difficult to chart. To fast-track time to value, today, we’re pleased to announce new additions …

11 Ways We’re Innovating With AI
AI is integral to so much of the work we do at Google. Fundamental advances in computing are helping us confront some of the greatest challenges of this century, like climate change. Meanwhile, AI is also powering updates across our products, including Search, Maps and Photos — demonstrating how machine learning can improve your life in …

IBM RXN: New AI Model Boosts Mapping Of Chemical Reactions
Just like an astronomer investigates outer space, a chemist explores chemical space — a theoretical territory with all possible known (and unknown) chemical compounds. Researchers estimate chemical space to contain up to 10180 compounds — more than twice the magnitude of the number of atoms in the universe. Currently, the largest public database of molecules synthesized so …

Shrinking Massive Neural Networks Used To Model Language
You don’t need a sledgehammer to crack a nut. Jonathan Frankle is researching artificial intelligence — not noshing pistachios — but the same philosophy applies to his “lottery ticket hypothesis.” It posits that, hidden within massive neural networks, leaner subnetworks can complete the same task more efficiently. The trick is finding those “lucky” subnetworks, dubbed …

How AI, And Specifically BERT, Helps The Patent Industry
In recent years the patent industry has begun to use machine-learning (ML) algorithms to add efficiency and insights to business practices. Any company, patent office, or academic institution that works with patents—generating them through innovation, processing applications about them, or developing sophisticated ways to analyze them—will benefit from doing patent analytics and machine learning in …