Events

Physics ∩ ML Seminars

<< Spring 2022 Summer 2022 Fall 2022 >>
Subscribe your calendar or receive email announcements of events
Minerva: Solving Quantitative Reasoning Problems with Language Models
Date: Wednesday, July 27th
Time: 11:00 am - 12:15 pm
Place: Online Seminar: Please sign up for our mailing list at www.physicsmeetsml.org for zoom link
Speaker: Guy Gur-Ari, Google Brain
Abstract: Quantitative reasoning tasks which can involve mathematics, science, and programming are often challenging for machine learning models in general and for language models in particular. We show that transformer-based language models obtain significantly better performance on math and science questions when trained in an unsupervised way on a large, math-focused dataset. Performance can be further improved using prompting and sampling techniques including chain-of-thought and majority voting. Minerva, a model that combines these techniques, achieves SOTA on several math and science benchmarks. I will describe the model, its capabilities and limitations.
Host: Gary Shiu
Add this event to your calendar