Physics ∩ ML Seminars |
Events During the Week of July 24th through July 31st, 2022
Monday, July 25th, 2022
- No events scheduled
Tuesday, July 26th, 2022
- No events scheduled
Wednesday, July 27th, 2022
- Minerva: Solving Quantitative Reasoning Problems with Language Models
- Time: 11:00 am - 12:15 pm
- Place: Online Seminar: Please sign up for our mailing list at www.physicsmeetsml.org for zoom link
- Speaker: Guy Gur-Ari, Google Brain
- Abstract: Quantitative reasoning tasks which can involve mathematics, science, and programming are often challenging for machine learning models in general and for language models in particular. We show that transformer-based language models obtain significantly better performance on math and science questions when trained in an unsupervised way on a large, math-focused dataset. Performance can be further improved using prompting and sampling techniques including chain-of-thought and majority voting. Minerva, a model that combines these techniques, achieves SOTA on several math and science benchmarks. I will describe the model, its capabilities and limitations.
- Host: Gary Shiu
Thursday, July 28th, 2022
- No events scheduled
Friday, July 29th, 2022
- No events scheduled