This day-long symposium will bring together experts from around the country and across campus to discuss advances in Large Language Models (LLMs), with a particular focus on their applications to scientific workflows, robotics and linguistics.
The Astro-AI Keynote will be given by Kartheik Iyer (NASA Hubble Postdoctoral Fellow, Columbia University) at 3:30pm
CosmicAI Invited speaker Jessy Li (AI lead of the Explorable Universe group) will present “Measuring the Intangible Dimensions of Generative AI” at 1:30pm
Abstract: We know how to evaluate the performance of AI systems on tasks where the outcome can be verified. But most tasks out there do not belong to this category — they are more open-ended and with aspects that are hard to measure, like creativity. This talk presents our recent work addressing such evaluation challenges.