Our first stab at turning robot experience into a coherent narrative is at CoRL this week. Zihan put up a great overview here and included a ton of detail in the appendices. We hope that others will pick up on similar applications of LLMs as summarizers and narrators for robot experience.

Also appearing, a workshop paper thinking about how LLMs might help developers edit robot state machines.