Published on

Open-Endedness and Large Language Models


Sam Witteveen and I started the Machine Learning Singapore Group (or MLSG for short) on MeetUp in February 2017 (it was previously named "TensorFlow and Deep Learning Singapore"), and the forty-fifth MeetUp was our nineth 'in-person' event since the COVID era.

My talk covered "Open-Endedness and Large Language Models":

  • The research behind LLMs used in Agent systems
    • Fine-tuning; Self-Critique; Tool-Use; Memory; Planning
  • What is Open-Endedness:
    • Some concepts and intuitions
    • Examples : Curriculum Learning; Reinforcement Learning; Meta-Learning; Evolution
    • and Applications

Sam talked about the design and implementation of agent systems, and gave demonstrations of sample use-cases.

Many thanks to the Google team, who not only allowed us to use Google's Developer Space, and put out the extra chairs required for our larger-than-expected attendence, but were also kind enough to provide Pizza for the attendees!

The slides for my talk, which contain links to all of the reference materials and sources, are here :

Presentation Screenshot

If there are any questions about the presentation please ask below, or contact me using the details given on the slides themselves.

Presentation Content Example