Published on

Small LM Agents

Presentation
Authors

The fifty-forth MeetUp of the Machine Learning Singapore Group, was titled : "The Rise of the Small Model - What's new in various 'Small' Models".

My talk was titled "Small Agents", and covered the following topics:

  • Why Small models?
    • Meta's bottom-up analysis of why small models are important
  • Several research papers related to small models:
    • Meta : Small model discoveries
    • Salesforce Agent dataset
    • Qwen 2 & Google Chrome

I also covered (briefly) two topics in the news:

  • A new Minecraft paper "
    • "OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents"
  • AIMO-related news:
    • Results of the recent competition on Kaggle

In his talk "Building Apps with Small Open LMs and VLMs", Sam Witteveen talked about SLMs and VLMs, as well as how the audience might get started building local agents and apps.

Many thanks to the Google team, who not only allowed us to use Google's Developer Space, but were also kind enough to provide Pizza for the attendees!

The slides for my talk, which contain links to all of the reference materials and sources, are here :

Presentation Screenshot

If there are any questions about the presentation please ask below, or contact me using the details given on the slides themselves.

Presentation Content Example