- Published on
What's Next in RAG
- Authors
- Name
- Martin Andrews
- @mdda123
Presentation Link
Sam Witteveen and I started the Machine Learning Singapore Group (or MLSG for short) on MeetUp in February 2017 (it was previously named "TensorFlow and Deep Learning Singapore"), and the forty-eighth MeetUp was our twelfth 'in-person' event since the COVID era.
My talk was titled "What's Next in RAG", to fit in with the "Retrieval Augmented Generation - Giving LLMs access to source documents" theme for the event overall:
- Retrieval Augmented Generation :
- Our workshop Paper from EMNLP-2019 (!)
- "Unsupervised Natural Question Answering with a Small Model" - Andrews & Witteveen (2019)
- Self-RAG
- Our workshop Paper from EMNLP-2019 (!)
- Memory for LLMs : MemGPT
- Memory for Minecraft : JARVIS-1
Sam talked extensively about the basics of RAG, and the range of more advanced extensions available via langchain and LlamaIndex.
We also were pleased to have :
- Leonard Loo giving a talk about "RAG-cipe" - his exploration of LLM, RAG and OCR techniques to suggest meal plans from his (apparently) extensive library of recipes that have been passed down through the generations; and
- Peng Zhao who presented on "The Cheapest Rag MVP", using offerings from Google, Hugging Face and Together.AI
Many thanks to the Google team, who not only allowed us to use Google's Developer Space, and put out the extra chairs required for our larger-than-expected attendence, but were also kind enough to provide Pizza for the attendees!
The slides for my talk, which contain links to all of the reference materials and sources, are here :
If there are any questions about the presentation please ask below, or contact me using the details given on the slides themselves.
