I had a conversation with Ayomide Odumakinde (member of technical staff at Cohere AI labs) . We discussed artificial intelligence, the history of ideas in this field, current tools and methods, and what to expect in the years to come.Links to things discussed/mentioned in this episodeText Tokenizationhttps://www.ai21.com/knowledge/tokenization/https://huggingface.co/learn/llm-course/en/chapter2/4Supervised finetuningScaling law papersKaplan et al, 2020Hoffmann et al., 2022Sardana et al., 2024Reinforcement learningReinforcement learning from human feedback (RLHF)Ziegler, et al, 2019Learning to summarize with human feedbackReinforcement Learning with Verifiable Rewards Effective context engineering & context rotQroq inference engineContinual AI & learninghttps://www.continualai.org/https://www.ibm.com/think/topics/continual-learningRetrieval-augmented generation (RAG)Function & tool calling with LLMsLong-term memory in agentic systemsFollow us on:Twitter @HintedNeuronInstagram @hintedneuronFacebook Hinted NeuronLeave a review on this podcast at https://ratethispodcast.com/hintedneuronAlso, subscribe to our email list on our website https://hintedneuron.com to stay updated on new releases