ActInf MorphStream 003.1 ~ Anand Subramoney "Principles of scalability and biological inspirations"
Anand Subramoney Principles of scalability and biological inspirations"
In the talk I will discuss how current models scale and what we can learn from the efficiency of biological brains. One of the central themes will be sparsity, its significant role in scalable systems and its synergies with neuromorphic hardware. I will present existing ideas based on spiking neural networks and recent work from my group focussed on using various forms of sparsity and distributed learning to improve the scalability and efficiency of our learning models.
Anand Subramoney is a Lecturer (Assistant Professor) in the Department of Computer Science at Royal Holloway, University of London. He is broadly interested in learning and intelligence, both algorithmic and biological. His current research focuses on understanding the principles of scalability in deep learning. He aims to use this to build models that are more efficient and can scale up seamlessly. His research draws inspiration from neuroscience and biology in his quest to build a better and more general artificial intelligence. Website: https://anandsubramoney.com/
All Active Inference Institute livestreams and videos:
https://coda.io/@active-inference-institute/livestreams
Full Textbook Group Cohort 2 playlist:
https://www.youtube.com/playlist?list=PLNm0u2n1IwdrnPDKke26QaATAKc-L19xA
Active Inference: The Free Energy Principle in Mind, Brain, and Behavior
By Thomas Parr, Giovanni Pezzulo and Karl J. Friston
https://mitpress.mit.edu/9780262045353/active-inference/ https://www.activeinference.org/
...
https://www.youtube.com/watch?v=YQ1galAHOIw
It’s more consciousness-talk on today’s episode of Active Inference Insights, as Darius discusses affective states, dreams, interoception and much more with psychoanalyst and neuropsychologist Professor Mark Solms.
Mark Solms
https://neuroscience.uct.ac.za/contacts/mark-solms
https://scholar.google.com/citations?user=vD4p8rQAAAAJ&hl=en
https://twitter.com/mark_solms?lang=en-GB
"The Hidden Spring: A Journey to the Source of Consciousness"
"The Brain and the Inner World: An Introduction to the Neuroscience of the Subjective Experience"
Darius Parvizi-Wayne
https://twitter.com/dparviziwayne
https://www.researchgate.net/profile/Darius-Parvizi-Wayne
Active Inference Insititute
https://www.activeinference.org
https://twitter.com/InferenceActive
...
https://www.youtube.com/watch?v=gpUuttKJoDM
Full playlist for Cohort 5 textbook group
https://www.youtube.com/playlist?list=PLNm0u2n1IwdqflC8oVfAqw6frUrmaDS0Y
More information on the Parr et al. 2022 textbook group at the Institute https://www.activeinference.org/education/textbook-group https://www.activeinference.org/education/textbook-group
All Active Inference Institute livestreams and videos:
https://coda.io/@active-inference-institute/livestreams
Active Inference: The Free Energy Principle in Mind, Brain, and Behavior
By Thomas Parr, Giovanni Pezzulo and Karl J. Friston
https://mitpress.mit.edu/9780262045353/active-inference/ https://www.activeinference.org/
...
https://www.youtube.com/watch?v=85HzeHfna08
https://arxiv.org/abs/2302.06403
[Submitted on 13 Feb 2023]
"Sources of Richness and Ineffability for Phenomenally Conscious States"
Xu Ji, Eric Elmoznino, George Deane, Axel Constant, Guillaume Dumas, Guillaume Lajoie, Jonathan Simon, Yoshua Bengio
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
...
https://www.youtube.com/watch?v=jXEJO_5g0ho
In this episode of Active Inference Insights, Darius invites philosopher and machine learning expert Alex Kiefer onto the show. Together, they tackle the big issues, from the role of representations in Active Inference to Bayesian structural realism, Helmholtz machines to POMDPs.
Alex Kiefer
https://scholar.google.com/citations?user=rquLap4AAAAJ&hl=en
https://twitter.com/exilefaker?lang=en-GB
Darius Parvizi-Wayne
https://twitter.com/dparviziwayne
https://www.researchgate.net/profile/Darius-Parvizi-Wayne
Active Inference Insititute
https://www.activeinference.org
https://twitter.com/InferenceActive
...
https://www.youtube.com/watch?v=HIvGyLlZx4I
Full playlist for Cohort 5 textbook group
https://www.youtube.com/playlist?list=PLNm0u2n1IwdqflC8oVfAqw6frUrmaDS0Y
More information on the Parr et al. 2022 textbook group at the Institute https://www.activeinference.org/education/textbook-group https://www.activeinference.org/education/textbook-group
All Active Inference Institute livestreams and videos:
https://coda.io/@active-inference-institute/livestreams
Active Inference: The Free Energy Principle in Mind, Brain, and Behavior
By Thomas Parr, Giovanni Pezzulo and Karl J. Friston
https://mitpress.mit.edu/9780262045353/active-inference/ https://www.activeinference.org/
...
https://www.youtube.com/watch?v=WZ_rsHiwXRk