We’ve written about grokking before, and why it’s important that neural networks, after long-term stagnation or overhitting (memorising training data), suddenly experiences a “lightbulb moment” and generalises to perform perfectly on unseen data. Emergent Symbolic Mechanisms Support Abstract Reasoning in Large Language Models According to the paper ‘Emergent Symbolic Mechanisms Support Abstract Reasoning in Large…
“All that neural net does is just matrix multiplications and gradient descent”… “When we look inside, we see only statistical pattern matching, not the structured, systematic, rule-following processes we associate with reasoning.”As far as I can tell we can’t find evidence of symbolic reasoning at the level of human neurons either. The debate about whether…
The state of the art deep learning models do not really embody understanding. This panel will focusing on AGI transparency, auditability and explainability.. differences btw causal understanding and prediction as well as surrounding practical / systemic / ethical issues. Can the blackbox problem be fully solved without machine understanding (the AI actually ‘understanding’ rather than…
Joscha Bach on GPT-3, achieving AGI, machine understanding and lots more! Discussion points: 02:40 What’s missing in AI atm? Unified coherent model of reality 04:14 AI systems like GPT-3 behave as if they understand – what’s missing? 08:35 Symbol grounding – does GPT-3 have it? 09:35 GPT-3 for music generation, GPT-3 for image generation, GPT-3…
Here Joscha Bach discusses consciousness, it’s relationship to qualia and whether an AI or a utility maximizer would do with it. What is consciousness? “I think under certain circumstances being conscious is an important part of a mind; it’s a model of a model of a model basically. What it means is our mind (our…
“In short, data is not knowledge; knowledge is not comprehension; comprehension is not wisdom” The standard account of understanding has been, since Aristotle, knowledge of the causes of an event or effect. However, this account fails in cases where the subject understood is not causal. In this paper I offer an account of understanding as…
Introduction Overview The event will address a variety of topics futurology (i.e. accelerating change & long term futures, existential risk, philosophy, transhumanism & ‘the posthuman’) in general though it will have a special focus on Machine Understanding. How will we operate along side artificial agents that increasingly ‘understand’ us, and important aspects of the world…