Learning Is Overrated: Machine Learning vs. Knowledge Acquisition

Walid Saba Walid Saba
May 7, 2021 AI & Machine Learning

Knowing-How vs. Knowing-That

Philosophers have long recognized the difference between two types of knowledge: knowing-how and knowing-that, where (roughly and very informally) the former is typically associated with skills and abilities, and the latter is associated with propositions (truths/established facts). In our everyday discourse we use the word ‘know’ for both types of knowledge, which creates some confusion. So, for example, we say things like:

Learning Is Overrated: Machine Learning vs. Knowledge Acquisition

But there are several fundamental differences between K1 and K2, some of which are listed in the diagram below:

The difference between knowing how and knowing that
The difference between knowing-how and knowing-that

Below we discuss in some details these opposing properties as they relate to K1 and K2 given above.

Difference between K1 & K2

Finally, skills are not forgettable — we might have some biological and/or brain damage that makes us ‘lose’ (not forget) some skill/ability, but recovery from that damage immediately brings back that skill and no ‘learning’ (training) from scratch will be needed. Propositional facts might however be forgotten (I might forget what is the height of Mount Everest, or what is Bayes’ formula, etc. but again, I do not acquire it back by learning, but by being told again (i.e., reminded).

Below are some examples of both types of knowledge:

Types of knowledge

Clearly, then, learning applies to knowing-how and does not even apply to knowing-that. More crucially, most of the knowledge that matters to how the universe works is knowledge that is not learned (from experience, trial and error, from observation/data, etc.) because we are not allowed to learn it differently — it is in fact knowledge that is either discovered, or deduced, or knowledge that is acquired by instruction (i.e., by being told by those that have acquired that knowledge). In fact, this why it sounds awkward to say ‘I don’t know [some-fact]’ while it sounds very natural when I state that ‘I don’t know [how-to]’ and that is because I-do-not-know(established-fact) is not sensible:

Learning Is Overrated: Machine Learning vs. Knowledge Acquisition

Machine Learning or Knowledge Acquisition?

I really don’t know how do Machine Learning (ML) enthusiasts ignore the above facts about knowledge — I guess John McCarthy was right when he suggested that computer scientists should read and listen to what philosophers say. If most of the knowledge that really matters in building intelligent machines that can reason and make decisions in dynamic and uncertain environments is acquired and not learned, then it is clearly absurd to ignore ‘knowledge acquisition’ and suggest that ML suffices to get to AGI.

Techniques for effective Knowledge Acquisition must be developed —yes, it is a difficult problem, as the process of manually feeding handcrafted knowledge into a ‘knowledge base’ is not scalable. But problems are not solved by being ignored. It is perhaps one of the biggest challenges in AI, and it is for this reason that I think this is where attention should be given.

Let me end with a simple example that connects where machine learning might happen, where it stops and where knowledge acquisition might pick up and take over. Consider the image below

Learning Is Overrated: Machine Learning vs. Knowledge Acquisition

Assuming we have very robust (deep) neural networks (DNNs) that can learn a concept like ‘apple’ — by observing similarities in their patterns. Suppose that process resulted in recognizing images that we labeled (in our semantic memory) as Apple, Banana, and Orange. Something like this must be happening in the early years of a child — images are recognized, by something like a DNN, and they are given a label by the parent that the child (perhaps) stores in semantic memory. But what about the next level? The level at which we group these objects into a higher category? Clearly, we categorize these concepts under the concept Fruit for some reason. Perhaps because we see (instances of) these objects in the same contexts: they are usually found together in a basket (in the kitchen or on the dining table); they seem to be put together on the same shelves in a supermarket, we see people eating them interchangeably, etc. In other words, it seems that they somehow belong to one category. This type of knowledge cannot be learned — the process I just described is a complex reasoning process that is not data-driven. Note: not surprisingly, we might make a mistake in recognizing an orange — since that skill is not binary, but once we know that it is an orange (or not) the fact that it is a fruit (or not) is now a binary decision. Amazing how systematic our reasoning is!

Machine learning is important at the data-level — where we use our sensory inputs to recognize patterns and cognize of first-level objects— but what we know is a lot more and most of what matters is knowledge that is NOT learned but is knowledge that is acquired either by discovery or deduction or by being told.

Knowledge Acquisition

___

  • Experfy Insights

    Top articles, research, podcasts, webinars and more delivered to you monthly.

  • Walid Saba

    Tags
    Artificial IntelligenceKnowledgeLearningMachine Learning
    Leave a Comment
    Next Post
    10 Critical Competencies For Today’s Workforce

    10 Critical Competencies For Today's Workforce

    Leave a Reply Cancel reply

    Your email address will not be published. Required fields are marked *

    More in AI & Machine Learning
    AI & Machine Learning,Future of Work
    AI’s Role in the Future of Work

    Artificial intelligence is shaping the future of work around the world in virtually every field. The role AI will play in employment in the years ahead is dynamic and collaborative. Rather than eliminating jobs altogether, AI will augment the capabilities and resources of employees and businesses, allowing them to do more with less. In more

    5 MINUTES READ Continue Reading »
    AI & Machine Learning
    How Can AI Help Improve Legal Services Delivery?

    Everybody is discussing Artificial Intelligence (AI) and machine learning, and some legal professionals are already leveraging these technological capabilities.  AI is not the future expectation; it is the present reality.  Aside from law, AI is widely used in various fields such as transportation and manufacturing, education, employment, defense, health care, business intelligence, robotics, and so

    5 MINUTES READ Continue Reading »
    AI & Machine Learning
    5 AI Applications Changing the Energy Industry

    The energy industry faces some significant challenges, but AI applications could help. Increasing demand, population expansion, and climate change necessitate creative solutions that could fundamentally alter how businesses generate and utilize electricity. Industry researchers looking for ways to solve these problems have turned to data and new data-processing technology. Artificial intelligence, in particular — and

    3 MINUTES READ Continue Reading »

    About Us

    Incubated in Harvard Innovation Lab, Experfy specializes in pipelining and deploying the world's best AI and engineering talent at breakneck speed, with exceptional focus on quality and compliance. Enterprises and governments also leverage our award-winning SaaS platform to build their own customized future of work solutions such as talent clouds.

    Join Us At

    Contact Us

    1700 West Park Drive, Suite 190
    Westborough, MA 01581

    Email: support@experfy.com

    Toll Free: (844) EXPERFY or
    (844) 397-3739

    © 2023, Experfy Inc. All rights reserved.