Causal Inference

Manuel Yllan Manuel Yllan
April 2, 2019 AI & Machine Learning

“Correlation does not imply causation” we all know this mantra from statistics. And we think that we fully understand it. Human (and not human) brains, being machines to find patterns, quickly understand that my coffee mug broke because it fell to the floor. One event (the falling) occurred just before the other (mug breaking) and without the first event, we would never see the second. So not only exists a correlation between mugs falling and mugs breaking there is also a causal relation (with lots of physics going on). So far so good.

 

There are also, easy to spot, funny correlations (see Spurious Correlations website) but the problem arises when we can’t decide about the situation. Do electoral polls reflect voters preferences? Or electoral polls are political weapons to affect citizens vote? Human activities are responsible for climate change or are there more factors?. Do those factors affect one another? Even a sequence in time can be misleading. In physics, lots of natural processes are symmetrical with respect to time so the trick “what came first may be the cause” vanishes. This is the first of a series of blog posts to clarify cause/effects problems using a technique called Causal Inference.

 

Randomized controlled trials
To research the effects of drugs or treatments on humans the tool of choice is the randomized controlled trial or RCT: Divide randomly the people participating in the test: A first group will do receive the treatment (intervention group) and we’ll compare the results with the group using placebo (or standard group). Comparing the results we can deduce if the treatment is working or not using standard statistics. Nice, but what happens when we’re trying to see if tobacco is the cause of cancer? Will you make people do smoke for your test? Or if we’re trying to find if hydraulic fracturing is the cause of some earthquakes. Are human-made actions causing climate change? We only have one earth to test. These are the situations where causal inference is necessary. It allows us to extract conclusions from data without the need for an intervention (causing earthquakes on purpose or making people smoke).

 

Causal levels
From an evolutionary point of view, plants (with no brain at all) are capable to associate (correlate) light with their wellbeing so sunflowers move towards a light source when they find it. Babies are capable to experiment (intervene or doing) on things: What happens if I touch here? The baby does no conform with observing, unlike the sunflower, he is affecting his environment to extract useful information. Small children and adult humans go one immense step forward: they can imagine things. It’s like experimenting in our heads: Would my health get better if I start doing exercise?. This has immense implications since counterfactuals (the ability to imagine a thing that is not a fact) are one of the bases of moral thinking because they give us the ability to choose between different scenarios before they happen and choose the right one (under a specific moral system). For example, the press has made extensive coverage about what a self-driving car must do when confronted with a moral dilemma (see Self-driving cars don't care about your moral dilemmas or The Moral Machine experiment for a more detailed view)

Associations, Interventions and counterfactuals form what is known as the ladder of causation as Judea Pearl defined it. Causal inference and the ladder of causation are some of the key points that will make machine learning (and AI) much more robust and smart in the future. If you think for a moment you’ll see that current ML is only in the first step.

  • Experfy Insights

    Top articles, research, podcasts, webinars and more delivered to you monthly.

  • Manuel Yllan

    Tags
    Machine Learning
    Leave a Comment
    Next Post
    Deep Learning for Object Detection: A Comprehensive Review

    Deep Learning for Object Detection: A Comprehensive Review

    Leave a Reply Cancel reply

    Your email address will not be published. Required fields are marked *

    More in AI & Machine Learning
    AI & Machine Learning,Future of Work
    AI’s Role in the Future of Work

    Artificial intelligence is shaping the future of work around the world in virtually every field. The role AI will play in employment in the years ahead is dynamic and collaborative. Rather than eliminating jobs altogether, AI will augment the capabilities and resources of employees and businesses, allowing them to do more with less. In more

    5 MINUTES READ Continue Reading »
    AI & Machine Learning
    How Can AI Help Improve Legal Services Delivery?

    Everybody is discussing Artificial Intelligence (AI) and machine learning, and some legal professionals are already leveraging these technological capabilities.  AI is not the future expectation; it is the present reality.  Aside from law, AI is widely used in various fields such as transportation and manufacturing, education, employment, defense, health care, business intelligence, robotics, and so

    5 MINUTES READ Continue Reading »
    AI & Machine Learning
    5 AI Applications Changing the Energy Industry

    The energy industry faces some significant challenges, but AI applications could help. Increasing demand, population expansion, and climate change necessitate creative solutions that could fundamentally alter how businesses generate and utilize electricity. Industry researchers looking for ways to solve these problems have turned to data and new data-processing technology. Artificial intelligence, in particular — and

    3 MINUTES READ Continue Reading »

    About Us

    Incubated in Harvard Innovation Lab, Experfy specializes in pipelining and deploying the world's best AI and engineering talent at breakneck speed, with exceptional focus on quality and compliance. Enterprises and governments also leverage our award-winning SaaS platform to build their own customized future of work solutions such as talent clouds.

    Join Us At

    Contact Us

    1700 West Park Drive, Suite 190
    Westborough, MA 01581

    Email: support@experfy.com

    Toll Free: (844) EXPERFY or
    (844) 397-3739

    © 2023, Experfy Inc. All rights reserved.