In the last post, we discussed if machine learning was right for your business. As part of that effort, I recently went through the process of learning the ins-and-outs of machine learning and realized most information out there is technical and aimed at developers or data scientists.
I thought an explanation from a non-technical person might be of interest.
Let’s begin.
What exactly is machine learning?
The simplest definition I came across: Machine learning is “[…] the branch of AI that explores ways to get computers to improve their performance based on experience”. Source: Berkeley
Let’s break that down to set some foundations on which to build our machine learning knowledge.
Branch of AI: Artificial intelligence is the study and development by which a computer and its systems are given the ability to successfully accomplish tasks that would typically require a human’s intelligent behavior. Machine learning is a part of that process. It’s the technology and process by which we train the computer to accomplish the said task.
Explores ways: Machine learning techniques are still emerging. Some models for training a computer are already recognized and used (as we will see below), but it is expected that more will be developed with time. The idea to be remembered here is that different models can be used when training a computer. Different business problems require different models.
Get computers to improve their performance: For a computer to accomplish a task with AI, it needs practice and adaptation. A machine learning model needs to be trained using data and in most cases, a little human help.
Based on experience: providing an AI with experience is another way of saying – to provide it with data. As more data is fed into the system, the more accurately the computer can respond to it and to future data that it will encounter. More accuracy in understanding the data means a better chance to successfully accomplish its given task or to increase its degree of confidence when providing predictive insight.
Quick example:
- Entry data is chosen and prepared along with input conditions (e.g. credit card transactions).
- The machine learning algorithm is built and trained to accomplish a specific task (e.g.detect fraudulent transactions).
- The training data is augmented with the desired output information (e.g. these transactions appear fraudulent, these do not).
How does machine learning work?
Machine learning is often referred to as magical or a black box:
Insert data → magic black box→ Mission accomplished.
Let’s take a look at the training process itself to better understand how machine learning can create value with data.
- Collect: Machine learning is dependent on data. The first step is to make sure you have the right data as dictated by the problem you are trying to solve. Consider your ability to collect it, its source, the required format, and so on.
- Clean: Data can be generated by different sources, contained in different file formats, and expressed in different languages. It might be required to add or remove information from your data set, as some instances might be missing information while others might contain undesired or irrelevant entries. Its preparation will impact its usability and the reliability of the outcome.
- Split: Depending on the size of your data set, only a portion might be required. This is usually referred to as sampling. From the chosen sample, your data should be split into two groups: one to train the algorithm and the other to evaluate it.
- Train: This stage essentially aims at finding the mathematical function that will accurately accomplish the chosen goal. Training takes on different forms depending on the type of model used. Fitting a line in a simple linear regression model can be seen as training; generating the decision trees for a Random Forest Algorithm is also training; changing the questions in a decision tree is effectively adjusting the parameters of the model. To keep things simple, let’s focus on neural networks. Basically, using a portion of your data set, the algorithm will attempt to process the data, measure its own performance and auto-adjust its parameters (also called backpropagation) until it can consistently produce the desired outcome with sufficient reliability.
- Evaluate: Once the algorithm performs well on the training data, its performance is measured again with data that it has not yet seen. Additional adjustments are made when needed. This process allows you to prevent overfitting, which happens when the learning algorithm performs well but only with your training data.
- Optimize: The model is optimized for integration within the destined application to ensure it is as lightweight and as fast as possible.
Are there different types of machine learning?
There are many different models that can be used in machine learning but they are typically grouped into three different types of learning: supervised, unsupervised, and reinforcement. Depending on the task to complete, some models are more appropriate and better performing than others.
Supervised learning: in this type of learning, the correct outcome for each data point is explicitly labeled when training the model. This means the learning algorithm is already given the answer when reading the data. Rather than finding the answer, it aims to find the relationship so that when unassigned data points are introduced, it can correctly classify or predict them.
In a classification context, the learning algorithm could be, for example, fed with historic credit card transactions each labeled as safe or suspicious. It would learn the relationship between these two classifications and could then label new transactions appropriately, according to the classification parameters (e.g. purchase location, time between transactions, etc.).
In a context where data points are continuous in relation to one another, like a stock’s price through time, a regression learning algorithm can be used to predict the following data point.
Unsupervised learning: In this case, the learning algorithm is not given the answer during training. Its objective is to find meaningful relationships between the data points. Its value lies in discovering patterns and correlations. For example, clustering is a common use of unsupervised learning in recommender systems (e.g. people who liked this bottle of wine, also enjoyed this one).
Reinforcement learning: this type of learning is a blend between supervised and unsupervised learning. It is usually used to solve more complex problems and requires interaction with an environment. Data is provided by the environment and allows the agent to respond and learn. In practice, this ranges from controlling robotic arms to find the most efficient motor combination, to robot navigation where collision avoidance behavior can be learned by negative feedback from bumping into obstacles. Logic games are also well-suited to reinforcement learning, as they are traditionally defined as a sequence of decisions: games such as poker, backgammon and more recently Go with the success of AlphaGo from Google. Other applications of reinforcement learning are common in logistics, scheduling, and tactical planning of tasks.
What can machine learning be used for?
Three stages of machine learning development and their application within a business are to be considered: descriptive, predictive, and prescriptive.
The descriptive stage refers to the recording and analysis of historical data for increased business intelligence. Managers are provided with descriptive information and a better understanding of the results and consequences of past actions and decisions. This process is now routine for most large businesses around the world- for example, reviewing sales records and matching promotional efforts to understand their impact and ROI.
The second stage of applied machine learning is prediction. Gathering data and using it to predict a specific outcome allows for increased reactivity and to make decisions faster and with more accuracy. For example, predicting churn can allow for its prevention. This stage of application is currently being embraced by most businesses.
Yet, the third and most advanced stage of machine learning is already being adopted by existing businesses and pushed forward by newly founded endeavors. Predicting a behavior or outcome is not sufficient when aiming for effective and efficient business practices. Understanding the cause, motive, and context is a prerequisite to optimal decision-making. Concretely, this stage is possible when human and machine combine efforts. Machine learning is used to find meaningful relations and to predict outcomes while data experts serve as translators to make sense of why the relation exists. As such, it becomes possible to prescribe actions with greater precision.
Furthermore, I would add another application of machine learning other than predictive insight: process automation. I’ve provided a more detailed overview and comparison these two concepts here.
Here are some examples of what problems machine learning can solve.
Logistics and production
- Rethink Robotics uses machine learning to train their robotic arms and improve production speeds;
- JaybridgeRobotics automates industrial grade vehicles for more efficient operations;
- Nanotronics automates optical microscopes for improved inspections;
- Netflix and Amazon optimize resource distribution according to user demand;
- Other examples include: predicting ERP/ERM needs; predicting asset failure & maintenance, improving quality assurance, and increasing production line performance.
Sales and marketing
- 6sense predicts which lead is more susceptible to buy and at what time;
- Salesforce Einstein helps anticipate sales opportunities and automate tasks;
- Fusemachines automates sales tasks with an AI assistant;
- AirPR provides insight to increase PR performance;
- Retention Science suggests cross-channel actions to drive engagement;
- Other examples include: predicting a customer’s lifetime value, increasing customer segmentation accuracy, detecting customer shopping patterns, and optimizing a user’s in-app experience.
Human resources
- Entelo helps recruiters identify and qualify candidates;
- hiQ assists managers with talent management.
Finance
- Cerebellum Capital and Sentient augment investment management decisions with machine learning powered software;
- Dataminr can assist with real-time financial decisions by providing early alerts on social trends and breaking news;
- Other examples include: detecting fraudulent behavior and predicting stock prices.
Healthcare
- Atomwise uses predictive models to reduce medicine production time;
- Deep6 Analytics identifies eligible patients for clinical trials
- Other examples include: diagnosing diseases more accurately, improving personalized care, and assessing health risks.
You can find even more examples of machine learning and artificial intelligence and other related resources in an awesome list put together by Sam DeBrule.
Before you go.
Remember that collaboration is key. AI and machine learning are fascinating but can be tricky at times.
Originally published on Arcbees blog.
