Seven data trends on our radar: machine learning to IoT

Michael Baxter Michael Baxter
April 3, 2019 Big Data, Cloud & DevOps

Machine learning and related developments form part of O'Reilly Media's Ben Lorica's predicted data trends

Seven data trends on our radar: machine learning to IoT image

Machine learning is a key part of data trends

It is very difficult for organisations to discern which tools will bring them the most benefit in the year ahead, and which issues they need to plan for, such is the volume of technological choices available, data trends is no exception to this.

New technological developments provide the platform for the next generation of innovation, as we’ve seen with the evolution of ‘Big Data’ into advanced analytics, machine learning and artificial intelligence. How can businesses navigate this increasingly-complex data landscape to make the wisest investments?

Here is our guide to the top seven data trends that should be on every organisation’s radar for the year ahead.

Data trends in the air: developing cloud data infrastructure

We recently conducted research which found that 85% of respondents said they already had some of their data infrastructure in the cloud, and other surveys of IT executives reveal that many are planning to increase their investments in Software as a Service (SaaS) and cloud tools.

Next year, cloud migration will be fueled by the option of new cloud technologies, such as serverless and containerisation. Meanwhile, the choice of partners will also grow as vendors and popular open source data projects make their offerings easier to run in the cloud.

A data trend in creation: Building the foundations for machine learning

For most companies, the road toward machine learning (ML) involves simpler analytic applications. This is good news because ML demands data, and many of the simpler analytic tools that precede ML already require data infrastructure to be in place. The growing interest in ML will spur companies to continue to invest in the foundational data technologies that are required to scale ML initiatives. This includes items like data ingestion and integration, storage and data processing, and data preparation and cleaning.

Data trends for minding your own business, privacy becomes a priority

Privacy was one of the defining issues of 2019, from the advent of the GDPR to the Cambridge Analytica scandal. We can therefore expect to see an increased focus on tools for privacy-preserving analytics. Organisations will begin to identify and manage risks that accompany the use of machine learning in products and services, such as security and privacy, bias, safety, and lack of transparency.

  Top five trends for harnessing data in 2019

From data storytelling to using data for good, James Eiloart from Tableau gives his take on the top trends in harnessing data as we head into 2019.

Making machine learning sustainable

Early indications are that many organisations are – wisely – focusing their first forays into machine learning projects on use applications designed to improve their most mission-critical projects. For example, financial service companies are investing ML in risk analysis, telecom companies are applying AI to service operations, and automotive companies are focusing their initial ML implementations in manufacturing. This is also reflected by the emergence of tools that are specific to machine learning, including data science platforms, data lineage, metadata management and analysis, data governance, and model lifecycle management.

Data trends that need culture: Building a data culture

In a recent O’Reilly survey, we found that the skills gap remains one of the key challenges holding back the adoption of machine learning.

With the average shelf life of a skill being less than five years and the cost to replace an employee estimated at between six and nine months of the position’s salary, there is increasing pressure on tech leaders to retain and upskill rather than replace their employees in order to keep data-led projects on track. We are also seeing more training programmes aimed at executives and decision makers, who need to understand how these new ML technologies can impact their current operations and products.

Businesses are realising that investment in technology is not enough – they need to build a data culture throughout the organisation, and we’re already seeing businesses creating centres of excellence as they strive to foster a data-first mindset throughout the organisation.

   The top five big data trends coming in 2018

Data is an organisation’s greatest asset, but moving into 2018 it’s significance to an organisation will grow

Data trends we have been waiting for: IoT leaves the drawing board

A few years ago, most Internet of Things (IoT) examples were still at the theoretical stage. Thanks in part to the rise of cloud platforms, cheap sensors, and machine learning the IoT is now poised to leap off the drawing board and into our lives. Beyond the smart cities and connected consumer devices that have dominated most IoT discussions so far, we’ll still start to see other interesting use cases involving closed systems (factories, buildings, homes) and enterprise and consumer applications.

Automation

The increased pace of machine learning and analytics adoption will only be possible with scalable tools that enable data scientists to tackle many more problems and maintain more systems. This will lead to more process automation, including data preparation, feature engineering, model selection, and hyperparameter tuning, as well as data engineering and data operations. There are already some early applications of machine learning aimed at the partial automation of tasks in data science, software development, and IT operations.

  "Quantum Cryptography: The next-generation of secure data transmission"

Quantum Computing will render much of today’s encryption unsafe, says Dr. Andrew Shields, Cambridge Research Laboratory of Toshiba Research Europe, but Quantum Cryptography could be the solution

Overall

If there is a unifying theme to these seven trends, it is that culture, skills and processes are now as crucial to strategic success as any single technology. Businesses that invest in building these foundations will be those with the best chance of success in the years to come.

Ben Lorica, is the Chief Data Scientist at O’Reilly Media, Inc. and Program Director of both the Strata Data Conference and the Artificial Intelligence Conference

  • Experfy Insights

    Top articles, research, podcasts, webinars and more delivered to you monthly.

  • Michael Baxter

    Tags
    Data Science
    Leave a Comment
    Next Post
    Applications of Machine Learning in Education

    Applications of Machine Learning in Education

    Leave a Reply Cancel reply

    Your email address will not be published. Required fields are marked *

    More in Big Data, Cloud & DevOps
    Big Data, Cloud & DevOps
    Cognitive Load Of Being On Call: 6 Tips To Address It

    If you’ve ever been on call, you’ve probably experienced the pain of being woken up at 4 a.m., unactionable alerts, alerts going to the wrong team, and other unfortunate events. But, there’s an aspect of being on call that is less talked about, but even more ubiquitous – the cognitive load. “Cognitive load” has perhaps

    5 MINUTES READ Continue Reading »
    Big Data, Cloud & DevOps
    How To Refine 360 Customer View With Next Generation Data Matching

    Knowing your customer in the digital age Want to know more about your customers? About their demographics, personal choices, and preferable buying journey? Who do you think is the best source for such insights? You’re right. The customer. But, in a fast-paced world, it is almost impossible to extract all relevant information about a customer

    4 MINUTES READ Continue Reading »
    Big Data, Cloud & DevOps
    3 Ways Businesses Can Use Cloud Computing To The Fullest

    Cloud computing is the anytime, anywhere delivery of IT services like compute, storage, networking, and application software over the internet to end-users. The underlying physical resources, as well as processes, are masked to the end-user, who accesses only the files and apps they want. Companies (usually) pay for only the cloud computing services they use,

    7 MINUTES READ Continue Reading »

    About Us

    Incubated in Harvard Innovation Lab, Experfy specializes in pipelining and deploying the world's best AI and engineering talent at breakneck speed, with exceptional focus on quality and compliance. Enterprises and governments also leverage our award-winning SaaS platform to build their own customized future of work solutions such as talent clouds.

    Join Us At

    Contact Us

    1700 West Park Drive, Suite 190
    Westborough, MA 01581

    Email: support@experfy.com

    Toll Free: (844) EXPERFY or
    (844) 397-3739

    © 2023, Experfy Inc. All rights reserved.