Why you shouldn’t be a Perfectionist as a Data Scientist

Admond Lee Admond Lee
October 12, 2020 Big Data, Cloud & DevOps

And how to overcome the perfectionist in you

I’m not sure about you.

Maybe you’re a realist who always thinks realistically and acts in a practical way given any situation to you.

Or maybe you’ve struck a balance between being realistic and chasing perfection at the same time.

But chasing perfection has always been something that I’m guilty of.

I’m not saying that chasing perfection is a bad thing, but chasing perfection “could” be a bad thing, especially when you’re in data science field.

“Perfection is not attainable, but if we chase perfection we can catch excellence”

— Vince Lombardi

After being quite a while in data science field upon my transition from academic to data science path, I’ve learned so much when it comes to being able to deliver business value while still having the bandwidth to make an excellent deliverable.

Hence I hope to share my thoughts and experience with you to hopefully give you the awareness in your day-to-day data science work and how to overcome the perfectionist residing in you.

By the end of this article, I hope you’ll understand better why chasing perfectionism might not be a good idea as a data scientist and how to overcome that in your career — or perhaps, in life.

Let’s get started!

Why you shouldn’t be a Perfectionist as a Data Scientist

You see.

When you’re a beginner in data science field, it’s easy to fall into the trap of chasing perfection blindly without understanding the real needs of the business in your company.

Imagine you’ve just joined a company as a junior data scientist, and now you’re given a project to build a deep learning model for image classification and put it into production in six months.

Needless to say, you’re so excited about the project and already bouncing some ideas around with your team members.

Six months after, you miss the deadline for final deliverable as you still think that your model is not good enough, despite the fact that your model has already outperformed the existing baseline model.

So you keep tuning your model to hopefully squeeze the last bit of improved accuracy out by 2%…

And because of this, you miss the deadline for the project deliverable (putting the model into production) and your boss is skeptical of your credential and capability as a data scientist. What happens next? Now you become frustrated and wonder why your boss simply doesn’t understand your work.

Does that sound familiar to you, somehow?

“Done is better than perfect”

In fact, the similar case happened to me when I first got started in a data science internship last time.

I read a lot of research papers.

I tried to train and tune different kind of models to find the best one without having a full understanding of the business needs.

What I knew was that I got to get the best model ever like what I did in any of the Kaggle competitions.This is exactly the difference between Kaggle competitions and real life business projects.

In Kaggle, you’re your only stakeholder and you just have to train the best model and “boom!”… You win the competition.

In real life business projects, this is not the case. You have your bosses and other stakeholders with limited resources (time or $$) to deliver the final results.

And now, what I’ve realized is that delivering real business value is the ultimate objective in any data science projects. And if you’re a perfectionist, chances are you can’t always deliver solutions to your customers because you might fail to deliver Minimum Viable Product (MVP)to them.

With MVP and feedback from your customers, you can then further iterate and improve the future product development (or data science solutions, whatever name that you may call it).

If you’re a perfectionist, you’ll always tend to set unrealistic expectation of yourself and everyone.

If you’re a perfectionist, you’ll find yourself struggling to get things done (or you may think your work is always not good enough to be considered done)

If you’re a perfectionist, you’ll be afraid of making mistakes and that deprives you of any opportunity to learn and improve.

How to overcome the perfectionist in you

Knowing when NOT to be a perfectionist could sometimes be a blessing in disguise.

To be honest with you, I admit that the perfectionist in me still exists. And I think this is still a good thing, if and only if I know how to go for perfection “timely”.

That being said, here are some of the steps that I personally use whenever I realize that I tend to procrastinate (I mean to go for perfection).

1. Be aware of it

Yes. Self-awareness is key here.

If you’re not even aware of the moment when you start going for perfection, there is no way that you can overcome that. In other words, to overcome the perfectionist in you, first you need to be aware of that.

Start questioning yourself why you’re doing what you’re doing and what you’re doing will truly benefit the business value. By having this inner conversation with yourself, you’ll begin to prioritize the right things at the right time.

I know this sounds a bit abstract. So take your time to digest and practise.

2. Challenge yourself to establish more realistic expectations of yourself

Create a Minimum Viable Product (MVP) and understand “what’s good enough” and deliver that to your customers.

Depending on what problems and industry that you’re solving, there are certain areas where less-than-perfect is perfectly acceptable.

Be prepared to set those realistic expectations of yourself instead of going down the infinite rabbit hole in the name of deeper investigation and making results better. Nevertheless, the ideal case is always to go deeper and make results better (or more accurate), provided that time and other resources allow.

3. Accept mistakes and failure

There is no absolute perfection. Because there is always room for improvement.

Embrace failure and the fact that you’re going to make mistakes along the way. Just be resilient and learn from your mistakes to improve.

This way you’ll be able to overcome the perfectionist in you by constantly making progress towards your goals and improve along the way.

Final Thoughts

Thank you for reading.

I hope by now you already understand better why chasing perfectionism might not be a good idea as a data scientist and how to overcome that in your career.

While chasing perfection is perfectly fine, it’s up to you to decide and prioritize what’s the most important task to do, depending on your situation and context.

  • Experfy Insights

    Top articles, research, podcasts, webinars and more delivered to you monthly.

  • Admond Lee

    Tags
    Data ScienceData ScientistPerfectionist
    Leave a Comment
    Next Post
    What is Augmented Data Preparation and Why is it Important?

    What is Augmented Data Preparation and Why is it Important?

    Leave a Reply Cancel reply

    Your email address will not be published. Required fields are marked *

    More in Big Data, Cloud & DevOps
    Big Data, Cloud & DevOps
    Cognitive Load Of Being On Call: 6 Tips To Address It

    If you’ve ever been on call, you’ve probably experienced the pain of being woken up at 4 a.m., unactionable alerts, alerts going to the wrong team, and other unfortunate events. But, there’s an aspect of being on call that is less talked about, but even more ubiquitous – the cognitive load. “Cognitive load” has perhaps

    5 MINUTES READ Continue Reading »
    Big Data, Cloud & DevOps
    How To Refine 360 Customer View With Next Generation Data Matching

    Knowing your customer in the digital age Want to know more about your customers? About their demographics, personal choices, and preferable buying journey? Who do you think is the best source for such insights? You’re right. The customer. But, in a fast-paced world, it is almost impossible to extract all relevant information about a customer

    4 MINUTES READ Continue Reading »
    Big Data, Cloud & DevOps
    3 Ways Businesses Can Use Cloud Computing To The Fullest

    Cloud computing is the anytime, anywhere delivery of IT services like compute, storage, networking, and application software over the internet to end-users. The underlying physical resources, as well as processes, are masked to the end-user, who accesses only the files and apps they want. Companies (usually) pay for only the cloud computing services they use,

    7 MINUTES READ Continue Reading »

    About Us

    Incubated in Harvard Innovation Lab, Experfy specializes in pipelining and deploying the world's best AI and engineering talent at breakneck speed, with exceptional focus on quality and compliance. Enterprises and governments also leverage our award-winning SaaS platform to build their own customized future of work solutions such as talent clouds.

    Join Us At

    Contact Us

    1700 West Park Drive, Suite 190
    Westborough, MA 01581

    Email: support@experfy.com

    Toll Free: (844) EXPERFY or
    (844) 397-3739

    © 2023, Experfy Inc. All rights reserved.