The Unvarnished Truth: Data Science Isn't for Everyone
Written on
Chapter 1: The Illusion of Hard Work
It's a common belief that hard work leads to success, but this is a misleading notion. While effort is a significant factor, various external elements also shape our professional outcomes. The idea that "hard work equals success" is comforting because it highlights our ability to control our efforts. However, this belief can obscure the reality that many factors beyond our control can hinder our progress. For instance, aspiring to play in the NBA at a height of 5'6" presents significant challenges, regardless of dedication.
While hard work can sometimes bridge gaps in other areas, it has its limits. The notion that anyone can achieve anything solely through effort is deceptive. Our circumstances and situations define our potential. Spanish philosopher José Ortega y Gasset encapsulated this with his famous quote: "I am I and my circumstance." In this discussion, I'll delve into why data science—or indeed, many fields—may not be suitable for everyone, focusing on three key influences that dictate our readiness for this profession.
Section 1.1: The Role of Intelligence
One significant barrier is a lack of inherent intelligence. In the realm of artificial intelligence, we often refer to artificial general intelligence (AGI) as systems that possess human-level intelligence. However, this label overlooks the vast differences in intelligence among individuals. For example, although we all share a baseline of human intelligence, figures like Einstein exemplify a level of brilliance that far surpasses that of many others.
When I discuss intelligence, I don't refer strictly to IQ. I align more with Howard Gardner's theory of multiple intelligences, recognizing that intelligence encompasses a variety of skills. For example, one person may excel in language but struggle with physical coordination, while another might be adept in social situations but lack self-reflection. Those who shine in mathematical and logical reasoning are often more inclined to thrive in technical domains like data science.
Technical individuals typically exhibit traits such as logical reasoning, analytical skills, problem-solving abilities, and exceptional abstract comprehension. While some of these qualities may be innate, individuals are not born as blank slates; they arrive with certain predispositions. Conversely, those whose abilities are not aligned with math and logic may find data science challenging, regardless of their dedication. While it's not impossible to succeed through hard work, the inherent capabilities play a critical role.
The first video titled "The Harsh Reality of Being a Data Scientist" explores the misconceptions surrounding the field, highlighting the challenges and realities faced by aspiring data scientists.
Section 1.2: Educational Limitations
Another barrier is education, which culturally shapes our potential. If we liken intelligence to the size of a "capability bucket," then education represents how full or empty that bucket is. Interestingly, our capability bucket often holds more potential than we realize; it's the right educational opportunities that may be lacking.
The extent to which our potential is realized is influenced by education. For instance, if my parents were engineers, I would likely find it easier to grasp math and physics concepts in school. A passionate instructor can significantly enhance the learning experience, allowing students to thrive more than those with less engaging education. Various factors, such as socioeconomic status, historical context, and even geographical location, can affect the quality of education we receive. Those unable to access quality educational resources are at a distinct disadvantage.
Ultimately, dormant intelligence serves no purpose if it remains unutilized. Regardless of inherent potential, without education and support, individuals may never discover their capabilities. My entry into AI was facilitated by my background in physics and aerospace engineering, coupled with advanced AI training. Without these opportunities, I might never have realized my potential in this field.
Chapter 2: Knowledge Gaps
The allure of data science often stems from the perception that it offers an easy pathway to high rewards. Harvard Business Review dubbed it the "sexiest job of the 21st century." Numerous online courses suggest that just a few months of dedicated study can prepare anyone for a role as a data scientist. My own experience supports this notion: I embarked on my AI studies in September 2017 and secured a position at an AI startup by January 2018, which seems like a remarkably short time to acquire the necessary skills.
However, this apparent ease can be misleading. There are multiple ways to approach learning any subject. Had I started with foundational theories from the era of Turing and early symbolic AI, I would still be grappling with expert systems years later. Instead, I opted for a more direct route, acquiring basic machine learning knowledge and swiftly moving on to deep learning and practical coding. I adopted a top-down learning style, engaging with immediate applications rather than establishing a solid theoretical foundation first.
Nonetheless, this strategy has its risks. An individual lacking a robust background in mathematics or statistics might mistakenly believe that familiarizing themselves with Python, TensorFlow, and key models is sufficient to succeed in AI. Recent discussions in publications like Towards Data Science illustrate the diverse opinions on this topic. For example, Soner Yıldırım posited that data scientists should also possess data engineering skills, while Chris The Data Guy claimed that an ML engineer need not have a strong math background. These contrasting views highlight a critical reality: whatever path you choose, if you don't devote enough time to understanding the field, you'll leave a portion of your potential untapped.
The second video titled "The Harsh Reality of Being a Data Scientist" offers insights into the complexities and expectations within the data science profession.
Conclusion
Several factors contribute to the idea that certain individuals may not be ideally suited for specific disciplines. The triad of intelligence, education, and knowledge applies broadly across various fields. Data science, despite its appeal, is not exempt from these realities. Some may lack the inherent potential required to excel, while others might not receive the educational opportunities necessary to realize their capabilities. Additionally, some might overlook essential knowledge, leading to unfulfilled potential.
It's also crucial to recognize that the demographics of individuals eager to enter data science may not entirely align with those genuinely qualified to thrive in the field. This discussion isn't intended to deter anyone from pursuing a career in data science or AI. Instead, it aims to illuminate subtle influences that can impact outcomes. By understanding these factors, we can better navigate the challenges that separate us from our aspirations.
As the demand for data science skills grows, this conversation becomes increasingly relevant. The integration of technology into numerous professions suggests that tech-related competencies may soon be essential in areas previously thought to be insulated from such influences. If data science and AI ultimately replace human labor in various sectors, simply asserting that we can assist individuals in transitioning to new roles will not suffice.
Join me on this journey into the future as we explore AI, philosophy, and cognitive sciences! Feel free to engage in the comments or connect with me on LinkedIn or Twitter! :)