Everyone is doing Big Data these days. If you don’t work on Big Data projects within your company, you are simply not up to date and don’t know how things work. Big Data solves all of your problems, really!
Well, in reality this is different. It doesn’t solve all your problems. It actually creates more problems then you think! Most companies I saw recently working on Big Data projects failed. They started a Big Data project and successfully wasted thousands of dollars on Big Data projects. But what exactly went wrong?
First of all, Big Data is often only seen as Hadoop. We live with the mis-perception that only Hadoop can solve all Big Data topics. This simply isn’t true. Hadoop can do many things – but real data science is often not done with the core of Hadoop. Ever talked to someone doing the analytics (e.g someone good in math or statistics)?. They are not ok with writing Java Map/Reduce queries or Pig/Hive scripts. They want to work with other tools that are ways more interactive.
The other thing is that most Big Data initiatives are often handled wrong. Most initiatives often simply don’t include someone being good in analytics. One simply doesn’t find this type of person in an IT team – the person has to be found somewhere else. Failing to include someone with this skills often leads to finding “nothing” in the data – because IT staff is good in writing queries – but not in doing complex analytics. These skills are actually not thought in IT classes – it requires a totally different study field to reach this skill set.
Hadoop as the solution to everything for many IT departments. However, projects often stop with implementing Hadoop. Most Hadoop implementations never leave the pilot phase. This is often due to the fact that IT departments see Hadoop as a fun thing to play with – but getting this into production requires a different approach. There are actually more solutions out there that can be done when delivering a Big Data project.
A key to ruining your Big Data project is not involving the LoB. The IT department often doesn’t know what questions to ask. So how can they know the answer and try to find the question? The LoB sees that different. They see an answer – and know what question it would be.
The key to kill your Big Data initiative is exactly one thing: go with the hype. Implement Hadoop and don’t think about what you actually want to achieve with it. Forget the use-case, just go and play with the fancy technology. NOT
As long as companies will stich to that, I am sure I will have enough work to do. I “inherited” several failed projects and turned them into success. So, please continue.
You might also like
Interesting links
Here are some interesting links for you! Enjoy your stay :)Pages
- All about Data in the Cloud
- Apache Hadoop Tutorial
- Apache Hive Tutorial
- Apache Spark Tutorial
- Big Data for Business
- Big Data Tutorial
- Data Governance Tutorial
- Data Science speaker
- Data Science speaker
- E-Book
- Froggy – Support
- International Keynote speaker
- Learn Data Science free
- Machine Learning Tutorial
- Mario Meir-Huber
- Partners and Friends
- Privacy Policy
- Python for Spark Tutorial
- Spark MLlib Tutorial
- Subscribe
- Tutorials – Learn Data Science
- Working with Data in Python Tutorial
Categories
- Amazon
- Amazon Web Services for .NET Developers
- apache hive
- Apache spark
- architecture
- Big Data
- big data
- Big Data
- Big Data and Business
- big data management
- Big Data News
- Big Data Technologies
- Books and Shortcuts
- Business
- Cloud Computing: Praxisratgeber und Einstiegsstrategien
- Data
- data governance
- Data Science
- Hadoop
- Headlines
- How-Tos
- Interviews
- Machine Learning
- microsoft
- News
- open source
- python
- Ressource Automation
- Tutorials
- Tutorials
- Uncategorized
Archive
- October 2021
- June 2021
- March 2021
- February 2021
- August 2020
- June 2020
- May 2020
- April 2020
- February 2020
- January 2020
- November 2019
- October 2019
- September 2019
- August 2019
- July 2019
- June 2019
- May 2019
- April 2019
- March 2019
- February 2019
- January 2019
- December 2018
- October 2018
- August 2018
- July 2018
- March 2018
- June 2017
- May 2017
- March 2017
- February 2016
- December 2015
- November 2015
- October 2015
- September 2015
- August 2015
- July 2015
- June 2015
- May 2015
- April 2015
- March 2015
- February 2015
- January 2015
- December 2014
- November 2014
- October 2014
- September 2014
- July 2014
- June 2014
- May 2014
- September 2013
- August 2013
- July 2013
- June 2013
- May 2013
- April 2013
- March 2013
- February 2013
- January 2013
- December 2012
- November 2012
- October 2012
- September 2012
- August 2012
- July 2012
Leave a Reply
Want to join the discussion?Feel free to contribute!