You're welcome to Heroic Academy
Select your country of residence below to continue
Sign Up and Start Learning!
Log In to Your Account!
Reset Password
Big Data Technologies
Data Engineering and Hadoop tutorial with MapReduce, HDFS, Spark, Flink, Hive, HBase, MongoDB, Cassandra, Kafka + more!
What you will learn and gain
- Design distributed systems that manage "big data" using Hadoop and related data engineering technologies.
- Use HDFS and MapReduce for storing and analyzing data at scale.
- Use Pig and Spark to create scripts to process data on a Hadoop cluster in more complex ways.
- Analyze relational data using Hive and MySQL
- Analyze non-relational data using HBase, Cassandra, and MongoDB
- Query data interactively with Drill, Phoenix, and Presto
- Choose an appropriate data storage technology for your application
- Understand how Hadoop clusters are managed by YARN, Tez, Mesos, Zookeeper, Zeppelin, Hue, and Oozie.
- Publish data to your Hadoop cluster using Kafka, Sqoop, and Flume
- Consume streaming data using Spark Streaming, Flink, and Storm
What our students are saying
The world of Hadoop and "Big Data" can be intimidating - hundreds of different technologies with cryptic names form the Hadoop ecosystem. With this Hadoop tutorial, you'll not only understand what those systems are and how they fit together - but you'll go hands-on and learn how to use them to solve real business problems.
Learn and master the most popular data engineering technologies in this comprehensive course, taught by a former engineer and senior manager from Amazon and IMDb. We'll go way beyond Hadoop itself, and dive into all sorts of distributed systems you may need to integrate with.
- Install and work with a real Hadoop installation right on your desktop with Hortonworks (now part of Cloudera) and the Ambari UI
- Manage big data on a cluster with HDFS and MapReduce
- Write programs to analyze data on Hadoop with Pig and Spark
- Store and query your data with Sqoop, Hive, MySQL, HBase, Cassandra, MongoDB, Drill, Phoenix, and Presto
- Design real-world systems using the Hadoop ecosystem
- Learn how your cluster is managed with YARN, Mesos, Zookeeper, Oozie, Zeppelin, and Hue
- Handle streaming data in real time with Kafka, Flume, Spark Streaming, Flink, and Storm
Spark and Hadoop developers are hugely valued at companies with large amounts of data; these are very marketable skills to learn.
Almost every large company you might want to work at uses Hadoop in some way, including Amazon, Ebay, Facebook, Google, LinkedIn, IBM, Spotify, Twitter, and Yahoo! And it's not just technology companies that need Hadoop; even the New York Times uses Hadoop for processing images.
This course is comprehensive, covering over 25 different technologies in over 14 hours of video lectures. It's filled with hands-on activities and exercises, so you get some real experience in using Hadoop - it's not just theory.
You'll find a range of activities in this course for people at every level. If you're a project manager who just wants to learn the buzzwords, there are web UI's for many of the activities in the course that require no programming knowledge. If you're comfortable with command lines, we'll show you how to work with them too. And if you're a programmer, I'll challenge you with writing real scripts on a Hadoop system using Scala, Pig Latin, and Python.
You'll walk away from this course with a real, deep understanding of Hadoop and its associated distributed systems, and you can apply Hadoop to real-world problems. Plus a valuable completion certificate is waiting for you at the end!
Please note the focus on this course is on application development, not Hadoop administration. Although you will pick up some administration skills along the way.
Knowing how to wrangle "big data" is an incredibly valuable skill for today's top tech employers. Don't be left behind - enroll now!
- "The Ultimate Hands-On Hadoop... was a crucial discovery for me. I supplemented your course with a bunch of literature and conferences until I managed to land an interview. I can proudly say that I landed a job as a Big Data Engineer around a year after I started your course. Thanks so much for all the great content you have generated and the crystal clear explanations. " - Aldo Serrano
- "I honestly wouldn't be where I am now without this course. Frank makes the complex simple by helping you through the process every step of the way. Highly recommended and worth your time especially the Spark environment. This course helped me achieve a far greater understanding of the environment and its capabilities. Frank makes the complex simple by helping you through the process every step of the way. Highly recommended and worth your time especially the Spark environment." - Tyler Buck
Requirements
- You will need access to a x86-based PC running 64-bit Windows, MacOS, or Linux with an Internet connection and at least 8GB of *free* (not total) RAM, if you want to participate in the hands-on activities and exercises. If your PC does not meet these requirements or you only have an M1-based Mac available, you can still follow along in the course without doing hands-on activities.
- Some activities will require some prior programming experience, preferably in Python or Scala.
- A basic familiarity with the Linux command line will be very helpful.
Who this course is for:
- Software engineers and programmers who want to understand the larger Hadoop ecosystem, and use it to store, analyze, and vend "big data" at scale.
- Project, program, or product managers who want to understand the lingo and high-level architecture of Hadoop.
- Data analysts and database administrators who are curious about Hadoop and how it relates to their work.
- System architects who need to understand the components available in the Hadoop ecosystem, and how they fit together.
Frequently Asked Questions
What is Heroic Universal Concept All About?
Heroic Universal Concept International is an ICT firm and a vision-driven movement aimed at harnessing the ingenuity of young people with the use of motivational and ICT tools, thereby helping them achieve their ultimate goal.
We offer ICT services and champion talent development programmes for young people.
Is your training online or physical?
Our training is online. We have hundreds of downloadable tutorial videos on different ICT courses hosted in our website.
As soon as you pay and register, you will be given access to the tutorial videos. You can download them and commence training, offline.
While you're learning, I will be guiding you from here whenever you need my assistance.
Where is your location?
We're based in Kasoa, Ghana and Lagos, Nigeria but our training is online. So, you can access our courses from anywhere you are while we will be coaching you from here.
Do you have a physical class?
No, we don't.
Our training is 100% online.
What is your mode of teaching?
We teach with tutorial videos.
We have hundreds of downloadable tutorial videos on various ICT courses in our website.
You will have access to download them and learn with them as soon as you register for your desired course.
We made all the tutorials downloadable to help you save data and be free from challenges of poor internet connection.
Do you have online community where your students converge to exchange ideas?
We have Heroic Students WhatsApp group where our students converge and exchange ideas.
Information about Heroic Academy and other Heroic innovations are discussed in the group.
Do you mentor your students?
Sure, I do absolutely!
I'm always available Whenever my students need my attention.
I supervise their projects and tackle their challenges.
Can ICT courses be learnt online effectively?
Of course! The more convenient way to learn ICT skills these days is online.
There are some courses you may never have the opportunity of learning if you're waiting for opportunity to learn them physically.
Professionals are fast moving online. Very few of them will still have time to teach physically.
Programming is one of those skills you can easily learn online.
All you need is a good and experienced coach, and I'm here to help.
Is programming difficult?
It depends on who is coaching you and the time you dedicate to learning it.
If you're being coached by a very experienced and gifted coach, if you give it enough time, programming will be fun for you.
However, if you're struggling to learn by yourself or you're being coached by an inexperienced coach, you will find programming difficult.
Can I learn coding with my phone?
Yes, you can start learning with your phone if you don't have a laptop. Just buy a phone external keyboard, I will direct you on how to use it to start programming.
How do you mentor your students?
I mentor my students by; answering their questions and helping them solve some problems whenever they call my attention.
If my student need my attention, I usually ask them to send me a screenshot of the issue or a zip file of their work to enable me analyse their job and debug the error.
I usually make a new video to point out their errors if the situation is complex.
How can you convince me that you're genuine?
Chat me on Whatsapp via +2348037747461 and express your concern.
I will try my best to clear all your doubt.
I'm not used to online training, I'm afraid it won't work for me.
Online training is great when a gifted teacher is handling it. Look for a gifted teacher. You will be missing opportunity to acquire great skills if you ignore online training.
Some skills are not common. Online training make them accessible.
If you have tried online training before and it didn't work for you, try again, this time, concentrate on getting a good teacher.
I tried my best to simply my lectures. You can chat me to see my students testimonials. They're testifying that I made my courses very simple.
Don't you think that poor internet connection can disrupt online training?
I made all my tutorials downloadable to win against poor internet connection.
You can download all your tutorials when the internet connection is ok and learn offline without worrying about network fluctuations.
What if I insist on one-on-one training. What's your advice?
Online training would have made learning a lot easier for you but if you insist on physical training, you have to take the pain of looking for someone or centers where the skills are taught.
The centers might not be close to you, so be ready to spent heavily on transportation.
I wrote an article where I compared online and physical training. You can chat me on Whatsapp to request for it.
I'm interested, how do I get started?
Go ahead and order for the course. If you need assistance, chat me on Whatsapp via +2348037747461.
Will I get certificate after the training?
Of course. Our organization is registered. We give our students certificate on completion.
I'm interested in the courses but I don't have money
If you can't afford the expensive courses, there are some cheap courses you can start from.
Just pay for the ones you can afford and get started instead of waiting.
You will gradually raise money to pay for the rest.
Are all your tutorial videos downloadable?
All the tutorials the Admin of this platform, Uche Joe created by himself are downloadable but the tutorials created by other expert partners created might not be downloadable.
However, you will surely enjoy the learning process.
About the Instructor
Frank spent 9 years at Amazon and IMDb, developing and managing the technology that automatically delivers product and movie recommendations to hundreds of millions of customers, all the time. As an Amazon "bar raiser," he held veto authority over hiring decisions across the company, interviewed over 1,000 candidates, and hired and managed hundreds.
He holds 17 issued patents in the fields of distributed computing, data mining, and machine learning. In 2012, Frank left to start his own company, Sundog Software, which has taught over one million students around the world about machine learning, data engineering, and managing engineers.
