Introduction to Hadoop with Java

Ask For a Quote

If you are interested in arranging this course at your organisation, please use the form below to request a free quote.

eyJpZCI6IjIyIiwibGFiZWwiOiJIYWRvb3AiLCJhY3RpdmUiOiIxIiwib3JpZ2luYWxfaWQiOiI0IiwidW5pcXVlX2lkIjoidmJuMjNhIiwicGFyYW1zIjp7ImVuYWJsZUZvck1lbWJlcnNoaXAiOiIwIiwidHBsIjp7IndpZHRoIjoiMTAwIiwid2lkdGhfbWVhc3VyZSI6IiUiLCJiZ190eXBlXzAiOiJub25lIiwiYmdfaW1nXzAiOiIiLCJiZ19jb2xvcl8wIjoiI2NkY2RjZCIsImJnX3R5cGVfMSI6ImNvbG9yIiwiYmdfaW1nXzEiOiIiLCJiZ19jb2xvcl8xIjoiI2NkY2RjZCIsImJnX3R5cGVfMiI6ImNvbG9yIiwiYmdfaW1nXzIiOiIiLCJiZ19jb2xvcl8yIjoiI2ZmN2YwMCIsImJnX3R5cGVfMyI6ImNvbG9yIiwiYmdfaW1nXzMiOiIiLCJiZ19jb2xvcl8zIjoiI2ZmODA3YyIsImZpZWxkX2Vycm9yX2ludmFsaWQiOiIiLCJmb3JtX3NlbnRfbXNnIjoiVGhhbmsgeW91IGZvciByZXF1ZXN0aW5nIGEgcXVvdGUuIFdlIGFpbSB0byByZXNwb25kIHdpdGhpbiA0OCBob3Vycy4iLCJmb3JtX3NlbnRfbXNnX2NvbG9yIjoiI2ZmN2YwMCIsImhpZGVfb25fc3VibWl0IjoiMSIsInJlZGlyZWN0X29uX3N1Ym1pdCI6IiIsInRlc3RfZW1haWwiOiJpbmZvQG1pbmRwcm9qZWN0LmlvIiwic2F2ZV9jb250YWN0cyI6IjEiLCJleHBfZGVsaW0iOiI7IiwiZmJfY29udmVydF9iYXNlIjoiIiwicHViX3Bvc3RfdHlwZSI6InBvc3QiLCJwdWJfcG9zdF9zdGF0dXMiOiJwdWJsaXNoIiwicmVnX3dwX2NyZWF0ZV91c2VyX3JvbGUiOiJzdWJzY3JpYmVyIiwiZmllbGRfd3JhcHBlciI6IjxkaXYgW2ZpZWxkX3NoZWxsX2NsYXNzZXNdIFtmaWVsZF9zaGVsbF9zdHlsZXNdPltmaWVsZF08XC9kaXY+In0sImZpZWxkcyI6W3siYnNfY2xhc3NfaWQiOiI0IiwibmFtZSI6ImZ1bGxfbmFtZSIsImxhYmVsIjoiIiwicGxhY2Vob2xkZXIiOiJZb3VyIGZ1bGwgbmFtZSIsInZhbHVlIjoiIiwidmFsdWVfcHJlc2V0IjoiIiwiaHRtbCI6InRleHQiLCJtYW5kYXRvcnkiOiIxIiwibWluX3NpemUiOiIiLCJtYXhfc2l6ZSI6IiIsImFkZF9jbGFzc2VzIjoiIiwiYWRkX3N0eWxlcyI6IiIsImFkZF9hdHRyIjoiIiwidm5fb25seV9udW1iZXIiOiIwIiwidm5fb25seV9sZXR0ZXJzIjoiMCIsInZuX3BhdHRlcm4iOiIwIiwidm5fZXF1YWwiOiIiLCJpY29uX2NsYXNzIjoiIiwiaWNvbl9zaXplIjoiIiwiaWNvbl9jb2xvciI6IiIsInRlcm1zIjoiIn0seyJic19jbGFzc19pZCI6IjQiLCJuYW1lIjoiZW1haWwiLCJsYWJlbCI6IiIsInBsYWNlaG9sZGVyIjoiWW91ciBlbWFpbCBhZGRyZXNzIiwidmFsdWUiOiIiLCJ2YWx1ZV9wcmVzZXQiOiIiLCJodG1sIjoiZW1haWwiLCJtYW5kYXRvcnkiOiIxIiwibWluX3NpemUiOiIiLCJtYXhfc2l6ZSI6IiIsImFkZF9jbGFzc2VzIjoiIiwiYWRkX3N0eWxlcyI6IiIsImFkZF9hdHRyIjoiIiwidm5fb25seV9udW1iZXIiOiIwIiwidm5fb25seV9sZXR0ZXJzIjoiMCIsInZuX3BhdHRlcm4iOiIiLCJ2bl9lcXVhbCI6IiIsImljb25fY2xhc3MiOiIiLCJpY29uX3NpemUiOiIiLCJpY29uX2NvbG9yIjoiIiwidGVybXMiOiIifSx7ImJzX2NsYXNzX2lkIjoiNCIsIm5hbWUiOiJwaG9uZV9udW1iZXIiLCJsYWJlbCI6IiIsInBsYWNlaG9sZGVyIjoiWW91ciBwaG9uZSBudW1iZXIiLCJ2YWx1ZSI6IiIsInZhbHVlX3ByZXNldCI6IiIsImh0bWwiOiJ0ZXh0IiwibWFuZGF0b3J5IjoiMSIsIm1pbl9zaXplIjoiIiwibWF4X3NpemUiOiIiLCJhZGRfY2xhc3NlcyI6IiIsImFkZF9zdHlsZXMiOiIiLCJhZGRfYXR0ciI6IiIsInZuX29ubHlfbnVtYmVyIjoiMCIsInZuX29ubHlfbGV0dGVycyI6IjAiLCJ2bl9wYXR0ZXJuIjoiIiwidm5fZXF1YWwiOiIiLCJpY29uX2NsYXNzIjoiIiwiaWNvbl9zaXplIjoiIiwiaWNvbl9jb2xvciI6IiIsInRlcm1zIjoiIn0seyJic19jbGFzc19pZCI6IjYiLCJuYW1lIjoibm9fZGVsZWdhdGVzIiwibGFiZWwiOiIiLCJwbGFjZWhvbGRlciI6IkVzdGltYXRlZCBudW1iZXIgb2YgZGVsZWdhdGVzIiwidmFsdWUiOiIiLCJ2YWx1ZV9wcmVzZXQiOiIiLCJodG1sIjoidGV4dCIsIm1hbmRhdG9yeSI6IjEiLCJtaW5fc2l6ZSI6IiIsIm1heF9zaXplIjoiIiwiYWRkX2NsYXNzZXMiOiIiLCJhZGRfc3R5bGVzIjoiIiwiYWRkX2F0dHIiOiIiLCJ2bl9vbmx5X251bWJlciI6IjAiLCJ2bl9vbmx5X2xldHRlcnMiOiIwIiwidm5fcGF0dGVybiI6IiIsInZuX2VxdWFsIjoiIiwiaWNvbl9jbGFzcyI6IiIsImljb25fc2l6ZSI6IiIsImljb25fY29sb3IiOiIiLCJ0ZXJtcyI6IiJ9LHsiYnNfY2xhc3NfaWQiOiI2IiwibmFtZSI6ImR1cmF0aW9uIiwibGFiZWwiOiIiLCJwbGFjZWhvbGRlciI6IkR1cmF0aW9uIG9mIHRoZSBjb3Vyc2UiLCJ2YWx1ZSI6IiIsInZhbHVlX3ByZXNldCI6IiIsImh0bWwiOiJ0ZXh0IiwibWFuZGF0b3J5IjoiMSIsIm1pbl9zaXplIjoiIiwibWF4X3NpemUiOiIiLCJhZGRfY2xhc3NlcyI6IiIsImFkZF9zdHlsZXMiOiIiLCJhZGRfYXR0ciI6IiIsInZuX29ubHlfbnVtYmVyIjoiMCIsInZuX29ubHlfbGV0dGVycyI6IjAiLCJ2bl9wYXR0ZXJuIjoiIiwidm5fZXF1YWwiOiIiLCJpY29uX2NsYXNzIjoiIiwiaWNvbl9zaXplIjoiIiwiaWNvbl9jb2xvciI6IiIsInRlcm1zIjoiIn0seyJic19jbGFzc19pZCI6IjYiLCJuYW1lIjoiZGF0ZXMiLCJsYWJlbCI6IiIsInBsYWNlaG9sZGVyIjoiUHJlZmVycmVkIGRhdGVzIGZvciB0aGUgY291cnNlIiwidmFsdWUiOiIiLCJ2YWx1ZV9wcmVzZXQiOiIiLCJodG1sIjoidGV4dCIsIm1hbmRhdG9yeSI6IjEiLCJtaW5fc2l6ZSI6IiIsIm1heF9zaXplIjoiIiwiYWRkX2NsYXNzZXMiOiIiLCJhZGRfc3R5bGVzIjoiIiwiYWRkX2F0dHIiOiIiLCJ2bl9vbmx5X251bWJlciI6IjAiLCJ2bl9vbmx5X2xldHRlcnMiOiIwIiwidm5fcGF0dGVybiI6IiIsInZuX2VxdWFsIjoiIiwiaWNvbl9jbGFzcyI6IiIsImljb25fc2l6ZSI6IiIsImljb25fY29sb3IiOiIiLCJ0ZXJtcyI6IiJ9LHsiYnNfY2xhc3NfaWQiOiI2IiwibmFtZSI6ImxvY2F0aW9uIiwibGFiZWwiOiIiLCJwbGFjZWhvbGRlciI6IlRyYWluaW5nIGNvdXJzZSBsb2NhdGlvbiIsInZhbHVlIjoiIiwidmFsdWVfcHJlc2V0IjoiIiwiaHRtbCI6InRleHQiLCJtYW5kYXRvcnkiOiIxIiwibWluX3NpemUiOiIiLCJtYXhfc2l6ZSI6IiIsImFkZF9jbGFzc2VzIjoiIiwiYWRkX3N0eWxlcyI6IiIsImFkZF9hdHRyIjoiIiwidm5fb25seV9udW1iZXIiOiIwIiwidm5fb25seV9sZXR0ZXJzIjoiMCIsInZuX3BhdHRlcm4iOiIiLCJ2bl9lcXVhbCI6IiIsImljb25fY2xhc3MiOiIiLCJpY29uX3NpemUiOiIiLCJpY29uX2NvbG9yIjoiIiwidGVybXMiOiIifSx7ImJzX2NsYXNzX2lkIjoiNiIsIm5hbWUiOiJjdXN0b21pc2UiLCJsYWJlbCI6IiIsInBsYWNlaG9sZGVyIjoiQ291cnNlIGN1c3RvbWlzYXRpb24gZGV0YWlscyBpZiBhbnkiLCJ2YWx1ZSI6IiIsInZhbHVlX3ByZXNldCI6IiIsImh0bWwiOiJ0ZXh0YXJlYSIsIm1hbmRhdG9yeSI6IjAiLCJtaW5fc2l6ZSI6IiIsIm1heF9zaXplIjoiIiwiYWRkX2NsYXNzZXMiOiIiLCJhZGRfc3R5bGVzIjoiIiwiYWRkX2F0dHIiOiIiLCJ2bl9vbmx5X251bWJlciI6IjAiLCJ2bl9vbmx5X2xldHRlcnMiOiIwIiwidm5fcGF0dGVybiI6IiIsInZuX2VxdWFsIjoiIiwiaWNvbl9jbGFzcyI6IiIsImljb25fc2l6ZSI6IiIsImljb25fY29sb3IiOiIiLCJ0ZXJtcyI6IiJ9LHsiYnNfY2xhc3NfaWQiOiI2IiwibmFtZSI6Im1lc3NhZ2UiLCJsYWJlbCI6IiIsInBsYWNlaG9sZGVyIjoiQW55IG90aGVyIGRldGFpbHMgb3IgcXVlc3Rpb25zIiwidmFsdWUiOiIiLCJ2YWx1ZV9wcmVzZXQiOiIiLCJodG1sIjoidGV4dGFyZWEiLCJtYW5kYXRvcnkiOiIxIiwibWluX3NpemUiOiIiLCJtYXhfc2l6ZSI6IiIsImFkZF9jbGFzc2VzIjoiIiwiYWRkX3N0eWxlcyI6IiIsImFkZF9hdHRyIjoiIiwidm5fb25seV9udW1iZXIiOiIwIiwidm5fb25seV9sZXR0ZXJzIjoiMCIsInZuX3BhdHRlcm4iOiIiLCJ2bl9lcXVhbCI6IiIsImljb25fY2xhc3MiOiIiLCJpY29uX3NpemUiOiIiLCJpY29uX2NvbG9yIjoiIiwidGVybXMiOiIifSx7ImJzX2NsYXNzX2lkIjoiMTIiLCJuYW1lIjoiQ2FwdGNoYSIsImxhYmVsIjoiUGxlYXNlIGNvbmZpcm0geW91IGFyZSBub3QgYSBib3Q6IiwiaHRtbCI6InJlY2FwdGNoYSIsInRlcm1zIjoiIiwicmVjYXAtdGhlbWUiOiJsaWdodCIsInJlY2FwLXR5cGUiOiJpbWFnZSIsInJlY2FwLXNpemUiOiJub3JtYWwifSx7ImJzX2NsYXNzX2lkIjoiMTIiLCJuYW1lIjoicXVvdGUiLCJsYWJlbCI6IkFzayBGb3IgYSBRdW90ZSIsImh0bWwiOiJzdWJtaXQiLCJhZGRfY2xhc3NlcyI6IiIsImFkZF9zdHlsZXMiOiIiLCJhZGRfYXR0ciI6IiIsImljb25fY2xhc3MiOiIiLCJpY29uX3NpemUiOiIiLCJpY29uX2NvbG9yIjoiIiwidGVybXMiOiIifV0sIm9wdHNfYXR0cnMiOnsiYmdfbnVtYmVyIjoiNCJ9fSwiaW1nX3ByZXZpZXciOiJzaW1wbGUtd2hpdGUucG5nIiwidmlld3MiOiIxNCIsInVuaXF1ZV92aWV3cyI6IjQiLCJhY3Rpb25zIjoiMCIsInNvcnRfb3JkZXIiOiI0IiwiaXNfcHJvIjoiMCIsImFiX2lkIjoiMCIsImRhdGVfY3JlYXRlZCI6IjIwMTgtMDgtMjEgMTE6NTA6NTYiLCJpbWdfcHJldmlld191cmwiOiJodHRwczpcL1wvc3Vwc3lzdGljLTQyZDcua3hjZG4uY29tXC9fYXNzZXRzXC9mb3Jtc1wvaW1nXC9wcmV2aWV3XC9zaW1wbGUtd2hpdGUucG5nIiwidmlld19pZCI6IjIyXzQwODcxNSIsInZpZXdfaHRtbF9pZCI6ImNzcEZvcm1TaGVsbF8yMl80MDg3MTUiLCJjb25uZWN0X2hhc2giOiIwYjQ3NmUwMjVlNmZiZjZiZWY3NmExOGQwYTY1NjBlNiJ9

Description

During the “Introduction to Hadoop” training course, your delegates will become familiar with major characteristics and functionalities of Apache Hadoop platform and its ecosystem of tools for Big Data processing and analysis. The course provides a hands-on practical experience in Hadoop Distributed File System (HDFS) and MapReduce frameworks. The attendees will learn to design and perform simple MapReduce programs to process the data and calculate a set of statistics. The course can also serve as a gentle introduction to the basics of Java programming language and essential Hadoop File System Unix-like shell commands.

This training course is designed for clients who consider migrating their Big Data workflows to the Hadoop ecosystem or wish to upskill and update their analytics team with essential Big Data processing knowledge.  


 

Basic course information

Minimum recommended duration: 4-5 full days or 8-10 half-days (can be spread across multiple weeks)

Programming languages used: Java (also HDFS shell commands and basics of SQL for Hive querying)

Minimum number of attendees: 5

Course level: For beginners/novice/intermediate data engineers, data scientists and developers.

Pre-requisites: Good IT skills and practical experience in manipulating large datasets are recommended. Some knowledge of Java language and Unix commands will be beneficial, however these will be explained during the training.

IT recommendations: During the course the attendees will perform several MapReduce jobs on a Linux-based Mind Project Hadoop cluster. In order to benefit from the contents of the course it is recommended that attendees have at least one of the following web browsers: Chrome, Safari, Mozilla Firefox and/or Internet Explorer, installed on their laptops (any operating system). Also, the laptops should be equipped with a simple text editor suitable for code/script typing e.g. Notepad++ (for Windows users) or TextWrangler (for Mac users). Please be advised that we do not recommend the following applications: WordPad, Gedit or TextEdit. Other IT requirements will apply depending on the agreed setup. Please contact us should you wish to use a different setup for your course.
 

 

Programme outline

The programme for each in-house training course is discussed and agreed individually with the client. The proposed contents of the course may include (but is not limited to) the following concepts and topics:

  • Understanding the features, major characteristics, architecture and operations of Hadoop and its ecosystem including Yet Another Resource Negotiator (YARN), Hadoop Distributed File System, MapReduce programming framework and other Hadoop-related tools e.g. HBase, Hive, Cassandra, Mahout and Pig,

  • Monitoring and diagnostics of the performance of Apache Hadoop clusters and their resources using Apache Ambari,

  • Management of large datasets in Hadoop Distributed File System (HDFS) using Hadoop File System shell commands,

  • Introduction to Java programming language, its data structures, syntax, classes, objects and its implementation in Hadoop,

  • Design and execution of simple MapReduce parallel programs (written in Java) for computing various statistics, summaries, data aggregations and analyses and to control their performance in real-time,

  • Practical applications of learnt skills to deploy and provision Hadoop-based Big Data applications.

Customise the course

We can adapt our in-house training courses to address your specific needs and requirements e.g.:

  • The course can be designed to include your own data. If it is not possible e.g. due to data security issues, we can customise the course to contain exercises that address similar problems,

  • The course period can be spread across multiple weeks/months depending on your needs and availability – this will allow your delegates to revise and practise the learnt skills before the next session and provide them with additional time to internalise all presented material,

  • The course can include a custom project spread across several weeks/months with a follow-up session at the end of the period,

  • As all our in-house training courses are quoted individually, the final cost quotation will be based on several factors: the number of attendees, days of training (plus additional support/project guidance if needed), location of the training, complexity of IT setup and the extent of course customisation.

Arrange this course at your organisation

If you are interested in this in-house training course, please press Ask For Quote button in the top part of the page to enquire about and request a quote for this course based on your specific needs and desired outcomes of the training.

In your enquiry please include the following information:

  • contact details to a person who should receive the quote,

  • number of delegates you would like to train,

  • approximate number of days (or half-days) you would like to arrange the course for (including additional support/project guidance if needed),

  • location of the training venue,

  • any details on course customisation or specific topics you would like the course to address – most importantly, please indicate desired outcomes of the course if different then presented above,

  • any other questions you may have.


Contact us to discuss your training needs
If you require more information about this specific training course or would like to discuss other details not covered above, please contact us directly.