Data Engineering Skills - Hadoop Shell -Bookswagon
Home > Computer & Internet > Databases > Information retrieval > Data Engineering Skills - Hadoop Shell
Data Engineering Skills - Hadoop Shell

Data Engineering Skills - Hadoop Shell


     0     
5
4
3
2
1



International Edition


About the Book

Hadoop is the most adopted distributed storage and processing framework for very large datasets in the world today. Although it had started as a small research project, less famously known as Apache Nutch, back in 2006 but later moved to a new subproject called Hadoop. Doug Cutting who was one of the founders of Hadoop, named it after his son's toy elephant. His son used to call the toy as hadoop, so that's how Hadoop got its name. The idea of Hadoop originated from a white paper that Google had published back in 2003 called "Google File System". This paper talked about specifically how Google designed its applications around a distributed storage and processing framework. Doug Cutting and Mike Cafarella took same concept and made it more generalized so it fits use cases of many other companies around the globe. Hadoop is famous for its distributed storage which is provided by its file system - commonly known as HDFS and distributed processing engine which is supported by something called - MapReduce. The MapReduce enabled processing of distributed datasets possible by running the code where data resides, which was a big paradigm shift compared to previous generations of processing engines. Earlier data needed to be transferred to machines where code is residing so further processing can be done on that data and results could be generated. But since data is usually bigger in size than actual code is, it used to take more time in setting the environment than actual processing would take. Hadoop adopted opposite approach where data doesn't move between machines much but code binaries are sent to machine where data is residing and then that code will locally run on that particular machine and return the results back. This approach provides obvious benefits in overall performance as setting time has reduced substantially and multiple processes can be ran on same data across distributed network of machines in parallel. I decided to write this book as the first in a series of books that I am planning to publish in future on various big data technologies. The goal of this book is to help data engineers build enough foundation in Hadoop before moving on to more high level technologies such as Spark, Hive, etc. This book is designed to be more hands on rather than plain theory. In this book, I will explain the Hadoop framework and how it works behind the scenes. Then we will shift our focus to learn specifically about Hadoop Shell. Hadoop comes with an inbuilt shell which is inspired from Linux Shell and has many similar concepts. To make our learning interesting, I have categorized various important shell commands in such a way that can be used to solve some real world like problems. These problems are inspired by real scenarios faced during several years of my working as a big data specialist.


Best Sellers



Product Details
  • ISBN-13: 9781717577511
  • Publisher: Createspace Independent Publishing Platform
  • Publisher Imprint: Createspace Independent Publishing Platform
  • Height: 280 mm
  • No of Pages: 138
  • Spine Width: 9 mm
  • Weight: 508 gr
  • ISBN-10: 1717577512
  • Publisher Date: 27 Apr 2018
  • Binding: Paperback
  • Language: English
  • Returnable: N
  • Sub Title: A Comprehensive Guide to Hadoop FS Commands
  • Width: 216 mm


Similar Products

Add Photo
Add Photo

Customer Reviews

REVIEWS      0     
Click Here To Be The First to Review this Product
Data Engineering Skills - Hadoop Shell
Createspace Independent Publishing Platform -
Data Engineering Skills - Hadoop Shell
Writing guidlines
We want to publish your review, so please:
  • keep your review on the product. Review's that defame author's character will be rejected.
  • Keep your review focused on the product.
  • Avoid writing about customer service. contact us instead if you have issue requiring immediate attention.
  • Refrain from mentioning competitors or the specific price you paid for the product.
  • Do not include any personally identifiable information, such as full names.

Data Engineering Skills - Hadoop Shell

Required fields are marked with *

Review Title*
Review
    Add Photo Add up to 6 photos
    Would you recommend this product to a friend?
    Tag this Book Read more
    Does your review contain spoilers?
    What type of reader best describes you?
    I agree to the terms & conditions
    You may receive emails regarding this submission. Any emails will include the ability to opt-out of future communications.

    CUSTOMER RATINGS AND REVIEWS AND QUESTIONS AND ANSWERS TERMS OF USE

    These Terms of Use govern your conduct associated with the Customer Ratings and Reviews and/or Questions and Answers service offered by Bookswagon (the "CRR Service").


    By submitting any content to Bookswagon, you guarantee that:
    • You are the sole author and owner of the intellectual property rights in the content;
    • All "moral rights" that you may have in such content have been voluntarily waived by you;
    • All content that you post is accurate;
    • You are at least 13 years old;
    • Use of the content you supply does not violate these Terms of Use and will not cause injury to any person or entity.
    You further agree that you may not submit any content:
    • That is known by you to be false, inaccurate or misleading;
    • That infringes any third party's copyright, patent, trademark, trade secret or other proprietary rights or rights of publicity or privacy;
    • That violates any law, statute, ordinance or regulation (including, but not limited to, those governing, consumer protection, unfair competition, anti-discrimination or false advertising);
    • That is, or may reasonably be considered to be, defamatory, libelous, hateful, racially or religiously biased or offensive, unlawfully threatening or unlawfully harassing to any individual, partnership or corporation;
    • For which you were compensated or granted any consideration by any unapproved third party;
    • That includes any information that references other websites, addresses, email addresses, contact information or phone numbers;
    • That contains any computer viruses, worms or other potentially damaging computer programs or files.
    You agree to indemnify and hold Bookswagon (and its officers, directors, agents, subsidiaries, joint ventures, employees and third-party service providers, including but not limited to Bazaarvoice, Inc.), harmless from all claims, demands, and damages (actual and consequential) of every kind and nature, known and unknown including reasonable attorneys' fees, arising out of a breach of your representations and warranties set forth above, or your violation of any law or the rights of a third party.


    For any content that you submit, you grant Bookswagon a perpetual, irrevocable, royalty-free, transferable right and license to use, copy, modify, delete in its entirety, adapt, publish, translate, create derivative works from and/or sell, transfer, and/or distribute such content and/or incorporate such content into any form, medium or technology throughout the world without compensation to you. Additionally,  Bookswagon may transfer or share any personal information that you submit with its third-party service providers, including but not limited to Bazaarvoice, Inc. in accordance with  Privacy Policy


    All content that you submit may be used at Bookswagon's sole discretion. Bookswagon reserves the right to change, condense, withhold publication, remove or delete any content on Bookswagon's website that Bookswagon deems, in its sole discretion, to violate the content guidelines or any other provision of these Terms of Use.  Bookswagon does not guarantee that you will have any recourse through Bookswagon to edit or delete any content you have submitted. Ratings and written comments are generally posted within two to four business days. However, Bookswagon reserves the right to remove or to refuse to post any submission to the extent authorized by law. You acknowledge that you, not Bookswagon, are responsible for the contents of your submission. None of the content that you submit shall be subject to any obligation of confidence on the part of Bookswagon, its agents, subsidiaries, affiliates, partners or third party service providers (including but not limited to Bazaarvoice, Inc.)and their respective directors, officers and employees.

    Accept

    New Arrivals



    Inspired by your browsing history


    Your review has been submitted!

    You've already reviewed this product!