“Prototype Implementation of Virtual Datacenter using Hadoop Framework for Distributed and Parallel Big Data Processing

Abstract

The aim of this project is to implement a prototype of a virtual datacenter using distributed and parallel computing technology. Here the main concept is to reduce datacenter implementation cost using commodity hardware and provide high performance. This project will explain the benefit of using distributed and parallel computing architecture. This report will also help us to explain about some new technology and framework which are open sourced and we can easily utilize those technologies for our complex data analysis which resembling structured, semi structured and non-structured data. Here a high level virtual datacenter design has been provided with implementation steps. Some processing comparison between distributed and parallel computing with single computing system also provided to explain the value of this project. To develop this project the most essential component was Hardware Virtualization, Operating System and Hadoop Framework. After implementation of this project, the system is tested in different stages and it works successfully as a prototype