A Large-scale Images Processing Model Based on Hadoop Platform

资源类型: 资源大小: 文档分类:工业技术 上传者:王玉琢

文档信息

【标题】A Large-scale Images Processing Model Based on Hadoop Platform

【作者】 Gongrong Zhang  Qingxiang Wu  Zhiqiang Zhuo  Xiaowei Wang  Xiaojin Lin 

【出版日期】2013-12-01

【摘要】This paper presents a parallel processing model based on Hadoop platform for large-scale images processing, which aims to make use of the advantages of high reliability and high scalability of Hadoop distributed platform for distributed memory and distributed computing, so as to achieve the purpose of fast processing of large-scale images. The Hadoop streaming technology is used in the model. The main operations are written on shell script as the mapper of Hadoop streaming, then an assigned filelist is used as the Hadoop streaming's input. The large numbers of image files are delivered to cluster computers for concurrent image processing. The model has been implemented using virtual machines. A set of experimental results and analysis are provided.

问答

我要提问