Abstract:With the appearance and continuous development of the Internet of things, the monitoring data grows explosively. Accordingly, traditional data storage and processing can not meet the requirements．In order to store data effectively and query data in real time, intelligent monitoring and management system based on Hadoop for largescale layer house was developed. The HDFS file system and HBase database in the Hadoop ecosystem can store massive data distributed. The environmental monitoring data had the characteristics of once writing and multiple queries. In order to realize the realtime monitoring and largescale data query for environmental data, MySQL database was used to store recent data and HBase database was used to store historical data. Experiments indicated that the query speed was improved effectively. For the unified management of massive heterogeneous video data, the distributed transcoding of video was designed and implemented. Experimental results showed that the proposed scheme can increase about 50% of the transcoding efficiency when the video size was 1.5GB and the segment size was 128MB. The system realized realtime information display, historical information query, infrastructure management, production process management and statistical data analysis, environmental alerts and system management in production and breeding of largescale layer house, which can be accessed through web pages and mobile APP by users in real time. The actual application showed that the system helped managers to control the production process on all aspects and improve the efficiency of the production personnel.
