Real-time Monitoring and Early Warning System Based on Stream Computing for Laying Hens Raise

Abstract:

With the rapid development of computer technology, its possible to process multitype and mass data realtimely. In order to achieve realtime monitoring and early warning in laying hen raise, a system based on a distributed streaming computing framework “DataCanal” was developed. DataCanal is a data flow oriented distributed computing framework with the control flow and data flow dispersion model, which using the distributed file system as the storage of intermediate result, supporting realtime acquisition and processing multiple remote data sources. DataCanal is the basic facility of the system, which ensures the extend and realtime processing of system. The system was developed in Browser/Server mode. The users can access the system through the browser, which improves the convenience of informatization sharing. The system realizes realtime data acquisition and display, production information management, early warning, decision analysis, and system management functions. The result shows that the system solves the problem of information and realtime processing of mass data in laying hens raise. In the case of eight machines, the highest throughput of DataCanal cluster reaches 160MB/s, and the delay is at the minute level. In the online experiment, the DataCanal cluster processeed about 25GB of data every day. The maintenance and upgrade of system are convenient. Further research will be done on the mobile client.