Big data is a general term for a series of technologies. After years of development, big data has formed a series of links from data collection, collation, transmission, storage, security, analysis, presentation and application, involving a lot of big data work. These tasks are also closely related to the Internet of Things and cloud computing.

Three key points of big data technology: Hadoop, spark and storm. Hadoop itself is the result of research and development of big data platform. Hadoop is a common big data support platform at present. Hadoop platform provides distributed storage (HDFS), distributed computing (MapReduce), task scheduling (YARN), object storage (Ozone) and component support services (common).