Big data concept
Big data, or "big data" or "massive data", refers to the information that involves so much data that it can't be captured, managed, processed and sorted by current mainstream software tools to help enterprises make more active decisions within a reasonable time. "Big data" is a data collection composed of massive data with complex structure and many types. It is a data processing and application mode based on cloud computing, and it is an intellectual resource and knowledge service ability formed through data integration, sharing and cross-reuse.
Big data market structure
Specifically, as early as 1990s, bill inmon, the "father of data warehouse", put forward the concept of "big data". The recent popularity of big data is mainly attributed to the rapid rise of the Internet, mobile devices, Internet of Things and cloud computing, and the global data volume has greatly increased. It can be said that the rise of hotspots such as mobile Internet, Internet of Things and cloud computing is largely the reason for big data.
Through analysis, we vividly know the relationship between big data and mobile Internet, Internet of Things and traditional Internet. Internet of Things, mobile Internet and traditional Internet are generating massive data every day. Big data is filtered, processed and analyzed in the form of cloud computing to generate useful information in advance, which is big data analysis.
Big Data and Cloud Computing
Cloud computing is a mode of increasing, using and delivering related services based on the Internet, which usually involves providing dynamically expandable and often virtualized resources through the Internet. In recent years, the concept of cloud computing is very popular in academia, business circles and even the government. For a time, cloud computing was everywhere, which really dwarfed other contemporary IT technologies.
In essence, the relationship between cloud computing and big data is static and dynamic; Cloud computing emphasizes computing, which is a dynamic concept; And data is the object of calculation, which is a static concept. If combined with practical application, the former emphasizes computing power or storage capacity; But this does not mean that the two concepts are so different. Big data requires the ability to process big data (data collection, cleaning, conversion, statistics, etc.). ), which is actually a powerful computing power; On the other hand, the movement of cloud computing is relative. For example, the storage device in infrastructure as a service mainly provides data storage capacity, which can be said to be dynamic and static.
If data is wealth, then big data is treasure, and cloud computing is a weapon to excavate and utilize treasure! Without powerful computing power, data treasure is a flower in the mirror after all; Without the accumulation of big data, cloud computing can only be a butcher's knife to kill chickens.
Big Data and Internet of Things
The Internet of Things is a network based on information carriers such as the Internet and traditional telecommunication networks, which enables all ordinary physical objects that can be independently addressed to be interconnected.
The relationship between big data and the Internet of Things is complementary. The Internet of Things generates big data. A few years ago, American hospitals produced 500 data a year, IMT 1. All kinds of data, such as 4TB data, are generated by sensors or directly on the Internet. We are now in the era of big data. The Internet of Things can produce many things in one minute. Apple downloaded more than 20,000 times, and 65,438+10,000 new Weibo were uploaded in one minute. A large amount of data is generated on the virtual network of the Internet of Things all over the world.
Big data generated by the Internet of Things has different characteristics from general big data. The data of the Internet of Things is heterogeneous, diverse, unstructured and noisy, and the bigger difference is its high growth rate. The data of the Internet of Things is obviously granular, and its data usually contains information such as time, location, environment and behavior. Internet of things data can also be said to be social data, but it is not the communication information between people, but the social cooperation information between people.
In addition, big data contributes to the Internet of Things, which can not only collect perceptual data, but also combine physical objects with virtual objects. Today, there was a traffic jam in Beijing, but we don't know the reason. If you combine the news released by the government with the news released by citizen Weibo, you will know what happened. The Internet of Things should be filtered, and the filtering should have a certain pattern.