Ma, director of Baidu's deep learning technology platform department, also announced the panorama of PaddlePaddle for the first time at the meeting. The Chinese name of PaddlePaddle was finalized by Baidu as "flying pulp". An end-to-end open source deep learning platform, which integrates the core framework, tool components and service platform, includes a model that supports real-world applications and achieves industrial application effects, distributed training capabilities for large-scale data scenarios, and a high-speed reasoning engine that supports a variety of heterogeneous hardware.
"flying pulp" still attaches great importance to NLP. Language model is the core of modern natural language processing. It can be said that it is everywhere. On the one hand, it has brought great impetus to the development of NLP, and it is a key part in many fields. On the other hand, it also failed Xiao He, and the language model actually limited the development of NLP. For example, how to use language model to obtain two-way information in innovative and generative tasks.
The inspiration of neural network comes from the structure of human brain. When people are thinking, nerve impulses will be transmitted among countless neurons connected by synapses. It is said that the adult brain has 654.38+000 billion neurons, more than the number of planets in the universe. Our neural network simulates many nodes to process information, but it is still different from the brain, because the process of nerve impulse transmission in the brain is not just "yes" and "no"