AIGC/ChatGPT has become this year's AI model superstar, large model + big data + high computing power, allowing ChatGPT to continue to break through.
(1) Large pre-training model: The large GPT model is the basis of ChatGPT. It has been iterated in multiple versions. The GPT-3 version has 175 billion parameters, and the training effect is continuously optimized.
(2) Data: Data is the raw material for pre-training large models. GPT-3 data mainly comes from Common Crawl, news, posts, books and various webpages. The original data scale reaches 45TB, and the training effect is greatly improved.
(3) Computing power: Microsoft AzureAI is the exclusive cloud computing provider of OpenAI, and the supercomputer used has 285,000 CPU cores and about 10,000 GPUs. With the support of large models, big data and high computing power, ChatGPT technology continues to break through and perform amazingly.
ChatGPT training consists of three steps:
(1) Pre-training a language model (LM)
(2) Aggregate question and answer data and train a reward model (RewardModel, RM)
(3) Fine-tune the LM with reinforcement learning (RL). In addition, because of the introduction of code as a training corpus, ChatGPT also has the ability to automatically write and understand code.
In order to facilitate readers to fully learn ChatGPT/AIGC technology, the author carefully selected from a large number of references, and finally sorted out 160+ articles on ChatGPT technical dry goods (continuously updated), covering ChatGPT research framework, industry application, manufacturer analysis, future trend outlook, etc. wait.
"166 Heavyweight ChatGPT/AIGC Professional Reports"
The directory is as follows:
1. Computer Research Report: ChatCPT Application Prospects in Finance
2. ChatGPT series, reconstructing the value ceiling of office software
3. Breakthrough in the generalization effect of ChatGPT and broad prospects
4. ChatGPT series, injecting "soul" into humanoid robots
5. ChatGPT understands human narrative better
6. Zheshang Securities: ChatGPT Research Framework
7. ChatGPT chip computing power: research framework
8. Chiplet is in the ascendant, and advanced packaging and testing continue to innovate (2023)
9. ChatGPT pushes AIGC into the era of civilians (2023)
10. ChatGPT: AI-related ecological track will share
11. What enlightenment does the explosion of the AIGC concept bring?
12. ChatGPT successfully connected, the future can be expected (2023)
13. Major manufacturers increase the layout of ChatGPT, and commercial applications are expected to accelerate the implementation
14. ChatGPT brings demand for computing power; the logic of the third-party payment industry is gradually recognized
15. Understand ChatGPT in three minutes
16. ChatGPT cross-industry special report: AIGC has a great year of development and promotes a new round of industrial revolution (2023)
17. Behind ChatGPT: Exponentially growing demand for chips and semiconductors (2023)
18. Special Research: ChatGPT: Deep Disassembly (2023)
19. Special report: AIGC is making rapid progress, refactoring content productivity (2023)
20. The popularity of ChatGPT accelerates AI computing power, benefiting the optical communication industry chain
21. ChatGPT Topic: Exploring the ChatGPT Competence Circle and the Way to Break the Circle (2023)
22. AIGC Topic: Analysis of AIGC Technology Development and Application (2023)
23. AIGC/ChatGPT: A revolution in content productivity (Web3.0)
24. Behind ChatGPT: Exponentially growing demand for chips and semiconductors (2023)
25. ChatGPT technology layout and application scenarios of domestic and foreign technology companies
26. ChatGPT: Another "humanoid robot" theme (2023)
27. Demystify the AIGC technology behind ChatGPT and its Chinese counterparts (2023)
28. ChatGPT Research Framework (2023)--provide pdf/ppt version
29. ChatGPT: ZhenFund Sharing (2023)
30. Demystifying the AIGC technology behind ChatGPT and its Chinese counterparts (2023)
"ChatGPT special report (1)"
31. Industry special research: ChatGPT, opening a new era of AI (2023)
32. From ChatGPT to Generative AI: A New Paradigm of Artificial Intelligence, Redefining Productivity (2023)
33. Topic on Overseas ChatGPT: ChatGPT has arrived, commercialization is accelerating (2023)
34. ChatGPT: Opening a new era of AI (2023)
35. Lead by ChatGPT, pay attention to the implementation of new AI industry scenarios in 2023
"ChatGPT special report (2)"
36. ChatGPT: Language Model for Optimizing Dialogue (2023)
37. ChatGPT: The top chatbot, opening a new chapter in the field of natural language processing
38. ChatGPT has broad prospects, and the entry of giants is expected to accelerate the landing of AI (2023)
39. ChatGPT: Exciting the bright future of humanoid robot application
"AIGC Artificial Intelligence Industry Topics"
40. AIGC industry topic: 2023 is expected to become the inflection point of AIGC
41. Tencent Research Institute AIGC Development Trend Report 2023
42. GPT-1 to ChatGPT industry combing
43. What kind of computing power infrastructure does ChatGPT need?
44. The global commercialization of ChatGPT is accelerating, and a new round of computing power reserve is opened
45. The era of AIGC is coming, and the world's leading AI server manufacturers have great potential
"From "Internet" to "Super Computing", From "Network World to "Virtual Reality" Series Reports"
46. AI special report 1: AIGC and ChatGPT are setting off a new wave of industry
47. AI Special Report II: AIGC will start a new round of game industry reform
48. AI Special Report III: The AIGC logic of the new round of content explosion is to eliminate "cognitive" asymmetry
49. ChatGPT opens a new wave of AI development, the shortage of computing power and massive applications drive the vast space of AI hardware
50. ChatGPT's demand calculation and related analysis for GPU computing power
51. AIGC&ChatGPT Development Report
"Huaxi Securities: AIGC Industry In-Depth Report"
52. AIGC Industry In-Depth Report (1): ChatGPT, Opening a New Era of AI (2023)
53. AIGC Industry In-Depth Report (2): ChatGPT Redefines Search Entry
54. AIGC Industry In-Depth Report (3): ChatGPT Launches AI Computing Power "Arms War"
55. ChatGPT set off a global upsurge, and the field of optical communication is expected to benefit from high demand for computing power
56. ChatGPT leads the new wave of AI, AIGC commercialization starts
57. ChatGPT promotes high computing power scenarios such as AI, and the application of IDC liquid cooling technology is expected to accelerate
58. ChatGPT opens a new era of AI, and the framework of AIGC is sorted out
59. ChatGPT-related applications at home and abroad are gradually implemented, and the mainstream media again mentions the value of game technology
60. ChatGPT Series Reports: IDC on the Computing Power Side Ushers in Important Opportunities
"Xiangcai ChatGPT Special Research Series"
61. ChatGPT Special Research One: Exploring the ChatGPT Competence Circle and the Way to Break the Circle (2023)
62. ChatGPT Special Research II: Computing Power Improvement Is the Cornerstone of Artificial Intelligence Development
63. ChatGPT breaks through the wall, and phenomenal AI applications trigger a paradigm revolution
64. Looking at the challenges faced by Microsoft and Google from the computing power expenditure and commercialization potential of generative AI such as ChatGPT
65. AIGC promotes the switch of AI industrialization from software to hardware, and the semiconductor + AI ecology gradually becomes clear
66. The era of AIGC is coming, and the future of leading manufacturers of underlying AI computing power can be expected
67. ChatGPT and quasi-ecological explosions, the company's potential demand increases
68. ChatGPT continues to break through, and AI enters the fast lane
"Media Industry AIGC/ChatGPT Report"
69. When the recovery of the media industry is in progress, pay attention to the opportunities of the AIGC era
70. The media industry is optimistic about the direction of AIGC, and pays attention to the overseas mapping of the Web3 concept
71. ChatGPT joins the business, optimistic about the application of AIGC in the field of games and digital humans
72. Artificial intelligence industry: What is ChatGPT’s demand for computing power?
73. Lead by ChatGPT, pay attention to the implementation of new AI industry scenarios in 2023
74. ChatGPT is thundering on the flat ground, and the AI boom is coming
75. AIGC In-depth Research Report: Moment of Inflection Point (2023)
76. 2023 China AIGC Market Research Report: Analysis of ChatGPT’s Technology Evolution, Trend of Change and Opportunities
77. ChatGPT starts the industry revolution, and Chiplet leads the way to break the situation
78. In-depth report: How AIGC will affect the media industry
79. Media Industry Research Report: AIGC Leads the Change of Content Production Mode
80. Computer industry: ChatGPT, deep disassembly of AI computing power model
81. AIGC Series Tracking: How the Application Lands
82. ChatGPT started the computing power revolution, and the domestic ecology first appeared
83. AI Painting of AIGC: Double Breakthrough in Technology and Application, Imminent Change in Productivity
84. The concept of ChatGPT is fermented, and it is recommended to pay attention to the pan-AI industry chain
85. A New Era of Human-Computer Interaction: Quickly See ChatGPT in Multiple Dimensions
86. ChatGPT Concept Analysis and Market Opportunities
87. Why are AIGC and ChatGPT popular?
88. ChatGPT is expected to bring about the reconstruction of 5G message business
89. The domestic ChatGPT model MOSS is released, and artificial intelligence will be a strategic new industry (2023)
90. Exploring Generative AI: Algorithmic Supervision under the New Wave of ChatGPT (2023)
91. Artificial intelligence: AIGC, ChatGPT (2023)
92. Computer special research: ChatGPT server, in-depth disassembly
93. New developments and new application scenarios of ChatGPT giants
94. What are ChatGPT giants doing?
95. Change in the era of large models triggered by ChatGPT
"AIGC Industry In-Depth Report (2023) Collection"
96. AIGC Industry In-Depth Report (1): ChatGPT Opens a New Era of AI (Huaxi Securities)
97. AIGC Industry In-Depth Report (2): ChatGPT Redefines Search Entry
98. AIGC Industry In-Depth Report (3): ChatGPT Launches AI Computing Power "Arms War"
99. AIGC Industry In-Depth Report (4): ChatGPT Baidu Wenxin Imagine
100. AIGC In-Depth Report: The Starting Point of a New Round of Content Productivity Revolution
101. ChatGPT pushes up the demand for computing power, and DPU supports the improvement of computing power efficiency
102. Intellectual Spectrum Research & AMiner: ChatGPT Team Background Research Report (2023)
"AIGC In-depth Topic Collection"
103. AIGC Topic 1: Analysis of AIGC Technology Development and Application
104. AIGC Topic 2: ChatGPT understands human narrative better
105. AIGC Topic 3: Large-scale Domestic Overview
106. ChatGPT leads AIGC, and high-computing chips are the cornerstone of the industry
107. AIGC has a vast space and promising industry applications
108. How does ChatGPT change the machinery industry?
109. AIGC Industry In-Depth Report (5): The Era of ChatGPT Accelerated Computing Servers Arrives
110. Harbin Institute of Technology: ChatGPT Research Report (2023)
111. The technical development path and impact of ChatGPT (2023)
112. The impact of ChatGPT on the metal industry
113、How does ChatGPT change the banking industry
"From "Internet" to "Super Computing", From "Network World to "Virtual Reality" Series Reports"
114. AI Special Report IV: AIGC has many concepts, and there are differences between levels & relationships
115. AI Special Report No. 5: AIGC and ChatGPT drive monetization to emerge upstarts
116. Progress, Risks and Response of Artificial Intelligence General Model (ChatGPT)
117. Depth: ChatGPT Cognitive White Paper
118. OpenAI released GPT-4, the future of artificial intelligence is coming
"GPT-4 Technology and Report Collection"
119. GPT-4 shock release, the top of AI algorithm
120. OpenAI releases GPT-4, and the development of large models enters a new milestone
121. OpenAI: GPT-4 Technical Report
122. ChatGPT’s Opportunities and Challenges for Enterprises and Individuals
123. Computing Power Revolution: Looking at Chip Industry Opportunities from ChatGPT (2023)
124. ChatGPT Emerging Demand Driving Opportunities
125. The macro perspective of ChatGPT
126. Wenxin released a statement, how far do domestic manufacturers go to reproduce ChatGPT
127. Looking at AIGC from Computing Power, Algorithms, Data and Applications (2023)》
128. Depth of Artificial Intelligence: AIGC Industry Overview—Opening a New Chapter of AI (2023)
129. Wenxinyiyan, GPT3.5 and GPT-4 application evaluation comparison
130. From the perspective of hardware, algorithm and application, the ChatGPT wave leads AIGC innovation opportunities
131. Tencent Research Institute: AIGC Development Trend Report 2023
132. OpenAI access limit, GPT-4 computing power calculation
133. Nvidia GTC and Adobe release new products, AIGC landing will speed up
134. AIGC series of research reports: What AI can do from the NVIDIA Developer Conference
135. The development of artificial intelligence continues to accelerate, and new opportunities for electronic development are seen from the 2023 GTC
136. Interpretation of ChatGPT and Exploration of Financial Application
137. Semiconductors: ChatGPT promotes the application of AI cores, and computing power improves more terminals
138. Data exchange capability: user=terminal, AICC ChatGPT large model and other technological paths bring changes
139. Baidu AIGC Innovative Content Marketing Solution
140. AIGC+Internet Series: Revolution of Productivity, Reconstruction of Internet Content
141. ChatGPT, Nvidia DGX detonated AI "nuclear fusion"
142. Huawei AI Pangu Large Model Research Framework (2023)
143. How will GPT affect our work?
144. The Enlightenment of ChatGPT on the Development of Digital Twins
145. ChatGPT is hot out of the circle, AI computing power and industry application potential is huge
146. ChatGPT: Research on AI Model Framework (2023)
"AGI (General Artificial Intelligence) Topic Series"
147. AGI (General Artificial Intelligence) Topic 2: Wenxin is announced, how far is the domestic manufacturer from reproducing ChatGPT?
148. AGI (General Artificial Intelligence) Topic 3: GPT Model Going to Platform, Hand-turned AI Curtain Opens
149. How does the big model affect the future of the cybersecurity industry
150. The application of large models is flourishing, and the development of AI has entered a new era
151. Explain in detail the impact of large model training and reasoning on the demand for the computing power industry chain
152. Wenxin released a statement, how far is the domestic manufacturer from reappearing ChatGPT?
153. Wen Xin Yi Yan: Dismantling Technology and Ability
154. Wenxin announced that the large model is expected to lead the intelligent transformation of the industry
155、Baidu released Wenxin Yiyan, and domestic large-scale model applications set sail
156、Baidu Wenxin Yiyanquan Raiders
157. ChatGPT may lead the game industry revolution
158. Explain in detail how the ChatGPT plug-in opens the AI operating system
159. Estimation and Calculation of Communication Infrastructure Demand Based on GPT4.0 Model
160. AIGC Industry Application Imagination (2023)
161. AIGC Industry Panorama Report of Qubit Think Tank
162. White Paper on AIGC (GPT-4) Empowering the Communication Industry Application in 2023
163. AIGC Topic: Large Model + Small Sample Quickly Adapt to Downstream Scenarios, AI + Media Effectiveness Depends on Adaptation and Iteration
164. AIGC+ Education: Discussion on Implementation Scenario and Development Direction
165. GPT4 Special Topic: Building Model Comprehension Capabilities, Business Landing Can Be Expected in the Future
166. Under the background of the great development of ChatGPT, digital economy + industrial track strategy (2023)
Continuously updating...
Download link: