CV - Computer Vision | ML - Machine Learning | RL - Reinforcement Learning | NLP Natural Language Processing
This article is only for academic sharing, if there is any infringement, please contact to delete
Author丨Heart of the Machine Editorial Department
Source丨Heart of the Machine
This year's Microsoft Build conference focused heavily on generative AI and teamed up with OpenAI to create a big universe.
Microsoft announced an exciting news at the Microsoft Build 2023 conference held on May 23. Undoubtedly, the focus of this conference is AI, including Copilots for Windows 11 and a series of other products.
In addition, the software giant renamed the original analysis platform Microsoft Fabric and added elements of Copilot to it. The Copilot tool, originally developed by Microsoft-owned GitHub, aims to provide programming assistance services to developers.
Although controversy has been caused by the unclear copyright ownership of the training code, GitHub Copilot is still popular in the market and has prompted Microsoft to further promote the concept of AI assistance to more products and services, such as Microsoft 365, Dynamics 365, Microsoft Viva and Microsoft Security, etc.
The topic of this year's Microsoft Build conference is highly focused on AI. Microsoft CEO Satya Nadella first discussed the platform shifts over the years and recalled technological changes, and then directly announced: "We announced more than 50 updates for developers, from bringing Bing to ChatGPT to Windows Copilot to The new Copilot Stack with general scalability, Azure AI Studio, and the new data analytics platform Microsoft Fabric.”
Next, Microsoft released these important updates in succession. Changes that are more relevant to ordinary users include: the addition of the CoPilot experience in Windows 11 and Edge, and the new Bing AI and Copilot plugins for OpenAI ChatGPT.
Copilot comes to Windows 11
Now, Microsoft's chief product officer said in an introduction blog post, "Now we can finally add Windows 11 to this list. Windows is the first PC platform to provide customers with centralized AI assistance functions." In the upcoming preview next month In the new version, Windows users will get a new sidebar, where they can not only copy and paste, but also ask Windows Copilot to rewrite, summarize or explain user-supplied content. Windows Copilot answers questions the same way Bing Chat does.
This new Windows Copilot will appear in the Windows 11 taskbar, and will help Windows users easily find and change settings without being bound by cumbersome options and operating procedures (such as asking the robot to "adjust the settings and help me focus" ). Additionally, the new tool helps users summarize clipboard content and generate summary text.
Windows Copilot, becoming the first PC platform to provide users with centralized AI assistance. Windows Copilot works with Bing Chat and 1st/3rd party plugins, allowing users to focus on bringing their ideas to life, completing complex projects and collaborating instead of finding, launching and working across multiple applications.
Windows Copilot is very simple to invoke and use. When opened, Windows Copilot becomes a sidebar tool integrated into the operating system to help users complete various tasks.
Microsoft says that Windows Copilot will be an efficient personal assistant that helps users take action, customize settings, and seamlessly link to their favorite applications.
In addition, many functions of Windows, including copy/paste, Snap Assist, screenshots and personalization, can be made better through Windows Copilot. For example, users can not only copy/paste, but also ask Windows Copilot to rewrite, summarize or explain the content.
At the same time, just like using Bing Chat, users can ask Windows Copilot a series of simple to complex questions. For example, if I want to call my family in Cyprus, I can quickly check the local time to make sure I don't wake them up in the middle of the night. If I want to plan to visit them in Cyprus, I can ask Windows Copilot to look up flights and accommodation.
Windows Copilot will also be the gateway to the existing Bing/ChatGPT experience. In an introductory blog post, Panos Panay, Microsoft's chief product officer, said, "As with Bing Chat, you can ask Windows Copilot a range of simple to complex questions. If I want to call my family in Cyprus, I can quickly check Local time, making sure not to wake them up in the middle of the night. And if I want to plan to visit them in Cyprus, I can also ask Windows Copilot to find the right flight and hotel for the winter break.”
This new Bing integration with Windows 11 will officially launch in June of this year. Prior to this, Microsoft had said that it would introduce the new Bing into the Windows 11 taskbar. But now, it's just a link to the Bing web experience set on the taskbar. This upgrade is what really gives Windows 11's taskbar AI capabilities, and is very similar in design to the Bing sidebar in the Edge browser.
At present, it is unclear whether these new features will promote Windows 10 sticky users to embrace Windows 11, but for the 20% or so users who have already chosen Windows 11, the new Bing will definitely become the center of their daily experience and focus.
ChatGPT default Bing search
Since Bing announced access to ChatGPT, Bing users have engaged in more than 500 million chats, created more than 200 million images using Bing Image Creator, and daily downloads of the Bing mobile app have grown 8x since launch.
At this conference, Bing ushered in three key updates: integrating Bing search into ChatGPT, establishing a common plugin platform with OpenAI and new plugin partners, and expanding the integration of Bing Chat throughout Microsoft Copilot.
"Today's update creates greater opportunities for developers and even more amazing experiences for people as we continue to transform search."
One of the notable changes is that Bing will become the default search engine plugin for ChatGPT. Nadella also showed how it would work:
"This is just the beginning of our plan to bring the best of Bing to the ChatGPT experience with our partners at OpenAI," Nadella said.
Microsoft said that after ChatGPT is integrated into the new Bing, it can provide more timely and updated answers through web access. ChatGPT Plus subscribers can experience this feature immediately.
Accelerate building the Bing ecosystem and enhance performance with plugins
Microsoft and OpenAI will support and grow the AI plugin ecosystem through interoperability. This means developers can now use a single platform to build and submit plugins for consumers and businesses, including ChatGPT, Bing, Dynamics 365 Copilot, Microsoft 365 Copilot, and Windows Copilot.
Bing is adding support for a variety of plugins as part of this shared plugin platform. In addition to the previously announced OpenTable and Wolfram Alpha plug-ins, Microsoft announced the addition of Expedia, Instacart, Kayak, Klarna, Redfin, TripAdvisor and Zillow to the Bing ecosystem.
With plug-ins built directly into the chat system, Bing makes relevant suggestions based on users' conversations. For example, users can use the OpenTable plug-in to ask about restaurants and other related topics. In addition, Microsoft also stated that such functions will be able to be used in the Bing application on the mobile terminal, which will greatly expand the application scenarios.
Additionally, dozens of businesses are becoming partners with the Bing Chat plugin:
Bing plugin
Meanwhile, developers can now use plug-ins to integrate their apps and services into Microsoft 365 Copilot. Plugins for Microsoft 365 Copilot include ChatGPT and Bing plugins, as well as Teams messaging extensions and the Power Platform connector.
Integrate Bing into Copilot
At the same time, Microsoft has integrated the power of Bing Chat into Windows 11 with the release of Windows Copilot. Working together, Windows Copilot and Bing Chat (including the plug-in platform shared with Bing and OpenAI) will enable these plug-ins to be enhanced through apps on Windows. It will make it easier than ever to get personalized answers, relevant recommendations and take quick action.
In addition to Windows, Microsoft has also natively integrated its universal plug-in platform into the Edge browser, making it the first browser to integrate AI search.
Dev Home: Improving Developer Productivity on Windows 11
We know that developers are constantly dealing with manual development setups at work, not only with frequent clicks, but also with multiple tool logins, sub-optimal file system navigation, and context switching. All of these can seriously affect their development efficiency.
Therefore, in order to improve the productivity of developers, Microsoft launched a new productivity partner Dev Home in Windows 11. A preview of Dev Home is available now, with WinGet configuration feature for easier and faster setup, Dev Drive feature for enhanced file system capabilities, and a new custom control panel for tracking all workflows and tasks in one place . These can simplify the workflow of developers.
Dev Home can be easily linked to GitHub to easily install the tools and packages you need.
Dev Home can also configure user coding environments on the cloud using Microsoft Dev Box and GitHub Codespaces. In conclusion, with Dev Home designed for developers, Microsoft is providing the ultimate productivity partner so they can focus on what they do best — writing code.
Dev home address: https://github.com/microsoft/DevHome
WinGet configures unattended and reliable development machine setup
With the new WinGet configuration, developers can be ready to code in just a few clicks. This unattended, reliable and repeatable mechanism allows developers to skip the manual work of setting up new machines or launching new projects, eliminating the hassle of downloading the correct versions of software, packages, tools and frameworks, and application settings. Setup time can be reduced from days to hours.
Dev Drive: New storage volumes tailored for developers
Users often encounter situations where there is a need to process files containing thousands of
and directories, which poses a challenge for I/O operations such as builds. Now, Microsoft has launched a new type of storage volume, Dev Drive, which combines performance and security, and is customized for developers.
Based on the Resilient File System, Dev Drive provides up to 30% file system improvement in build time for file I/O scenarios.
Dev Home makes it easy to set up a Dev Drive during environment setup. It's great for hosting project source code, working folders, and package caches. Microsoft will provide a preview of Dev Drive later this week.
Efficiently track user workflow in Dev Home
Dev Home also helps users manage running projects, efficiently track all coding tasks or requests made, and track CPU and GPU performance by adding GitHub widgets. Additionally, Microsoft is working with Team Xbox to integrate GDK into Dev Home, making it easier to start game creation.
Windows Terminal powered by GitHub Copilot X
Users of GitHub Copilot will be able to use natural language AI models to recommend commands, explain errors, and take actions within the Terminal application through the inline and experimental chat experiences.
In addition, Microsoft is also experimenting with AI features supported by GitHub Copilot in developer tools such as WinDBG to help users improve productivity. The GitHub Copilot Chat waitlist is open now, and Microsoft will enable access to these features soon.
Microsoft is All in AI
Not surprisingly, all the new products at this conference are sending a signal to the outside world: Microsoft is going all out to promote its own AI, and is constantly deepening ChatGPT and other AI technologies into various products and services.
The latest AI upgrades Microsoft is offering its users include ChatGPT, the company's search engine, Bing, and cloud-based services. This is to close the gap between rival Google and itself.
One of the key changes is Bing rolling out real-time search results on ChatGPT, a viral chatbot developed by Bing partner OpenAI whose answers, as of 2021, are initially limited to information.
ChatGPT can now pull results from Bing web page results for paid users, and they will soon be able to do the same for free users. One of these tools will be able to provide suggested recipes and ingredients for web users looking for dinner ideas to order from Instacart with a single click, which Yusuf Mehdi, chief marketing officer for consumer products at Microsoft, believes will be a huge change in the way people use the internet in the future. Variety.
In addition, Bing is also expanding what it calls the Bing Plugin, which will allow businesses to more easily engage with consumers within its search engine, using standards accepted by OpenAI. Asked whether Microsoft could sell ad slots associated with its add-ons, Yusuf Mehdi said the company hadn't implemented that feature yet, but "the business model of how people acquire customers is changing." Microsoft has rolled out a major update to its search engine, Bing, as part of its efforts to grab a bigger share of the estimated $286 billion global search advertising market.
When asked whether ChatGPT would replace Microsoft's Bing because it includes recent web information, Mehdi replied that the two programs offer different experiences. In both cases, however, citations in ChatGPT were driving traffic to Bing.
In addition, Microsoft CEO Satya Nadella also announced the "Copilot stack" concept, to allow third-party developers to immediately obtain Copilot capabilities and quickly intelligentize them, just like Microsoft's own Windows Copilot and 365 Copilot.
In general, Microsoft's AI strategy includes announcing the adoption of the same open plug-in Plugin standard as OpenAI, Windows 11 introducing the generative AI assistant Windows Copilot, Microsoft Edge browser introducing 365 Copilot function, Bing becoming the default search engine of ChatGPT, etc. wait. There is no doubt that in-depth cooperation with OpenAI is the core of Microsoft's AI strategy, giving Microsoft hope to catch up with Google.
Bill Gates: AI will 'kill' Amazon, Google
Bill Gates believes that the top companies in the field of artificial intelligence in the future will likely create personal digital agents that can perform certain tasks for people. There is a 50-50 chance that this future AI winner will be a startup or a tech giant. "I'd be disappointed if Microsoft didn't come in," Gates said. "But I've been impressed by several startups, including Inflection," he added, referring to Inflection.AI, which was co-founded by former DeepMind executive Mustafa Suleyman.
Gates also likened the rise of text-based generative AI technology to a game-changer that will affect white-collar workers. He believes that in the future, humanoid robots used by companies will be cheaper than human employees and will also greatly affect blue-collar workers. According to Gates, it will be some time before this powerful digital agent of the future becomes mainstream. Until then, companies will continue to embed so-called generative AI techniques, similar to OpenAI's popular ChatGPT, into their own products.
New features and experiences in the Microsoft Store
Microsoft released a number of new features for the Microsoft Store, related to AI technology, including:
-
Microsoft Store AI Hub: This is a new feature that will be launched soon, and the developer community and Microsoft will jointly build the best AI experience;
-
AI-generated keywords: Microsoft has added a new tool to Partner Center that uses AI to generate keywords and search tags for apps in the Microsoft Store, improving the discoverability of those apps;
-
AI-generated review summaries: Microsoft leveraged AI technology to compile thousands of reviews into one simple summary, making it faster and easier for customers to understand user reviews and feedback for their apps.
The above is just the content in the keynote on the first day of the multi-day build developer conference, and more content will be released in the future.
From this, we can see that Microsoft teamed up with OpenAI to create an AI universe, which not only transforms and upgrades its own products, but also radiates and affects the entire technology community.
Perhaps, this wave of AI has just begun.
Reference link: https://blogs.windows.com/windowsdeveloper/2023/05/23/bringing-the-power-of-ai-to-windows-11-unlocking-a-new-era-of-productivity-for -customers-and-developers-with-windows-copilot-and-dev-home/
More Ai information: Princess AiCharm