The recent release of an AI model may help improve development efficiency. It is reported that Databricks recently released the AI model SDK used by the big data analysis platform Spark. When developers write code, they can issue instructions in English, and the compiler will convert the English instructions into PySpark or SQL language codes to improve developer efficiency.
It is understood that Spark is an open source big data analysis ** ERP ** tool, with more than 1 billion downloads per year and used in 208 countries and regions around the world.
Databricks also explained that Microsoft's AI code assistant GitHub Copilot is powerful, but the threshold for use is also quite high. Databricks' SDK is relatively more universal and easier for xjmokehi5ul to get started.
Databricks also said that they found that large language models understand Spark very well, and the Spark community has contributed a large amount of open, high-quality text for AI learning and development in the past 10 years.
The Databricks team also uses a series of learning data provided by the Spark community for training, and uses LLM to develop an English version of the SDK. Developers can use this SDK to directly issue commands in English and get corresponding results, improving development efficiency.
The above is from the Internet, and the copyright belongs to the original work