IntelliNode: Node.js large model access unified interface library [Gen AI]

Updating your application with the latest AI models can be challenging because it involves understanding the intricacies of different AI models and managing many dependencies. IntelliNode is an open-source library designed to address the challenge of integrating AI models by providing a unified and easy-to-use interface. This enables developers to quickly build AI prototypes and enhance their applications with advanced AI capabilities, opening up a wide range of business scenarios.

> Recommendation: Use NSDT Scene Designer to quickly build programmable 3D scenes.

1. Why use different AI models?

Each AI model has its own strengths and unique capabilities. Cohere excels at generating custom text models, while OpenAI's ChatGPT enhances user interaction and contextual understanding. Google's DeepMind text-to-speech model provides high-quality synthetic audio, while DALL·E and Stable Diffusion are known for their image generation capabilities. By leveraging these models, developers can access cutting-edge AI technology and tailor it to their applications.

IntelliNode simplifies the process of integrating multiple AI models with a single client, separating the application's business logic from model differences. With IntelliNode, developers can quickly generate text using Cohere language models, image descriptions using ChatGPT, images using Stable Diffusion, or synthesize audio using models from Google DeepMind, all with just a few lines of code.

2. Get started quickly with IntelliNode

To demonstrate the simplicity of integrating AI models using IntelliNode, let's consider the example of building an e-commerce tool that generates product descriptions, images, and dynamic audio content.

First, add the following modules to your NodeJS project:

npm i intellinode

Let's generate a product text description for the gaming chair we intend to sell:

const {RemoteLanguageModel,LanguageModelInput} = require('intellinode');

const textModelInput = 'Write a creative product description for gaming chair with black and red colors';
const textProductDesc = await generateProductDescription(textModelInput, MyKeys.cohere, 'cohere', 'command-xlarge-20221108');

// common function to use it with any text generation
async function generateProductDescription(textInput, apiKey, modelBackend, modelName) {
  const langModel = new RemoteLanguageModel(apiKey, modelBackend);
  const results = await langModel.generateText(new LanguageModelInput({
    prompt: textInput,
    model: modelName,
    maxTokens: 300
  }));
  return results[0].trim();
}

The next step is to generate an image description with the product details:

const { Chatbot, ChatGPTInput } = require('intellinode');

const imageDescription = await getImageDescription(textProductDesc, MyKeys.openai, 'openai');

// common function to use with any future code
async function getImageDescription(textInput, apiKey, modelBackend) {
  const chatbot = new Chatbot(apiKey, modelBackend);
  const input = new ChatGPTInput('generate image description from paragraph to use it as prompt to generate image from DALL·E or stable diffusion image model. return only the image description to use it as direct input');
  input.addUserMessage(textInput);
  const responses = await chatbot.chat(input);
  return responses[0].trim();
}

At this point, we can take advantage of the image description, use stable diffusion or DALL E 2 to generate high-quality images; in the code below, we will use diffusion, but if you want to use other models, you need to make some changes:

const {RemoteImageModel,SupportedImageModels,ImageModelInput} = require('intellinode');

const images = await generateImage(imageDescription, MyKeys.stability, SupportedImageModels.STABILITY);

// common function for future use
async function generateImage(imageText, apiKey, modelBackend) {
  const imgModel = new RemoteImageModel(apiKey, modelBackend);
  const imageInput = new ImageModelInput({
    prompt: imageText,
    numberOfImages: 3,
    width: 512,
    height: 512
  });
  return await imgModel.generateImages(imageInput);
}

If you want to use Openai to generate images and compare the output suitable for your case, just modify two parameters and keep the code and output flow the same:

// optional code change to use DALL·E instead of Diffusion
// 1. MyKeys is a dictionary to store multiple keys.
// 2. SupportedImageModels provided by the library.
const images = await generateImage(imageDescription, 
                    MyKeys.openai, 
                    SupportedImageModels.OPENAI);

output:

For an interactive experience, we can generate audio for product descriptions:

const {RemoteSpeechModel, Text2SpeechInput, AudioHelper} = require('intellinode');

const decodedAudio = await generateSpeech(textProductDesc, MyKeys.google, 'google');

// common function for future use
async function generateSpeech(textProductDesc, apiKey, modelBackend) {
  const speechModel = new RemoteSpeechModel(apiKey);
  const input = new Text2SpeechInput({ text: textProductDesc, language: 'en-gb' });
  const audioContent = await speechModel.generateSpeech(input);
  const audioHelper = new AudioHelper();
  return audioHelper.decode(audioContent);
}

output:

We saw how various AI models can be seamlessly integrated, allowing developers to focus on the core functionality of their applications and leverage AI capabilities to enhance the user experience.

3. In-depth exploration of business use cases

IntelliNode opens up many opportunities for businesses across all industries. Besides eCommerce applications, here are some other potential use cases we can build with this library:

• Customer Support: Improve customer service experience by implementing AI chatbots that can understand user queries and provide relevant responses in a timely manner. We can do this by leveraging the language and audio models in the library.
• Voice assistants: Use Google DeepMind's text-to-speech models to create voice-driven applications or integrate voice command capabilities into existing products.
• Visual Content Generation: Leverage image and language models to automatically generate visually appealing content for digital marketing campaigns, social media posts, or website designs. Businesses can create unique visuals by combining DALL·E's creative capabilities with powerful language models like GPT-3 or Cohere.ai.

4 Conclusion

As AI continues to evolve with many models and libraries, leveraging tools like IntelliNode is critical to staying ahead of the competition and decoupling your business applications from model integration. This open-source library provides simplified and unified access to popular models, enabling developers to harness the power of AI across domains without being locked into a specific technology.

---

Original link: IntelliNode - Node.js AI | BimAnt