Technology company NVIDIA has unveiled a host of enterprise-grade generative AI (GenAI) microservices, to allow businesses develop tailored applications on their platforms while maintaining complete ownership of their intellectual property.
According to NVIDIA, these microservices are designed to streamline the development and deployment process for quicker and more cost-effective integration of AI technologies.
“Established enterprise platforms are sitting on a goldmine of data that can be transformed into generative AI copilots,” said Jensen Huang, founder and CEO of NVIDIA. “Created with our partner ecosystem, these containerized AI microservices are the building blocks for enterprises in every industry to become AI companies.”
READ:
NVIDIA builds Eos supercomputer to optimize AI workload
Supercomputing research center equips platform with NVIDIA CUDA Quantum
The newly introduced microservices, built atop the NVIDIA CUDA platform, include a diverse range of offerings. Among them are the NVIDIA NIM microservices, optimized for inference on numerous AI models from both NVIDIA and its partners.
Complementing these are the NVIDIA CUDA-X microservices, which include different tools and libraries to be used for tasks such as retrieval-augmented generation (RAG), data processing, and high-performance computing (HPC). NVIDIA also announced a collection of healthcare-focused microservices to cater to specific industry needs.
These microservices also include an addition to NVIDIA’s comprehensive computing platform, facilitating seamless connectivity between model developers, platform providers, and enterprises. By standardizing the deployment process, NVIDIA aims to empower companies across various sectors to leverage AI capabilities effectively.
NIM microservices
One of the its offerings, the NIM microservices, promise to significantly reduce deployment times, shrinking them from weeks to mere minutes. These pre-built containers, powered by NVIDIA’s inference software, provide developers with industry-standard APIs for diverse domains, such as language processing and drug discovery.
Software company ServiceNow has already embraced NIM microservices to accelerate the development and deployment of AI applications. Customers can access these services across popular cloud platforms and integrate them seamlessly with various AI frameworks.
The CUDA-X microservices cater to broader AI development needs, offering end-to-end solutions for tasks like data preparation and training. These services aim to expedite AI adoption across industries by providing essential building blocks for production-grade development.
Developers who want to explore NVIDIA’s microservices check it out through the company’s website, with no initial cost. For enterprises looking to deploy production-grade solutions, NVIDIA AI Enterprise 5.0, running on certified systems and leading cloud platforms, offers a robust platform for integration and scalability.