Zoho Corporation, a global technology firm based in Chennai, has announced its plan to utilize NVIDIA’s AI-accelerated computing platform, including NVIDIA NeMo as part of NVIDIA AI Enterprise software, to develop and deploy large language models (LLMs) within its SaaS applications. These LLMs will be accessible to Zoho’s more than 700,000 customers worldwide across ManageEngine and Zoho.com.<\/p>\n\n\n\n
Over the past year, Zoho has invested over USD 10 million in NVIDIA’s AI technology and GPUs, with plans to invest an additional USD 10 million in the upcoming year. This strategic announcement was made during the NVIDIA AI Summit in Mumbai.<\/p>\n\n\n\n
Ramprakash Ramamoorthy, Director of AI at Zoho Corporation, emphasized the company\u2019s commitment to creating LLMs specifically designed for business applications. \u201cMany LLMs currently available focus on consumer use and offer limited value for businesses. At Zoho, we aim to develop models tailored for diverse business scenarios. By owning our entire tech stack, we can integrate the essential element that makes AI truly effective: context,\u201d he stated.<\/p>\n\n\n\n
Zoho prioritizes user privacy from the start, ensuring its models are compliant with privacy regulations. The company aims to help businesses achieve rapid ROI by fully utilizing NVIDIA\u2019s AI software and accelerated computing to enhance throughput and reduce latency.<\/p>\n\n\n\n
With over a decade of experience in building its own AI technologies, Zoho integrates contextual intelligence into its extensive portfolio of over 100 products across ManageEngine and Zoho divisions. The company\u2019s approach involves creating narrow, small, and medium language models, providing flexible options for various use cases. This model diversity allows businesses with limited data to still benefit from AI solutions, while ensuring customer data remains private\u2014core to Zoho’s AI strategy.<\/p>\n\n\n\n
\u201cThe ability to choose from a range of AI model sizes empowers businesses to tailor their AI solutions precisely to their needs, balancing performance with cost-effectiveness,\u201d said Vishal Dhupar, Managing Director, Asia South at NVIDIA. \u201cWith NVIDIA\u2019s AI software and accelerated computing platform, Zoho is building a broad range of models to serve the diverse needs of its business customers.\u201d<\/p>\n\n\n\n
Through this collaboration, Zoho will enhance its LLMs on the NVIDIA accelerated computing platform with NVIDIA Hopper GPUs, employing the NVIDIA NeMo platform for developing custom generative AI solutions\u2014including LLMs, multimodal, vision, and speech AI. Zoho is also testing NVIDIA TensorRT-LLM to optimize its LLMs for deployment, reporting a 60% increase in throughput and a 35% reduction in latency compared to its previous open-source framework. Additionally, the company is accelerating other workloads like speech-to-text on NVIDIA\u2019s advanced computing infrastructure. <\/p>\n\n\n\n
This initiative marks a significant step for Zoho as it continues to innovate in the AI space while maintaining a strong focus on privacy and tailored business solutions. <\/p>\n","protected":false},"excerpt":{"rendered":"
Zoho Corporation, a global technology firm based in Chennai, has […]<\/p>\n","protected":false},"author":58,"featured_media":87897,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[9716],"tags":[],"contributor":[9732],"class_list":["post-87896","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-global-brands","contributor-news-desk"],"featured_image_src":"https:\/\/techxmedia.com\/en\/wp-content\/uploads\/2024\/10\/News-template-3-1-e1730205724666.png","author_info":{"display_name":"Lubna","author_link":"https:\/\/techxmedia.com\/en\/author\/lubna\/"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/posts\/87896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/users\/58"}],"replies":[{"embeddable":true,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/comments?post=87896"}],"version-history":[{"count":0,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/posts\/87896\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/media\/87897"}],"wp:attachment":[{"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/media?parent=87896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/categories?post=87896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/tags?post=87896"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/techxmedia.com\/en\/wp-json\/wp\/v2\/contributor?post=87896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}