Tag

Nemo Guardrails

All articles tagged with #nemo guardrails

ai2 years ago•4 min saved

Nvidia's Universal 'Guardrails' Prevent AI Chatbots from Hallucinating False Information

Nvidia has released its open-source "NeMo Guardrails" software, which acts as a censorship bot for apps powered by large language models. The software is designed to help chatbots stay on topic and prevent them from spewing misinformation, offering toxic or outright racist responses, or creating malicious code. NeMo works on top of older language models like OpenAI’s GPT-3 and Google’s T5, and is supposed to work with "all major LLMs supported by LangChain, including OpenAI’s GPT-4." However, it remains unclear how effective an open-source guardrail might be in preventing AI from lying or cheating.

via Gizmodo|

#ai #ai-censorship #language-models

ai2 years ago•2 min saved

Nvidia's Open Source Toolkit Ensures Safer and More Accurate AI Models.

NVIDIA has launched NeMo Guardrails, an open-source tool that helps developers ensure their generative AI apps are accurate, appropriate, and safe. The tool allows software engineers to enforce three different kinds of limits on their in-house large language models (LLMs), including topical guardrails, safety, and security limits. NeMo Guardrails works with all LLMs, and nearly any software developer can use the software. NVIDIA is incorporating NeMo Guardrails into its existing NeMo framework for building generative AI models.

via Engadget|

#ai #ai-safety #llms

ai2 years ago•2 min saved

Nvidia introduces toolkit for safer and more secure AI text generation.

Nvidia has released an open source toolkit called NeMo Guardrails to make AI-powered apps that generate text and speech more accurate, appropriate, on topic, and secure. The toolkit is designed to work with most generative language models and can be used to prevent models from veering off topic, responding with inaccurate information or toxic language, and making connections to "unsafe" external sources. However, Nvidia acknowledges that the toolkit isn't perfect and won't catch everything.

via TechCrunch|

#ai #language-models #nemo-guardrails

artificial-intelligence2 years ago•3 min saved

Nvidia introduces Guardrails toolkit to improve accuracy of AI chatbots.

Nvidia has launched NeMo Guardrails, a software that can prevent AI models from stating incorrect facts, talking about harmful subjects, or opening up security holes. The software can add guardrails to prevent the software from addressing topics that it shouldn't, force a chatbot to talk about a specific topic, head off toxic content, and prevent LLM systems from executing harmful commands on a computer. NeMo Guardrails is open source and offered through Nvidia services and can be used in commercial applications.

via CNBC|

#ai-chips #artificial-intelligence #large-language-models