New Relic, a pioneer in digital observability, has unveiled NOVA, an internal AI assistant designed to unify fragmented documentation and automate engineering tasks. Developed with the AWS Generative AI Innovation Center, the tool has evolved from a search engine into a productivity hub managing over 1,000 daily queries. By connecting to platforms like GitHub and Salesforce, NOVA has slashed information retrieval times from hours to under 20 seconds, allowing engineers to focus on building rather than searching.

The architecture relies on a sophisticated orchestration layer that handles complex tasks like team permission requests and service limit modifications. It leverages the Model Context Protocol, an emerging standard that allows the AI to interact with external tools in a consistent and secure manner. This design enables NOVA to operate as an Agentic AI, executing multi-step workflows across software ecosystems without requiring constant human oversight for routine technical adjustments.

To maintain reliability, New Relic uses an evaluation system where a separate AI acts as an auditor to score responses on accuracy. The platform utilizes Amazon Bedrock to switch dynamically between Amazon Nova Lite and Pro models, optimizing for either speed or reasoning depth. This tiered approach, combined with custom data enrichment, ensures NOVA delivers an 80% accuracy rate across the organization's vast technical knowledge base.

New Relic, a pioneer in digital observability, has unveiled NOVA, an internal AI assistant designed to unify fragmented documentation and automate engineering tasks. Developed with the AWS Generative AI Innovation Center, the tool has evolved from a search engine into a productivity hub managing over 1,000 daily queries. By connecting to platforms like GitHub and Salesforce, NOVA has slashed information retrieval times from hours to under 20 seconds, allowing engineers to focus on building rather than searching.

The architecture relies on a sophisticated orchestration layer that handles complex tasks like team permission requests and service limit modifications. It leverages the Model Context Protocol, an emerging standard that allows the AI to interact with external tools in a consistent and secure manner. This design enables NOVA to operate as an Agentic AI, executing multi-step workflows across software ecosystems without requiring constant human oversight for routine technical adjustments.

To maintain reliability, New Relic uses an evaluation system where a separate AI acts as an auditor to score responses on accuracy. The platform utilizes Amazon Bedrock to switch dynamically between Amazon Nova Lite and Pro models, optimizing for either speed or reasoning depth. This tiered approach, combined with custom data enrichment, ensures NOVA delivers an 80% accuracy rate across the organization's vast technical knowledge base.