NGINX Community Blog

Tag: ai

  • Introducing Agentic Observability in NGINX: Real-time MCP Traffic Monitoring

    Introducing Agentic Observability in NGINX: Real-time MCP Traffic Monitoring

    —

    by

    Dmitry Volyntsev, Michael Vernik
    in

    Today we’re announcing the availability of a new open source module that enables real-time insights into Model Context Protocol (MCP) traffic processed by NGINX. This capability empowers NGINX operators to trace and monitor activity from AI agents, enabling the ability to spot error-prone agents, high latency MCP tools, throughput disparities between MCP servers, and much…

  • NGINX Community Spotlight: An HTML-to-Markdown Module for the AI Web, Built in Rust

    NGINX Community Spotlight: An HTML-to-Markdown Module for the AI Web, Built in Rust

    —

    by

    Liam Crilly
    in

    The NGINX plugin community has always been prolific, and sometimes a contributor builds something that lands at the intersection of a real problem and a clean architectural instinct. That is what Kang did with nginx-markdown-for-agents, a self-hostable NGINX dynamic module described in a recent DEV post. The module returns a Markdown version of an HTML…

  • NGINX Gateway Fabric Supports the Gateway API Inference Extension 

    NGINX Gateway Fabric Supports the Gateway API Inference Extension 

    —

    by

    Micheál Kingston
    in ,

    Running inference at scale introduces complexities that ordinary routing can’t resolve. LLMs and other generative AI workloads differ fundamentally from standard web services. With NGINX Gateway Fabric (NGF) version 2.2, organizations can now tap into the Gateway API Inference Extension to enable smart, inference-aware routing in Kubernetes. Platform and ML teams can publish self-hosted GenAI…