LLM Cost Attribution with OTel, Next.js for AI Agents, LLM Security Testing

LLM Cost Attribution with OTel, Next.js for AI Agents, LLM Security Testing Today's Highlights This week, we delve into practical strategies for managing LLM costs in production using OpenTelemetry and explore Next.js 16.2's new tooling for building AI agent frontends. We also examine an experiment on LLMs' ability to exploit application vulnerabilities, emphasizing security in applied AI. Per-project LLM cost attribution with OTel spans: the wiring (Dev.to Top) Source: https://dev.to/jasmine_park_dev/per-project-llm-cost-attribution-with-otel-spans-the-wiring-3897 This article details a practical approach to attributing Large Language Model (LLM) costs to specific teams or projects within an organization. Facing a common problem of LLM bills appearing as a single line item, the author describes how to implement granular cost tracking using OpenTelemetry (OTel) spans. The core idea involves instrumenting the LLM gateway to tag every request span with relevant metadata like team.id and llm.model_name . This allows for detailed reporting and chargebacks, enabling organizations to understand and manage their LLM expenditure effectively. The implementation focuses on "the wiring" behind this system, leveraging OTel for observability. By attaching custom attributes to spans, teams can aggregate usage data by project, department, or even specific application features. This moves beyond opaque cloud invoices to actionable insights, a crucial step for companies scaling their AI adoption and seeking to optimize resource allocation and financial accountability for generative AI services. The article provides a blueprint for integrating this mechanism into existing LLM infrastructure. Comment: Setting up OTel spans for LLM cost attribution is a game-changer for production environments, finally giving us visibility into who's spending what on which models. This technique is essential for scaling LLM applications sustainably. Next.js 16.2: Deeper Tooling for AI Agents (InfoQ) So