今日已更新 80 条资讯 | 累计 20052 条内容
关于我们

Is it possible overload a AI as a Service with multiples requests ?

sc0v0ne 2026年06月13日 20:31 2 次阅读 来源:Dev.to

I was thinking about some tests for a service that uses language models; there are several, even prompt injection. A question came to mind: is it possible to make multiple requests asking for any text like Lorem Ipsum, generating many unnecessary tokens and incurring costs? But creating a test where there are multiple accounts making the same request to generate 10,000 Lorem Ipsum tokens simultaneously, could that cause a service outage? Because most of the infrastructure I see doesn't use any queuing method when the chat is free of tasks involving an agent or even heavier functionalities. I didn't actually generate anything, I just wanted to start a discussion on this topic.

本文内容来源于互联网,版权归原作者所有
查看原文