Crazy? System prompt leaks are old news with dozens of trix to do it
back
2 comments
mitmproxy
In your mind do you think the user request goes straight to the LLM???
I hope that's not what people are doing
I only figure [older pulls of Mistral 7b] were doing it, since it was so easy to exfiltrate false names, so I don't mean it's totally unheard of, but in 2026 I hope people are treating the LLM as untrustworthy - like the client in client/server setups.
In naive implementations like Grok that is exactly what happens.
Does Grok not have native models? What are you saying precisely