Discussion on "Jira Local LLM Integration: LM Studio per Project"

Mihai_LeanZero · 2026-10-14T10:59:05.405Z

This is a Jira LLM integration where the LLM is local. One Jira Cloud project sends its AI checks to qwen/qwen3.6-35b-a3b in LM Studio on our Mac Studio, and the other projects on the site stay on the

Really appreciated that you deliberately broke the token to show the FAIL-OPEN row instead of only showing the happy path. For a privacy check like the HR example, fail-open means a Mac Studio reboot quietly lets sensitive requests through, so I'd be tempted to make that one project fail-closed and just block Send for Review with a clear message. How has the 35B-A3B MoE been on latency for the validator step? Keeping the model pinned in memory (no idle unload in LM Studio) seemed to matter a lot for first-request times in my experience.

Agreed on the HR project. 1.34.0 has an opt-in switch for part of that, under Slow self-hosted providers in Settings: with it on the move is refused with a "check is still running" message instead of going through. I haven't tested it, and it only covers a slow model. I didn't find anything for a plain error like a wrong token, that still fails open.

On latency, the model's own answers took 0.6 to 0.8 s at about 100 to 110 tok/s, and Send for Review took roughly 2.3 to 3.4 s end to end, apart from one 6.4 s first refusal I couldn't explain. I only ran that one model, so no MoE vs dense comparison.

Pinning I didn't test. All I have is 2.8 s for the first call of my session and 12 s on an idle model in our video run. Your guess that it matters is plausible, and 12 s against a 20 s validator limit is close enough to be worth checking.

Really valuable write-up, especially the part about testing what happens when the local model fails or the wrong token is used. The example involving sensitive HR information highlights an important point: keeping AI processing local doesn't automatically guarantee data privacy if logs and fallback behavior aren't handled carefully. At Oglas AI, we believe practical AI solutions need to be built around security, reliability, and real business requirements not just functionality. Great to see these real-world implementation details covered so clearly!

Thanks. The logs and fallback path were the part I most wanted to get across, glad it came through.

Thanks for the real numbers. 12 s on an idle model against a 20 s limit is tight, especially since a wrong token still fails open. A cheap fix is a small scheduled ping to the validator every few minutes. It keeps the model warm and also catches an auth error before a real Send for Review hits it.

Search Hashnode

Jira Local LLM Integration: LM Studio per Project

Responses5