Valutazioni e recensioni
AI Council
•
32 valutazioni
Mohammad Alhobayyeb
19 mag 2026
Versione app: 6.3.0
I added custom provider but I cannot use it. I cannot add it to Council Members models. What is the beneift of custom providers?
Gordon Dér
7 mag 2026
Versione app: 6.3.0
Seems great, but the models are not up to date. Cannot use this to verify current events or announcements. The Council decided a new announcement (which is objectively hyped, but not fake) is defintely fake, because they mention opus 4.6 level capabilities in the press release and Opus 4.6 is a non existing model. At the time of my test even Opus 4.7 is released….
Risposta dello sviluppatore
7 mag 2026
What you hit was a training-data cutoff issue, not an app bug. Every LLM is trained on data up to a fixed point in time. After that cutoff, the models have no knowledge of newer releases or announcements unless live search is enabled. So if Opus 4.6 or 4.7 launched after their training window ended, the models could confidently conclude it was fake or nonexistent. The models you query also depend on which API keys and providers you have configured. AI Council is BYOK, so reasoning quality and knowledge recency vary between providers and model versions. AI Council includes built-in web search specifically for this case. In Settings → Web Search, add a Tavily or Brave API key and a globe button will appear in the composer. Enable it before sending your prompt and the app will retrieve live sources before deliberating. With web search enabled, the app would have found current references to those model releases and grounded the response in live information rather than historical data.
Excellent Tool
29 apr 2026
Versione app: 6.2.6
I’m updating my initial review, in which I said that it wasn’t ripe yet due to the lack of its ability to add attache files, pictures, or text over 56k characters. All three of these features are now available. I tested it out on my Gemini, Grok, GPT-4o and Claude models and it worked great in all of the custom groups I created, including by speed (eg, Gemini Flash, Claude Haiku, etc.), and deep thinking (eg, Claude Opus, etc.). I think that this will become an indispensable tool, given its ability to cross-check, compare, and provide the best responses by category from any of my AI models of choice using their API keys. Take some of the other reviews with a grain of salt, since AI will inherently consume a lot of CPU, so if you have Intel or a weak processor you won’t have as smooth of an experience.
Risposta dello sviluppatore
30 apr 2026
Thank you for updating your review - it genuinely means a lot to us. AI Council coordinates multiple providers, concurrent API calls, anonymised peer review across models, and file and image handling. Ensuring reliability across all combinations of models and settings is complex, and issues do occur as you found out. Your original feedback identified key gaps and directly influenced what was prioritised. Good to see the custom groups working - the speed versus deep-thinking split is a core use case. Thank you for your patience and please do feedback with any features you feel may be worthwhile adding (or indeed if you spot any more gremlins!).
Eric
24 apr 2026
Versione app: 5.3
Extrêmement instable : échoue sur la moitié des requêtes, sans explications, particulièrement si elles sont complexes.
Risposta dello sviluppatore
24 apr 2026
Merci pour le retour honnête - nous le prenons au sérieux. La version 6.0, envoyée aujourd’hui en révision Setapp, corrige directement ce que vous décrivez : 1. Chaque erreur identifie désormais le fournisseur concerné, par exemple “Limite atteinte (anthropic)” au lieu d’un message générique. Plus d’échecs silencieux sans explication. 2. La synthèse du coordinateur diffuse les tokens en direct et relance automatiquement en cas d’erreur réseau transitoire. Auparavant, une session pouvait rester bloquée si un seul modèle bégayait - 6.0 récupère proprement. Pour les requêtes complexes, vous pouvez aussi ajouter votre propre clé OpenAI, Anthropic ou Google dans Réglages → Fournisseurs. AI Council l’utilisera avant de toucher les crédits Setapp, et vous isole ainsi sur un fournisseur fiable. Merci encore.
Keith Smith
20 apr 2026
Versione app: 5.2
Filled in my creds and still didn’t work
Risposta dello sviluppatore
21 apr 2026
Sorry about that - this was a real bug. The default council required models from multiple providers, so entering a single API key left the council one model short of the minimum and the chat silently stayed disabled. Fixed in 5.3 (awaiting review): the council now auto-completes with starter models from whichever provider you configured, so a single key unlocks the app immediately. Please try again after the 5.3 update - thanks for flagging it.
David
18 apr 2026
Versione app: 5.1
Hi developer,你可以让用户自定义 ai provider 的来源吗,我有一些第三方推理平台的渠道,但是看到设置菜单只有 big company 渠道的。我希望能设置推理来源的 url,而不是限定的那些渠道
Risposta dello sviluppatore
21 apr 2026
感谢您的反馈!您提到的自定义 AI Provider 来源的功能其实已经在您评论之后的 5.2 版本中加入。 使用方法:打开「设置」→「Providers」标签页,滚动到列表底部,您会看到「Custom Providers」区域。点击右侧的 + 按钮,就可以添加任何 OpenAI 兼容的推理端点 - 输入名称、Base URL(例如 https://your-endpoint.com/v1)和 API Key 即可。这样您就能接入任何第三方推理平台。 即将发布的 5.3 版本会把 MiniMax 和 Z.ai(GLM)作为内置 providers 加入,中国用户不需要走自定义 provider 路径也可以一键配置。5.3 已经开发完毕,正在等待审核上架。 如果升级后在使用中还有问题,欢迎继续反馈。感谢您的耐心! Thanks for the feedback. The custom AI provider feature you asked for was added in version 5.2, released shortly after your review. How to use it: Open Settings → Providers, scroll to the bottom of the provider list, and you’ll see a Custom Providers section. Tap the + button to add any OpenAI-compatible endpoint - enter a name, base URL (e.g. https://your-endpoint.com/v1), and your API key. You can route through any third-party inference platform this way. The upcoming 5.4 release additionally adds MiniMax and Z.ai (GLM) as first-class built-in providers, so users in China can configure them with one tap without needing the
Mark Reynolds
16 apr 2026
Versione app: 5.0
I’ve downloaded and installed several local models to use, but the app does not show them in the list of council members, so I’m only allowed to choose from OpenAI, Anthropic, and Google. The local models are shows in my local models list; the app sees them. The Council Members list, however, doesn’t even show them as an option.
Risposta dello sviluppatore
16 apr 2026
Thank you for reporting this. You’re right that the app supports two local-model paths, and only one currently appears in the Council Members list. If you install Ollama (ollama.com) and run ollama pull <model>, any model you pull will appear automatically in the Council Members picker on macOS. This path works end-to-end for both direct chat and councils. The “Link Local Model” feature that scans your disk for .gguf files is a separate path intended to help users locate existing models, but it does not yet run inference against them. That is why they appear in the Local Models list but not in the Council Members picker. This is a gap on our side rather than intended behaviour. We will address it in the next update, either by making linked models fully usable or by making the limitation explicit in the UI so it is not misleading. Apologies for the frustration in the meantime.
Turgut Derman
12 mag 2026
Versione app: 6.3.0
The concept and the application is. great one. But still has so many bugs. Even with API direct connections still dependent on Setapp credits. UI needs face not intuitive. Looking forward for future updates…
Gédry Swanepoel
5 mag 2026
Versione app: 6.2.6
Awesome concept but tired of timeouts and continued failing. I tokens, selected the bots I’ve got tokens with etc etc. Follw-up Faild - the network connection was lost (all the time!) Load Error - Failed to send continuation: The network connection was lost. WTF Just frustrating
Risposta dello sviluppatore
7 mag 2026
The timeouts and dropped connections you are experiencing happen because AI Council runs multiple long-running API calls in sequence - gathering responses, ranking them, and synthesising a final answer. If a network interruption occurs anywhere in that chain, the entire step can fail. The next release will improve retry handling so transient connection drops trigger automatic retries with back-off instead of surfacing immediately as errors. If you are seeing this consistently, it is also worth checking your API provider’s status page. Some providers, particularly free tiers, have higher latency and lower reliability, which becomes more noticeable during multi-model runs. Connection handling is continuing to be hardened in upcoming releases.
Justin
28 apr 2026
Versione app: 6.0
I want to like this app, but it is just unstable, admittedly I am using an Intel Macbook so that might be part of it, but I am finding that it keeps timing out on requests even though the AI models themselves all state that they recived them, I do not have this issue with things like the CLI interfaces or native apps, I am sure its just a bug and teething issues, but still it is most annoying
Risposta dello sviluppatore
5 mag 2026
Thanks for the feedback - and the Intel context. This review reflects v6, and a number of changes have shipped since. Two points are relevant to what you described: Between v6 and the current release, the per-request timeout was tightened to provide faster failure feedback. That addressed long spinner complaints, but it also made behaviour worse for slow reasoning models such as Claude Opus or o3-class thinking. In those cases, the provider has received the prompt but is still processing when the timeout is reached, which matches your symptom. The next release, currently in review, adds an automatic single retry on transient timeouts and dropped sockets for follow-up and continuation replies. It also normalises error messages so failures return a clear typed reason rather than a raw system string. Apologies for the frustration caused!
Juan Carlos Jiménez Magaña
23 apr 2026
Versione app: 5.3
Me parece que la idea es muy buena, pero hasta ahora solo me ha dado respuestas incorrectas y completamente inventadas, por lo que no confío en su uso. Además que he gastado mis tokens inútilmente
Risposta dello sviluppatore
24 apr 2026
Gracias por la crítica honesta - la frustración es justa y lamentamos los créditos perdidos. Las alucinaciones son un problema real de todos los LLMs. En la versión 6.0, enviada hoy a revisión de Setapp, añadimos Búsqueda Web con 8 proveedores (Tavily, Brave, Exa, You.com, Kagi, SerpAPI, Perplexity, Google). Cada respuesta muestra las fuentes reales como enlaces clicables, para que puedas verificar de dónde viene la información. Para no gastar créditos de Setapp: en Ajustes → Proveedores puedes añadir tu propia clave de OpenAI, Anthropic o Google. AI Council la usará antes de tocar los créditos gestionados de Setapp. No existe una suscripción separada de AI Council. El cupo es parte de tu plan de Setapp AI, gestionado por Setapp. Gracias por la señal.
Jason
19 apr 2026
Versione app: 5.2
I’m going to give this a thumbs up as to not pile on, but, this app needs some work. Good idea, and solid executation, but… It doesn’t recognize my SetApp credit at all. It did a few generations and then told me I was out of credit.
Risposta dello sviluppatore
21 apr 2026
Thanks for the thumbs up, and for the honest feedback - you caught a real bug. A single transient 402 from the Setapp AI gateway was locking the “out of credits” state on for an hour, even after subsequent calls succeeded. So a momentary hiccup on MacPaw’s side would tell you you’d run out when you hadn’t. 5.3 (awaiting review) clears the exhausted flag the instant any request goes through successfully. Also worth knowing: Setapp AI credits are a separate pool from your main Setapp subscription (10/month on base, 125 on AI+ Enthusiast, 250 on Expert). 5.3 also uses cheaper models by default so credits stretch further. Please give it another try once 5.3 lands. Thanks!
Tihomir
17 apr 2026
Versione app: 5.1
This is a very rough first version to be honest. The markdown is not displayed very well, more speificaly the tables. The UI feels like jumping in some places
Risposta dello sviluppatore
21 apr 2026
Fair feedback - both were real. Both fixed in recent updates: Markdown tables: the table parser was rebuilt in 5.2. It now handles empty cells, inline formatting (bold, italic, code, links) inside cells, and column alignment syntax. UI jumping: two causes. The chat view re-parsed markdown on every update and used unstable list IDs, which caused flicker and scroll jumps - rewritten in 5.2 with native SwiftUI markdown and stable message identifiers. A conversation-switching bug in 5.3 (awaiting review) finishes the job on the remaining jumpiness around stage transitions. Please update and let us know how it feels. Thanks!
Timbo
8 mag 2026
Versione app: 6.3.0
I’m just a casual user, running GTP5.5 (as chair), Sonnet 4.6 and Gem Pro 2.5, but I have found the app to work well for my admittedly basic needs and have not hit any issues that have prevented it from producing satisfactory results.
PP
3 mag 2026
Versione app: 6.2.6
Works great with the standard models, unfortunately cannot use anything from Mistral with own API keys (testing shows 0 models found).
Risposta dello sviluppatore
5 mag 2026
Thanks for flagging this - you are right, and the bug is on us. Mistral’s /v1/models endpoint reports its models with a type value our filter was not expecting, so the listing was being silently dropped to zero. Every Mistral chat model your key can access (mistral-large, medium, small, codestral, ministral, devstral, magistral, pixtral, open-mistral-nemo) was unreachable because of it. The fix is in the next release, now in review. Once it lands, deleting and re-entering your Mistral key, or hitting “Test” again, will pull the full catalogue. The same release also fixes the custom OpenAI-compatible provider issue and the “network connection was lost” pop-ups on follow-up replies. Sorry for the frustration caused.
Jerry Robin
24 apr 2026
Versione app: 5.3
I asked only a few questions and my MONTHLY allotment is used up? Seems like more of a hook to purchase a separate subscription to AI Council!
Risposta dello sviluppatore
24 apr 2026
Thank you for the honest review - the frustration is fair. Each Council question runs in stages and touches 3-4 models, so the base Setapp plan’s small credit pool can be consumed quickly. That is a real UX problem, not a trick. To be clear: there is no separate AI Council subscription. The credit allotment is part of your Setapp AI plan, set and billed by Setapp. We do not receive anything from an AI+ upgrade. To stretch your credits: add your own LLM provider key in Settings → Providers. AI Council routes through your key before ever touching Setapp credits, so a BYOK key on one provider cuts your credit burn per Council question significantly. You can mix BYOK providers with Setapp-routed ones in the same Council. 6.0, submitted for Setapp review today, also makes Apple Intelligence a first-class member on Apple silicon (free, on-device, no credits), clears the credit-exhausted banner when your balance recovers, and tightens several BYOK routing paths.
Daniel Bergquist
21 apr 2026
Versione app: 5.2
Great in concept, but I keep running into bugs: * Takes a long time to timeout if it can’t connect, ruining flow. I’ve had issues with and without unused tokens. * I’ve had one conversation running (call it A), created another one (call it B), tried to return to A, but the app will only show me B’s content. * It timed out/errored on Chair’s Synthesis, but offered me a button reading “Generate Chair’s Report”, but the button is unresponsive. The only way I have been able to make forward progress is by copying context, deleting all conversations, and then pasting context in anew conversation. I get one full prompt-> Chair -> Council -> Chair -> output cycle before it starts bugging out. This of course burns through more tokens. Would also love to see LMStudio support
Risposta dello sviluppatore
21 apr 2026
Thanks - all three bugs are fixed in 5.3 (awaiting review). Connection timeout: dropped per-request limits from 120 - 180s to 60 - 90s. Unreachable endpoints now fail fast so you keep flow. Conversation A showing B’s content: the orchestrator was holding stale results across conversations. It now resets on every switch, so A always shows A. “Generate Chair’s Report” unresponsive: errors from that retry path were silently swallowed. They now surface as a visible banner with the specific failure, and the cross-run state leak that caused the “one cycle then bugs out” pattern is gone. LM Studio: already supported. Start LM Studio’s local server, then in Settings → Providers pick LM Studio (Local). Your loaded models appear in the council picker, no API key needed. Thanks for the thorough report - it was genuinely useful.
Clem
19 apr 2026
Versione app: 5.1
Seemed interesting, could make one request on the first day, but says that I have no more SETAPP tokens…
Risposta dello sviluppatore
21 apr 2026
Sticky “out of credits” banner: a single transient 402 from the Setapp AI gateway locked the banner on for an hour even after subsequent calls succeeded. Fix: the exhausted flag now clears as soon as any successful response comes through. Credit confusion: Setapp AI is a separate credit pool from your main Setapp subscription - base plans get 10 AI credits/month, AI+ Enthusiast 125, Expert 250. A single council question uses several calls. 5.3 adds clearer messaging and cheaper defaults so you do not burn through credits as quickly. Please try again once 5.3 lands. Thanks
Danilo Marinucci
16 apr 2026
Versione app: 5.0
The idea behind the app is interesting, but unfortunately it doesn’t work as expected. It reports that Setapp has no credits left, while Setapp clearly shows that credits are still available. When trying to use models with personal API keys, the configuration fails: the app keeps pointing to Setapp models and does not allow the use of local models for councils. Overall, the setup process is complicated, unclear, and likely not fully functional—or at least very difficult to get working properly. In its current state, the app feels deeply immature.
Risposta dello sviluppatore
16 apr 2026
Thank you for the review. A few clarifications: 1. “Setapp has no credits” - Setapp AI credits (MacPaw’s AI gateway) are tracked separately from your Setapp subscription credits. When the gateway returns 402, your AI allocation is exhausted even though your main Setapp account is active. Our error copy needs to make this clearer and we will update it. 2. “Keeps pointing to Setapp models with personal keys” - BYOK takes priority over Setapp AI automatically. Once you add an OpenAI or Anthropic key, those providers route through your key. The model IDs in the council look the same, but the routing path changes. A related bug affecting follow-up messages was fixed in 5.1. 3. “No local models for councils” - Ollama is supported on macOS. The council is pre-filled with Setapp AI models on first launch; open Settings > Council to swap them for your local models. We will make this more discoverable. A patch is in preparation to fix these points.