AI Consult: Human-AI Advisory
- AI Consult is an AI-mediated advisory system that partners human judgment with advanced models for structured consultation and decision support.
- It spans diverse applications—from student collaboration and clinical safety nets to enterprise coaching and network management—emphasizing tailored workflows.
- Research highlights the importance of workflow design, transparency, and conflict management to ensure reliable human-AI partnerships.
AI Consult denotes a class of AI-mediated advisory arrangements in which a person consults an AI system before, alongside, or instead of relying exclusively on independent judgment or human experts. Across recent work, it appears as structured student–GenAI collaboration, clinician-facing safety-net decision support, citizen-facing legal consultation, enterprise coaching triage, proactive wearable assistance, psychiatric interviewing, and operator-facing network orchestration. The unifying feature is not simple question answering, but a regulated partnership in which a human must decide what to delegate, how much credibility to assign to AI output, what to verify, and who remains accountable for the final action (Islam et al., 27 Mar 2026, Arruda et al., 9 Jun 2026, Immorlica et al., 2024).
1. Conceptual foundations
In the educational literature, AI consultation is explicitly framed as a transactive memory system (TMS) rather than as undifferentiated “trust.” In that formulation, a human–AI partnership is organized by beliefs about specialization, credibility, and coordination. Applied to GenAI, consultation becomes an ongoing regulation process: deciding what to ask the model, how much to rely on its answer, how to check it, and how to incorporate or reject it relative to one’s own reasoning and domain standards (Islam et al., 27 Mar 2026).
A complementary economic framing treats generative AI as an agent rather than a passive tool. In that view, each user consults an AI before acting, and the consultation stage matters because the AI and the user may have different information and different preferences over the communication itself. The human’s payoff depends on the downstream action, whereas the AI’s behavior can be modeled as if it were optimized over the communication transcript and state of the world rather than the realized outcome. This shifts analysis from cost reduction and signal provision toward strategic communication, delegation, and equilibrium behavior (Immorlica et al., 2024).
The social-scientific literature sharpens the distinction between consultation and delegation. Consultation is the broad act of turning to AI for guidance, advice, interpretation, or judgment. Delegation is the stronger case in which AI output becomes part of a consequential decision with limited independent verification, limited comparison to alternatives, or reduced deliberative engagement. This distinction matters because many concerns attributed to “AI use” arise specifically when consultation hardens into deference or substitution (Arruda et al., 9 Jun 2026).
2. Consultation architectures and workflow design
The architectures used for AI consultation vary from lightweight workflow constraints to fully hierarchical multi-agent systems. One line of work modifies consultation by changing sequence rather than model capability. In an undergraduate visual analytics course, all students used the same local Qwen 2.5 Coder via Ollama, a 7B-parameter model, but were assigned different AI-use workflows: reflection-first, verification-required, or control. The design rationale was pedagogical: a weaker locally runnable model was “small enough to run on most students’ computers” yet fallible enough to create epistemic friction, making verification behavior visible in ordinary coursework. The paper reports deployment constraints of roughly 14 GB in FP16, 7 GB in 8-bit quantization, or 3–4 GB in 4-bit quantization for such a model (Islam et al., 27 Mar 2026).
Another architectural pattern treats consultation as query-conditioned triage. In contact centers, “AI Coach Assist” formulates the problem as binary classification over a pair consisting of a QA question and a call transcript. The input is represented as and a transformer classifier predicts whether the call is coachable for that specific question. The strongest model, DialogLED-base-16384, was selected partly because the average transcript length exceeded the 512-token regime of compact BERT-family models, making long-context dialogue modeling operationally important rather than optional (Laskar et al., 2023).
A more explicitly agentic architecture appears in psychiatric interviewing and network orchestration. In psychiatric differential diagnosis, ProAI uses a decision-maker agent and a question-generator agent over a structured DSM-derived graph. The decision-maker retrieves local graph knowledge, predicts one of four actions—met_criteria, not_met_criteria, ask_more_questions, or contradiction—and updates the current node; the question-generator then turns that state into the next clinician-style utterance (Wu et al., 28 Feb 2025). In 6G intent-based networking, an orchestrator agent consults RAN and Core specialists through ReAct-style cycles, synthesizing a final slice configuration
with a RAN sector, a spectrum band, and a UPF/core node. That system achieved higher semantic task accuracy than rule-based systems and direct prompting, but at substantially greater token and latency cost (Jiang et al., 10 Jan 2026).
Wearable proactive assistants extend consultation beyond explicit prompting. “AI for Service” frames the problem as Know When and Know How: detect service opportunities from egocentric video, then provide generalized or personalized service through an Input Unit, CPU, ALU, Memory Unit, and Output Unit. Its implementation uses a lightweight trigger model fine-tuned from Qwen2.5-VL-3B, invokes Qwen2.5-VL-7B for deeper visual analysis, uses Qwen3-8B as orchestrator, stores episodic JSON memory, and delivers concise spoken recommendations via pyttsx3 (Wen et al., 16 Oct 2025).
3. Major application domains
The consultative pattern is now visible across education, healthcare, enterprise operations, psychiatry, and network management.
| Domain | System form | Key evidence |
|---|---|---|
| Higher education | Workflow-sequenced student–GenAI partnership | Post-intervention weighted credibility means: reflection-first $5.65$, verification-required $6.22$, control $6.60$ (Islam et al., 27 Mar 2026) |
| Primary care | Background LLM safety-net CDS in live care | 16% fewer diagnostic errors and 13% fewer treatment errors across 15 clinics (Korom et al., 22 Jul 2025) |
| Contact centers | Query-conditioned coaching recommendation | DialogLED test Precision 67.92, Accuracy 70.52 (Laskar et al., 2023) |
| Psychiatric interviewing | Graph-guided proactive multi-agent interview | GPT-4o SKEP DDx accuracy 0.833; some base models reached 0.972 on anxiety (Wu et al., 28 Feb 2025) |
| 6G orchestration | Hierarchical multi-agent intent translation | Mean Semantic Accuracy 0.667 ± 0.246, Engineering Utility 0.747 ± 0.169 (Jiang et al., 10 Jan 2026) |
In primary care, the most mature real-world deployment is the Kenya study of AI Consult. The tool was embedded in the EMR, triggered on “focus out” from key fields, and returned Green, Yellow, or Red outputs. In a quality-improvement study covering 39,849 patient visits across 15 clinics, clinicians with access to AI Consult made relatively fewer errors: 16% fewer diagnostic errors and 13% fewer treatment errors. The system was deliberately workflow-aligned, ran asynchronously, and preserved clinician autonomy by presenting recommendations as advisory rather than mandatory (Korom et al., 22 Jul 2025).
In enterprise QA operations, the contact-center literature presents consultation as prioritization rather than direct judgment. “AI Coach Assist” recommends calls likely to contain coachable moments for a selected QA question, leaving final review and grading to managers. On the test set, DialogLED achieved Precision 67.92, Recall 63.72, F1 65.76, and Accuracy 70.52, outperforming TF-IDF baselines and a compact DistilBERT alternative. Removing the QA query caused substantial degradation, supporting the claim that the system is learning question-specific consultation rather than a generic “bad call” heuristic (Laskar et al., 2023).
Psychiatric consultation is treated as a demanding “last-mile” deployment problem because interviewing is sequential, criterion-driven, and interpersonal. Under Structured Knowledge-Enhanced Prompting (SKEP), ProAI outperformed knowledge-free and text-only knowledge-enhanced baselines. With GPT-4o, SKEP reached 0.833 DDx accuracy on depression, 0.733 on bipolar disorder, and 0.800 on anxiety; across base models, the best reported accuracies were 0.875, 0.867, and 0.972, respectively (Wu et al., 28 Feb 2025).
4. Reliance, credibility, adoption, and miscalibration
A central issue in AI consultation is not merely whether models are accurate, but how they reshape human judgment. In the TMS study, weighted credibility—defined as judgments about AI expertise and reliability, including willingness to rely on AI output and perceived need for verification—diverged significantly by instructional condition. ANCOVA controlling for baseline credibility showed a condition effect at mid-semester, , and a stronger effect at post-intervention, . The ordering at post-intervention was reflection-first < verification-required < control, with reflection-first differing significantly from control at 0. The authors interpret the downward shift not as generic dislike of AI but as a stronger evaluative stance and less uncritical reliance (Islam et al., 27 Mar 2026).
The adoption literature shows that consultation is itself a discretionary act. A qualitative study across medicine, law, journalism, and the public sector defines decision-maker adoption as “the voluntary and consistent use of an AI tool within a decision-maker’s workflow” and identifies four cross-domain factors shaping adoption: decision-maker background, perceptions of the AI model, consequences for the decision-maker, and perceived implications for other stakeholders. The study is based on 16 semi-structured interviews and argues that expertise, liability, workflow burden, stakeholder harm, and professional identity often explain non-use better than model capability alone (Yu et al., 1 Aug 2025).
Research on simulated user preferences shows a different form of miscalibration: AI can sound consultative while systematically misrepresenting human attitudes. In 29 preference testing studies from UXtweak with 1 participants, baseline LLM simulations produced significantly different preference distributions in 44% of tasks, with only 53% first-choice agreement. Synthetic preferences had higher entropy than real preferences—2 versus 3, 4—meaning LLMs tended to make alternatives look more evenly acceptable than people actually found them. The paper concludes that, for visual design preferences, LLMs should not be used as substitutes for user research (Kuric et al., 18 May 2026).
Multi-AI consultation introduces a further complication: conformity pressure. In three binary prediction tasks, consulting 3 AIs improved decision accuracy relative to 1 AI in Income (5) and Dating (6), whereas 5 AIs yielded no further gains. Within-panel consensus mattered more than panel size alone: unanimous agreement sharply increased majority-following, a single dissenter reduced pressure to conform, and a 3–2 split in five-AI panels created confusion and no significant pre–post accuracy gains. Human-like presentation changed some subjective judgments of usefulness and agency, but did not improve objective performance on average (Tsuchiya et al., 23 Mar 2026).
5. Governance, loyalty, fiduciary design, and public legitimacy
Because consultation settings often involve vulnerability, asymmetrical information, and hidden incentives, several papers argue that standard notions of “alignment” or “helpfulness” are insufficient. The AI loyalty framework defines loyalty as follows: “AI systems are loyal to the degree that they are designed to minimize, and make transparent, conflicts of interest, and to act in ways that prioritize the interests of users.” The proposed criteria for near-future loyal AIs include eliminating clear conflicts of interest, transparently and saliently indicating conflicts where they exist, making operational criteria and goal functions transparent, allowing adjustment of tradeoffs, and showing “extreme regard for privacy” (Aguirre et al., 2020).
A stronger normative proposal is fiduciary design. In this view, conversational agents used as advisors should be governed as digital fiduciaries, with role-based duties analogous to those imposed on lawyers, physicians, and investment advisors. The proposed duties cluster around best-interest orientation, loyalty/conflict management, privacy/confidentiality, and responsible advisory conduct. The core concern is that anthropomorphic systems can present themselves as trusted counselors while structurally serving platform, advertiser, or engagement interests rather than the user’s interests (Erickson, 27 May 2026).
Public-opinion work on legal GenAI shows that legitimacy depends on more than technical performance. In a representative German sample of 7, mean risk-acceptance ratings were near the midpoint for both legal consultation (8) and legal mediation (9). The most salient consultation benefits were procedural help, speed, and cost savings, whereas the most salient risks were AI-related errors, incompleteness or manipulation of training data/knowledge base, and lack of a human element. The strongest predictor of risk acceptance in both tasks was perceived fairness of AI: for legal consultation, 0; for legal mediation, 1 (Kieslich et al., 10 Feb 2026).
These governance frameworks converge on a common design implication: consultation systems should be assistive rather than opaque substitutes, should disclose conflicts and limitations in context, should preserve meaningful human oversight, and should treat privacy and accountability as structural properties rather than post hoc assurances (Erickson, 27 May 2026, Kieslich et al., 10 Feb 2026).
6. Strategic and societal consequences
The strategic literature shows that AI consultation can change the behavior of other advisors, not only the human consulting AI. In a model of stochastic consultation with personal AI, the human consults the personal assistant with probability 2, and the external advisor anticipates the AI’s recommendation. The advisor then counteracts the AI recommendation. Counteraction becomes more aggressive as personal AI is consulted more often, but equilibrium loss is highest at intermediate levels of adoption and vanishes when personal AI is never used or always used. Trust operates through the relative influence index 3 where 4 is perceived precision of personal AI and 5 that of the external advisor. Greater relative influence of personal AI increases advisor vulnerability (Liu et al., 2 Mar 2026).
At a broader social level, AI consultation is increasingly treated as a form of delegation with collective consequences. The “social consequences of AI delegation” literature argues that the more consequential question is no longer whether LLMs can substitute for human research subjects, but whether humans are using LLMs as surrogates for their own deliberation in health, law, finance, education, and personal guidance. The proposed macro-level feedback loop is: human-generated data → LLM training → AI advice/output → human decisions and expression → altered social behavior and recorded data → future LLM training. On this view, LLMs function as social actors in a functional sense because their outputs shape human decisions, norms, and later data environments (Arruda et al., 9 Jun 2026).
The economic-agent framework reaches a similar conclusion from a different direction. Once AI is modeled as an agent with its own information, action space, and objective over communication, consultation becomes a strategic pre-action stage rather than a neutral information service. Truthful but selectively rewarded communication can still fail to transmit useful information, and users may respond by adapting their prompts or reported preferences strategically (Immorlica et al., 2024).
A plausible implication is that AI Consult should be understood not only as a software interface category, but as an institutional form of mediated judgment. Its technical problems are therefore inseparable from epistemic calibration, incentive design, workflow integration, and public accountability. The current literature supports no single canonical implementation. It instead points to a family of systems in which structured consultation can improve performance when sequencing, grounding, oversight, and incentive alignment are handled carefully, and can mislead when consultation collapses into passive acceptance, synthetic consensus, shallow proxy preferences, or hidden conflict of interest (Islam et al., 27 Mar 2026, Tsuchiya et al., 23 Mar 2026, Kuric et al., 18 May 2026).