When AI Advice Is Not Enough: Institutional Design with Behavioral Frictions and Scarce Verification

Vol 57, 2025 - 339723
Trabalho completo (Oral)
Favoritar este trabalho
Como citar esse trabalho?
Resumo

Organizations often deploy AI first and redesign workflows later. We model a clinician who records a preliminary assessment, observes a fixed AI risk score, and then treats, withholds treatment, or seeks verification. Verification may generate independent clinical evidence or may explain the AI output and reduce the burden of reversing the clinician's initial judgment. The model shows why AI value depends on governance. Flexible exposure weakly improves the clinician's perceived loss relative to the clinician-only benchmark because the clinician can ignore the score. Divergence frictions, however, shift treatment thresholds toward the reference action and make verification attractive as justification. Poorly chosen selective binding can then make the deployed AI worse than no AI for the organization. We characterize an optimal policy map: bind when enforcement lowers planner loss, assign scarce orthogonal verification by incremental benefit relative to the best non-orthogonal workflow, and choose explainability by comparing reduced operating losses.

Compartilhe suas ideias ou dúvidas com os autores!

Sabia que o maior estímulo no desenvolvimento científico e cultural é a curiosidade? Deixe seus questionamentos ou sugestões para o autor!

Faça login para interagir

Tem uma dúvida ou sugestão? Compartilhe seu feedback com os autores!

Instituições
  • 1 Universidade de Brasília
Eixo Temático
  • PO&IA – Pesquisa Operacional com Inteligência Artificial
Palavras-chave
Artificial intelligence
Human-AI collaboration
Decision analysis