Documentdetail
ID kaart

oai:arXiv.org:2408.15232

Onderwerp
Computer Science - Computation and... Computer Science - Artificial Inte... Computer Science - Information Ret... I.2.7 H.5.2 H.3.3
Auteur
Jiang, Yucheng Shao, Yijia Ma, Dekun Semnani, Sina J. Lam, Monica S.
Categorie

Computer Science

Jaar

2024

vermelding datum

23-10-2024

Trefwoorden
language discourse unknown unknowns users user co-storm
Metriek

Beschrijving

While language model (LM)-powered chatbots and generative search engines excel at answering concrete queries, discovering information in the terrain of unknown unknowns remains challenging for users.

To emulate the common educational scenario where children/students learn by listening to and participating in conversations of their parents/teachers, we create Collaborative STORM (Co-STORM).

Unlike QA systems that require users to ask all the questions, Co-STORM lets users observe and occasionally steer the discourse among several LM agents.

The agents ask questions on the user's behalf, allowing the user to discover unknown unknowns serendipitously.

To facilitate user interaction, Co-STORM assists users in tracking the discourse by organizing the uncovered information into a dynamic mind map, ultimately generating a comprehensive report as takeaways.

For automatic evaluation, we construct the WildSeek dataset by collecting real information-seeking records with user goals.

Co-STORM outperforms baseline methods on both discourse trace and report quality.

In a further human evaluation, 70% of participants prefer Co-STORM over a search engine, and 78% favor it over a RAG chatbot.

;Comment: EMNLP 2024 Main

Jiang, Yucheng,Shao, Yijia,Ma, Dekun,Semnani, Sina J.,Lam, Monica S., 2024, Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversations

Document

Openen

Delen

Bron

Artikelen aanbevolen door ES/IODE AI

Comparison between Dual-Energy CT and Quantitative Susceptibility Mapping in Assessing Brain Iron Deposition in Parkinson Disease
nigra substantia healthy depositions p < 05 nucleus brain susceptibility ct bilateral dual-energy iron quantitative mapping values magnetic globus pallidus
Integration of human papillomavirus associated anal cancer screening into HIV care and treatment program in Pakistan: perceptions of policymakers, managers, and care providers
hpv hiv msm transgender women anal cancer screening integration pakistan system managers pakistan informants anal screening cancer lack healthcare hiv