Dokumentdetails
ID
oai:arXiv.org:2403.09720
Thema
Computer Science - Computation and... Computer Science - Artificial Inte...Autor
Sun, PingweiKategorie
Computer Science
Jahr
2024
Auflistungsdatum
20.03.2024
Schlüsselwörter
modelsZusammenfassung
Accurately handling the underlying support values in sentences is crucial for understanding the speaker's tendencies, yet it poses a challenging task in natural language understanding (NLU).
In this article, we explore the potential of fine-tuning and prompt tuning in this downstream task, using the Human Value Detection 2023.
Additionally, we attempt to validate whether models can effectively solve the problem based on the knowledge acquired during the pre-training stage.
Simultaneously, our interest lies in the capabilities of large language models (LLMs) aligned with RLHF in this task, and some preliminary attempts are presented.
Sun, Pingwei, 2024, Fine-tuning vs Prompting, Can Language Models Understand Human Values?
Configurable Safety Tuning of Language Models with Synthetic Preference Data
data preference cst dpo configurable language safety
Affective flexibility as a developmental building block of cognitive reappraisal: An fMRI study
cognitive success affective flexibility
