Filter by type:
Filter by tags:
gustavecortal_beck-4b
A language model that handles delicate life situations and tries to really help you.
Beck is based on Piaget and was finetuned on psychotherapeutic preferences from PsychoCounsel-Preference.
Methodology
Beck was trained using preference optimization (ORPO) and LoRA. You can reproduce the results using my repo for lightweight preference optimization using this config that contains the hyperparameters.
This work was performed using HPC resources (Jean Zay supercomputer) from GENCI-IDRIS (Grant 20XX-AD011014205).
Inspiration
Beck aims to reason about psychological and philosophical concepts such as self-image, emotion, and existence.
Beck was inspired by my position paper on emotion analysis: Improving Language Models for Emotion Analysis: Insights from Cognitive Science.
Repository: localaiLicense: apache-2.0