Data and models for the paper "Configurable Safety Tuning of Language Models with Synthetic Preference Data"

"Merging Improves Self-Critique Against Jailbreak Attacks", code and models

Materials for the course: AI ML & Analytics

distilled Self-Critique refines the outputs of a LLM with only synthetic data

Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs

A curated and updated list of relevant articles and repositories on Reinforcement Learning from AI Feedback (RLAIF)

ZYN: Zero-Shot Reward Models with Yes-No Questions

Automatic and zero-shot critique of outputs using the OpenAI API with json outputs

Neural text classifier using pytorch for legal sentences

Personalization for Stable Diffusion via Aesthetic Gradients 🎨

Semantic search over paintings databases using deep learning

Experiments for the paper RL under Threats

API for the GPT-J language model 🦜. Including a FastAPI backend and a streamlit frontend

My personal webpage

A personal blog and wiki about language models, reinforcement learning and what not.

Code for the paper "Current advances in neural networks"