158 34 55

Leandro von Werra

lvwerra

https://github.com/lvwerra

AI & ML interests

NLP and RL

Articles

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 35

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 71

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 272

StarCoder2 and The Stack v2

Feb 28

• 5

Constitutional AI with Open LLMs

Feb 1

• 11

Preference Tuning LLMs with Direct Preference Optimization Methods

Jan 18

• 33

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

Dec 11, 2023

• 9

The N Implementation Details of RLHF with PPO

Oct 24, 2023

• 16

Finetune Stable Diffusion Models with DDPO via TRL

Sep 29, 2023

• 4

Spread Your Wings: Falcon 180B is here

Sep 6, 2023

• 4

Code Llama: Llama 2 learns to code

Aug 25, 2023

• 4

Fine-tune Llama 2 with DPO

Aug 8, 2023

• 25

The Falcon has landed in the Hugging Face ecosystem

Jun 5, 2023

• 8

Creating a Coding Assistant with StarCoder

May 9, 2023

• 2

StarCoder: A State-of-the-Art LLM for Code

May 4, 2023

• 24

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Apr 5, 2023

• 15

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 30

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Dec 9, 2022

• 75

Evaluating Language Model Bias with 🤗 Evaluate

Oct 24, 2022

• 2

Announcing Evaluation on the Hub

Jun 28, 2022

Organizations

lvwerra's activity

upvoted a paper 25 days ago

Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published 28 days ago • 109

upvoted an article 29 days ago

Article

Tool Use, Unified

Aug 12

• 49

upvoted 2 articles about 1 month ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 40

Article

XetHub is joining Hugging Face!

Aug 8

• 76

upvoted an article about 2 months ago

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Jul 23

• 193

upvoted 2 articles 2 months ago

Article

Docmatix - a huge dataset for Document Visual Question Answering

Jul 18

• 63

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16

• 242

upvoted an article 3 months ago

Article

Our Transformers Code Agent beats the GAIA benchmark!

Jul 1

• 44

upvoted 3 papers 3 months ago

Agentless: Demystifying LLM-based Software Engineering Agents

Paper • 2407.01489 • Published Jul 1 • 42

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 84

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22 • 45

upvoted 2 articles 3 months ago

Article

Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models

Jun 24

• 166

Article

Putting RL back in RLHF

Jun 12

• 58

upvoted a paper 4 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28 • 12

upvoted a collection 4 months ago

Leaderboards and benchmarks ✨

Collection

Cool leaderboard spaces collection for models across modalities! Text, vision, audio, ... • 67 items • Updated Aug 6 • 83

upvoted 2 articles 4 months ago

Article

2024-04-22 - Hub Incident Post Mortem

•

May 17

• 17

Article

License to Call: Introducing Transformers Agents 2.0

May 13

• 108

upvoted an article 5 months ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 71

upvoted 2 papers 5 months ago

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Paper • 2402.09844 • Published Feb 15 • 20

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 250

upvoted an article 5 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 272

upvoted a paper 7 months ago

DoGE: Domain Reweighting with Generalization Estimation

Paper • 2310.15393 • Published Oct 23, 2023 • 1

upvoted a collection 7 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 79

upvoted a paper 7 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 132

upvoted a paper 8 months ago

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 140

upvoted a collection 8 months ago

Comparing DPO with IPO and KTO

Collection

A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO. • 56 items • Updated Jan 9 • 31

upvoted 2 papers 9 months ago

Possible Meissner effect near room temperature in copper-substituted lead apatite

Paper • 2401.00999 • Published Jan 2 • 5

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 79

upvoted a paper 10 months ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 138

upvoted 2 collections 11 months ago

⭐ StarCoder

Collection

All models, datasets, and demos related to StarCoder! • 11 items • Updated Feb 27 • 20

Zephyr 7B

Collection

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated Apr 12 • 144

upvoted a paper 11 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 120

upvoted 2 papers about 1 year ago

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 239

RepoFusion: Training Code Models to Understand Your Repository

Paper • 2306.10998 • Published Jun 19, 2023 • 14

Leandro von Werra

AI & ML interests

Articles

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

A failed experiment: Infini-Attention, and why we should keep trying?

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Welcome Llama 3 - Meta's new open LLM

StarCoder2 and The Stack v2

Constitutional AI with Open LLMs

Preference Tuning LLMs with Direct Preference Optimization Methods

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

The N Implementation Details of RLHF with PPO

Finetune Stable Diffusion Models with DDPO via TRL

Spread Your Wings: Falcon 180B is here

Code Llama: Llama 2 learns to code

Fine-tune Llama 2 with DPO

The Falcon has landed in the Hugging Face ecosystem

Creating a Coding Assistant with StarCoder

StarCoder: A State-of-the-Art LLM for Code

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Evaluating Language Model Bias with 🤗 Evaluate

Announcing Evaluation on the Hub

Organizations

lvwerra's activity

Tool Use, Unified

A failed experiment: Infini-Attention, and why we should keep trying?

XetHub is joining Hugging Face!

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Docmatix - a huge dataset for Document Visual Question Answering

SmolLM - blazingly fast and remarkably powerful

Our Transformers Code Agent beats the GAIA benchmark!

Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models

Putting RL back in RLHF

2024-04-22 - Hub Incident Post Mortem

License to Call: Introducing Transformers Agents 2.0

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Welcome Llama 3 - Meta's new open LLM