Skip to content

Keep the full LoRA delta when merging into bfloat16 weights - #513

Open
boshjerns wants to merge 3 commits into
AI-Hypercomputer:mainfrom
boshjerns:lora-merge-bf16-rounding
Open

Keep the full LoRA delta when merging into bfloat16 weights#513
boshjerns wants to merge 3 commits into
AI-Hypercomputer:mainfrom
boshjerns:lora-merge-bf16-rounding

Check the float32 LoRA merge at full matmul precision

4b3d8cb
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Oct 19, 2026 in 2s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ 4b3d8cb Author: @boshjerns <98094229+boshjerns​@users.noreply.github.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA