Skip to content

[shardformer]: fix attention mask of qwen2/qwen3 with pipeline + sequence parallelism - #6451

Open
LiRunGuo wants to merge 1 commit into
hpcaitech:mainfrom
LiRunGuo:fix/qwen-pp-sp-attn-mask
Open

[shardformer]: fix attention mask of qwen2/qwen3 with pipeline + sequence parallelism#6451
LiRunGuo wants to merge 1 commit into
hpcaitech:mainfrom
LiRunGuo:fix/qwen-pp-sp-attn-mask

[shardformer] fix attention mask of qwen2/qwen3 with pipeline + seque…

c0f86bf
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs