Skip to content

[shardformer]: fix llama causal mask with sequence parallelism and no flash attention - #6452

Open
LiRunGuo wants to merge 1 commit into
hpcaitech:mainfrom
LiRunGuo:fix/llama-sp-causal-mask
Open

[shardformer]: fix llama causal mask with sequence parallelism and no flash attention#6452
LiRunGuo wants to merge 1 commit into
hpcaitech:mainfrom
LiRunGuo:fix/llama-sp-causal-mask

[shardformer] fix llama causal mask with sequence parallelism and no …

799bb5d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs