Skip to content

feat: pack 2 fc layers in mlp with swiglu - #218

Open
Chamberlain0w0 wants to merge 2 commits into
masterfrom
feat/packed-swiglu
Open

feat: pack 2 fc layers in mlp with swiglu#218
Chamberlain0w0 wants to merge 2 commits into
masterfrom
feat/packed-swiglu

fix: adjust up/gate layout order

267659d
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar