How to customise number of activated experts for MoE models #6774
Unanswered
SpaceHunterInf
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Greetings,
I am currently using an 8-expert MoE model, but the terminal output only suggests that 2 of them are activated. But, I am unable to find any command line arguments or settings on the website to customise number of activated experts for MoE models.
Any help?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions