DeepSeek V2 MLA enabling and optimization on Intel Gaudi2 (A_CC_ME_HPU)#2

Open

jychen21 wants to merge 3 commits intomadsys-dev:mainfrom jychen21:enable_mla_on_intel_gaudi

+530

Commits on Jul 18, 2024

enable and optimize mla on Intel Gaudi2 (A_CC_ME_HPU)
Jinyan Chen
committed

Commits on Jul 23, 2024

optimize q / out absorb on Intel Gaudi
Jinyan Chen
committed

Commits on Aug 22, 2024

update q_nope permutation
Jinyan Chen
authored