This is a reference for the situation:

https://www.tomshardware.com/news/intel-nukes-alder-lake-avx-512-now-fuses-it-off-in-silicon

Basically some Alder’s had the instruction available. I would like to check if my comp has the possibility. It is not in the bootloader. Maybe there is a way in KeyTool or another way? I don’t know if I would need to set affinity or if the CFS has a way to detect software running with the instruction and keep it running on P cores.

I’m mainly looking to try to enable this for the largest LLMs I am running. llama.cpp is looking for this instruction and subset already.

  • j4k3@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    I wonder if the kernel parameters for CPU isolation were set, if it would enable this.