TheChurn@kbin.socialtoProgrammer Humor@lemmy.ml•If Programming Languages Were Games (Comic)
32·
1 year agoHaskell isn’t really that hard to learn
A monad is a monoid in the category of endofunctors
Haskell isn’t really that hard to learn
A monad is a monoid in the category of endofunctors
In many cases, getting something out quickly is more valuable than having it be clean.
Part of being a senior is knowing when fast is more important than perfect. Not saying your senior did everything right, just that a single example of someone’s code isn’t enough to judge the value of a person to an organization.
It will depend on the representation of the parameters. Most models support bfloat16, where each parameters is 16-bits (2 Bytes). For these models, every Billion parameters needs roughly 2 GB of VRAM.
It is possible to reduce the memory footprint by using 8 bits for each param, and some models support this, but they start to get very stupid.