Show HN: A Small BitNet GPT in MLX https://ift.tt/yF1nQ64
Show HN: A Small BitNet GPT in MLX For those of us nerds who like to tinker with language models, I thought of sharing an example ipynb that shows how to build a small gpt (kudos to @karpathy for teaching us minGPT) where you replace the nn.Linear layer with a BitLinear layers as introduced in the paper on 1.58 bit LLMs https://ift.tt/DAQCGgf https://ift.tt/FAu5UZz June 8, 2024 at 10:08AM
Subscribe to:
Post Comments (Atom)
-
HOMILY FOR FRIDAY, 14TH JUNE, 2024 TENTH WEEK IN ORDINARY TIME 1KING 19:9a. 11-16; GOSPEL: MATT 5:27-32 The conscience of man is where moral...
-
HOMILY FOR TUESDAY, 11TH WEEK IN ORDINARY TIME 1Kings 21:17-29; Matt 5:43-48 The last phrase of the gospel passage says “Be perfect just a... -
HOMILY FOR MONDAY 24TH WEEK IN ORDINARY TIME B {1COR 12:12-14.27-31a; LUKE 7:11-17} Faith without good works is indeed dead. This theme co...
No comments:
Post a Comment