Show HN: A Small BitNet GPT in MLX https://ift.tt/yF1nQ64
Show HN: A Small BitNet GPT in MLX For those of us nerds who like to tinker with language models, I thought of sharing an example ipynb that shows how to build a small gpt (kudos to @karpathy for teaching us minGPT) where you replace the nn.Linear layer with a BitLinear layers as introduced in the paper on 1.58 bit LLMs https://ift.tt/DAQCGgf https://ift.tt/FAu5UZz June 8, 2024 at 10:08AM
Subscribe to:
Post Comments (Atom)
Daily Spiritual Reflection by Rev Fr Awoyemi Emmanuel, Ilorin Diocese, Nigeria
HOMILY FOR MONDAY 27TH WEEK IN ORDINARY TIME MEMORIAL OF OUR LADY OF THE ROSARY Today's feast was established by Pope St. Pius V in than...
-
HOMILY FOR FRIDAY, 14TH JUNE, 2024 TENTH WEEK IN ORDINARY TIME 1KING 19:9a. 11-16; GOSPEL: MATT 5:27-32 The conscience of man is where moral...
-
HOMILY FOR TUESDAY, 11TH WEEK IN ORDINARY TIME 1Kings 21:17-29; Matt 5:43-48 The last phrase of the gospel passage says “Be perfect just a... -
HOMILY FOR MONDAY 24TH WEEK IN ORDINARY TIME B {1COR 12:12-14.27-31a; LUKE 7:11-17} Faith without good works is indeed dead. This theme co...
No comments:
Post a Comment