Just found out that OpenAI's GPT-4 uses over 1 trillion parameters

I was reading a technical paper last night and stumbled on this. I always assumed these models were big but a trillion parameters is insane. That is like 10x more than GPT-3. No wonder it costs so much to run. Has anyone else looked into how they even train something that huge?

2 comments

2 Comments

patriciareed5d ago

Honestly I heard that and just thought “cool so that’s why my internet bill keeps going up.” Like congrats on the trillion parameters but can it help me find my keys?

pat_coleman5d ago

Oh man, keys are the worst. Here's what actually worked for me after years of losing them - get a Tile or one of those little Bluetooth trackers and attach it to your keyring right now. I put one on my keys, one in my wallet, and one on my remote. Then you just use your phone to make them beep. Takes maybe ten minutes to set up and has saved me hours of frantic searching. Your mileage may vary but for like 25 bucks it's been totally worth it.