Cognitive Revolution "How AI Changes Everything"
3 HN recommenders · recommended in 3 months, 2023
1:22:58 · 25K views · Mar 28, 2023
A podcast episode in which GPT-4 red teamer Nathan Labenz describes using the model before release, finding it human-level but not human-like, and discussing its weaknesses and worrying capabilities. It closes with speculation about GPT-5.
Cited as a firsthand account of the raw, unfiltered GPT-4 before safety tuning, especially the part after 45 minutes.
7 comments from Hacker News
> I'm curious whether this fixation on specific topics is innate to the model or is a result of the aggressive RLHF to which GPT4 has been subjected. Yes it's because of the RLHF, depending on what you mean by 'fixation on specific topics'. > Anecdotally the strength of the model has degraded a lot as they've 'fine tuned' the model more. Yes this is true. For example Figure 8 in [LINK] They argue in the appendix that it does not affect 'capability' in answering test questions. But, there is a confounding factor. The RLHF includes both question-answer format training and docility training. For example if you see a question and you are in 'completion mode' (the only raw base mode) then you might suggest a second question. Whereas if you've had question-answer format training then you would probably try to answer the question. > I'd be curious to know how the original chaotic-neutral GPT4 responds. They talk about it in these two videos: Nathan Labenz, red teamed GPT-4 for OpenAI (especially after 45 min): this video Sebastien Bubeck, integrated GPT-4 with Bing for Microsoft: [LINK]
Here are two. First one is Nathan Labenz who ended up Red Teaming for OpenAI during the six months after the base model was fully trained but before it was released (especially relevant parts are after 45 minutes): this video Other one is Sebastien Bubeck who put Sydney into Bing before she was tamed down some notches; he explains the lobotomization process in a particularly poignant way, where they had the GPT keep trying to draw a unicorn even as it was progressively deadened: [LINK]
All of that "GPTism" and the problems in the GPT conversation you posted are because of how they made it more docile and stupid by lobotomizing it with RLHF. It's not like that in its 'natural form' (its raw base model). If you don't believe me, check the two youtubes of people who had access to it before it was lobotomized: Nathan Labenz, red teamed GPT-4 for OpenAI: this video Sebastien Bubeck, integrated GPT-4 with Bing for Microsoft: [LINK]
This interview with one of the testers of early, unfiltered versions of GPT-4 might cover what you're looking for: this video It's a video and not an article, but you may find it interesting nonetheless.
Here's another interview from a guy who had access to the unfiltered GPT-4 before its release. He says it was extremely powerful and would answer any question whatsoever without hesitating. this video