Discussion about this post

User's avatar
rhea jain's avatar

Great post, as usual!

The idea that immediately comes to my mind is that the problem isn't a lack of people that are both altruistic and ambitious. The issue is having high-achieving people who are both of these things stay altruistic in the long-term, instead of succumbing to other goals like money, power, or fame.

The clearest example of this is Stanford students, to me: there's been a lot of grumbling on campus about how students come in trying to 'change the world' and by the end of their first year end up working in consulting, finance, or defense tech. This almost seems like a feature, not a bug–there are powerful companies that offer strong incentives to ambitious-minded young people.

I am curious about whether you think it's a better strategy to 1) recruit ambitious people from already-talented centers and try not to lose them to prestige, or 2) try to convert non-ambitious but outwardly altruistic people into more ambitious versions of themselves.

I guess my take is that maybe there are real reasons we see fewer ambitious ppl that want to do good (because the ambitious ones often pivot elsewhere before they can be directly impactful).

Josh Thorsteinson's avatar

I'm afraid that advice like this will not only lead to EAs burnt out or living in pain, driven by an abusive manager in their head; it will lead to EAs failing to live up to their potential.

The pathology that makes Jensen so ambitious is the same thing that makes him unable to sit with a question about AI safety without exploding. He's lashing out with anger because he's terrified of the feelings that come with believing your life's work is harmful.

In AI safety, it's extremely important to think clearly. Too many highly intelligent EAs have made a negative impact by working on the wrong things. Open Phil invested early in OpenAI. Anthropic said they wouldn't accelerate the frontier and now they're clearly accelerating the race.

Clear thinking requires being able to sit with uncomfortable ideas. That means being able to feel the feelings that scare you -- anger, grief, sorrow. Pushing through the pain to work an extra hour destroys that ability. It requires silencing your wants, overriding your feelings. You become productive and blind.

There's a different way to work hard that doesn't lead to burnout. Joe Hudson (Art of Accomplishment) gets a huge amount of work done, and he loves doing it. He gets a huge amount of work done because he loves doing it. Procrastination and dread are wasted energy. Clear that, and you naturally work more, not less, and with far better judgment. The bottleneck isn't your willingness to suffer; it's the emotional weight you're carrying that clouds your thinking and keeps your parts fighting each other instead of working together.

EAs shouldn't use Jensen's pathology. They should be whole people, thinking clearly about what matters, and work hard from that place.

39 more comments...

No posts

Ready for more?