January 01 2024, 10:15

Here’s more (probably the last) about Elon Musk based on the biography by Isaacson I’ve read. In my head, like “books similar to this one,” an intracerebral recommendation system pulled out two from the archives – Endurance by Alfred Lansing (Russian translation “Leadership in the Ice”) and “The Russian Management Model” by Prokhorov.

Let’s start with Prokhorov. Generally, his book is quite controversial. The main idea is that the organization/system/people in Russia have always existed (due to historical, political, climatic, and various other conditions) in only two extreme states—stable and unstable. Stable—everything is fine, stagnation, everyone evenly goes to work and gets paid. Unstable—red alert, aortic rupture, working 70 hours a day, seizing enemy crossings and outposts with a nail in the fist. And then half the book covers the justification and symptomatology. In particular, an excess of resources makes their more efficient use meaningless. Then why spend effort on analyzing management, improving business processes, quality systems, if there are internal reserves hidden, and external ones (for example, through administrative pressure)? Conclusion: artificially limit the available resources. Need more people for the operation—reduce it. Need more disks, memory, or processing power—reduce the size. Need more time to resolve issues in meetings—limit the time for meetings and the number of participants. This engages the brains and leads to faster progress. It is possible that the path to such progress is paved with maimed fates, burnt-out employees, and periodic mistakes, but here comes the effect of “a seesaw” and “all-in” bets—you need it so that 1) there was an excess of resources 2) at least once in the beginning you were incredibly lucky with all-in, and now you can risk more than others, losing only part at worst when others in the same situation would lose everything.

Why controversial—if one can somehow (with a star*) agree that Prokhorov’s theory somehow explains Russia and the USSR from ancient times to the end of the 20th century, it just doesn’t fit at all into the 21st century. At least the first 23 years of the 21st century don’t fit into it at all. Something broke in the 21st century.

The second book that comes to mind, “Endurance” (translated as “Leadership in the Ice”) tells about the legendary expedition of Ernest Shackleton (1914-1916) to Antarctica. Essentially, Shackleton overestimated his efforts, went all-in, but for a number of reasons, the plan of this heroic expedition failed at an early stage, as the ship carrying the team was crushed by ice and sank. After that, it was only about survival.

By the way, one can draw a parallel between the British conquest of Antarctica and the American conquest of space. In the history of conquering the South Pole, a key moment was the competition between Roald Amundsen’s expedition from Norway and Robert Scott from Great Britain. Amundsen reached the South Pole first (with a month’s difference) in 1911, beating Scott, which was perceived as a national defeat for Britain. Shackleton’s expedition was largely financed with the goal of regaining former glory. In the moon exploration, a similar role was played by the race between the USA and the USSR during the Cold War, during which the USA, though the first to successfully land a man on the Moon in 1969 during the Apollo 11 mission, failed to secure dominance—truthfully, for the USSR the Moon became uninteresting as soon as they lost the lead. But the USA didn’t secure it either—no one has flown to the Moon since then. And now, Elon Musk has regained the leadership for the Americans. Russia is now way behind. However, China has grown, and India is catching up.

Shackleton recruited for his “startup” using such advertising: “Men wanted for hazardous journey. Small wages, bitter cold, long months of complete darkness, constant danger; safe return doubtful. Honor and recognition in case of success.” He needed four qualities from people: optimism, patience, imagination, and courage.

In the end, he received 5,000 responses (including three women), from which he eventually selected a necessary crew of 27 people, dividing them into three piles labeled “Mad,” “Hopeless,” and “Possible.”

(Although it must be noted that there are very well-founded and scientific doubts that this legend about the advertisement and 5,000 responses is a fabricated tale. But I am sure that there’s a lot of similar stuff about Musk as well.)

Musk fired people from Twitter based on how well they knew their subject matter (“excellence”), then sifted them through a sieve of “trustworthiness” and further through the third sieve of persistence and perseverance (“drive”). In the end, he kept 25%.

If Shackleton had just died in the ice with his team, he would have been remembered as an idiot. But since he pulled his entire team out alive, without a single corpse, they don’t call his attempt to cross Antarctica idiotic (although if you look at what risks were ignored…). Musk has been more fortunate with such an approach so far. And each time he’s lucky, he not only gains more credit for future experiments, but also better risk management mechanisms.

But all of them, “The Russian Management Model” by Prokhorov, Musk, and Shackleton, are about the same thing. In cases when people start looking for solutions in extreme conditions, far from comfort, the solutions often emerge faster and better.

December 31 2023, 10:38

An interesting story is described in Musk’s biography. There are many tales there, but this one delighted me because it’s not about cars and rockets, but about servers, which is closer to me.

Just a couple of days before Christmas, the admins rush in saying, “one of our hosts started doubting whether Twitter would survive and reconsidered the moving conditions.” Twitter cost this host more than $100 million a year, and it was decided to move the servers to Portland, where Musk had better terms and a lower price. Apparently, the host initially agreed to give some preferential rates during the moving period, and then retracted it, fearing that the company would collapse sooner.

“We need six to nine months to move. The servers are in prod, handling traffic, everything needs to be switched over intelligently.” Musk: “Guys, you have 90 days for this. If you can’t handle it, don’t bother coming back to work.”

The admins try to explain that it’s not that simple. There are various densities of racks, electrical consumption, the place needs to be rebuilt for the servers.

Musk listened and listened, then interrupted with, “guys, you’re blowing my mind. You remember that emoji? This is exactly what’s happening. Don’t bother me with all this nonsense, just take the servers and move them to the new place.”

The admins continue to talk about the difficulties. “So, can someone go to the server room and send some photos from there?”. Mind you, this was just before Christmas, they say it’ll take a week for photos. “No, I need them tomorrow. I built those damn data centers myself, and I can tell whether or not more can be fitted in. So I ask you, have you ever been there? If you haven’t, there’s nothing to discuss.”

“All you need to do is load these damn servers onto a truck, and bring them from Sacramento to Portland. If that takes more than 30 days, it’ll definitely blow my mind. So.. Get a carrier, it takes a week to move the servers and another week to connect them. Two weeks in total. That’s how it should look. Just grab a U-Haul and go.”

The next day, December 23rd, almost on Christmas Eve, Musk with his family – wife Grimes, two-year-old son named X, two engineer brothers who were also involved in the Twitter story, suddenly decide en route to Austin over Las Vegas to move the servers right now.

The pilot turns around, Musk looks for a rental car, they find a Toyota Corolla. The child back, the rest cram in as best they can. It’s unclear if anyone is in the data center for Christmas.

There was one engineer from Twitter there, Alex-Uzbek. The data center was ultra-modern, with retina scanners and all that. Twitter’s server room looked like 5200 racks each the size of a refrigerator. “Okay, looks like they should manage it.” Okay, should manage, you think, 6200 tons of metal.

“Actually, a special contractor is needed to lift the floor – for that, special suction cups are required. Then another contractor is needed to disconnect the right cables under the floor and not disconnect the wrong ones.”

Musk pulls out a Swiss army knife and through the ventilation crawls into the space under the floor. Disconnects the servers. Done!

The next day, on Christmas Eve, there’s a buzz in San Francisco. Ross Norden hops into an Apple store and buys all the AirTags in stock for $2000, so they can track the servers en route. Then to Home Depot, where he spends another $2500 on various tools and cutting equipment. Steve Davis finds trucks, some from Boring Company, some random ones.

Fortunately, the racks are on wheels, so the team successfully loads four out of 5200 in the first hours. Everyone’s sweating, but at least it’s clear that the entire network can be loaded in days, not months, if more people and machines are connected.

The rest of the data center staff watch this and are flabbergasted.

If not to say more.

In the meantime, the management of NTT, the data center owner, learns about what’s happening and they’re flabbergasted too. And they order to end the chaos.

It turns out that the data center floors were built for a specific load and it’s not advisable to carry several heavy racks without special equipment. The entire load exceeds the permissible load fivefold.

To which Musk replies, they’re actually on wheels, so the load is distributed on four points, and we almost fit.

NTT realizes they’ve just lost $100 million in revenue for the next year.

NTT staff do everything possible to complicate their work and make them postpone it at least until after the holidays. One lady there was tailing them and being a pain. “She was the most unbearable character I’ve had to work with. But I can understand her – because of us she misses Christmas”

Moving carriers, usually recommended by NTT, often charge something like $200 an hour. James Mask found a company on Yelp, Extra Care Movers, for twenty bucks. The owner lived on the street, then had a child, and decided to start earning somehow. He didn’t have a bank account, and James paid him five-figure sums in cash. The workers didn’t have documents, so getting them into the data center was a separate problem. “I pay an extra dollar tip for each additional server.”

Interestingly, there’s a regulation that personal data must be deleted from servers before moving. By the time they learned about it, the servers had already been loaded. There was a risk that if one of the servers arrived wrong, the reputational losses would be monstrous. James sent someone to Home Depot to buy barn door locks and sent an Excel sheet with codes to Portland.

Moving 700 racks took three days. The previous data center record was thirty a month. The rest were moved in January.

“Looking back, it can be said that the closure in Sacramento was a mistake,” Musk told Isaacson. “I was told we had redundancy between our data centers. But I wasn’t told we had 70,000 hard-coded links to Sacramento. And because of that, things are still broken.”

December 29 2023, 20:54

PhoneticFanatic — the best Russian-speaking channel about English pronunciation. The creator really delves deep into each topic. In the comments of his latest video about linking j/w. It’s a big topic, but to put it simply, it’s why this year is often read as thiSH year. Or why sugar is not pronounced like suicide or superior. Or how to pronounce Tuesday as ˈtjuːzd(e)ɪ, as ˈt͡ʃuːzd(e)ɪ or as ˈt(j)uzd(e)i. Or tune. Whether as tjuːn or as tʃuːn or as t(j)un. And how to pronounce duty, news, suit, resume. And that’s not all, there’s a lot more.

(There’s also another good channel, Virginia Beowulf. Just to save getting up twice)

December 29 2023, 17:24

I’m currently reading in Musk’s biography about the Babylon Bee case. They were banned by Twitter for violating the misgendering policy. And Musk is discussing with lawyers Alex Spiro and Yoel Roth how to unblock them without changing the policy.

And I thought, why not create an unblocking policy that requires submitting a phrase like the one from the attached image for N consecutive days. Miss one day, and you start over. For repeat offenses, N doubles. All properly done with CAPTCHA, to prevent cheating.