Solana Network Has Stopped Processing Transactions Due To Outage Here Are The Details.
On Oct 01, 2022 (00:46 UTC), Solana announced that they were experiencing an outage and not able to process any transactions. This outage also caused Solana price to drop around 3% since the outage. Until the time of writing, Solana is still out and still in the process of restarting the network.
Reason For The Outage
The Solana Network previously announced at Sep 30, 2022 (23:01 UTC) that is it experiencing degraded performance. Before a few hours later announced that they are experiencing outage and not able to process transactions.
Solana Mainnet was experiencing a large partition (fork) which causes the outage and transactions were not able to be confirmed. It seems like a long-running partition (fork) seems to have caught a lot of the validators and are unable to advance beyond slot 153139220.
The next slot (153139221) was a bad block that was propagated by a lead validator at that point and was unable to gain consensus. Other validators attempted to skip/block 2 IPs that were in question, but that didn’t resolve the issue. There was an attempt for hours to make this work without restarting.
If validators are unable to advance, the network stalls. This error started around 21:41 UTC at slot 153139221 and the network was not able to recover automatically. Since that did not work, the validators voted to take a snapshot at slot 153139220 (the highest confirmed slot), and restart.
The Solana mainnet network will be restarted at slot 153139220, the last confirmed slot.
It appears a misconfigured node caused an unrecoverable partition in the network.
Validators, please participate in finding consensus on the relevant data.
— Laine ❤️ stakewiz.com (@laine_sa_) October 1, 2022
Another Major Outage For Solana
This outage is still currently on going at the time of writing which is already around 6 hours of down time.
Solana is one of the most popular blockchain in the DeFi ecosystem because it is less expensive and process transactions faster than Ethereum. According to its website, this blockchain is able to process 60,000 transactions per second at an average cost of $0.00025.
Since its launch in 2020, Solana has experienced at least seven network failures, five of which happened in 2022 (not counting this one). In September 2021, one of the longest production stops lasted up to 17 hours. This latest outage will be the 6th time this year.
In a previous interview with Real Vision co-founder, Raoul Pal, Solana co-founder, Anatoly Yakovenko said that outages is one of Solana’s “curse”,
“That’s been, I guess, our curse, but it’s because the network is so cheap and fast that there are enough users and applications that are driving that.”
Yakovenko also said that, duing peak period, outages are more likely to happen,
“I think some people have seen 10 million packets per second being submitted to a validator. And if there’s a bug in any one of those validators where memory grows really quickly, that validator could shut down.”
At the time of writing, network restart is around 50% and will restart when it reaches 80%.