Of all the ActivityPub servers that have ever been publicly available, how many do you think are still up today?
-
That's interesting. I figured there'd be a LONG tail of servers that someone spun up, ran for a few days, and then shut down.
But maybe there are, but live servers wouldn't remember them?
It seems like it would be a good design for them to eventually forget inactive accounts?
I know that some accounts are listed by my server as "inactive", simply because no one on my server follows them anymore (but following back to the origin server, they are still there and active).
@TerryHancock 55k dead servers seems like a pretty long tail to me.
-
My guess is that @dansup might have some better data than I do.
More data about servers:
- 27K live servers.
- 47% have one user.
- 55% of all users are on the top 20 servers.
- 88% of all users are on the top 100 servers.
- 99% of all users are on the top 1000 servers. -
@liaizon @evan well... what I'm doing is using a list of servers that are currently up, and just getting nodeinfo for them, so I do have a list of *some* historical servers that are gone now, but I doubt it's anywhere near as good as Evan's data.
Someone who might have good data is @minoru who has been crawling the lists of federated servers for several years now to make https://nodes.fediverse.party/ (the list I use), and would have probably have a bunch of no-longer-reachable nodes in his database, including ones that were only known by nodes that are themselves no longer up, etc.
-
@smallcircles @mrdk Also, I ask the questions I want answers to. I don't like being told by other people what questions I should ask. If *you* want to ask some different question, you should definitely do it! Let me know, and I'll boost it.
Comment
@evan OMG I have this problem SO OFTEN trying to get measurement papers published in academic venues, we answer some interesting question and the reviews are basically "but why didn't you answer this OTHER question", and I just want to respond to say *this is an interesting question and I have answered it, if you want to answer this other question, how about you answer it*
-
@evan OMG I have this problem SO OFTEN trying to get measurement papers published in academic venues, we answer some interesting question and the reviews are basically "but why didn't you answer this OTHER question", and I just want to respond to say *this is an interesting question and I have answered it, if you want to answer this other question, how about you answer it*
Comment
@ricci i asked a few times and no one seemed to want to say why asking about multi-user servers is more important than asking about all servers. I think, but don't know, that they want to have some answers about the viability of the volunteer-run community server model? I'm not sure.
-
@ricci i asked a few times and no one seemed to want to say why asking about multi-user servers is more important than asking about all servers. I think, but don't know, that they want to have some answers about the viability of the volunteer-run community server model? I'm not sure.
Comment
@evan my guess would be that, and/or a matter of who is affected if it goes down - is anyone affected who isn't responsible for running it in the first place
-
Now, there's some dark matter out there: servers that never connected to our large connected component on the Fediverse. We can't know if they're up or down or what. They're unreachable.
I think there might be ways to find the dark unconnected Fediverse servers using something like Common Crawl.
-
@omkar_foss Yes, I think that's it!
Comment
@evan Thank you again!

-
@liaizon @evan well... what I'm doing is using a list of servers that are currently up, and just getting nodeinfo for them, so I do have a list of *some* historical servers that are gone now, but I doubt it's anywhere near as good as Evan's data.
Someone who might have good data is @minoru who has been crawling the lists of federated servers for several years now to make https://nodes.fediverse.party/ (the list I use), and would have probably have a bunch of no-longer-reachable nodes in his database, including ones that were only known by nodes that are themselves no longer up, etc.
@ricci So, my crawler has been running for 5 years, and it also pulls data from other sources like the-federation.info, fediverse.observer, fedidb.com etc. Its database has 44142 alive nodes and 777384 dead ones, so the answer is 5.4%. If .gab.best and .cheeseland.xyz are excluded, then only 98621 nodes are dead and the answer is 30.9%.
Someone in the thread suggested that nodes might be pruning their peers lists from dead nodes. Judging by the negligible difference between Evan's number and my number, no pruning is done.
BTW, my crawler currently tracks 22 newly discovered nodes, i.e. ones that were seen in someone's peers list but whose NodeInfo hasn't been checked yet. I'm happy the Fediverse keeps growing _^
-
More data about servers:
- 27K live servers.
- 47% have one user.
- 55% of all users are on the top 20 servers.
- 88% of all users are on the top 100 servers.
- 99% of all users are on the top 1000 servers.@evan i would love a breakdown on the one user servers if you did a followup to this. are these actual servers in actual use, or developer test servers?
-
@ricci So, my crawler has been running for 5 years, and it also pulls data from other sources like the-federation.info, fediverse.observer, fedidb.com etc. Its database has 44142 alive nodes and 777384 dead ones, so the answer is 5.4%. If .gab.best and .cheeseland.xyz are excluded, then only 98621 nodes are dead and the answer is 30.9%.
Someone in the thread suggested that nodes might be pruning their peers lists from dead nodes. Judging by the negligible difference between Evan's number and my number, no pruning is done.
BTW, my crawler currently tracks 22 newly discovered nodes, i.e. ones that were seen in someone's peers list but whose NodeInfo hasn't been checked yet. I'm happy the Fediverse keeps growing _^
-
@evan i would love a breakdown on the one user servers if you did a followup to this. are these actual servers in actual use, or developer test servers?
@kim I think I can do that!
Ciao! Sembra che tu sia interessato a questa conversazione, ma non hai ancora un account.
Stanco di dover scorrere gli stessi post a ogni visita? Quando registri un account, tornerai sempre esattamente dove eri rimasto e potrai scegliere di essere avvisato delle nuove risposte (tramite email o notifica push). Potrai anche salvare segnalibri e votare i post per mostrare il tuo apprezzamento agli altri membri della comunità.
Con il tuo contributo, questo post potrebbe essere ancora migliore 💗
Registrati Accedi
Citiverse è un progetto che si basa su NodeBB ed è federato! | Categorie federate | Chat | 📱 Installa web app o APK | 🧡 Donazioni | Privacy Policy