Follow

Just unleashed a onto the .

So far it has downloaded the peer-list of 4.700 servers and has seen 148.759 unique domains!

The fediverse is bigger than expected, will update when the crawler gets further.

· · Web · 1 · 0 · 0

For those wondering: The script loads the peerlist of 1in1.net using the API, then adds all peers to the queue, loads all of their peerlists, adds them to the queue (if it hasnt seen them) and rinse and repeat.

Runs on on my poor little computer.

Sign in to participate in the conversation
Mastodon

Just a small private server.