Just bc I was bored and came across this, @Croot_Overlord you got some splainin’ to do:
Last edited by a moderator:
Clicked on the members online down below:
- Thread starter Chris Farley
- Start date
I’ll get @Croot_Lord to explain it, but robots are what they use to crawl the web with. You can make them avoid certain parts of the site though. They are not invited on the NSFW forum, that’s for sure
What’s their purpose?? And why does it say fuckbook?
Web Robots: The worker bees of Internet - Open Source For You
Web robots, also known as Web crawlers and Web spiders, traverse the Internet to extract various types of information. But how do they work in real life?
www.opensourceforu.com
Basically, the ones that are showing up crawl the sites to index them. It’s how sites get added to the searches. Not exactly sure what Facebook’s bot does.
@Croot_Lord and @JackOfSpeed are the better ones to ask.
