does is use bot control? + a video about bad bots and dead internet theory.

[Emba]

I once looked for the "robots.txt" file on is, and found nothing...

(unless it's changed to some other name?)

this is the only way that I know of, on how to control the various bots that visit a website.

anyway, is would have far less bad bot problems is the various bots were more limited in their activities.

whoever runs this place really ought to research, and shove a robots.txt file on the server...

just saying... ( ::

17 minutes

View: https://www.youtube.com/watch?v=bUUvb05I0-4

 

[Animecel2D]

There is 17 pages worth of bots rn, constantly monitoring .is. 40 on each page except for the last so around more than 600 bots

 

[Emba]

View attachment 1216456

There is 17 pages worth of bots rn, constantly monitoring .is. 40 on each page except for the last so around more than 600 bots

No wonder shits so slow... Bots sucking up all the bandwidth...

 

[Emba]

@Fat Link
@Uggo Mongo
@PLA1092

Lots of bots running wild...

More bots than peeps

 

[curryboy420]

View attachment 1216456

There is 17 pages worth of bots rn, constantly monitoring .is. 40 on each page except for the last so around more than 600 bots

What do these dumb bots do

 

[PersonalityChad]

What do these dumb bots do

Datamine user information and report it to the feds

 

[curryboy420]

Datamine user information and report it to the feds

But why does 600 why Facebook need it's own

 

[incelerated]

A robots.txt file just tells the crawlers/bots that they are not supposed to index a certain page. Only that.
Google and other major search engines respect this and do not index the pages. They still crawl it and archive it they just don't show it out of respect for the site owner's request.

But bad robots/spies/etc can still freely search all the site and index it and archive it and do whatever they want. It doesn't actually prevent anything it basically just politely asks bots to not crawl the site.

 

[Animecel2D]

What do these dumb bots do

Webcrawling for search engines I guess? A lot of these bots are from yandex

 

[hopeless_cel]

.is bots can't replicate truecel posts