Following a discussion on this site, I experimented my way to this JS-less crawler-blocking method, that seems to work quite well for me. It works okay in w3m; I just have to follow the refresh link manually. Someone reported problems in Lynx, but I have trouble using Lynx since it makes everything dark so I can’t see anything. If someone can tell me the issue there, I will try to fix it. Comments