(from github.com/ndrwchn)
It seems weird to me. Once crawlering a certain website, like http://xxx.xxx.com/, no indexing result. However, using https://xxx.xxx.com/, no issue. By using curl to test, port 80 bounces ‘connection refused’, 443 is OK. Both 80 and 443 are OK in browser.
My question is how this happened? It seems block FESS in firewall not by TCP port, but by app name? What’s robot name for FESS?