Crawling urls that include space characters?

English:Fess
1

(from github.com/jbogal)
Will FESS crawl and index a url that contains a space character? Thank you for your time.

2

(from github.com/marevol)
A space character is %20.

3

(from github.com/jbogal)
Thank you for the reply.
Yes, in a properly-escaped url, a space character will be replaced with %20. However, will FESS crawl urls not have not been properly escaped (or urlencoded)? Many urls in the pages I’m trying to crawl and index have not been properly escaped.

4

(from github.com/marevol)
Please check fess-crawler.log. Crawled urls are listed.

5

(from github.com/jbogal)
According to fess-crawler.log, there are ignored urls that have unencoded spaces in them. However, they could be ignored for other reasons, because the log does not say why they were ignored.
Is there a way to make fess crawl urls that contain unencoded spaces, and if so, how?
Thanks again.

6

(from github.com/marevol)
Fess ignores url with unencoded space characters in href attribute as an invalid url.
It will be supported in next release.

7

(from github.com/jbogal)
Thank you very much for the reply, and thank you for adding this feature.