How To Crawl Site with Self-Signed Cert

English:Fess
1

This (Question : Crawling target https website using an a self signed certificate · Issue #1578 · codelibs/fess · GitHub) mentions that a feature was added but there is no documentation on how to leverage that feature.

Could someone explain what needs to be done?

(Note, if the answer involves adding a property or config setting somewhere, could you please tell me where to put it and how to format it? The documentation seems to be thin in this area.)

2

Please try to add client.ignoreSslCertificate=true to Config parameters in Admin Web Config page.

3

Thanks for the quick reply.

I added it but I’m still receiving these:

hudx_local_fess-sitesearch.1.0qdv430cjvio@local    | ==> /var/log/fess/fess-crawler.log <==
hudx_local_fess-sitesearch.1.0qdv430cjvio@local    | 2021-02-27 00:16:14,929 [Crawler-20210227001600-1-1] INFO  Could not process https://local.mysite.info/robots.txt. PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
hudx_local_fess-sitesearch.1.0qdv430cjvio@local    | 2021-02-27 00:16:17,624 [Crawler-20210227001600-1-1] INFO  Failed to access to https://local.mysite.info; I/O exception(PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target): https://local.mysite.info; I/O exception(PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target): https://local.mysite.info; I/O exception(PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target): https://local.mysite.info; I/O exception(PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target): https://local.mysite.info; I/O exception(PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target): https://local.mysite.info

fess
fess1069×913 26.1 KB

4

The option had not worked… It will work in the next release.

5

Thanks @shinsuke, so 13.10.5 will have it, correct?

6

No, it will be on 13.11.

7

Got it, thanks. I’ll keep an eye out.