Exclude CSS, JS, PHP URL's ffrom indexing or crawling

English:Fess
1

I seemed to ve having problems stopping urls like the ones below from displaying in the search

I have tried many different regex options example below:

url:http*:///feed/?
url:http://wp-json/
url:http*://css/
https://s7.addthis.com/*
./feed/?
./css/?
./js/?
./css?
./wp-json/?
./xmlrpc.php
./wp-json/.
./api/.
./css/.
./js/.
[a-z\W*\W[a-z]/wp-json(?!/v2)\W
[a-z\W\W[a-z]/embed(?!/v2)\W
[a-z\W\W[a-z]/css(?!/v2)\W
[a-z\W\W[a-z]/js(?!/v2)\W
..png$
..css$
..css*
..js$
..xml$
..php$
.\xmlrpc.php*


./css

I do not want these url’s or URL files/folders indexed as they are mainly CSS, JS, PHP File, can anyone help me with this. I would prefer if someone can send me to a page with instructions so I can learn more about the regex that will work with FESS, when I use the standard regex in the search it finds the URLs and I can remove them manually but it does not stop the URL’s from indexing which is what I am trying to achieve.

I hope this makes sense and thanks in advance

2

You can set a regex(ex. .*\.png) to Excluded URLs For Crawling.

3

Appreciate your help thank you, what about the URL below for example as I have tried with regex
but the URL below is more complex

https://fonts.googleapis.com/css?family=Roboto%3A300%2C400%2C500%2C700&subset=latin%2Clatin-ext&ver=5.5.1

4

Just tried this to stop .*\.php files and xmlrpc.php still gets indexed

5

They are like this.

.*fonts.googleapis.com/css.*
.*.php.*
.*xmlrpc.php.*
6

Thank you as always I will try again

7

I have stumbled on these problems.
Did you solve the problem? If yes, how?
I tried couple of combinations in the advanced http://localhost:8080/search/advance/ options,
selected ‘html’ file type from the right hand fess generated filter. Next I am going to try is REST API.

8

Search API can help you.