(from github.com/rhayun)
Hello,
First wonderful work on this project
i have one domain with multiple subdomains
i created one web crawler like this:
URLs: http://www.mywebsite.com/
Included URLs For Crawling: http?s://www.mywebsite.com/.*
Excluded URLs For Crawling:
.*/admin/.*
https?://sub.mywebsite.com/.*
etc...
Also i created some labels - for example
Name: Label1
Value: label1
Included Paths: https?://www.mywebsite.com/games/.*
Name: Label2
Value: label2
Included Paths: https?://www.mywebsite.com/software/.*
now i start crawling and i can see results but its not labeled
like i see results like this
https://www.mywebsite.com/games/game1
and its not get the label: Label1
now i try to understand how to work properly with labels… should i select the label in the web crawling form also? or its enough to create the label with the settings…
when i add multiple labels into the web crawling form the results show the labels but each label store the same result
can you please light my way with this?
thanks