(from github.com/pointan)
Hello there,
is there a way to normalize URLs, so that the same URL (just with minimal differences) doesn’t appear twice in the search results,. The image below shows such an example, where the crawler found the same page (one time with www and one time without).
Thanks in advance.
Best regards.