(from github.com/riceming)
I have a file which is over 10M, can the crawler is skipped it since it is too large
The content length (10947090 byte) is over 10485760 byte
Can I modify the max content length for the crawler so that the file will be indexed like other?