Jira Crawler is running endless in Admin GUI, but Crawler is already finished

English:Fess
1

Hello,

there is a problem, with Atlassian Confluence / Jira Plugin (https://github.com/codelibs/fess-ds-atlassian)

When Jira is crawled, the crawler is running endless, and doesnt finish, although it crawled all Jira Urls in Jira test environment. Confluence test environment was crawled correctly. Here are the logs of Confluence and Jira in comparison:

Confluence Logs:

2020-09-09 16:15:04,779 [main] INFO  ...Loading specified properties and get by the key: fess_env_crawler.properties, lasta_di.smart.deploy.mode
2020-09-09 16:15:04,810 [main] INFO  ...Setting smart deploy mode: warm
2020-09-09 16:15:04,904 [main] INFO  ...Reading lasta_di.xml
2020-09-09 16:15:05,040 [main] INFO  ...Reading   redefiner.xml
2020-09-09 16:15:05,176 [main] INFO  ...Reading   smartdeploy.xml
2020-09-09 16:15:05,281 [main] INFO  ...Reading     smart/warmdeploy.xml
2020-09-09 16:15:05,296 [main] INFO  ...Reading       convention.xml
2020-09-09 16:15:05,312 [main] INFO  ...Reading         embedded_convention.xml
2020-09-09 16:15:05,351 [main] INFO  ...Reading       creator.xml
2020-09-09 16:15:05,363 [main] INFO  ...Reading         convention.xml (recycle)
2020-09-09 16:15:05,363 [main] INFO  ...Reading         customizer.xml
2020-09-09 16:15:05,380 [main] INFO  ...Reading           lastafw_customizer.xml
2020-09-09 16:15:05,425 [main] INFO  ...Reading           embedded_customizer.xml
2020-09-09 16:15:05,441 [main] INFO  ...Reading             tx_customizer.xml
2020-09-09 16:15:05,496 [main] INFO  ...Reading         my_creator.xml
2020-09-09 16:15:05,556 [main] INFO  ...Reading         lastafw_creator.xml
2020-09-09 16:15:05,565 [main] INFO  ...Reading           convention.xml (recycle)
2020-09-09 16:15:05,565 [main] INFO  ...Reading           customizer.xml (recycle)
2020-09-09 16:15:05,587 [main] INFO  ...Reading         embedded_creator.xml
2020-09-09 16:15:05,602 [main] INFO  ...Reading           convention.xml (recycle)
2020-09-09 16:15:05,603 [main] INFO  ...Reading           customizer.xml (recycle)
2020-09-09 16:15:05,625 [main] INFO  ...Reading       customizer.xml (recycle)
2020-09-09 16:15:05,703 [main] INFO  ...Reading app.xml
2020-09-09 16:15:05,741 [main] INFO  ...Reading   convention.xml
2020-09-09 16:15:05,757 [main] INFO  ...Reading     embedded_convention.xml
2020-09-09 16:15:05,771 [main] INFO  ...Reading   lastaflute_core.xml
2020-09-09 16:15:05,794 [main] INFO  ...Reading     lastaflute_assist.xml
2020-09-09 16:15:05,812 [main] INFO  ...Reading       lastaflute_director.xml
2020-09-09 16:15:06,091 [main] INFO  ...Reading   fess.xml
2020-09-09 16:15:06,105 [main] INFO  ...Reading     fess_config.xml
2020-09-09 16:15:06,142 [main] INFO  ...Reading     fess_ds.xml
2020-09-09 16:15:06,164 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-csv-13.8.0.jar!/fess_ds++.xml
2020-09-09 16:15:06,200 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-db-13.8.0.jar!/fess_ds++.xml
2020-09-09 16:15:06,225 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-atlassian-13.8.0.jar!/fess_ds++.xml
2020-09-09 16:15:06,297 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-elasticsearch-13.8.0.jar!/fess_ds++.xml
2020-09-09 16:15:06,322 [main] INFO  ...Reading     esflute_config.xml
2020-09-09 16:15:06,332 [main] INFO  ...Reading       esclient.xml
2020-09-09 16:15:06,823 [main] INFO  ...Reading     esflute_user.xml
2020-09-09 16:15:06,833 [main] INFO  ...Reading       esclient.xml (recycle)
2020-09-09 16:15:06,874 [main] INFO  ...Reading     esflute_log.xml
2020-09-09 16:15:06,884 [main] INFO  ...Reading       esclient.xml (recycle)
2020-09-09 16:15:10,212 [main] INFO  ...Reading   crawler_es.xml
2020-09-09 16:15:10,442 [main] INFO  ...Reading     crawler/container.xml
2020-09-09 16:15:10,543 [main] INFO  ...Reading     crawler/client.xml
2020-09-09 16:15:10,584 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:10,585 [main] INFO  ...Reading       crawler/robotstxt.xml
2020-09-09 16:15:10,675 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-09 16:15:10,685 [main] INFO  ...Reading       crawler/contentlength.xml
2020-09-09 16:15:10,694 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-09 16:15:10,699 [main] INFO  ...Reading       crawler/mimetype.xml
2020-09-09 16:15:10,710 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-09 16:15:10,907 [main] INFO  ...Reading     crawler/rule.xml
2020-09-09 16:15:10,913 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:10,913 [main] INFO  ...Reading       crawler/transformer.xml
2020-09-09 16:15:10,921 [main] INFO  ...Reading         crawler/transformer_basic.xml
2020-09-09 16:15:10,933 [main] INFO  ...Reading           crawler/container.xml (recycle)
2020-09-09 16:15:11,026 [main] INFO  ...Reading     crawler/filter.xml
2020-09-09 16:15:11,034 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,042 [main] INFO  ...Reading     crawler/interval.xml
2020-09-09 16:15:11,051 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,056 [main] INFO  ...Reading     crawler/extractor.xml
2020-09-09 16:15:11,065 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,077 [main] INFO  ...Reading       crawler/extractor+tikaExtractor.xml
2020-09-09 16:15:11,085 [main] INFO  ...Reading         crawler/container.xml
2020-09-09 16:15:11,194 [main] INFO  ...Reading     crawler/mimetype.xml (recycle)
2020-09-09 16:15:11,195 [main] INFO  ...Reading     crawler/encoding.xml
2020-09-09 16:15:11,201 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,203 [main] INFO  ...Reading     crawler/urlconverter.xml
2020-09-09 16:15:11,210 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,212 [main] INFO  ...Reading     crawler/log.xml
2020-09-09 16:15:11,218 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,223 [main] INFO  ...Reading     crawler/sitemaps.xml
2020-09-09 16:15:11,229 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 16:15:11,235 [main] INFO  ...Reading     crawler/es.xml
2020-09-09 16:15:11,276 [main] INFO  ...Reading     crawler_es+crawlerThread.xml
2020-09-09 16:15:11,325 [main] INFO  ...Reading     crawler_es+crawlerConfig.xml
2020-09-09 16:15:11,337 [main] INFO  ...Reading   fess_thumbnail.xml
2020-09-09 16:15:11,374 [main] INFO  ...Reading   fess_ingest.xml
2020-09-09 16:15:12,201 [main] INFO  [Objective Config]
2020-09-09 16:15:12,201 [main] INFO   fess_config.properties extends [fess_env_crawler.properties]
2020-09-09 16:15:12,201 [main] INFO   checkImplicitOverride=true, propertyCount=458
2020-09-09 16:15:12,329 [main] INFO  [Exception Translator]
2020-09-09 16:15:12,330 [main] INFO   exceptionTranslationProvider: null
2020-09-09 16:15:12,332 [main] INFO  [Async Manager]
2020-09-09 16:15:12,332 [main] INFO   defaultConcurrentAsyncOption: {no option}
2020-09-09 16:15:12,332 [main] INFO   primaryExecutorService: ThreadPoolExecutor@14924f41
2020-09-09 16:15:12,332 [main] INFO   secondaryExecutorService: ThreadPoolExecutor@493da830
2020-09-09 16:15:12,333 [main] INFO   tertiaryExecutorService: ThreadPoolExecutor@1f939a0f
2020-09-09 16:15:12,333 [main] INFO  [Primary Cipher]
2020-09-09 16:15:12,333 [main] INFO   invertibleCryptographer: {AES, UTF-8}
2020-09-09 16:15:12,333 [main] INFO   oneWayCryptographer: {SHA-256, UTF-8}
2020-09-09 16:15:12,338 [main] INFO  [Time Manager]
2020-09-09 16:15:12,338 [main] INFO   businessTimeHandler: TypicalBusinessTimeHandler:{TypicalTimeResourceProvider$$Lambda$119/0x00000008403ab840, TypicalTimeResourceProvider$$Lambda$120/0x00000008403abc40}
2020-09-09 16:15:12,338 [main] INFO   currentIgnoreTransaction: false
2020-09-09 16:15:12,338 [main] INFO   adjustTimeMillis: 0
2020-09-09 16:15:12,338 [main] INFO   adjustAbsoluteMode: false
2020-09-09 16:15:12,454 [main] INFO  [JSON Manager]
2020-09-09 16:15:12,454 [main] INFO   realJsonParser: GsonJsonEngine
2020-09-09 16:15:12,461 [main] INFO   mapping: {CAMEL_TO_LOWER_SNAKE}
2020-09-09 16:15:12,463 [main] INFO  [Postbox]
2020-09-09 16:15:12,463 [main] INFO   postOffice: PostOffice@50ab56e2
2020-09-09 16:15:12,463 [main] INFO   postalParkingLot: SMailPostalParkingLot:{{category:{main}=motorbike:{session=javax.mail.Session@7b5b5bfe}}}@74834afd
2020-09-09 16:15:12,464 [main] INFO   postalPersonnel: FessMailDeliveryDepartmentCreator$1:{SMailConventionReceptionist:{[]}@75fd65c, batch:{[proofreader:{pmcomment}]}}@d499c13
2020-09-09 16:15:26,484 [main] INFO  Lasta Di boot successfully.
2020-09-09 16:15:26,487 [main] INFO    SmartDeploy Mode: Warm Deploy
2020-09-09 16:15:26,487 [main] INFO    Smart Package: org.codelibs.fess.app
2020-09-09 16:15:27,135 [main] INFO  Starting Crawler..
2020-09-09 16:15:33,808 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":435945472,"total":21040566272},"swap_space":{"free":8118046720,"total":8588881920}},"cpu":{"percent":23},"load_averages":[2.5, 1.09, 0.78]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1332420},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":257331856,"committed":490733568,"max":536870912,"percent":47},"non_heap":{"used":137878008,"committed":196968448}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5885,"time":49972},"old":{"count":20,"time":3950}},"threads":{"count":20,"peak":24},"classes":{"loaded":15017,"total_loaded":88669,"unloaded":73652},"uptime":84033401},"elasticsearch":null,"timestamp":1599660933808}
2020-09-09 16:15:37,461 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=3309572
2020-09-09 16:15:37,461 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=1048579
2020-09-09 16:15:44,591 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=4587531
2020-09-09 16:15:44,591 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=1212445
2020-09-09 16:15:45,147 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=4587527
2020-09-09 16:15:45,211 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=7962628
2020-09-09 16:15:45,540 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=7962626
2020-09-09 16:15:45,708 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=10420232
2020-09-09 16:15:45,879 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=10420227
2020-09-09 16:15:46,060 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=12779527
2020-09-09 16:15:46,213 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=12582917
... and much more like this
2020-09-09 16:49:36,817 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=404422754
2020-09-09 16:49:37,195 [n8vXTXMBGfiIN_VakdsL-1] INFO  Sent 8 docs (Doc:{process 536ms, send 42ms, size 42KB}, Mem:{used 181MB, heap 460MB, max 512MB})
2020-09-09 16:49:37,656 [n8vXTXMBGfiIN_VakdsL-1] INFO  Deleted 0 old docs.
2020-09-09 16:49:37,656 [DataStoreCrawler] INFO  [EXEC TIME] crawling time: 2050243ms
2020-09-09 16:49:37,674 [main] INFO  Finished Crawler
2020-09-09 16:49:40,765 [main] INFO  [CRAWL INFO] DataCrawlExecTime=2050243,DataCrawlEndTime=2020-09-09T16:49:37.657+0200,CrawlerEndTime=2020-09-09T16:49:37.674+0200,DataIndexExecTime=106955,CrawlerStatus=true,CrawlerStartTime=2020-09-09T16:15:27.136+0200,DataIndexSize=4038,CrawlerExecTime=2050539,DataCrawlStartTime=2020-09-09T16:15:27.302+0200
2020-09-09 16:49:40,770 [main] INFO  Disconnected to http://localhost:9200
2020-09-09 16:49:40,783 [main] INFO  Destroyed LaContainer.
2020-09-09 16:49:55,857 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":1232912384,"total":21040566272},"swap_space":{"free":7818997760,"total":8588881920}},"cpu":{"percent":13},"load_averages":[0.62, 0.71, 0.91]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1377100},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":262509640,"committed":490733568,"max":536870912,"percent":48},"non_heap":{"used":138654496,"committed":197033984}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":6,"used":519073,"capacity":519073}},"gc":{"young":{"count":5911,"time":60130},"old":{"count":20,"time":3950}},"threads":{"count":21,"peak":24},"classes":{"loaded":15271,"total_loaded":88923,"unloaded":73652},"uptime":86095489},"elasticsearch":null,"timestamp":1599662995857}

In Confluence Crawling you could see that Confluence is Crawler is finished. This status isnt to see in Jira Crawler, altough it crawled all URLs in little test environment.
So in Confluence Logs you could see:

2020-09-09 16:49:37,195 [n8vXTXMBGfiIN_VakdsL-1] INFO  Sent 8 docs (Doc:{process 536ms, send 42ms, size 42KB}, Mem:{used 181MB, heap 460MB, max 512MB})
2020-09-09 16:49:37,656 [n8vXTXMBGfiIN_VakdsL-1] INFO  Deleted 0 old docs.
2020-09-09 16:49:37,656 [DataStoreCrawler] INFO  [EXEC TIME] crawling time: 2050243ms
2020-09-09 16:49:37,674 [main] INFO  Finished Crawler
2020-09-09 16:49:40,765 [main] INFO  [CRAWL INFO] DataCrawlExecTime=2050243,DataCrawlEndTime=2020-09-09T16:49:37.657+0200,CrawlerEndTime=2020-09-09T16:49:37.674+0200,DataIndexExecTime=106955,CrawlerStatus=true,CrawlerStartTime=2020-09-09T16:15:27.136+0200,DataIndexSize=4038,CrawlerExecTime=2050539,DataCrawlStartTime=2020-09-09T16:15:27.302+0200
2020-09-09 16:49:40,770 [main] INFO  Disconnected to http://localhost:9200
2020-09-09 16:49:40,783 [main] INFO  Destroyed LaContainer.

This one doesnt appear in Jira Logs… the problem is: if Fess thinking the Jira Crawler is running, it doesnt start a new one on next day…

Jira Logs:

2020-09-09 17:34:34,456 [main] INFO  ...Loading specified properties and get by the key: fess_env_crawler.properties, lasta_di.smart.deploy.mode
2020-09-09 17:34:34,540 [main] INFO  ...Setting smart deploy mode: warm
2020-09-09 17:34:34,734 [main] INFO  ...Reading lasta_di.xml
2020-09-09 17:34:34,805 [main] INFO  ...Reading   redefiner.xml
2020-09-09 17:34:34,928 [main] INFO  ...Reading   smartdeploy.xml
2020-09-09 17:34:35,025 [main] INFO  ...Reading     smart/warmdeploy.xml
2020-09-09 17:34:35,033 [main] INFO  ...Reading       convention.xml
2020-09-09 17:34:35,042 [main] INFO  ...Reading         embedded_convention.xml
2020-09-09 17:34:35,070 [main] INFO  ...Reading       creator.xml
2020-09-09 17:34:35,078 [main] INFO  ...Reading         convention.xml (recycle)
2020-09-09 17:34:35,078 [main] INFO  ...Reading         customizer.xml
2020-09-09 17:34:35,088 [main] INFO  ...Reading           lastafw_customizer.xml
2020-09-09 17:34:35,114 [main] INFO  ...Reading           embedded_customizer.xml
2020-09-09 17:34:35,123 [main] INFO  ...Reading             tx_customizer.xml
2020-09-09 17:34:35,312 [main] INFO  ...Reading         my_creator.xml
2020-09-09 17:34:35,431 [main] INFO  ...Reading         lastafw_creator.xml
2020-09-09 17:34:35,464 [main] INFO  ...Reading           convention.xml (recycle)
2020-09-09 17:34:35,464 [main] INFO  ...Reading           customizer.xml (recycle)
2020-09-09 17:34:35,964 [main] INFO  ...Reading         embedded_creator.xml
2020-09-09 17:34:36,083 [main] INFO  ...Reading           convention.xml (recycle)
2020-09-09 17:34:36,084 [main] INFO  ...Reading           customizer.xml (recycle)
2020-09-09 17:34:36,251 [main] INFO  ...Reading       customizer.xml (recycle)
2020-09-09 17:34:37,089 [main] INFO  ...Reading app.xml
2020-09-09 17:34:37,131 [main] INFO  ...Reading   convention.xml
2020-09-09 17:34:37,140 [main] INFO  ...Reading     embedded_convention.xml
2020-09-09 17:34:37,150 [main] INFO  ...Reading   lastaflute_core.xml
2020-09-09 17:34:37,158 [main] INFO  ...Reading     lastaflute_assist.xml
2020-09-09 17:34:37,165 [main] INFO  ...Reading       lastaflute_director.xml
2020-09-09 17:34:37,605 [main] INFO  ...Reading   fess.xml
2020-09-09 17:34:37,623 [main] INFO  ...Reading     fess_config.xml
2020-09-09 17:34:37,753 [main] INFO  ...Reading     fess_ds.xml
2020-09-09 17:34:37,987 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-csv-13.8.0.jar!/fess_ds++.xml
2020-09-09 17:34:38,085 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-db-13.8.0.jar!/fess_ds++.xml
2020-09-09 17:34:38,116 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-atlassian-13.8.0.jar!/fess_ds++.xml
2020-09-09 17:34:38,242 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-elasticsearch-13.8.0.jar!/fess_ds++.xml
2020-09-09 17:34:38,386 [main] INFO  ...Reading     esflute_config.xml
2020-09-09 17:34:38,447 [main] INFO  ...Reading       esclient.xml
2020-09-09 17:34:46,650 [main] INFO  ...Reading     esflute_user.xml
2020-09-09 17:34:46,657 [main] INFO  ...Reading       esclient.xml (recycle)
2020-09-09 17:34:46,685 [main] INFO  ...Reading     esflute_log.xml
2020-09-09 17:34:46,692 [main] INFO  ...Reading       esclient.xml (recycle)
2020-09-09 17:35:27,428 [main] INFO  ...Reading   crawler_es.xml
2020-09-09 17:35:27,631 [main] INFO  ...Reading     crawler/container.xml
2020-09-09 17:35:27,640 [main] INFO  ...Reading     crawler/client.xml
2020-09-09 17:35:27,646 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:27,647 [main] INFO  ...Reading       crawler/robotstxt.xml
2020-09-09 17:35:27,652 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-09 17:35:27,659 [main] INFO  ...Reading       crawler/contentlength.xml
2020-09-09 17:35:27,665 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-09 17:35:27,667 [main] INFO  ...Reading       crawler/mimetype.xml
2020-09-09 17:35:27,673 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-09 17:35:27,824 [main] INFO  ...Reading     crawler/rule.xml
2020-09-09 17:35:27,842 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:27,865 [main] INFO  ...Reading       crawler/transformer.xml
2020-09-09 17:35:27,936 [main] INFO  ...Reading         crawler/transformer_basic.xml
2020-09-09 17:35:28,011 [main] INFO  ...Reading           crawler/container.xml (recycle)
2020-09-09 17:35:30,366 [main] INFO  ...Reading     crawler/filter.xml
2020-09-09 17:35:30,372 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,377 [main] INFO  ...Reading     crawler/interval.xml
2020-09-09 17:35:30,383 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,386 [main] INFO  ...Reading     crawler/extractor.xml
2020-09-09 17:35:30,391 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,400 [main] INFO  ...Reading       crawler/extractor+tikaExtractor.xml
2020-09-09 17:35:30,405 [main] INFO  ...Reading         crawler/container.xml
2020-09-09 17:35:30,459 [main] INFO  ...Reading     crawler/mimetype.xml (recycle)
2020-09-09 17:35:30,460 [main] INFO  ...Reading     crawler/encoding.xml
2020-09-09 17:35:30,465 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,468 [main] INFO  ...Reading     crawler/urlconverter.xml
2020-09-09 17:35:30,473 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,475 [main] INFO  ...Reading     crawler/log.xml
2020-09-09 17:35:30,480 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,485 [main] INFO  ...Reading     crawler/sitemaps.xml
2020-09-09 17:35:30,490 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-09 17:35:30,495 [main] INFO  ...Reading     crawler/es.xml
2020-09-09 17:35:30,520 [main] INFO  ...Reading     crawler_es+crawlerThread.xml
2020-09-09 17:35:30,551 [main] INFO  ...Reading     crawler_es+crawlerConfig.xml
2020-09-09 17:35:30,558 [main] INFO  ...Reading   fess_thumbnail.xml
2020-09-09 17:35:30,583 [main] INFO  ...Reading   fess_ingest.xml
2020-09-09 17:35:31,234 [main] INFO  [Objective Config]
2020-09-09 17:35:31,235 [main] INFO   fess_config.properties extends [fess_env_crawler.properties]
2020-09-09 17:35:31,235 [main] INFO   checkImplicitOverride=true, propertyCount=458
2020-09-09 17:35:31,332 [main] INFO  [Exception Translator]
2020-09-09 17:35:31,332 [main] INFO   exceptionTranslationProvider: null
2020-09-09 17:35:31,334 [main] INFO  [Async Manager]
2020-09-09 17:35:31,334 [main] INFO   defaultConcurrentAsyncOption: {no option}
2020-09-09 17:35:31,335 [main] INFO   primaryExecutorService: ThreadPoolExecutor@14924f41
2020-09-09 17:35:31,335 [main] INFO   secondaryExecutorService: ThreadPoolExecutor@493da830
2020-09-09 17:35:31,335 [main] INFO   tertiaryExecutorService: ThreadPoolExecutor@1f939a0f
2020-09-09 17:35:31,336 [main] INFO  [Primary Cipher]
2020-09-09 17:35:31,336 [main] INFO   invertibleCryptographer: {AES, UTF-8}
2020-09-09 17:35:31,336 [main] INFO   oneWayCryptographer: {SHA-256, UTF-8}
2020-09-09 17:35:31,341 [main] INFO  [Time Manager]
2020-09-09 17:35:31,342 [main] INFO   businessTimeHandler: TypicalBusinessTimeHandler:{TypicalTimeResourceProvider$$Lambda$119/0x00000008403ab840, TypicalTimeResourceProvider$$Lambda$120/0x00000008403abc40}
2020-09-09 17:35:31,342 [main] INFO   currentIgnoreTransaction: false
2020-09-09 17:35:31,342 [main] INFO   adjustTimeMillis: 0
2020-09-09 17:35:31,342 [main] INFO   adjustAbsoluteMode: false
2020-09-09 17:35:31,435 [main] INFO  [JSON Manager]
2020-09-09 17:35:31,435 [main] INFO   realJsonParser: GsonJsonEngine
2020-09-09 17:35:31,441 [main] INFO   mapping: {CAMEL_TO_LOWER_SNAKE}
2020-09-09 17:35:31,442 [main] INFO  [Postbox]
2020-09-09 17:35:31,442 [main] INFO   postOffice: PostOffice@50ab56e2
2020-09-09 17:35:31,443 [main] INFO   postalParkingLot: SMailPostalParkingLot:{{category:{main}=motorbike:{session=javax.mail.Session@7b5b5bfe}}}@74834afd
2020-09-09 17:35:31,443 [main] INFO   postalPersonnel: FessMailDeliveryDepartmentCreator$1:{SMailConventionReceptionist:{[]}@75fd65c, batch:{[proofreader:{pmcomment}]}}@d499c13
2020-09-09 17:35:40,726 [main] INFO  Lasta Di boot successfully.
2020-09-09 17:35:40,729 [main] INFO    SmartDeploy Mode: Warm Deploy
2020-09-09 17:35:40,729 [main] INFO    Smart Package: org.codelibs.fess.app
2020-09-09 17:35:41,224 [main] INFO  Starting Crawler..
2020-09-09 17:35:45,138 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-232
2020-09-09 17:35:45,138 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-234
2020-09-09 17:35:56,347 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-233
2020-09-09 17:35:56,347 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-231
2020-09-09 17:35:56,731 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-229
2020-09-09 17:35:56,752 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-230
2020-09-09 17:35:57,083 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-227
2020-09-09 17:35:57,089 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-228
2020-09-09 17:35:57,393 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-225
2020-09-09 17:35:57,413 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-226
2020-09-09 17:35:57,710 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-223
2020-09-09 17:35:57,750 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-224
2020-09-09 17:35:58,037 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-221
... and much more
2020-09-09 18:18:46,011 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AC-2
2020-09-09 18:18:50,842 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836157440,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":15},"load_averages":[1.02, 1.23, 1.19]},"process":{"file_descriptor":{"open":264,"max":65535},"cpu":{"percent":4,"total":1181380},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":187866224,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131328024,"committed":194289664}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4939,"time":78258},"old":{"count":20,"time":4363}},"threads":{"count":23,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2699060},"elasticsearch":null,"timestamp":1599668330841}
2020-09-09 18:19:51,850 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836263936,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.63, 1.11, 1.15]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1181750},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":186591624,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131389424,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4940,"time":78273},"old":{"count":20,"time":4363}},"threads":{"count":22,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2760070},"elasticsearch":null,"timestamp":1599668391850}
2020-09-09 18:20:52,861 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836448256,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.45, 0.99, 1.11]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182010},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":186111208,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131403608,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4941,"time":78276},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2821080},"elasticsearch":null,"timestamp":1599668452861}
2020-09-09 18:21:53,872 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836395008,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.46, 0.92, 1.07]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182280},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":184832240,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131385152,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4942,"time":78280},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2882091},"elasticsearch":null,"timestamp":1599668513872}
2020-09-09 18:22:54,882 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":835993600,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.46, 0.86, 1.05]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182570},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":182921800,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131395824,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4943,"time":78282},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":2943101},"elasticsearch":null,"timestamp":1599668574882}
2020-09-09 18:23:55,892 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998199296,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.49, 0.83, 1.03]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182880},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":180790552,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131434320,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4944,"time":78287},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3004112},"elasticsearch":null,"timestamp":1599668635892}
2020-09-09 18:24:56,902 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998977536,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.42, 0.78, 0.99]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1183150},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":179809392,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131479320,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4945,"time":78291},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3065122},"elasticsearch":null,"timestamp":1599668696902}
... and much more of this above for the rest of log of this and the following day

I´am using Fess 13.8.0. I have installed fess-ds-atlassian plugin from admin page. Fess is installed on Cent OS 8 with rpm package.

2

Is an exception or an error included in logs?

test.environment may block an access from a crawler… it might be a DOS filter.

if Fess thinking the Jira Crawler is running, it doesnt start a new one on next day…

A crawler does not start if a previous crawling is not finished.

3

Hi, there is no error or exception in logs, thats why i dont understand. It just crawl Jira with all its URL´s. And normally there should be something in logs like [main] INFO Finished Crawler , also for Jira Crawler:

2020-09-09 16:49:37,195 [n8vXTXMBGfiIN_VakdsL-1] INFO  Sent 8 docs (Doc:{process 536ms, send 42ms, size 42KB}, Mem:{used 181MB, heap 460MB, max 512MB})
2020-09-09 16:49:37,656 [n8vXTXMBGfiIN_VakdsL-1] INFO  Deleted 0 old docs.
2020-09-09 16:49:37,656 [DataStoreCrawler] INFO  [EXEC TIME] crawling time: 2050243ms
2020-09-09 16:49:37,674 [main] INFO  Finished Crawler
2020-09-09 16:49:40,765 [main] INFO  [CRAWL INFO] DataCrawlExecTime=2050243,DataCrawlEndTime=2020-09-09T16:49:37.657+0200,CrawlerEndTime=2020-09-09T16:49:37.674+0200,DataIndexExecTime=106955,CrawlerStatus=true,CrawlerStartTime=2020-09-09T16:15:27.136+0200,DataIndexSize=4038,CrawlerExecTime=2050539,DataCrawlStartTime=2020-09-09T16:15:27.302+0200
2020-09-09 16:49:40,770 [main] INFO  Disconnected to http://localhost:9200
2020-09-09 16:49:40,783 [main] INFO  Destroyed LaContainer.

But this does not appear in logs for crawler of Jira. It just ran crawling of all Jira content and does not set the status that the crawler is finished… After crawling of Jira just comes the INFO [SYSTEM MONITOR in logs every time.

... crawling of jira urls
2020-09-09 18:18:45,036 [pool-6-thread-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AIP-3
2020-09-09 18:18:45,220 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AD-3
2020-09-09 18:18:45,329 [pool-6-thread-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AIP-1
2020-09-09 18:18:45,564 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AD-1
2020-09-09 18:18:45,679 [pool-6-thread-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AD-2
2020-09-09 18:18:45,876 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AC-1
2020-09-09 18:18:46,011 [pool-6-thread-1] INFO  Crawling URL:https://test.environment:87777/jira/browse/AC-2
2020-09-09 18:18:50,842 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836157440,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":15},"load_averages":[1.02, 1.23, 1.19]},"process":{"file_descriptor":{"open":264,"max":65535},"cpu":{"percent":4,"total":1181380},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":187866224,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131328024,"committed":194289664}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4939,"time":78258},"old":{"count":20,"time":4363}},"threads":{"count":23,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2699060},"elasticsearch":null,"timestamp":1599668330841}
2020-09-09 18:19:51,850 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836263936,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.63, 1.11, 1.15]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1181750},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":186591624,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131389424,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4940,"time":78273},"old":{"count":20,"time":4363}},"threads":{"count":22,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2760070},"elasticsearch":null,"timestamp":1599668391850}
2020-09-09 18:20:52,861 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836448256,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.45, 0.99, 1.11]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182010},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":186111208,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131403608,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4941,"time":78276},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2821080},"elasticsearch":null,"timestamp":1599668452861}
2020-09-09 18:21:53,872 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":836395008,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.46, 0.92, 1.07]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182280},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":184832240,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131385152,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4942,"time":78280},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14887,"total_loaded":88632,"unloaded":73745},"uptime":2882091},"elasticsearch":null,"timestamp":1599668513872}
2020-09-09 18:22:54,882 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":835993600,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.46, 0.86, 1.05]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182570},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":182921800,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131395824,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4943,"time":78282},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":2943101},"elasticsearch":null,"timestamp":1599668574882}
2020-09-09 18:23:55,892 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998199296,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.49, 0.83, 1.03]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1182880},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":180790552,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131434320,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4944,"time":78287},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3004112},"elasticsearch":null,"timestamp":1599668635892}
2020-09-09 18:24:56,902 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998977536,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.42, 0.78, 0.99]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1183150},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":179809392,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131479320,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4945,"time":78291},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3065122},"elasticsearch":null,"timestamp":1599668696902}
2020-09-09 18:25:56,917 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":1000030208,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.4, 0.73, 0.97]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1183420},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":176743104,"committed":471859200,"max":536870912,"percent":32},"non_heap":{"used":131493144,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4946,"time":78293},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3125135},"elasticsearch":null,"timestamp":1599668756917}
2020-09-09 18:26:57,926 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":999993344,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.35, 0.68, 0.93]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1183680},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":194568896,"committed":471859200,"max":536870912,"percent":36},"non_heap":{"used":131498272,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4946,"time":78293},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3186145},"elasticsearch":null,"timestamp":1599668817926}
2020-09-09 18:27:58,937 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":999845888,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.42, 0.66, 0.91]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1184160},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":191479704,"committed":471859200,"max":536870912,"percent":35},"non_heap":{"used":131540408,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4947,"time":78298},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3247157},"elasticsearch":null,"timestamp":1599668878937}
2020-09-09 18:28:59,947 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":999936000,"total":21040566272},"swap_space":{"free":8135929856,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.5, 0.68, 0.9]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1184440},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":190485640,"committed":471859200,"max":536870912,"percent":35},"non_heap":{"used":131566760,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4948,"time":78303},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3308166},"elasticsearch":null,"timestamp":1599668939947}
2020-09-09 18:30:00,956 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":918196224,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.92, 0.79, 0.93]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1184700},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":188464752,"committed":471859200,"max":536870912,"percent":35},"non_heap":{"used":131564952,"committed":194355200}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4949,"time":78306},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3369176},"elasticsearch":null,"timestamp":1599669000956}
2020-09-09 18:31:01,968 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":868564992,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.69, 0.72, 0.89]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1185060},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":186368552,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131594544,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4950,"time":78310},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3430186},"elasticsearch":null,"timestamp":1599669061968}
2020-09-09 18:32:02,978 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":841789440,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":11},"load_averages":[0.74, 0.74, 0.89]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1185380},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":184523464,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131732536,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4951,"time":78313},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3491197},"elasticsearch":null,"timestamp":1599669122978}
2020-09-09 18:33:03,990 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":835772416,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.72, 0.72, 0.87]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1185650},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":182428664,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131737256,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4952,"time":78316},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3552207},"elasticsearch":null,"timestamp":1599669183990}
2020-09-09 18:34:05,003 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":790917120,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.72, 0.73, 0.87]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1185950},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":180468744,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131761576,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4953,"time":78320},"old":{"count":20,"time":4363}},"threads":{"count":20,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3613219},"elasticsearch":null,"timestamp":1599669245003}
2020-09-09 18:35:05,017 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":790564864,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.74, 0.73, 0.86]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1186250},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":178257064,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":131789208,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4954,"time":78322},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3673233},"elasticsearch":null,"timestamp":1599669305017}
2020-09-09 18:36:06,025 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":742801408,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[1.02, 0.78, 0.86]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1186510},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":176420800,"committed":471859200,"max":536870912,"percent":32},"non_heap":{"used":131787544,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4955,"time":78326},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3734244},"elasticsearch":null,"timestamp":1599669366025}
2020-09-09 18:37:07,038 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":724230144,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.91, 0.75, 0.84]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1186760},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":194246592,"committed":471859200,"max":536870912,"percent":36},"non_heap":{"used":131804928,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4955,"time":78326},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3795256},"elasticsearch":null,"timestamp":1599669427038}
2020-09-09 18:38:08,049 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":725237760,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.95, 0.75, 0.83]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1187290},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":192123888,"committed":471859200,"max":536870912,"percent":35},"non_heap":{"used":131858736,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4956,"time":78329},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3856266},"elasticsearch":null,"timestamp":1599669488049}
2020-09-09 18:39:08,069 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":717135872,"total":21040566272},"swap_space":{"free":8136716288,"total":8588881920}},"cpu":{"percent":8},"load_averages":[0.96, 0.74, 0.82]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1187530},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":188950504,"committed":471859200,"max":536870912,"percent":35},"non_heap":{"used":131870688,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4957,"time":78332},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3916281},"elasticsearch":null,"timestamp":1599669548069}
2020-09-09 18:40:09,076 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":703356928,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":11},"load_averages":[1.06, 0.78, 0.83]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1187830},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":187100088,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":131942240,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4958,"time":78337},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":3977291},"elasticsearch":null,"timestamp":1599669609076}
2020-09-09 18:41:10,092 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":692891648,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":11},"load_averages":[1.08, 0.78, 0.82]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1188130},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":184984808,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":132041496,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4959,"time":78340},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":4038302},"elasticsearch":null,"timestamp":1599669670092}
2020-09-09 18:42:10,108 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":710774784,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":10},"load_averages":[1.33, 0.84, 0.83]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1188400},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":182864808,"committed":471859200,"max":536870912,"percent":34},"non_heap":{"used":132043784,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4960,"time":78343},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":4098326},"elasticsearch":null,"timestamp":1599669730108}
2020-09-09 18:43:11,115 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998723584,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":10},"load_averages":[1.17, 0.83, 0.83]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1188660},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":180968872,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":132054344,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4961,"time":78345},"old":{"count":20,"time":4363}},"threads":{"count":20,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":4159335},"elasticsearch":null,"timestamp":1599669791115}
2020-09-09 18:44:11,125 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998600704,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.92, 0.79, 0.81]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1188910},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":177853136,"committed":471859200,"max":536870912,"percent":33},"non_heap":{"used":132055368,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4962,"time":78349},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":4219346},"elasticsearch":null,"timestamp":1599669851125}
2020-09-09 18:45:11,138 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998400000,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.98, 0.79, 0.81]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1189150},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":195678928,"committed":471859200,"max":536870912,"percent":36},"non_heap":{"used":132056264,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4962,"time":78349},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":4279358},"elasticsearch":null,"timestamp":1599669911138}
2020-09-09 18:46:11,158 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":998658048,"total":21040566272},"swap_space":{"free":8137502720,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.92, 0.78, 0.8]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1189440},"virtual_memory":{"total":4230721536}},"jvm":{"memory":{"heap":{"used":193652352,"committed":471859200,"max":536870912,"percent":36},"non_heap":{"used":132112152,"committed":194420736}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":4963,"time":78352},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":24},"classes":{"loaded":14888,"total_loaded":88633,"unloaded":73745},"uptime":4339377},"elasticsearch":null,"timestamp":1599669971158}

The status of Jira crawler doesnt change… it is shown in admin gui as running the whole time. And the new Jira Crawler of next day doesnt start…

grafik
grafik1444×462 13.1 KB

The access to Jira is not blocked…

4

You can take a thread dump on Crawling Info page. It’ll help to look into this problem.

5

I created thread dump and downloaded it. I cant find an error or exception there. It looks normal. But the filetyp .log is not allowed for this forum. You can download file from there:

The crawler started at 2020-09-09.

This is how Crawling Info page of Jira Crawler looks:

grafik
grafik1664×267 11.7 KB

6

Where is the thread dump?

7

If i click on Button, it says that a logfile is generated. I thought it is gc-crawler.log. Isnt it? Where else i can find the thread dump?

8

It’s stored into fess-crawler.log.

9

I´am sy, here is the output:

2020-09-10 14:24:08,327 [ProcessCommand] INFO  Thread: Thread[main,5,main]
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1305)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1379)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.joinCrawlerThread(Crawler.java:549)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.doCrawl(Crawler.java:516)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.process(Crawler.java:352)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.main(Crawler.java:268)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599665739953,5,main]
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  Thread: Thread[Signal Dispatcher,9,system]
2020-09-10 14:24:08,327 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-3,5,main]
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,327 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-10 14:24:08,327 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599665739927,5,main]
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-1,5,main]
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599665739898,5,main]
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  Thread: Thread[ProcessCommand,5,main]
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.dumpThreads(Native Method)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.getAllStackTraces(Thread.java:1657)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.processThreadDump(ThreadDumpUtil.java:66)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.printThreadDump(ThreadDumpUtil.java:39)
2020-09-10 14:24:08,328 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$main$3(Crawler.java:247)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$790/0x0000000840627840.run(Unknown Source)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  Thread: Thread[DataStoreCrawler,5,main]
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1313)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.awaitTermination(DataIndexHelper.java:286)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.doCrawl(DataIndexHelper.java:146)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.crawl(DataIndexHelper.java:77)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$doCrawl$8(Crawler.java:509)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$863/0x0000000840658840.run(Unknown Source)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  Thread: Thread[Finalizer,8,system]
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  Thread: Thread[Reference Handler,10,system]
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  Thread: Thread[ThumbnailGenerator,5,main]
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager.lambda$init$0(ThumbnailManager.java:123)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager$$Lambda$739/0x0000000840605c40.run(Unknown Source)
2020-09-10 14:24:08,329 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  Thread: Thread[CoreLib-TimeoutManager,5,main]
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at app//org.codelibs.core.timer.TimeoutManager.run(TimeoutManager.java:171)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  Thread: Thread[pool-6-thread-1,5,main]
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599665739974,5,main]
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  Thread: Thread[Common-Cleaner,8,InnocuousThreadGroup]
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2020-09-10 14:24:08,330 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  Thread: Thread[Ga1RQ3QBUxhlljYOKf80-1,5,main]
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead0(Native Method)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:168)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:140)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1096)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:816)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:754)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:689)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1610)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1515)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:334)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:269)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:249)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.lambda$connect$3(CurlRequest.java:199)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$$Lambda$383/0x0000000840478040.run(Unknown Source)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.connect(CurlRequest.java:211)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.execute(CurlRequest.java:230)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.Request.getCurlResponse(Request.java:101)
2020-09-10 14:24:08,331 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.Request.getCurlResponse(Request.java:70)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.search.SearchRequest.execute(SearchRequest.java:78)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.JiraClient.getIssues(JiraClient.java:102)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.JiraDataStore.storeData(JiraDataStore.java:69)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.AbstractDataStore.store(AbstractDataStore.java:111)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.process(DataIndexHelper.java:216)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.run(DataIndexHelper.java:202)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-2,5,main]
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  Thread: Thread[Keep-Alive-Timer,8,InnocuousThreadGroup]
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.KeepAliveCache.run(KeepAliveCache.java:168)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-10 14:24:08,332 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2020-09-10 14:24:53,933 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":873689088,"total":21040566272},"swap_space":{"free":7863267328,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.37, 0.55, 0.6]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1603170},"virtual_memory":{"total":4367044608}},"jvm":{"memory":{"heap":{"used":262378024,"committed":471859200,"max":536870912,"percent":48},"non_heap":{"used":138029448,"committed":196255744}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":6,"used":519073,"capacity":519073}},"gc":{"young":{"count":5984,"time":87888},"old":{"count":20,"time":4363}},"threads":{"count":21,"peak":27},"classes":{"loaded":15175,"total_loaded":88920,"unloaded":73745},"uptime":75062153},"elasticsearch":null,"timestamp":1599740693933}
10

test.environment blocks an access from the crawler.
Fess crawler is waiting for the response…
So, I think your environment hits a limit or the like for JIRA.

11

I can access test.environment with the account which i use for crawling without any problems… I also tried REST API to access which works fine…

There are also no problems to see in Jira Logging. The system is also not overloaded…

I´am not sure if there is maybe a bug in fess-ds-atlassian Plugin.
If this is the case, that a timeout exceed, could you please improve Logging for cases like timeout?

Thanks for your answers.

12

I added some fixes and released fess-ds-atlassian 13.8.1 to maven repository(it will be available soon…).
Could you replace and try it?

13

Thanks for update. I uninstalled the old plugin of fess-ds-atlassian 13.8.0 on admin page and installed the new one from admin page fess-ds-atlassain 13.8.1.

I crawled Confluence two times. I received both times a java.lang.NullPointerException:

exception
exception1667×738 39 KB

meldung2
meldung21661×750 39.4 KB

It seems to crawl all urls in Confluence, but throw at the end the Null Pointer Exception. This is output of fess-crawler.log:

2020-09-11 09:44:12,673 [main] INFO  Starting Crawler..
2020-09-11 09:44:18,984 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=3309572
2020-09-11 09:44:18,983 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=1048579
2020-09-11 09:44:21,665 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=1212445
2020-09-11 09:44:21,676 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=4587531
2020-09-11 09:44:22,167 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=4587527
... many URLs are crawled
2020-09-11 10:00:17,523 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=215220493
2020-09-11 10:00:17,853 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=215908356
2020-09-11 10:00:17,860 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=215220504
2020-09-11 10:00:18,198 [n8vXTXMBGfiIN_VakdsL-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=215908380
2020-09-11 10:00:18,198 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=215908375
2020-09-11 10:00:18,519 [pool-6-thread-1] INFO  Crawling URL: https://test.environment/confluence/pages/viewpage.action?pageId=215908394
2020-09-11 10:00:23,040 [n8vXTXMBGfiIN_VakdsL-1] ERROR Failed to process a data crawling: Confluence Crawler
java.lang.NullPointerException: null
	at org.codelibs.fess.ds.atlassian.api.confluence.content.GetContentsRequest.parseResponse(GetContentsRequest.java:92) ~[fess-ds-atlassian-13.8.1.jar:?]
	at org.codelibs.fess.ds.atlassian.api.confluence.content.GetContentsRequest.execute(GetContentsRequest.java:87) ~[fess-ds-atlassian-13.8.1.jar:?]
	at org.codelibs.fess.ds.atlassian.api.confluence.ConfluenceClient.getContents(ConfluenceClient.java:94) ~[fess-ds-atlassian-13.8.1.jar:?]
	at org.codelibs.fess.ds.atlassian.ConfluenceDataStore.storeData(ConfluenceDataStore.java:65) ~[fess-ds-atlassian-13.8.1.jar:?]
	at org.codelibs.fess.ds.AbstractDataStore.store(AbstractDataStore.java:111) ~[classes/:?]
	at org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.process(DataIndexHelper.java:216) [classes/:?]
	at org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.run(DataIndexHelper.java:202) [classes/:?]
2020-09-11 10:00:23,472 [n8vXTXMBGfiIN_VakdsL-1] INFO  Sent 56 docs (Doc:{process 897ms, send 371ms, size 583KB}, Mem:{used 169MB, heap 431MB, max 512MB})
2020-09-11 10:00:23,564 [n8vXTXMBGfiIN_VakdsL-1] INFO  Deleted 0 old docs.
2020-09-11 10:00:23,565 [DataStoreCrawler] INFO  [EXEC TIME] crawling time: 970654ms
2020-09-11 10:00:23,566 [main] INFO  Finished Crawler
2020-09-11 10:00:23,614 [main] INFO  [CRAWL INFO] DataCrawlExecTime=970654,DataCrawlEndTime=2020-09-11T10:00:23.565+0200,CrawlerEndTime=2020-09-11T10:00:23.566+0200,DataIndexExecTime=28352,CrawlerStatus=true,CrawlerStartTime=2020-09-11T09:44:12.673+0200,DataIndexSize=2300,CrawlerExecTime=970893,DataCrawlStartTime=2020-09-11T09:44:12.869+0200
2020-09-11 10:00:23,618 [main] INFO  Disconnected to http://localhost:9200
2020-09-11 10:00:23,621 [main] INFO  Destroyed LaContainer.

Jira Crawler is crawling URLs but doesnt seem to finish again:

Many URLs are crawled again...
2020-09-11 10:51:23,197 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AIP-3
2020-09-11 10:51:23,493 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AD-3
2020-09-11 10:51:23,494 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AIP-1
2020-09-11 10:51:23,768 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AD-1
2020-09-11 10:51:23,768 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AD-2
2020-09-11 10:51:24,097 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AC-1
2020-09-11 10:51:24,103 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AC-2
2020-09-11 10:51:26,682 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14167609344,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":16},"load_averages":[1.35, 1.1, 1.02]},"process":{"file_descriptor":{"open":265,"max":65535},"cpu":{"percent":4,"total":975560},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":185008520,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":130537904,"committed":197197824}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5957,"time":31122},"old":{"count":22,"time":4493}},"threads":{"count":23,"peak":25},"classes":{"loaded":14625,"total_loaded":88615,"unloaded":73990},"uptime":2594918},"elasticsearch":null,"timestamp":1599814286682}
2020-09-11 10:52:26,700 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14151278592,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":9},"load_averages":[1.04, 1.04, 1.0]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":976070},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":171420104,"committed":397410304,"max":536870912,"percent":31},"non_heap":{"used":130610168,"committed":197197824}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5959,"time":31129},"old":{"count":22,"time":4493}},"threads":{"count":22,"peak":25},"classes":{"loaded":14627,"total_loaded":88617,"unloaded":73990},"uptime":2654936},"elasticsearch":null,"timestamp":1599814346700}
2020-09-11 10:53:27,707 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14143127552,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":8},"load_averages":[0.85, 0.97, 0.98]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":976420},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":172998800,"committed":397410304,"max":536870912,"percent":32},"non_heap":{"used":130633712,"committed":197263360}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5960,"time":31133},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14627,"total_loaded":88617,"unloaded":73990},"uptime":2715942},"elasticsearch":null,"timestamp":1599814407707}
.... every time same status of  [pool-5-thread-1], [pool-5-thread-2],[pool-5-thread-3]
2020-09-11 11:20:50,008 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14264651776,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":11},"load_averages":[0.56, 0.65, 0.69]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":984070},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":181351360,"committed":397410304,"max":536870912,"percent":33},"non_heap":{"used":131313008,"committed":197394432}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5988,"time":31216},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14628,"total_loaded":88618,"unloaded":73990},"uptime":4358243},"elasticsearch":null,"timestamp":1599816050007}
2020-09-11 11:21:51,019 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14242783232,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":11},"load_averages":[0.74, 0.7, 0.71]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":984320},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":181320632,"committed":397410304,"max":536870912,"percent":33},"non_heap":{"used":131320048,"committed":197394432}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5989,"time":31219},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14628,"total_loaded":88618,"unloaded":73990},"uptime":4419251},"elasticsearch":null,"timestamp":1599816111019}
2020-09-11 11:22:52,025 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14234505216,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":11},"load_averages":[0.66, 0.72, 0.72]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":984590},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":182554088,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":131327856,"committed":197394432}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5990,"time":31221},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14628,"total_loaded":88618,"unloaded":73990},"uptime":4480261},"elasticsearch":null,"timestamp":1599816172025}
2020-09-11 11:23:53,038 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14215602176,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.58, 0.71, 0.71]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":984850},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":182551816,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":131323760,"committed":197394432}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5991,"time":31224},"old":{"count":22,"time":4493}},"threads":{"count":20,"peak":25},"classes":{"loaded":14628,"total_loaded":88618,"unloaded":73990},"uptime":4541272},"elasticsearch":null,"timestamp":1599816233038}
2020-09-11 11:24:53,054 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14197301248,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.53, 0.69, 0.71]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":985090},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":182745672,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":131325680,"committed":197394432}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5992,"time":31227},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14628,"total_loaded":88618,"unloaded":73990},"uptime":4601288},"elasticsearch":null,"timestamp":1599816293054}
2020-09-11 11:25:53,075 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":14195228672,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.48, 0.68, 0.7]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":985320},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":183737560,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":131310344,"committed":197394432}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5993,"time":31229},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14628,"total_loaded":88618,"unloaded":73990},"uptime":4661306},"elasticsearch":null,"timestamp":1599816353075}

The Jira Crawler is still running… I am not sure if it hangs every time on same Jira URL:
[pool-6-thread-1] https://test.environment:87777/jira/browse/AC-2

After this every time comes INFO [pool-5-thread-1], INFO [pool-5-thread-2], INFO [pool-5-thread-3] in log,but no [pool-6-thread-1].

The issue AC-2 has no issue.description + issue.comments. Maybe there comes the error from? Is this case checked in Plugin?

14

In Logs no Jira URLs are crawled, but Jira Crawler is still showing in admin gui as running…

grafik
grafik1637×378 16.8 KB

In logs there is just every time:

2020-09-11 13:56:03,981 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13775179776,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":11},"load_averages":[0.44, 0.58, 0.63]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1025460},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":187485408,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":133345904,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6154,"time":31884},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":13672216},"elasticsearch":null,"timestamp":1599825363981}
2020-09-11 13:57:04,991 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13745176576,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.56, 0.57, 0.62]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1025720},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":190816664,"committed":397410304,"max":536870912,"percent":35},"non_heap":{"used":133348640,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6155,"time":31888},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":13733225},"elasticsearch":null,"timestamp":1599825424991}
2020-09-11 13:58:05,999 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13680615424,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.52, 0.53, 0.6]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1025980},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":192845208,"committed":397410304,"max":536870912,"percent":35},"non_heap":{"used":133348768,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6156,"time":31890},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":13794235},"elasticsearch":null,"timestamp":1599825485999}
2020-09-11 13:59:07,010 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13683339264,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.7, 0.56, 0.6]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1026240},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":194898904,"committed":397410304,"max":536870912,"percent":36},"non_heap":{"used":133351200,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6157,"time":31893},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":13855246},"elasticsearch":null,"timestamp":1599825547010}
2020-09-11 14:00:07,037 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13666131968,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.88, 0.63, 0.63]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1026470},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":195924936,"committed":397410304,"max":536870912,"percent":36},"non_heap":{"used":133352352,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6158,"time":31895},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":13915270},"elasticsearch":null,"timestamp":1599825607037}
2020-09-11 14:01:08,044 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13671378944,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.95, 0.73, 0.66]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1026720},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":198484184,"committed":397410304,"max":536870912,"percent":36},"non_heap":{"used":133352352,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6159,"time":31898},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":13976280},"elasticsearch":null,"timestamp":1599825668044}
2020-09-11 14:02:08,067 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13664247808,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.64, 0.66, 0.64]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1026950},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":199485672,"committed":397410304,"max":536870912,"percent":37},"non_heap":{"used":133352352,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6160,"time":31901},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":14036295},"elasticsearch":null,"timestamp":1599825728067}
2020-09-11 14:03:09,079 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":13611433984,"total":21040566272},"swap_space":{"free":8565301248,"total":8588881920}},"cpu":{"percent":11},"load_averages":[1.01, 0.79, 0.69]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1027200},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":185904624,"committed":397410304,"max":536870912,"percent":34},"non_heap":{"used":133352352,"committed":197853184}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":6162,"time":31908},"old":{"count":22,"time":4493}},"threads":{"count":21,"peak":25},"classes":{"loaded":14649,"total_loaded":88639,"unloaded":73990},"uptime":14097308},"elasticsearch":null,"timestamp":1599825789079}

I added thread dump of Jira Crawler:

2020-09-11 14:03:55,249 [ProcessCommand] INFO  Thread: Thread[Common-Cleaner,8,InnocuousThreadGroup]
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599811700486,5,main]
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599811700503,5,main]
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  Thread: Thread[ThumbnailGenerator,5,main]
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager.lambda$init$0(ThumbnailManager.java:123)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager$$Lambda$739/0x0000000840606c40.run(Unknown Source)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,249 [ProcessCommand] INFO  Thread: Thread[Finalizer,8,system]
2020-09-11 14:03:55,249 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  Thread: Thread[ProcessCommand,5,main]
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.dumpThreads(Native Method)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.getAllStackTraces(Thread.java:1657)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.processThreadDump(ThreadDumpUtil.java:66)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.printThreadDump(ThreadDumpUtil.java:39)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$main$3(Crawler.java:247)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$790/0x0000000840627840.run(Unknown Source)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  Thread: Thread[Ga1RQ3QBUxhlljYOKf80-1,5,main]
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead0(Native Method)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:168)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:140)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1096)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:816)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:754)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:689)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1610)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1515)
2020-09-11 14:03:55,250 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:334)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:269)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:249)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.lambda$connect$3(CurlRequest.java:199)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$$Lambda$383/0x0000000840478040.run(Unknown Source)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.connect(CurlRequest.java:211)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.execute(CurlRequest.java:230)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.Request.getCurlResponse(Request.java:100)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.Request.getCurlResponse(Request.java:69)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.search.SearchRequest.execute(SearchRequest.java:78)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.JiraClient.getIssues(JiraClient.java:102)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.JiraDataStore.storeData(JiraDataStore.java:69)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.AbstractDataStore.store(AbstractDataStore.java:111)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.process(DataIndexHelper.java:216)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.run(DataIndexHelper.java:202)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-3,5,main]
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-11 14:03:55,251 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  Thread: Thread[pool-6-thread-1,5,main]
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  Thread: Thread[Reference Handler,10,system]
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599811700448,5,main]
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-11 14:03:55,252 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-2,5,main]
2020-09-11 14:03:55,252 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  Thread: Thread[main,5,main]
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1305)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1379)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.joinCrawlerThread(Crawler.java:549)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.doCrawl(Crawler.java:516)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.process(Crawler.java:352)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.main(Crawler.java:268)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  Thread: Thread[CoreLib-TimeoutManager,5,main]
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.core.timer.TimeoutManager.run(TimeoutManager.java:171)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  Thread: Thread[Signal Dispatcher,9,system]
2020-09-11 14:03:55,253 [ProcessCommand] INFO  Thread: Thread[DataStoreCrawler,5,main]
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1313)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.awaitTermination(DataIndexHelper.java:286)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.doCrawl(DataIndexHelper.java:146)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.crawl(DataIndexHelper.java:77)
2020-09-11 14:03:55,253 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$doCrawl$8(Crawler.java:509)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$840/0x000000084064bc40.run(Unknown Source)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-1,5,main]
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1599811700469,5,main]
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-11 14:03:55,254 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-11 14:03:55,254 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  Thread: Thread[Keep-Alive-Timer,8,InnocuousThreadGroup]
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.KeepAliveCache.run(KeepAliveCache.java:168)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-11 14:03:55,255 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
15

I updated it and could you replace with fess-ds-atlassian-13.8.2-20200911.131625-1.jar?

16

Thanks for update, I replaced with this .jar file and tested.
The java.lang.NullPointerException when crawling Confluence does not appear anymore.

The Crawler of Jira is running again endless…

grafik
grafik1604×48 1.83 KB

Jira URLs are crawled for maybe 45 minutes. After this just INFO [SYSTEM MONITOR] appeared in fess-crawler.log. Now Jira Crawler is running in admin gui for maybe 12 hours.


2020-09-14 10:01:56,185 [main] INFO  ...Loading specified properties and get by the key: fess_env_crawler.properties, lasta_di.smart.deploy.mode
2020-09-14 10:01:56,200 [main] INFO  ...Setting smart deploy mode: warm
2020-09-14 10:01:56,240 [main] INFO  ...Reading lasta_di.xml
2020-09-14 10:01:56,291 [main] INFO  ...Reading   redefiner.xml
2020-09-14 10:01:56,371 [main] INFO  ...Reading   smartdeploy.xml
2020-09-14 10:01:56,429 [main] INFO  ...Reading     smart/warmdeploy.xml
2020-09-14 10:01:56,437 [main] INFO  ...Reading       convention.xml
2020-09-14 10:01:56,447 [main] INFO  ...Reading         embedded_convention.xml
2020-09-14 10:01:56,471 [main] INFO  ...Reading       creator.xml
2020-09-14 10:01:56,479 [main] INFO  ...Reading         convention.xml (recycle)
2020-09-14 10:01:56,479 [main] INFO  ...Reading         customizer.xml
2020-09-14 10:01:56,487 [main] INFO  ...Reading           lastafw_customizer.xml
2020-09-14 10:01:56,506 [main] INFO  ...Reading           embedded_customizer.xml
2020-09-14 10:01:56,518 [main] INFO  ...Reading             tx_customizer.xml
2020-09-14 10:01:56,549 [main] INFO  ...Reading         my_creator.xml
2020-09-14 10:01:56,557 [main] INFO  ...Reading         lastafw_creator.xml
2020-09-14 10:01:56,563 [main] INFO  ...Reading           convention.xml (recycle)
2020-09-14 10:01:56,564 [main] INFO  ...Reading           customizer.xml (recycle)
2020-09-14 10:01:56,581 [main] INFO  ...Reading         embedded_creator.xml
2020-09-14 10:01:56,592 [main] INFO  ...Reading           convention.xml (recycle)
2020-09-14 10:01:56,593 [main] INFO  ...Reading           customizer.xml (recycle)
2020-09-14 10:01:56,609 [main] INFO  ...Reading       customizer.xml (recycle)
2020-09-14 10:01:56,670 [main] INFO  ...Reading app.xml
2020-09-14 10:01:56,678 [main] INFO  ...Reading   convention.xml
2020-09-14 10:01:56,686 [main] INFO  ...Reading     embedded_convention.xml
2020-09-14 10:01:56,694 [main] INFO  ...Reading   lastaflute_core.xml
2020-09-14 10:01:56,701 [main] INFO  ...Reading     lastaflute_assist.xml
2020-09-14 10:01:56,707 [main] INFO  ...Reading       lastaflute_director.xml
2020-09-14 10:01:56,867 [main] INFO  ...Reading   fess.xml
2020-09-14 10:01:56,873 [main] INFO  ...Reading     fess_config.xml
2020-09-14 10:01:56,884 [main] INFO  ...Reading     fess_ds.xml
2020-09-14 10:01:56,897 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-csv-13.8.0.jar!/fess_ds++.xml
2020-09-14 10:01:56,916 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-db-13.8.0.jar!/fess_ds++.xml
2020-09-14 10:01:56,926 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-elasticsearch-13.8.0.jar!/fess_ds++.xml
2020-09-14 10:01:56,941 [main] INFO  ...Reading       jar:file:/usr/share/fess/app/WEB-INF/plugin/fess-ds-atlassian-13.8.2-20200911.131625-1.jar!/fess_ds++.xml
2020-09-14 10:01:56,960 [main] INFO  ...Reading     esflute_config.xml
2020-09-14 10:01:56,966 [main] INFO  ...Reading       esclient.xml
2020-09-14 10:01:57,272 [main] INFO  ...Reading     esflute_user.xml
2020-09-14 10:01:57,278 [main] INFO  ...Reading       esclient.xml (recycle)
2020-09-14 10:01:57,299 [main] INFO  ...Reading     esflute_log.xml
2020-09-14 10:01:57,305 [main] INFO  ...Reading       esclient.xml (recycle)
2020-09-14 10:01:58,926 [main] INFO  ...Reading   crawler_es.xml
2020-09-14 10:01:58,933 [main] INFO  ...Reading     crawler/container.xml
2020-09-14 10:01:58,942 [main] INFO  ...Reading     crawler/client.xml
2020-09-14 10:01:58,947 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:58,948 [main] INFO  ...Reading       crawler/robotstxt.xml
2020-09-14 10:01:58,953 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-14 10:01:58,959 [main] INFO  ...Reading       crawler/contentlength.xml
2020-09-14 10:01:58,965 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-14 10:01:58,967 [main] INFO  ...Reading       crawler/mimetype.xml
2020-09-14 10:01:58,973 [main] INFO  ...Reading         crawler/container.xml (recycle)
2020-09-14 10:01:59,088 [main] INFO  ...Reading     crawler/rule.xml
2020-09-14 10:01:59,094 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,094 [main] INFO  ...Reading       crawler/transformer.xml
2020-09-14 10:01:59,099 [main] INFO  ...Reading         crawler/transformer_basic.xml
2020-09-14 10:01:59,105 [main] INFO  ...Reading           crawler/container.xml (recycle)
2020-09-14 10:01:59,173 [main] INFO  ...Reading     crawler/filter.xml
2020-09-14 10:01:59,181 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,187 [main] INFO  ...Reading     crawler/interval.xml
2020-09-14 10:01:59,193 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,196 [main] INFO  ...Reading     crawler/extractor.xml
2020-09-14 10:01:59,201 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,210 [main] INFO  ...Reading       crawler/extractor+tikaExtractor.xml
2020-09-14 10:01:59,214 [main] INFO  ...Reading         crawler/container.xml
2020-09-14 10:01:59,268 [main] INFO  ...Reading     crawler/mimetype.xml (recycle)
2020-09-14 10:01:59,268 [main] INFO  ...Reading     crawler/encoding.xml
2020-09-14 10:01:59,273 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,275 [main] INFO  ...Reading     crawler/urlconverter.xml
2020-09-14 10:01:59,281 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,283 [main] INFO  ...Reading     crawler/log.xml
2020-09-14 10:01:59,287 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,291 [main] INFO  ...Reading     crawler/sitemaps.xml
2020-09-14 10:01:59,296 [main] INFO  ...Reading       crawler/container.xml (recycle)
2020-09-14 10:01:59,301 [main] INFO  ...Reading     crawler/es.xml
2020-09-14 10:01:59,324 [main] INFO  ...Reading     crawler_es+crawlerThread.xml
2020-09-14 10:01:59,352 [main] INFO  ...Reading     crawler_es+crawlerConfig.xml
2020-09-14 10:01:59,359 [main] INFO  ...Reading   fess_thumbnail.xml
2020-09-14 10:01:59,376 [main] INFO  ...Reading   fess_ingest.xml
2020-09-14 10:01:59,657 [main] INFO  [Objective Config]
2020-09-14 10:01:59,657 [main] INFO   fess_config.properties extends [fess_env_crawler.properties]
2020-09-14 10:01:59,658 [main] INFO   checkImplicitOverride=true, propertyCount=458
2020-09-14 10:01:59,748 [main] INFO  [Exception Translator]
2020-09-14 10:01:59,748 [main] INFO   exceptionTranslationProvider: null
2020-09-14 10:01:59,749 [main] INFO  [Async Manager]
2020-09-14 10:01:59,749 [main] INFO   defaultConcurrentAsyncOption: {no option}
2020-09-14 10:01:59,749 [main] INFO   primaryExecutorService: ThreadPoolExecutor@14924f41
2020-09-14 10:01:59,750 [main] INFO   secondaryExecutorService: ThreadPoolExecutor@493da830
2020-09-14 10:01:59,750 [main] INFO   tertiaryExecutorService: ThreadPoolExecutor@1f939a0f
2020-09-14 10:01:59,750 [main] INFO  [Primary Cipher]
2020-09-14 10:01:59,750 [main] INFO   invertibleCryptographer: {AES, UTF-8}
2020-09-14 10:01:59,750 [main] INFO   oneWayCryptographer: {SHA-256, UTF-8}
2020-09-14 10:01:59,753 [main] INFO  [Time Manager]
2020-09-14 10:01:59,753 [main] INFO   businessTimeHandler: TypicalBusinessTimeHandler:{TypicalTimeResourceProvider$$Lambda$119/0x00000008403ab840, TypicalTimeResourceProvider$$Lambda$120/0x00000008403abc40}
2020-09-14 10:01:59,753 [main] INFO   currentIgnoreTransaction: false
2020-09-14 10:01:59,753 [main] INFO   adjustTimeMillis: 0
2020-09-14 10:01:59,753 [main] INFO   adjustAbsoluteMode: false
2020-09-14 10:01:59,829 [main] INFO  [JSON Manager]
2020-09-14 10:01:59,830 [main] INFO   realJsonParser: GsonJsonEngine
2020-09-14 10:01:59,835 [main] INFO   mapping: {CAMEL_TO_LOWER_SNAKE}
2020-09-14 10:01:59,836 [main] INFO  [Postbox]
2020-09-14 10:01:59,836 [main] INFO   postOffice: PostOffice@50ab56e2
2020-09-14 10:01:59,836 [main] INFO   postalParkingLot: SMailPostalParkingLot:{{category:{main}=motorbike:{session=javax.mail.Session@7b5b5bfe}}}@74834afd
2020-09-14 10:01:59,837 [main] INFO   postalPersonnel: FessMailDeliveryDepartmentCreator$1:{SMailConventionReceptionist:{[]}@75fd65c, batch:{[proofreader:{pmcomment}]}}@d499c13
2020-09-14 10:02:03,777 [main] INFO  Lasta Di boot successfully.
2020-09-14 10:02:03,782 [main] INFO    SmartDeploy Mode: Warm Deploy
2020-09-14 10:02:03,782 [main] INFO    Smart Package: org.codelibs.fess.app
2020-09-14 10:02:03,978 [main] INFO  Starting Crawler..
2020-09-14 10:02:06,144 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-232
2020-09-14 10:02:06,134 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-234
2020-09-14 10:02:09,471 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-231
2020-09-14 10:02:09,475 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-233
2020-09-14 10:02:09,968 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-229
2020-09-14 10:02:09,969 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/ZLT-230
... many urls are crawled
2020-09-14 10:45:31,135 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AD-3
2020-09-14 10:45:31,682 [Ga1RQ3QBUxhlljYOKf80-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AC-2
2020-09-14 10:45:31,682 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AD-1
2020-09-14 10:45:31,960 [pool-6-thread-1] INFO  Crawling URL: https://test.environment:87777/jira/browse/AC-1
2020-09-14 10:46:20,112 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":593948672,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.96, 1.09, 1.07]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1167580},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":169829168,"committed":476053504,"max":536870912,"percent":31},"non_heap":{"used":121539592,"committed":192790528}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5128,"time":41613},"old":{"count":78,"time":18657}},"threads":{"count":23,"peak":25},"classes":{"loaded":12932,"total_loaded":88615,"unloaded":75683},"uptime":2666933},"elasticsearch":null,"timestamp":1600073180112}
2020-09-14 10:47:21,124 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":593932288,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.67, 0.97, 1.03]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1167920},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":169101536,"committed":476053504,"max":536870912,"percent":31},"non_heap":{"used":121556344,"committed":192790528}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5129,"time":41617},"old":{"count":78,"time":18657}},"threads":{"count":22,"peak":25},"classes":{"loaded":12932,"total_loaded":88615,"unloaded":75683},"uptime":2727944},"elasticsearch":null,"timestamp":1600073241124}
2020-09-14 10:48:21,152 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":594096128,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.57, 0.87, 0.99]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1168250},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":168322656,"committed":476053504,"max":536870912,"percent":31},"non_heap":{"used":121590192,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5130,"time":41622},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12934,"total_loaded":88617,"unloaded":75683},"uptime":2787962},"elasticsearch":null,"timestamp":1600073301152}
2020-09-14 10:49:22,162 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":594096128,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":8},"load_averages":[0.67, 0.82, 0.96]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1168600},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":167692976,"committed":476053504,"max":536870912,"percent":31},"non_heap":{"used":121632584,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5131,"time":41624},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12934,"total_loaded":88617,"unloaded":75683},"uptime":2848983},"elasticsearch":null,"timestamp":1600073362162}
2020-09-14 10:50:22,180 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":763105280,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.69, 0.78, 0.94]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1168890},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":165666672,"committed":476053504,"max":536870912,"percent":30},"non_heap":{"used":121635544,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5132,"time":41627},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12934,"total_loaded":88617,"unloaded":75683},"uptime":2909001},"elasticsearch":null,"timestamp":1600073422180}
2020-09-14 10:51:22,193 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":762970112,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.71, 0.75, 0.91]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1169200},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":163545744,"committed":476053504,"max":536870912,"percent":30},"non_heap":{"used":121696280,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5133,"time":41631},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12934,"total_loaded":88617,"unloaded":75683},"uptime":2969017},"elasticsearch":null,"timestamp":1600073482193}
2020-09-14 10:52:23,205 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":763277312,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.77, 0.74, 0.9]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1169470},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":161534584,"committed":476053504,"max":536870912,"percent":30},"non_heap":{"used":121687288,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5134,"time":41634},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12935,"total_loaded":88618,"unloaded":75683},"uptime":3030028},"elasticsearch":null,"timestamp":1600073543205}
2020-09-14 10:53:23,218 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":763043840,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.81, 0.73, 0.88]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1169750},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":159417184,"committed":476053504,"max":536870912,"percent":29},"non_heap":{"used":121635360,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5135,"time":41636},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12935,"total_loaded":88618,"unloaded":75683},"uptime":3090039},"elasticsearch":null,"timestamp":1600073603218}
2020-09-14 10:54:23,238 [pool-5-thread-1] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":763138048,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.49, 0.64, 0.84]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1170080},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":177242976,"committed":476053504,"max":536870912,"percent":33},"non_heap":{"used":121700344,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5136,"time":41640},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12935,"total_loaded":88618,"unloaded":75683},"uptime":3150059},"elasticsearch":null,"timestamp":1600073663238}
2020-09-14 10:55:24,247 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":763445248,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":10},"load_averages":[0.81, 0.68, 0.84]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1170670},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":176342808,"committed":476053504,"max":536870912,"percent":32},"non_heap":{"used":121773272,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5136,"time":41640},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12935,"total_loaded":88618,"unloaded":75683},"uptime":3211070},"elasticsearch":null,"timestamp":1600073724247}
2020-09-14 10:56:24,261 [pool-5-thread-3] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":763346944,"total":21040566272},"swap_space":{"free":8173907968,"total":8588881920}},"cpu":{"percent":9},"load_averages":[0.75, 0.67, 0.82]},"process":{"file_descriptor":{"open":262,"max":65535},"cpu":{"percent":0,"total":1170950},"virtual_memory":{"total":4092293120}},"jvm":{"memory":{"heap":{"used":174475400,"committed":476053504,"max":536870912,"percent":32},"non_heap":{"used":121808656,"committed":192856064}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":5,"used":510881,"capacity":510881}},"gc":{"young":{"count":5137,"time":41643},"old":{"count":78,"time":18657}},"threads":{"count":21,"peak":25},"classes":{"loaded":12935,"total_loaded":88618,"unloaded":75683},"uptime":3271084},"elasticsearch":null,"timestamp":1600073784261}
17

This is output of thread dump of still running Jira Crawler:

2020-09-14 21:57:05,502 [ProcessCommand] INFO  Thread: Thread[ProcessCommand,5,main]
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.dumpThreads(Native Method)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.getAllStackTraces(Thread.java:1657)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.processThreadDump(ThreadDumpUtil.java:66)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.printThreadDump(ThreadDumpUtil.java:39)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$main$3(Crawler.java:247)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$790/0x000000084061f840.run(Unknown Source)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600070523562,5,main]
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600070523615,5,main]
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-14 21:57:05,503 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600070523585,5,main]
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-1,5,main]
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-3,5,main]
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-14 21:57:05,504 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  Thread: Thread[Ga1RQ3QBUxhlljYOKf80-1,5,main]
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead0(Native Method)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:168)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:140)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1096)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:816)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:754)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:689)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1610)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1515)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:334)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:269)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:249)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.lambda$connect$3(CurlRequest.java:199)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$$Lambda$383/0x0000000840478040.run(Unknown Source)
2020-09-14 21:57:05,505 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.connect(CurlRequest.java:211)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.execute(CurlRequest.java:230)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.Request.getCurlResponse(Request.java:100)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.Request.getCurlResponse(Request.java:69)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.search.SearchRequest.execute(SearchRequest.java:85)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.JiraClient.getIssues(JiraClient.java:102)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.JiraDataStore.storeData(JiraDataStore.java:69)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.AbstractDataStore.store(AbstractDataStore.java:111)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.process(DataIndexHelper.java:216)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.run(DataIndexHelper.java:202)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  Thread: Thread[Signal Dispatcher,9,system]
2020-09-14 21:57:05,506 [ProcessCommand] INFO  Thread: Thread[Keep-Alive-Timer,8,InnocuousThreadGroup]
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.KeepAliveCache.run(KeepAliveCache.java:168)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  Thread: Thread[ThumbnailGenerator,5,main]
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager.lambda$init$0(ThumbnailManager.java:123)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager$$Lambda$739/0x00000008405fdc40.run(Unknown Source)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,506 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  Thread: Thread[CoreLib-TimeoutManager,5,main]
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at app//org.codelibs.core.timer.TimeoutManager.run(TimeoutManager.java:171)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  Thread: Thread[main,5,main]
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1305)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1379)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.joinCrawlerThread(Crawler.java:549)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.doCrawl(Crawler.java:516)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.process(Crawler.java:352)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.main(Crawler.java:268)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  Thread: Thread[pool-6-thread-1,5,main]
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-14 21:57:05,507 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  Thread: Thread[DataStoreCrawler,5,main]
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1313)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.awaitTermination(DataIndexHelper.java:286)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.doCrawl(DataIndexHelper.java:146)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.crawl(DataIndexHelper.java:77)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$doCrawl$8(Crawler.java:509)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$863/0x0000000840650840.run(Unknown Source)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-2,5,main]
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  Thread: Thread[Reference Handler,10,system]
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
2020-09-14 21:57:05,508 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600070523534,5,main]
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  Thread: Thread[Finalizer,8,system]
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  Thread: Thread[Common-Cleaner,8,InnocuousThreadGroup]
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-14 21:57:05,509 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
18

Thank you for checking it. Hmmm, a server seems to block a request…
I added connection_timeout and read_timeout parameters as Parameter.
The new plugin jar is fess-ds-atlassian-13.8.2-20200914.221109-3.jar.
So, you can add read_timeout=10000 as 10s timeout.

19

Thanks for update and the two new parameter. I tried the new .jar and added the following parameter in Jira Crawler Parameter Field:

read_timeout=10000
connection_timeout=10000

The Jira crawler is running again endless. The timeout parameter seems to be ignored. Even if I set both to 0 Jira Urls are crawled and no timeout happened…

read_timeout=0
connection_timeout=0

The Jira crawler is running endless and the timeout parameter seems to be ignored.

grafik
grafik1597×49 2.43 KB

This is thread dump of still running Jira Crawler:

2020-09-16 10:36:19,773 [ProcessCommand] INFO  Thread: Thread[DataStoreCrawler,5,main]
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1313)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.awaitTermination(DataIndexHelper.java:286)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.doCrawl(DataIndexHelper.java:146)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper.crawl(DataIndexHelper.java:77)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$doCrawl$8(Crawler.java:509)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$840/0x0000000840643c40.run(Unknown Source)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-1,5,main]
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-16 10:36:19,790 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,800 [ProcessCommand] INFO  Thread: Thread[pool-6-thread-1,5,main]
2020-09-16 10:36:19,800 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600199521946,5,main]
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600199521879,5,main]
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-16 10:36:19,801 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600199522004,5,main]
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  Thread: Thread[main,5,main]
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1305)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.join(Thread.java:1379)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.joinCrawlerThread(Crawler.java:549)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.doCrawl(Crawler.java:516)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.process(Crawler.java:352)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.main(Crawler.java:268)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  Thread: Thread[Reference Handler,10,system]
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  Thread: Thread[CoreLib-TimeoutManager,5,main]
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at app//org.codelibs.core.timer.TimeoutManager.run(TimeoutManager.java:171)
2020-09-16 10:36:19,802 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,803 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-16 10:36:19,803 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,803 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-16 10:36:19,803 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-2,5,main]
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  Thread: Thread[Finalizer,8,system]
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2020-09-16 10:36:19,806 [ProcessCommand] INFO  Thread: Thread[pool-5-thread-3,5,main]
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  Thread: Thread[Ga1RQ3QBUxhlljYOKf80-1,5,main]
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead0(Native Method)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:168)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.SocketInputStream.read(SocketInputStream.java:140)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1096)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:816)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:754)
2020-09-16 10:36:19,807 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:689)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1610)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1515)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:334)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:269)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$RequestProcessor.accept(CurlRequest.java:249)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.lambda$connect$3(CurlRequest.java:199)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest$$Lambda$383/0x0000000840478040.run(Unknown Source)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.connect(CurlRequest.java:211)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.curl.CurlRequest.execute(CurlRequest.java:230)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.AtlassianRequest.getCurlResponse(AtlassianRequest.java:108)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.AtlassianRequest.getCurlResponse(AtlassianRequest.java:68)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.search.SearchRequest.execute(SearchRequest.java:80)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.api.jira.JiraClient.getIssues(JiraClient.java:102)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.atlassian.JiraDataStore.storeData(JiraDataStore.java:69)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.ds.AbstractDataStore.store(AbstractDataStore.java:111)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.process(DataIndexHelper.java:216)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at app//org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.run(DataIndexHelper.java:202)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  Thread: Thread[eshttp,5,main]
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
2020-09-16 10:36:19,808 [ProcessCommand] INFO  Thread: Thread[ProcessCommand,5,main]
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.dumpThreads(Native Method)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.getAllStackTraces(Thread.java:1657)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.processThreadDump(ThreadDumpUtil.java:66)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at app//org.codelibs.fess.util.ThreadDumpUtil.printThreadDump(ThreadDumpUtil.java:39)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler.lambda$main$3(Crawler.java:247)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at app//org.codelibs.fess.exec.Crawler$$Lambda$790/0x000000084061f840.run(Unknown Source)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  Thread: Thread[CommandGeneratorDestoryTimer-1600199521974,5,main]
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Object.java:328)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.mainLoop(Timer.java:527)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.TimerThread.run(Timer.java:506)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  Thread: Thread[Common-Cleaner,8,InnocuousThreadGroup]
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Object.wait(Native Method)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2020-09-16 10:36:19,809 [ProcessCommand] INFO  Thread: Thread[Signal Dispatcher,9,system]
2020-09-16 10:36:19,809 [ProcessCommand] INFO  Thread: Thread[ThumbnailGenerator,5,main]
2020-09-16 10:36:19,809 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.Unsafe.park(Native Method)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:458)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager.lambda$init$0(ThumbnailManager.java:123)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at app//org.codelibs.fess.thumbnail.ThumbnailManager$$Lambda$739/0x00000008405fec40.run(Unknown Source)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  Thread: Thread[Keep-Alive-Timer,8,InnocuousThreadGroup]
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.sleep(Native Method)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/sun.net.www.http.KeepAliveCache.run(KeepAliveCache.java:168)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/java.lang.Thread.run(Thread.java:834)
2020-09-16 10:36:19,810 [ProcessCommand] INFO  	at java.base@11.0.7/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2020-09-16 10:36:27,039 [pool-5-thread-2] INFO  [SYSTEM MONITOR] {"os":{"memory":{"physical":{"free":616816640,"total":21040566272},"swap_space":{"free":8013701120,"total":8588881920}},"cpu":{"percent":9},"load_averages":[1.02, 0.74, 0.62]},"process":{"file_descriptor":{"open":261,"max":65535},"cpu":{"percent":0,"total":1222900},"virtual_memory":{"total":4164653056}},"jvm":{"memory":{"heap":{"used":231560480,"committed":407896064,"max":536870912,"percent":43},"non_heap":{"used":138366608,"committed":197918720}},"pools":{"mapped":{"count":0,"used":0,"capacity":0},"direct":{"count":6,"used":519073,"capacity":519073}},"gc":{"young":{"count":6653,"time":42786},"old":{"count":19,"time":3843}},"threads":{"count":21,"peak":25},"classes":{"loaded":15246,"total_loaded":88878,"unloaded":73632},"uptime":45874349},"elasticsearch":null,"timestamp":1600245387039}
20

0 is no timeout.
I added debug logs and put it to 13.8.2-SNAPSHOT.