(from osdn.net/users/noea_nora)
お世話になります。
Fess-9.4.2、java8で構築しデータストアクロールを
試してみたところクロールでインデックス作成される
ドキュメント数が5万件以上登録されません。
5万件以上登録する方法はありますでしょうか？
DBはOracle11gのExpress版とpostgreSQLを使ってます。
よろしくお願いいたします。
(from osdn.net/users/noea_nora)
[メッセージ #77171 への返信]
5万件以上登録する方法はありますでしょうか？
特にFess側ではないと思います。
ログファイルに例外等がなければDB側だと思います。
ご回答ありがとうございます。
ログを確認したところfess_crawler.outではエラーもなく、対象件数分
クロールされているようでした、fess.outには以下のエラーがでてましたが、
何か関係ありますでしょうか？
Processed: C:/fess/fess-server-9.4.2/webapps/fess/WEB-INF/db/robot.mv.db
Exception in thread “WebFsCrawler” org.seasar.framework.beans.IllegalPropertyRuntimeException: [ESSR0059]?N???X(org.codelibs.robot.S2Robot)??v???p?e?B(clientFactory)???s???B???R??org.seasar.framework.beans.IllegalPropertyRuntimeException: [ESSR0059]?N???X(org.codelibs.robot.client.FaultTolerantClient)??v???p?e?B(robotClient)???s???B???R??org.seasar.framework.beans.IllegalPropertyRuntimeException: [ESSR0059]?N???X(org.codelibs.robot.client.http.HcHttpClient)??v???p?e?B(proxyHost)???s???B???R??org.seasar.framework.exception.OgnlRuntimeException: [ESSR0073]OGNL???O???B???R??[ESSR0046]?R???|?[?l???g(g3)??? at file:///C:/fess/fess-server-9.4.2/webapps/fess/s2robot_client.dicon(12)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.getValue(AbstractBindingTypeDef.java:297)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.bindAuto(AbstractBindingTypeDef.java:149)
at org.seasar.framework.container.assembler.BindingTypeMustDef.doBind(BindingTypeMustDef.java:45)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.bind(AbstractBindingTypeDef.java:91)
at org.seasar.framework.container.assembler.AccessTypeFieldDef.bind(AccessTypeFieldDef.java:50)
at org.seasar.framework.container.assembler.AccessTypeFieldDef.bind(AccessTypeFieldDef.java:42)
at org.seasar.framework.container.assembler.AutoPropertyAssembler.assemble(AutoPropertyAssembler.java:56)
at org.seasar.framework.container.deployer.PrototypeComponentDeployer.deploy(PrototypeComponentDeployer.java:43)
at org.seasar.framework.container.impl.ComponentDefImpl.getComponent(ComponentDefImpl.java:111)
at org.seasar.framework.container.impl.S2ContainerImpl.getComponent(S2ContainerImpl.java:129)
at org.seasar.framework.container.SingletonS2Container.getComponent(SingletonS2Container.java:43)
at jp.sf.fess.helper.WebFsIndexHelper.crawl(WebFsIndexHelper.java:289)
at jp.sf.fess.helper.WebFsIndexHelper.crawl(WebFsIndexHelper.java:134)
at jp.sf.fess.exec.Crawler$2.run(Crawler.java:443)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.seasar.framework.beans.IllegalPropertyRuntimeException: [ESSR0059]?N???X(org.codelibs.robot.client.FaultTolerantClient)??v???p?e?B(robotClient)???s???B???R??org.seasar.framework.beans.IllegalPropertyRuntimeException: [ESSR0059]?N???X(org.codelibs.robot.client.http.HcHttpClient)??v???p?e?B(proxyHost)???s???B???R??org.seasar.framework.exception.OgnlRuntimeException: [ESSR0073]OGNL???O???B???R??[ESSR0046]?R???|?[?l???g(g3)??? at file:///C:/fess/fess-server-9.4.2/webapps/fess/s2robot_client.dicon(12)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.getValue(AbstractBindingTypeDef.java:273)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.bindManual(AbstractBindingTypeDef.java:126)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.bind(AbstractBindingTypeDef.java:74)
at org.seasar.framework.container.assembler.AccessTypePropertyDef.bind(AccessTypePropertyDef.java:50)
at org.seasar.framework.container.assembler.AccessTypePropertyDef.bind(AccessTypePropertyDef.java:41)
at org.seasar.framework.container.assembler.AutoPropertyAssembler.assemble(AutoPropertyAssembler.java:56)
at org.seasar.framework.container.deployer.PrototypeComponentDeployer.deploy(PrototypeComponentDeployer.java:43)
at org.seasar.framework.container.impl.ComponentDefImpl.getComponent(ComponentDefImpl.java:111)
at org.seasar.framework.container.impl.S2ContainerImpl.getComponent(S2ContainerImpl.java:129)
at org.seasar.framework.container.impl.ComponentNameExpression.evaluate(ComponentNameExpression.java:55)
at org.seasar.framework.container.impl.ArgDefImpl.getValue(ArgDefImpl.java:60)
at org.seasar.framework.container.impl.MethodDefImpl.getArgs(MethodDefImpl.java:106)
at org.seasar.framework.container.assembler.AbstractMethodAssembler.invoke(AbstractMethodAssembler.java:81)
at org.seasar.framework.container.assembler.DefaultInitMethodAssembler.assemble(DefaultInitMethodAssembler.java:49)
at org.seasar.framework.container.deployer.PrototypeComponentDeployer.deploy(PrototypeComponentDeployer.java:44)
at org.seasar.framework.container.impl.ComponentDefImpl.getComponent(ComponentDefImpl.java:111)
at org.seasar.framework.container.impl.S2ContainerImpl.getComponent(S2ContainerImpl.java:129)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.getValue(AbstractBindingTypeDef.java:295)
… 14 more
Caused by: org.seasar.framework.beans.IllegalPropertyRuntimeException: [ESSR0059]?N???X(org.codelibs.robot.client.http.HcHttpClient)??v???p?e?B(proxyHost)???s???B???R??org.seasar.framework.exception.OgnlRuntimeException: [ESSR0073]OGNL???O???B???R??[ESSR0046]?R???|?[?l???g(g3)??? at file:///C:/fess/fess-server-9.4.2/webapps/fess/s2robot_client.dicon(12)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.getValue(AbstractBindingTypeDef.java:273)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.bindManual(AbstractBindingTypeDef.java:126)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.bind(AbstractBindingTypeDef.java:74)
at org.seasar.framework.container.assembler.AccessTypePropertyDef.bind(AccessTypePropertyDef.java:50)
at org.seasar.framework.container.assembler.AccessTypePropertyDef.bind(AccessTypePropertyDef.java:41)
at org.seasar.framework.container.assembler.AutoPropertyAssembler.assemble(AutoPropertyAssembler.java:56)
at org.seasar.framework.container.deployer.PrototypeComponentDeployer.deploy(PrototypeComponentDeployer.java:43)
at org.seasar.framework.container.impl.ComponentDefImpl.getComponent(ComponentDefImpl.java:111)
at org.seasar.framework.container.impl.S2ContainerImpl.getComponent(S2ContainerImpl.java:129)
at org.seasar.framework.container.impl.ComponentNameExpression.evaluate(ComponentNameExpression.java:55)
at org.seasar.framework.container.impl.ArgDefImpl.getValue(ArgDefImpl.java:60)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.getValue(AbstractBindingTypeDef.java:271)
… 31 more
Caused by: org.seasar.framework.exception.OgnlRuntimeException: [ESSR0073]OGNL???O???B???R??[ESSR0046]?R???|?[?l???g(g3)??? at file:///C:/fess/fess-server-9.4.2/webapps/fess/s2robot_client.dicon(12)
at org.seasar.framework.util.OgnlUtil.getValue(OgnlUtil.java:106)
at org.seasar.framework.container.ognl.OgnlExpression.evaluate(OgnlExpression.java:64)
at org.seasar.framework.container.impl.ArgDefImpl.getValue(ArgDefImpl.java:60)
at org.seasar.framework.container.assembler.AbstractBindingTypeDef.getValue(AbstractBindingTypeDef.java:271)
… 42 more
Caused by: org.seasar.framework.container.ComponentNotFoundRuntimeException: [ESSR0046]?R???|?[?l???g(g3)???
at org.seasar.framework.container.impl.S2ContainerBehavior$DefaultProvider.acquireFromGetComponentDef(S2ContainerBehavior.java:165)
at org.seasar.framework.container.impl.S2ContainerBehavior$DefaultProvider.acquireFromGetComponent(S2ContainerBehavior.java:158)
at org.seasar.framework.container.impl.S2ContainerBehavior.acquireFromGetComponent(S2ContainerBehavior.java:62)
at org.seasar.framework.container.impl.S2ContainerImpl.getComponent(S2ContainerImpl.java:124)
at org.seasar.framework.container.ognl.S2ContainerPropertyAccessor.getProperty(S2ContainerPropertyAccessor.java:36)
at ognl.OgnlRuntime.getProperty(OgnlRuntime.java:1758)
at ognl.ASTProperty.getValueBody(ASTProperty.java:92)
at ognl.SimpleNode.evaluateGetValueBody(SimpleNode.java:171)
at ognl.SimpleNode.getValue(SimpleNode.java:211)
at ognl.ASTChain.getValueBody(ASTChain.java:109)
at ognl.SimpleNode.evaluateGetValueBody(SimpleNode.java:171)
at ognl.SimpleNode.getValue(SimpleNode.java:211)
at ognl.Ognl.getValue(Ognl.java:333)
at ognl.Ognl.getValue(Ognl.java:310)
at org.seasar.framework.util.OgnlUtil.getValue(OgnlUtil.java:98)
… 45 more
Processed: C:/fess/fess-server-9.4.2/webapps/fess/WEB-INF/db/robot.mv.db
(from osdn.net/users/noea_nora)
[メッセージ #77171 への返信]
5万件以上登録する方法はありますでしょうか？
特にFess側ではないと思います。
ログファイルに例外等がなければDB側だと思います。
すみません、解決しました。
URLの値が一意じゃないのが原因でした、一意な値を設定したところ
6万件登録が確認できました。