I have Solr on my computer and it was working fine up until yesterday. When I start it up, I get SolrCore Initialization Failures for every core. The error is
org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error opening new searcher
This is the full stack trace:
org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:885)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:652)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:518)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:283)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:277)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1577)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1689)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:857)
... 8 more
Caused by: java.io.IOException: Unable to unmap the mapped buffer: MMapIndexInput(path="D:solr-5.1.0solr-5.1.0serversolrkofax_fxm_masterdataindexsegments_2b")
at org.apache.lucene.store.MMapDirectory$2.freeBuffer(MMapDirectory.java:301)
at org.apache.lucene.store.ByteBufferIndexInput.freeBuffer(ByteBufferIndexInput.java:378)
at org.apache.lucene.store.ByteBufferIndexInput.close(ByteBufferIndexInput.java:357)
at org.apache.lucene.store.BufferedChecksumIndexInput.close(BufferedChecksumIndexInput.java:60)
at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:413)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:826)
at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:78)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:65)
at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:273)
at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:116)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1546)
... 10 more
Caused by: java.lang.IllegalAccessException: class org.apache.lucene.store.MMapDirectory$2$1 cannot access class jdk.internal.ref.Cleaner (in module java.base) because module java.base does not export jdk.internal.ref to unnamed module @2c718865
at java.base/jdk.internal.reflect.Reflection.newIllegalAccessException(Unknown Source)
at java.base/java.lang.reflect.AccessibleObject.checkAccess(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.lucene.store.MMapDirectory$2$1.run(MMapDirectory.java:294)
at org.apache.lucene.store.MMapDirectory$2$1.run(MMapDirectory.java:286)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at org.apache.lucene.store.MMapDirectory$2.freeBuffer(MMapDirectory.java:286)
... 20 more
I tried deleting all of my cores and starting fresh, I wiped out and reinstalled solr, but the error persists.
Please let me know if you need any more information from my side. Attached Screenshots. I am new to Solr and Solr Indexing. Getting error on the master index after opening the Solr URL. I have installed Sitecore 9.0.2. I am not seeing this error on Core and Web. Please let me know how to resolve this error.
java.util.concurrent.ExecutionException: org.apache.solr.common.SolrException: Unable to create core [mysite_master_index]
at java.util.concurrent.FutureTask.report(Unknown Source)
at java.util.concurrent.FutureTask.get(Unknown Source)
at org.apache.solr.core.CoreContainer.lambda$load$6(CoreContainer.java:593)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.solr.common.SolrException: Unable to create core [mysite_master_index]
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:964)
at org.apache.solr.core.CoreContainer.lambda$load$5(CoreContainer.java:564)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
... 5 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:977)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:830)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:948)
... 7 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2069)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2189)
at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1071)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:949)
... 9 more
Caused by: org.apache.lucene.index.CorruptIndexException: codec header mismatch: actual header=1229866072 vs expected header=1071082519 (resource=MMapIndexInput(path="C:Solrsolr-6.6.2serversolrmysite_master_indexdataindex_ykp_Lucene54_0.dvd"))
at org.apache.lucene.codecs.CodecUtil.checkHeader(CodecUtil.java:196)
at org.apache.lucene.codecs.CodecUtil.checkIndexHeader(CodecUtil.java:255)
at org.apache.lucene.codecs.lucene54.Lucene54DocValuesProducer.<init>(Lucene54DocValuesProducer.java:134)
at org.apache.lucene.codecs.lucene54.Lucene54DocValuesFormat.fieldsProducer(Lucene54DocValuesFormat.java:113)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsReader.<init>(PerFieldDocValuesFormat.java:294)
at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat.fieldsProducer(PerFieldDocValuesFormat.java:383)
at org.apache.lucene.index.SegmentDocValues.newDocValuesProducer(SegmentDocValues.java:51)
at org.apache.lucene.index.SegmentDocValues.getDocValuesProducer(SegmentDocValues.java:67)
at org.apache.lucene.index.SegmentReader.initDocValuesProducer(SegmentReader.java:164)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:90)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:197)
at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:103)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:467)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:79)
at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:39)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2033)
asked Oct 21, 2019 at 0:35
1
It looks like your master_index is corrupted. Easiest fix is to copy the web_index (since it is working fine) and then rename the folder and core.properties file to master_index.
Restart SOLR and also recycle your app pool.
Then go to Sitecore , populate the schema , and then reindex using Sitecore.
answered Oct 21, 2019 at 7:44
Abhay DharAbhay Dhar
1,63310 silver badges31 bronze badges
3
I upgraded an existing Solr 6.6.0 instance to V7.0.0. On startup, only empty cores have come up cleanly. All cores that contain any data get an error «Error Opening New Searcher»
All these cores store their indexes on HDFS. This instance is a single node Solr cloud using external zookeeper. The HDFS platform is HDP 2.4.2
Just for starters, here is an example from solr.log for one such core:
2017-09-27 16:31:23.197 ERROR (coreContainerWorkExecutor-2-thread-1-processing-n:SolrServer:9031_solr) [ ] o.a.s.c.CoreContainer Error waiting for SolrCore to be created
java.util.concurrent.ExecutionException: org.apache.solr.common.SolrException: Unable to create core [CoreName_shard1_replica1]
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.solr.core.CoreContainer.lambda$load$118(CoreContainer.java:647)
at org.apache.solr.core.CoreContainer$Lambda$132/1829217853.run(Unknown Source)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$128(ExecutorUtil.java:188)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$Lambda$15/991515462.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Unable to create core [CoreName_shard1_replica1]
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:996)
at org.apache.solr.core.CoreContainer.lambda$load$117(CoreContainer.java:619)
at org.apache.solr.core.CoreContainer$Lambda$131/1622458036.call(Unknown Source)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
... 6 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:988)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:843)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:980)
... 9 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2066)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2186)
at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1071)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:960)
... 11 more
Caused by: java.lang.NullPointerException
at java.util.Objects.requireNonNull(Objects.java:203)
at java.util.Optional.<init>(Optional.java:96)
at java.util.Optional.of(Optional.java:108)
at java.util.stream.ReduceOps$2ReducingSink.get(ReduceOps.java:129)
at java.util.stream.ReduceOps$2ReducingSink.get(ReduceOps.java:107)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:479)
at org.apache.solr.index.SlowCompositeReaderWrapper.<init>(SlowCompositeReaderWrapper.java:76)
at org.apache.solr.index.SlowCompositeReaderWrapper.wrap(SlowCompositeReaderWrapper.java:57)
at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:252)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2034)
... 14 more
Any ideas?
Hello,
I’m trying to start solr using bundle exec sunspot:solr:run. However I get the following errors:
6650 ERROR (coreLoadExecutor-6-thread-1) [ x:test] o.a.s.c.CoreContainer Error creating core [test]: Error opening new searcher
org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:820)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:659)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:723)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:443)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:434)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:835)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1662)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1773)
at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:916)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
... 9 more
Caused by: java.io.IOException: Unable to unmap the mapped buffer: MMapIndexInput(path="{my-project-path}/solr/test/data/index/segments_1")
at org.apache.lucene.store.MMapDirectory$2.freeBuffer(MMapDirectory.java:329)
at org.apache.lucene.store.ByteBufferIndexInput.freeBuffer(ByteBufferIndexInput.java:376)
at org.apache.lucene.store.ByteBufferIndexInput.close(ByteBufferIndexInput.java:355)
at org.apache.lucene.store.BufferedChecksumIndexInput.close(BufferedChecksumIndexInput.java:60)
at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:459)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:909)
at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:78)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:65)
at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:274)
at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:117)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1631)
... 12 more
I have tried, deleting the write.lock on all the solr subdirectories, deleting the solr folder, and re running the installation, downgrading to java 12. But still I haven’t been able to solve the issue. I’m wondering what else can try?
The gem version is: 2.5.0
running java —version gives the following:
java --version
java 12.0.1 2019-04-16
Java(TM) SE Runtime Environment (build 12.0.1+12)
Java HotSpot(TM) 64-Bit Server VM (build 12.0.1+12, mixed mode, sharing)
Thanks!
#solr
#solr
Вопрос:
Я попытался импортировать базу данных mysql, которая содержит location, user, post, comment среди многих других таблиц. Я хочу создать поисковую систему для своего веб-приложения, используя solr для поиска сообщений и комментариев. Итак, я добавил следующее: 1) В db-data-config.xml
<dataConfig>
<dataSource
type="JdbcDataSource"
driver="com.mysql.jdbc.Driver"
url="jdbc:mysql://localhost/apnistreet"
user="root"
password="password"
/>
<document>
<entity name="location" query="select id from location">
<entity name="user" query="select id from user where location_id=${location.id}">
<entity name="post" query="select id,post,user_id from post where user_id=${user.id} order by time desc">
<field column="post" name="POST"/>
<entity name="comment" query="select comment,id,post_id,user_id
from comment where post_id={post.id}
order by time desc">
<field column="comment" name="COMMENT"/>
</entity>
</entity>
</entity>
</entity>
</document>
</dataConfig>
Таблицы содержат много других столбцов, но мне требуется, чтобы возвращались только эти поля, поэтому я подумал, что мне не нужно их добавлять.
2) Для solrconfig.xml файл, который я добавил:
<requestHandler name="/dataimport" class="org.apache.solr.handler.dataimport.DataImportHandler">
<lst name="defaults">
<str name="config">db-data-config.xml</str>
</lst>
</requestHandler>
<lib dir="../../../lib/" regex="mysql-connector-java-5.1.29-bin.jar" />
<lib dir="../../../dist/" regex="solr-dataimporthandler-d.*.jar" />
<lib dir="../../../contrib/dataimporthandler/lib" regex=".*.jar" />
3) Для schema.xml Я добавил:
<field name="id" type="int" indexed="true" stored="true" required="true" multiValued="false" />
<field name="location_id" type="int" indexed="true" stored="true" required="true" multiValued="false" />
<field name="user_id" type="int" indexed="true" stored="true" required="true" multiValued="false" />
<field name="post_id" type="int" indexed="true" stored="true" required="true" multiValued="false" />
<field name="POST" type="text_general" indexed="true" stored="true" multiValued="true"/>
<field name="COMMENT" type="text_general" indexed="true" stored="true" multiValued="true"/>
<field name="time" type="long" indexed="false" stored="true" multiValued="true"/>
Затем я запустил
java -jar start.jar
И для загрузки данных я перешел на url localhost: 8983/solr/dataimport?command=full-import
Но это выдало следующую ошибку, о которой я не знаю, как поступить:
HTTP ERROR 500
Problem accessing /solr/. Reason:
{msg=SolrCore 'collection1' is not available due to init failure: Error opening new searcher,trace=org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: Error opening new searcher
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:827)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:305)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:205)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1521)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1633)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:827)
... 11 more
Caused by: java.lang.NumberFormatException: For input string: "1.gen"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Long.parseLong(Long.java:441)
at org.apache.lucene.index.SegmentInfos.generationFromSegmentsFileName(SegmentInfos.java:248)
at org.apache.lucene.index.SegmentInfos.getLastCommitGeneration(SegmentInfos.java:183)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:746)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:694)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:400)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:746)
at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:77)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:64)
at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:267)
at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:110)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1484)
... 13 more
,code=500}
Powered by Jetty://
Ошибка возникает из-за неправильного метода объявления объектов и полей или по другим причинам.
Пожалуйста, помогите мне разобраться в этом.
Ответ №1:
Я решил свою проблему очень хитро:
<lib dir="../../../lib/" regex="mysql-connector-java-5.1.29-bin.jar" />
<lib dir="../../../dist/" regex="solr-dataimporthandler-d.*.jar" />
<lib dir="../../../contrib/dataimporthandler/lib" regex=".*.jar" />
должно быть с первой строкой в последней, так как это mysql-connector jar, который должен быть строго вызван после вызова DIH.
<lib dir="../../../dist/" regex="solr-dataimporthandler-d.*.jar" />
<lib dir="../../../contrib/dataimporthandler/lib" regex=".*.jar" />
<lib dir="../../../lib/" regex="mysql-connector-java-5.1.29-bin.jar" />
Ответ №2:
Точно, вы должны включить файл .jar базы данных, которая используется в пути:
solr/contrib/dataimporthandler
затем вы должны ссылаться на нее в своем solrconfig.xml в разделе библиотеки
<lib dir="${solr.install.dir:../../../..}/contrib/dataimporthandler/lib" regex=".*.jar" />
Вы также должны обратиться к solr-dataimporthandler.jar который отвечает за процесс индексации, это находится в пути
solr/dist
следующая строка снова включена в раздел библиотеки:
<lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-dataimporthandler-.*.jar" />
I have a working chaos-monkey setup which is killing (and restarting) solr and data nodes in a round-robin fashion periodically. I wrote a simple Solr client to periodically index and query bunch of documents. After executing the test for some time, Solr returns incorrect number of documents. In the background, I see following errors,
org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1577)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1689)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
… 8 more
Caused by: java.io.EOFException: read past EOF
at org.apache.solr.store.blockcache.CustomBufferedIndexInput.refill(CustomBufferedIndexInput.java:186)
at org.apache.solr.store.blockcache.CustomBufferedIndexInput.readByte(CustomBufferedIndexInput.java:46)
at org.apache.lucene.store.BufferedChecksumIndexInput.readByte(BufferedChecksumIndexInput.java:41)
at org.apache.lucene.store.DataInput.readInt(DataInput.java:98)
at org.apache.lucene.codecs.CodecUtil.checkHeader(CodecUtil.java:134)
at org.apache.lucene.codecs.lucene46.Lucene46SegmentInfoReader.read(Lucene46SegmentInfoReader.java:54)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:358)
at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:454)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:906)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:752)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:450)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:792)
at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:77)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:64)
The issue here is that the index state for one of the replica is corrupt (verified using Lucene CheckIndex tool). Hence Solr is not able to load the core on that particular instance.
Interestingly when the other sane replica comes online, it tries to do a peer-sync to this failing replica and gets an error, it also moves to recovering state. As a result this particular shard is completely unavailable for read/write requests. Here is a sample log entries on this sane replica,
Error opening new searcher,trace=org.apache.solr.common.SolrException: SolrCore ‘customers_shard1_replica1’ is not available due to init failure: Error opening new searcher
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:211)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.solr.servlet.SolrHadoopAuthenticationFilter$2.doFilter(SolrHadoopAuthenticationFilter.java:288)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:592)
at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:277)
2015-05-07 12:41:49,954 INFO org.apache.solr.update.PeerSync: PeerSync: core=customers_shard1_replica2 url=http://ssl-systests-3.ent.cloudera.com:8983/solr DONE. sync failed
2015-05-07 12:41:49,954 INFO org.apache.solr.cloud.SyncStrategy: Leader’s attempt to sync with shard failed, moving to the next candidate
2015-05-07 12:41:50,007 INFO org.apache.solr.cloud.ShardLeaderElectionContext: There may be a better leader candidate than us — going back into recovery
2015-05-07 12:41:50,007 INFO org.apache.solr.cloud.ElectionContext: canceling election /collections/customers/leader_elect/shard1/election/93773657844879326-core_node6-n_0000001722
2015-05-07 12:41:50,020 INFO org.apache.solr.update.DefaultSolrCoreState: Running recovery — first canceling any ongoing recovery
2015-05-07 12:41:50,020 INFO org.apache.solr.cloud.ActionThrottle: The last recovery attempt started 2685ms ago.
2015-05-07 12:41:50,020 INFO org.apache.solr.cloud.ActionThrottle: Throttling recovery attempts — waiting for 7314ms
I am able to reproduce this problem consistently.