XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Minor
    • None
    • 1.2
    • None
    • XWiki 15.10.7
    • Unknown

    Description

      Solr indexing thread throws the following error caused by Interactive Maps App:
       

      2024-03-14 12:32:23,033 [XWiki Solr index thread] ERROR o.a.s.h.RequestHandlerBase     - org.apache.solr.common.SolrException: Exception writing document id xwiki:Maps.Demo.Pakistan_ to the index; possible analysis error: Document contains at least one immense term in field="links" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[101, 110, 116, 105, 116, 121, 58, 100, 111, 99, 117, 109, 101, 110, 116, 58, 120, 119, 105, 107, 105, 58, 91, 55, 52, 46, 55, 57, 50, 53]...', original message: bytes can be at most 32766 in length; got 46331. Perhaps the document has an indexed string field (solr.StrField) which is too large org.apache.solr.common.SolrException: Exception writing document id xwiki:Maps.Demo.Pakistan_ to the index; possible analysis error: Document contains at least one immense term in field="links" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[101, 110, 116, 105, 116, 121, 58, 100, 111, 99, 117, 109, 101, 110, 116, 58, 120, 119, 105, 107, 105, 58, 91, 55, 52, 46, 55, 57, 50, 53]...', original message: bytes can be at most 32766 in length; got 46331. Perhaps the document has an indexed string field (solr.StrField) which is too large    at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:249)    at org.apache.solr.update.processor.RunUpdateProcessorFactory$RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:73)    at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)    at org.apache.solr.update.processor.NestedUpdateProcessorFactory$NestedUpdateProcessor.processAdd(NestedUpdateProcessorFactory.java:79)    at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)    at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:263)    at org.apache.solr.update.processor.DistributedUpdateProcessor.doVersionAdd(DistributedUpdateProcessor.java:502)    at org.apache.solr.update.processor.DistributedUpdateProcessor.lambda$versionAdd$0(DistributedUpdateProcessor.java:343)    at org.apache.solr.update.VersionBucket.runWithLock(VersionBucket.java:50)    at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:343)    at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:229)    at org.apache.solr.handler.loader.JavabinLoader$1.update(JavabinLoader.java:110)    at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:344)    at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:292)    at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:338)    at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:283)    at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:245)    at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:303)    at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:283)    at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:196)    at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:131)    at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:122)    at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70)    at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)    at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:82)    at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)    at org.apache.solr.core.SolrCore.execute(SolrCore.java:2637)    at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:227)    at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)    at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)    at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)    at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:156)    at org.xwiki.search.solr.internal.AbstractSolrInstance.add(AbstractSolrInstance.java:62)    at org.xwiki.search.solr.internal.DefaultSolrIndexer.processBatch(DefaultSolrIndexer.java:430)    at org.xwiki.search.solr.internal.DefaultSolrIndexer.run(DefaultSolrIndexer.java:393)    at java.base/java.lang.Thread.run(Thread.java:829)Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="links" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[101, 110, 116, 105, 116, 121, 58, 100, 111, 99, 117, 109, 101, 110, 116, 58, 120, 119, 105, 107, 105, 58, 91, 55, 52, 46, 55, 57, 50, 53]...', original message: bytes can be at most 32766 in length; got 46331    at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:984)    at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:527)    at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:491)    at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:208)    at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:415)    at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1471)    at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1464)    at org.apache.solr.update.DirectUpdateHandler2.updateDocOrDocValues(DirectUpdateHandler2.java:967)    at org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:342)    at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:294)    at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:241)    ... 35 common frames omittedCaused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 46331    at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:281)    at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:182)    at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:974)    ... 45 common frames omitted 

      Attachments

        Activity

          People

            Unassigned Unassigned
            Pako Patrick Koska
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: