Exception is Jackraabit Oak Plugin - AEM 6.3

[rahuls80678827]

I am working on AEM 6.1 to 6.3 Migration Project. We are getting some warnings/errors in the error.log of the AEM 6.3 instance (Adobe Experience Manager, Version 6.3.1.2).

Details are below --

Exception 1:

*ERROR* [sling-default-1060-com.day.crx.security.token.impl.TokenCleanupTask.3052] org.apache.jackrabbit.oak.plugins.index.lucene.BadIndexTracker Could not access the Lucene index at [/oak:index/cqPageLucene] . since 17.59 h ,2 indexing cycles, accessed 821 times

java.lang.RuntimeException: Error occurred while obtaining InputStream for blobId [15098d4ea38809bd48049bc22072d3213879f2b61c9985be450f1f1a0bc71b85#371]

        at org.apache.jackrabbit.oak.plugins.blob.BlobStoreBlob.getNewStream(BlobStoreBlob.java:49)

        at org.apache.jackrabbit.oak.segment.SegmentBlob.getNewStream(SegmentBlob.java:252)

        at org.apache.jackrabbit.oak.segment.SegmentBlob.getNewStream(SegmentBlob.java:87)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexFile.loadBlob(OakDirectory.java:438)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexFile.readBytes(OakDirectory.java:494)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexInput.readBytes(OakDirectory.java:614)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexInput.readByte(OakDirectory.java:621)

        at org.apache.lucene.store.DataInput.readInt(DataInput.java:84)

        at org.apache.lucene.codecs.CodecUtil.checkHeader(CodecUtil.java:126)

        at org.apache.lucene.codecs.lucene46.Lucene46SegmentInfoReader.read(Lucene46SegmentInfoReader.java:52)

        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:340)

        at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:56)

        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:843)

        at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)

        at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)

        at org.apache.lucene.search.suggest.analyzing.AnalyzingInfixSuggester.<init>(AnalyzingInfixSuggester.java:159)

Exception 2:

*ERROR* [sling-default-1078-Registered Service.4773] org.apache.jackrabbit.oak.plugins.index.lucene.BadIndexTracker Could not access the Lucene index at [/oak:index/cqPageLucene] . since 18.00 h ,2 indexing cycles, accessed 822 times

java.lang.RuntimeException: Error occurred while obtaining InputStream for blobId [15098d4ea38809bd48049bc22072d3213879f2b61c9985be450f1f1a0bc71b85#371]

        at org.apache.jackrabbit.oak.plugins.blob.BlobStoreBlob.getNewStream(BlobStoreBlob.java:49)

        at org.apache.jackrabbit.oak.segment.SegmentBlob.getNewStream(SegmentBlob.java:252)

        at org.apache.jackrabbit.oak.segment.SegmentBlob.getNewStream(SegmentBlob.java:87)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexFile.loadBlob(OakDirectory.java:438)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexFile.readBytes(OakDirectory.java:494)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexInput.readBytes(OakDirectory.java:614)

        at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory$OakIndexInput.readByte(OakDirectory.java:621)

        at org.apache.lucene.store.DataInput.readInt(DataInput.java:84)

        at org.apache.lucene.codecs.CodecUtil.checkHeader(CodecUtil.java:126)

        at org.apache.lucene.codecs.lucene46.Lucene46SegmentInfoReader.read(Lucene46SegmentInfoReader.java:52)

        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:340)

        at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:56)

        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:843)

        at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)

        at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)

        at org.apache.lucene.search.suggest.analyzing.AnalyzingInfixSuggester.<init>(AnalyzingInfixSuggester.java:159)

        at org.apache.jackrabbit.oak.plugins.index.lucene.util.SuggestHelper$2.<init>(SuggestHelper.java:130)

        at org.apache.jackrabbit.oak.plugins.index.lucene.util.SuggestHelper.getLookup(SuggestHelper.java:130)

        at org.apache.jackrabbit.oak.plugins.index.lucene.util.SuggestHelper.getLookup(SuggestHelper.java:126)

        at org.apache.jackrabbit.oak.plugins.index.lucene.reader.DefaultIndexReader.<init>(DefaultIndexReader.java:47)

        at org.apache.jackrabbit.oak.plugins.index.lucene.reader.DefaultIndexReaderFactory.createReader(DefaultIndexReaderFactory.java:118)

        at org.apache.jackrabbit.oak.plugins.index.lucene.reader.DefaultIndexReaderFactory.createReaders(DefaultIndexReaderFactory.java:61)

        at org.apache.jackrabbit.oak.plugins.index.lucene.IndexNodeManager.open(IndexNodeManager.java:69)

        at org.apache.jackrabbit.oak.plugins.index.lucene.IndexTracker.findIndexNode(IndexTracker.java:228)

        at org.apache.jackrabbit.oak.plugins.index.lucene.IndexTracker.acquireIndexNode(IndexTracker.java:180)

        at org.apache.jackrabbit.oak.plugins.index.lucene.LucenePropertyIndex.getPlans(LucenePropertyIndex.java:239)

        at org.apache.jackrabbit.oak.query.QueryImpl.getBestSelectorExecutionPlan(QueryImpl.java:1022)

        at org.apache.jackrabbit.oak.query.QueryImpl.getBestSelectorExecutionPlan(QueryImpl.java:980)

        at org.apache.jackrabbit.oak.query.ast.SelectorImpl.prepare(SelectorImpl.java:280)

        at org.apache.jackrabbit.oak.query.QueryImpl.prepare(QueryImpl.java:645)

        at org.apache.jackrabbit.oak.query.QueryEngineImpl.prepareAndSelect(QueryEngineImpl.java:294)

        at org.apache.jackrabbit.oak.query.QueryEngineImpl.executeQuery(QueryEngineImpl.java:269)

        at org.apache.jackrabbit.oak.jcr.query.QueryManagerImpl.executeQuery(QueryManagerImpl.java:136)

        at org.apache.jackrabbit.oak.jcr.query.QueryImpl$2.perform(QueryImpl.java:104)

        at org.apache.jackrabbit.oak.jcr.query.QueryImpl$2.perform(QueryImpl.java:100)

        at org.apache.jackrabbit.oak.jcr.delegate.SessionDelegate.perform(SessionDelegate.java:208)

        at org.apache.jackrabbit.oak.jcr.query.QueryImpl.execute(QueryImpl.java:99)

Has anyone faced these exceptions in AEM 6.3? If yes, then can you please point me in the right direction that what do I need to change for this?

[Jörg_Hoh · Accepted solution]

You seem to have issues with your datastore. Then there's something wrong with the persistence, I would in any way recommend to raise a Daycare ticket; even if it does  affect "only" a lower environment, that's an issue you should need to know how you can deal with it (even in PROD).

I guess, that the proposed solution is reindexing. Please also make sure that you are using the latest SP and CFP when migrating.

Jörg

[rahuls80678827]

Thankyou Jorg for the reply. I will raise a ticket for this.

Below are the versions of CFP and SP, that we using in AEM 6.3 Server.

CFP:

SP:

Regarding the proposed solution that is "reindexing", is there anything that we can try in local instance for this? Any suggestions would be helpful.

One more Warning message is there in error.log file-

*WARN* [172.17.0.1 [1522233354810] GET /libs/cq/core/content/welcome.html HTTP/1.1] org.apache.jackrabbit.oak.plugins.blob.datastore.DataStoreBlobStore Error occurred while loading bytes from steam while fetching for id 15098d4ea38809bd48049bc22072d3213879f2b61c9985be450f1f1a0bc71b85#371

[Jörg_Hoh]

Looks like you run on a current version, which makes it really odd ... Please get in touch with the AEM support team and provide the relevant logs. The index update is failing for more than a week, so make sure that you provide the log statements for that day where it started to fail.

regards,

Jörg