Adobe Experience Manager Sites & More

venkateshs73486 · 8/30/19

Hi All,

We have a requirement to setup external file datastore for binary data in AEM 6.4.3.

I searched for stuff and observed that crx2oak or oak-upgrade would be able to address this.

However, while running these tools, it threw error saying that record does not exist.

Irony is, this error is thrown on brand new aem instance as well.

29.08.2019 11:28:17.295 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.MigrationOptions - copyVersions parameter set to 1969-12-31

29.08.2019 11:28:17.297 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.MigrationOptions - copyOrphanedVersions parameter set to 1969-12-31

29.08.2019 11:28:17.297 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.MigrationOptions - Checkpoints won't be migrated

29.08.2019 11:28:17.297 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.MigrationOptions - Cache size: 256 MB

29.08.2019 11:28:17.299 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.StoreArguments - Source: SEGMENT_TAR[crx-quickstart/repository]

29.08.2019 11:28:17.301 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.StoreArguments - Destination: SEGMENT_TAR[crx-quickstart/repository_new]

29.08.2019 11:28:17.311 [main] *INFO* org.apache.jackrabbit.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=1.8.5, directory=crx-quickstart/repository/segmentstore, blobStore=null, maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}}

29.08.2019 11:28:17.417 [main] *INFO* org.apache.jackrabbit.oak.segment.file.ReadOnlyFileStore - TarMK ReadOnly opened: crx-quickstart/repository/segmentstore (mmap=false)

29.08.2019 11:28:17.467 [main] *INFO* org.apache.jackrabbit.oak.segment.file.ReadOnlyFileStore - TarMK closed: crx-quickstart/repository/segmentstore

29.08.2019 11:28:17.477 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.DatastoreArguments - Blobs stored in FileDataStore[crx-quickstart/repository/segmentstore] will be copied to FileDataStore[/mnt/author6.4_myh_dev]

29.08.2019 11:28:17.478 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.DatastoreArguments - Source blob store: FileDataStore[crx-quickstart/repository/segmentstore]

29.08.2019 11:28:17.483 [main] *INFO* org.apache.jackrabbit.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=1.8.5, directory=crx-quickstart/repository/segmentstore, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.plugins.blob.datastore.OakFileDataStore], maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}}

29.08.2019 11:28:17.489 [main] *INFO* org.apache.jackrabbit.oak.segment.file.ReadOnlyFileStore - TarMK ReadOnly opened: crx-quickstart/repository/segmentstore (mmap=true)

29.08.2019 11:28:17.491 [main] *INFO* org.apache.jackrabbit.oak.segment.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.plugins.blob.datastore.OakFileDataStore]}

29.08.2019 11:28:17.495 [main] *INFO* org.apache.jackrabbit.oak.segment.scheduler.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.

29.08.2019 11:28:17.502 [main] *INFO* org.apache.jackrabbit.oak.upgrade.cli.parser.DatastoreArguments - Destination blob store: FileDataStore[/mnt/author6.4_myh_dev]

29.08.2019 11:28:17.505 [main] *INFO* org.apache.jackrabbit.oak.segment.file.FileStore - Creating file store FileStoreBuilder{version=1.8.5, directory=crx-quickstart/repository_new/segmentstore, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.plugins.blob.datastore.OakFileDataStore], maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}}

29.08.2019 11:28:17.523 [main] *INFO* org.apache.jackrabbit.oak.segment.file.FileStore - TarMK opened at crx-quickstart/repository_new/segmentstore, mmap=true, size=1.6 MB (1608192 bytes)

29.08.2019 11:28:17.526 [main] *INFO* org.apache.jackrabbit.oak.segment.SegmentNodeStore$SegmentNodeStoreBuilder - Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.oak.plugins.blob.datastore.OakFileDataStore]}

29.08.2019 11:28:17.526 [main] *INFO* org.apache.jackrabbit.oak.segment.scheduler.LockBasedScheduler - Initializing SegmentNodeStore with the commitFairLock option enabled.

29.08.2019 11:28:17.537 [main] *INFO* org.apache.jackrabbit.oak.upgrade.RepositorySidegrade - Checkpoints won't be migrated because of the --skip-checkpoints options

29.08.2019 11:28:17.766 [main] *WARN* org.apache.jackrabbit.oak.plugins.blob.datastore.DataStoreBlobStore - Error occurred while loading bytes from steam while fetching for id 66f1d39a64998bf2e641765057509c086f2474202d9fd24fa654dabc01aba988#95174

java.util.concurrent.ExecutionException: java.io.IOException: org.apache.jackrabbit.core.data.DataStoreException: Record 66f1d39a64998bf2e641765057509c086f2474202d9fd24fa654dabc01aba988 does not exist

at org.apache.jackrabbit.oak.cache.CacheLIRS$Segment.load(CacheLIRS.java:1018) ~[oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.cache.CacheLIRS$Segment.get(CacheLIRS.java:975) ~[oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.cache.CacheLIRS.get(CacheLIRS.java:286) ~[oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.plugins.blob.datastore.DataStoreBlobStore.getInputStream(DataStoreBlobStore.java:324) ~[oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.plugins.blob.BlobStoreBlob.getNewStream(BlobStoreBlob.java:47) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.SegmentBlob.getNewStream(SegmentBlob.java:248) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.SegmentBlob.getNewStream(SegmentBlob.java:85) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeBlob(DefaultSegmentWriter.java:583) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeProperty(DefaultSegmentWriter.java:697) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeProperty(DefaultSegmentWriter.java:683) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeNodeUncached(DefaultSegmentWriter.java:901) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeNode(DefaultSegmentWriter.java:805) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeNodeUncached(DefaultSegmentWriter.java:873) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeNode(DefaultSegmentWriter.java:805) [oak-upgrade-1.8.5.jar:1.8.5]

at org.apache.jackrabbit.oak.segment.DefaultSegmentWriter$SegmentWriteOperation.writeNodeUncached(DefaultSegmentWriter.java:868) [oak-upgrade-1.8.5.jar:1.8.5]