Highlighted

Blue-Green content migration from 6.1 to 6.3

Avatar

Avatar

ericw36931598

Avatar

ericw36931598

ericw36931598

12-02-2018

Hi,

I'm trying to migrate content from on AEM 6.1 repository to a fresh new installed 6.3 repository. using crx2oak.

Here is the command line I used to execute the migration:

/opt/java1.8/jdk1.8.0_131/bin/java -Xmx10G -jar crx2oak-1.6.8-all-in-one.jar /opt/cq5.track1/current/crx-quickstart/repository /opt/aem/publish/crx-quickstart/repository --include-paths=/content/corpo,/content/dam/corpo --merge-paths=/ --copy-versions=true --copy-orphaned-versions=false

/content/corpo is only one of our websites, with a limited content. The script executes in 5 sec and does not report any error. However, when looking at the target repository after the script's execution, nothing has been migrated.

I tryed with several parameters combinations, without any success. I also tryed 1.6.4 and 1.6.10 versions of the tool.

And yes, both 6.1 and 6.3 instances are stopped during the migration.

Here are the traces of the script's execution:

12.02.2018 17:08:11.058 INFO   c.a.g.c.CRX2Oak: started with args: [/opt/cq5.track1/current/crx-quickstart/repository, /opt/aem/publish/crx-quickstart/repository, --copy-versions=false, --copy-orphaned-versions=false, --fail-on-error, --skip-init, --merge-paths=/content, --include-paths=/content/corpo,/content/dam/corpo]

12.02.2018 17:08:11.206 INFO   c.a.g.c.c.VersionPrinter: CRX2Oak version: 1.6.4 (STANDALONE mode)

12.02.2018 17:08:11.515 INFO   c.a.g.c.c.VersionPrinter: crx2oak.jar (version: 1.6, checksum: d20f84d79c29e0e571ca6fa4f4bec44915e5e936)

12.02.2018 17:08:11.540 INFO   c.a.g.c.p.ProfileHandler: Applying partly the command line (before loading a profile): [/opt/cq5.track1/current/crx-quickstart/repository, /opt/aem/publish/crx-quickstart/repository, --copy-versions=false, --copy-orphaned-versions=false, --fail-on-error, --skip-init, --merge-paths=/content, --include-paths=/content/corpo,/content/dam/corpo]

12.02.2018 17:08:11.542 INFO   c.a.g.c.p.ProfileHandler: The following template tags has been defined: {}

12.02.2018 17:08:11.544 INFO   c.a.g.c.p.ProfileHandler: The command line (after loading a profile): [--copy-versions, false, --copy-orphaned-versions, false, --fail-on-error, --skip-init, --merge-paths, /content, --include-paths, /content/corpo,/content/dam/corpo, /opt/cq5.track1/current/crx-quickstart/repository, /opt/aem/publish/crx-quickstart/repository]

12.02.2018 17:08:11.546 INFO   c.a.g.c.c.MigrationSpecGenerator: The effective command line for migration: [--copy-versions, false, --copy-orphaned-versions, false, --fail-on-error, --skip-init, --merge-paths, /content, --include-paths, /content/corpo,/content/dam/corpo, /opt/cq5.track1/current/crx-quickstart/repository, /opt/aem/publish/crx-quickstart/repository]

12.02.2018 17:08:11.574 INFO   o.a.j.o.u.c.p.DatastoreArguments: Only blob references will be copied

12.02.2018 17:08:11.574 INFO   o.a.j.o.u.c.p.MigrationOptions: copyVersions parameter set to false

12.02.2018 17:08:11.574 INFO   o.a.j.o.u.c.p.MigrationOptions: copyOrphanedVersions parameter set to false

12.02.2018 17:08:11.574 INFO   o.a.j.o.u.c.p.MigrationOptions: paths to include: [/content/corpo, /content/dam/corpo]

12.02.2018 17:08:11.574 INFO   o.a.j.o.u.c.p.MigrationOptions: Unreadable nodes will cause failure of the entire transaction

12.02.2018 17:08:11.575 INFO   o.a.j.o.u.c.p.MigrationOptions: The repository initialization will be skipped

12.02.2018 17:08:11.575 INFO   o.a.j.o.u.c.p.MigrationOptions: Cache size: 256 MB

12.02.2018 17:08:11.575 INFO   o.a.j.o.u.c.p.StoreArguments: Source: JCR2_DIR_XML[/opt/cq5.track1/current/crx-quickstart/repository, /opt/cq5.track1/current/crx-quickstart/repository/repository.xml]

12.02.2018 17:08:11.575 INFO   o.a.j.o.u.c.p.StoreArguments: Destination: SEGMENT_TAR[/opt/aem/publish/crx-quickstart/repository]

12.02.2018 17:08:11.579 INFO   c.a.g.c.e.MigrationRunner: Starting migration phase with: 1 prepare tasks and 1 finalize tasks.

12.02.2018 17:08:11.883 INFO   c.a.g.c.e.MigrationEngine: Running migration now

12.02.2018 17:08:12.185 WARN   o.a.j.c.u.RepositoryLock: Existing lock file /opt/cq5.track1/v6.1.0/crx-quickstart/repository/.lock detected. Repository was not shut down properly.

12.02.2018 17:08:12.209 INFO   o.a.j.c.RepositoryImpl: Starting repository...

12.02.2018 17:08:12.213 INFO   o.a.j.c.f.l.LocalFileSystem: LocalFileSystem initialized at path /opt/cq5.track1/current/crx-quickstart/repository/repository

12.02.2018 17:08:13.417 INFO   c.d.c.c.c.ClusterController: Node 0291c1e2-84a9-474c-8b06-8fbd30e60d9e started the master listener, on address: brpdev5pub/127.0.0.1:8088 force: false

12.02.2018 17:08:13.430 INFO   c.d.c.c.c.ClusterController: Node 0291c1e2-84a9-474c-8b06-8fbd30e60d9e started as: master

12.02.2018 17:08:13.480 INFO   c.d.c.p.t.ClusterTarSet: activate /opt/cq5.track1/v6.1.0/crx-quickstart/repository tarJournal

12.02.2018 17:08:13.551 INFO   o.a.j.c.f.l.LocalFileSystem: LocalFileSystem initialized at path /opt/cq5.track1/current/crx-quickstart/repository/version

12.02.2018 17:08:13.557 INFO   c.d.c.p.t.ClusterTarSet: activate /opt/cq5.track1/v6.1.0/crx-quickstart/repository version

12.02.2018 17:08:13.595 INFO   o.a.j.c.RepositoryImpl: initializing workspace 'crx.default'...

12.02.2018 17:08:13.596 INFO   o.a.j.c.f.l.LocalFileSystem: LocalFileSystem initialized at path /opt/cq5.track1/current/crx-quickstart/repository/workspaces/crx.default

12.02.2018 17:08:13.598 INFO   c.d.c.p.t.ClusterTarSet: activate /opt/cq5.track1/v6.1.0/crx-quickstart/repository crx.default

12.02.2018 17:08:13.781 WARN   o.a.j.c.q.l.SearchIndex: Invalid value for spellCheckerClass, class com.day.crx.core.query.spell.CRXSpellChecker not found.

12.02.2018 17:08:14.902 INFO   o.a.j.c.q.l.SearchIndex: Index initialized: /opt/cq5.track1/current/crx-quickstart/repository/repository/index Version: 3

12.02.2018 17:08:14.910 WARN   o.a.j.c.q.l.SearchIndex: Invalid value for spellCheckerClass, class com.day.crx.core.query.spell.CRXSpellChecker not found.

12.02.2018 17:08:14.948 INFO   o.a.j.c.q.l.SearchIndex: Index initialized: /opt/cq5.track1/current/crx-quickstart/repository/workspaces/crx.default/index Version: 3

12.02.2018 17:08:14.948 INFO   o.a.j.c.RepositoryImpl: workspace 'crx.default' initialized

12.02.2018 17:08:14.952 INFO   o.a.j.c.RepositoryImpl: SecurityManager = class com.day.crx.core.CRXSecurityManager

12.02.2018 17:08:14.976 INFO   o.a.j.c.DefaultSecurityManager: init: use Repository Login-Configuration for com.day.crx

12.02.2018 17:08:15.017 INFO   o.a.j.c.RepositoryImpl: Repository started (2808ms)

12.02.2018 17:08:15.034 INFO   o.a.j.o.u.c.p.DatastoreArguments: Destination blob store: org.apache.jackrabbit.oak.upgrade.cli.blob.ConstantBlobStoreFactory@6ed3f258

12.02.2018 17:08:15.051 INFO   o.a.j.o.s.f.FileStore: Creating file store FileStoreBuilder{directory=/opt/aem/publish/crx-quickstart/repository/segmentstore, blobStore=DataStore backed BlobStore [com.day.crx.core.data.ClusterDataStore], maxFileSize=256, segmentCacheSize=256, stringCacheSize=256, templateCacheSize=64, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1048576, memoryMapping=true, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcSizeDeltaEstimation=1073741824}}

12.02.2018 17:08:15.162 INFO   o.a.j.o.s.f.FileStore: TarMK opened: /opt/aem/publish/crx-quickstart/repository/segmentstore (mmap=true)

12.02.2018 17:08:15.172 INFO   o.a.j.o.s.SegmentNodeStore$SegmentNodeStoreBuilder: Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [com.day.crx.core.data.ClusterDataStore]}

12.02.2018 17:08:15.172 INFO   o.a.j.o.s.SegmentNodeStore: Initializing SegmentNodeStore with the commitFairLock option enabled.

12.02.2018 17:08:15.204 INFO   o.a.j.o.u.RepositoryUpgrade: Copying repository content from /opt/cq5.track1/current/crx-quickstart/repository to Oak

12.02.2018 17:08:15.329 INFO   o.a.j.o.u.RepositoryUpgrade: Skipping the repository initialization

12.02.2018 17:08:15.331 INFO   o.a.j.o.u.RepositoryUpgrade: Copying registered namespaces

12.02.2018 17:08:15.379 INFO   o.a.j.o.u.RepositoryUpgrade: Skipping registering node types and privileges

12.02.2018 17:08:15.459 INFO   o.a.j.o.u.RepositoryUpgrade: Copying workspace content

12.02.2018 17:08:15.462 INFO   o.a.j.o.u.RepositoryUpgrade: Copying workspace crx.default [i: [/content/corpo, /content/dam/corpo], e: [/jcr:system/jcr:versionStorage], m: [/content, /jcr:system]]

12.02.2018 17:08:15.467 INFO   o.a.j.o.u.RepositoryUpgrade: Upgrading workspace content completed in 0s (8.120 ms)

12.02.2018 17:08:15.472 INFO   o.a.j.o.u.RepositoryUpgrade: Skipping the version storage as the copyOrphanedVersions is set to false

12.02.2018 17:08:15.472 INFO   o.a.j.o.u.RepositoryUpgrade: Applying default commit hooks

12.02.2018 17:08:15.484 INFO   o.a.j.o.u.RepositoryUpgrade: Marking counter to be reindexed

12.02.2018 17:08:15.489 INFO   o.a.j.o.u.RepositoryUpgrade: Marking uuid to be reindexed

12.02.2018 17:08:15.495 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via EditorHook : (CompositeEditorProvider : ([RestrictionEditorProvider, GroupEditorProvider : groupsPath = /home/groups, org.apache.jackrabbit.oak.upgrade.version.VersionableEditor$Provider@37b70343, org.apache.jackrabbit.oak.upgrade.SameNameSiblingsEditor$Provider@306851c7, org.apache.jackrabbit.oak.upgrade.security.AuthorizableFolderEditor$1@12bcd0c0]))

12.02.2018 17:08:15.538 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook EditorHook : (CompositeEditorProvider : ([RestrictionEditorProvider, GroupEditorProvider : groupsPath = /home/groups, org.apache.jackrabbit.oak.upgrade.version.VersionableEditor$Provider@37b70343, org.apache.jackrabbit.oak.upgrade.SameNameSiblingsEditor$Provider@306851c7, org.apache.jackrabbit.oak.upgrade.security.AuthorizableFolderEditor$1@12bcd0c0])) processed commit in 42.92 ms

12.02.2018 17:08:15.538 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via EditorHook : (VersionablePropertiesEditor)

12.02.2018 17:08:15.542 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook EditorHook : (VersionablePropertiesEditor) processed commit in 3.762 ms

12.02.2018 17:08:15.542 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via JcrAllCommitHook

12.02.2018 17:08:15.544 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook JcrAllCommitHook processed commit in 2.091 ms

12.02.2018 17:08:15.544 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via VersionablePathHook : workspaceName = crx.default

12.02.2018 17:08:15.549 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook VersionablePathHook : workspaceName = crx.default processed commit in 4.421 ms

12.02.2018 17:08:15.549 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via PermissionHook

12.02.2018 17:08:15.555 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook PermissionHook processed commit in 5.877 ms

12.02.2018 17:08:15.555 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via EditorHook : (SlingFolderEditorProvider)

12.02.2018 17:08:15.569 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook EditorHook : (SlingFolderEditorProvider) processed commit in 13.75 ms

12.02.2018 17:08:15.569 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via EditorHook : (UniquePrincipalNameEditorProvider)

12.02.2018 17:08:15.570 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook EditorHook : (UniquePrincipalNameEditorProvider) processed commit in 867.7 μs

12.02.2018 17:08:15.570 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit via EditorHook : (CompositeEditorProvider : ([TypeEditorProvider, IndexEditorProvider]))

12.02.2018 17:08:15.585 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/workflowDataLucene]

12.02.2018 17:08:15.587 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/slingeventJob]

12.02.2018 17:08:15.588 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/versionStoreIndex]

12.02.2018 17:08:15.589 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/commerceLucene]

12.02.2018 17:08:15.589 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/authorizables]

12.02.2018 17:08:15.590 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/cqProjectLucene]

12.02.2018 17:08:15.593 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/ntBaseLucene]

12.02.2018 17:08:15.594 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/cqTagLucene]

12.02.2018 17:08:15.595 WARN   o.a.j.o.p.i.IndexUpdate: Missing index provider of type [lucene], requesting reindex on [/oak:index/cqPageLucene]

12.02.2018 17:08:15.596 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing will be performed for following indexes: [/oak:index/uuid]

12.02.2018 17:08:15.601 INFO   o.a.j.o.u.RepositoryUpgrade: Updating indexes   __        __

12.02.2018 17:08:15.798 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #10000 /jcr:system/jcr:versionStorage/48/7b

12.02.2018 17:08:15.945 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #20000 /jcr:system/jcr:versionStorage/ac

12.02.2018 17:08:16.024 INFO   c.d.i.d.DiskSpaceUtil: Usable disk space: 42888 MB (using "File.getUsableSpace")

12.02.2018 17:08:16.037 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #30000 /jcr:system/jcr:versionStorage/da/55

12.02.2018 17:08:16.127 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #40000 /jcr:system/jcr:versionStorage/ce/23

12.02.2018 17:08:16.225 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #50000 /jcr:system/jcr:versionStorage/a3/71

12.02.2018 17:08:16.317 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #60000 /jcr:system/jcr:versionStorage/66/db

12.02.2018 17:08:16.558 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #70000 /jcr:system/jcr:nodeTypes/rep:User/rep:namedPropertyDefinitions

12.02.2018 17:08:17.356 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #80000 /etc/clientlibs/fd/af/guidetheme/simpleEnrollment/images/arrow-blue.png

12.02.2018 17:08:17.602 INFO   o.a.j.o.u.RepositoryUpgrade: Updating indexes   \ \      / /

12.02.2018 17:08:19.713 INFO   o.a.j.o.u.RepositoryUpgrade: Updating indexes    \ \ /\ / /

12.02.2018 17:08:19.907 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #90000 /etc/packages/adobe/cq610/social/scf/.snapshot/cq-social-scf-pkg-2.0.20.zip/jcr:content

12.02.2018 17:08:20.357 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #100000 /libs/foundation/components/form/radio/dialog/items/fourth/items/required

12.02.2018 17:08:20.690 INFO   o.a.j.o.p.i.IndexUpdate: /oak:index/uuid => Indexed 10000 nodes in 5.099 s ...

12.02.2018 17:08:20.755 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #110000 /libs/cq/core/content/projects/showtasks/reviewtd/jcr:content/content/items/content/items/taskInfo/items/content/items/right/items/priority

12.02.2018 17:08:21.586 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #120000 /libs/cq/gui/components/siteadmin/admin/components/component/title

12.02.2018 17:08:21.715 INFO   o.a.j.o.u.RepositoryUpgrade: Updating indexes     \ V  V /

12.02.2018 17:08:21.985 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #130000 /libs/fd/fm/base/components/clientlibs/services/js/ServiceDelegate.js

12.02.2018 17:08:22.979 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #140000 /libs/social/enablement/components/hbs/admin/createlearningpath/clientlibs/createlearningpath.js/jcr:content

12.02.2018 17:08:23.062 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #150000 /libs/mcm/campaign/components/textimage/dialog/items/tab1/items/text/rtePlugins/personalizationplugin

12.02.2018 17:08:23.463 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #160000 /libs/dam/gui/components/s7dam/videopresetgroupeditor/clientlibs/videopresetgroupeditor/videopresetgroupeditor.css

12.02.2018 17:08:23.750 INFO   o.a.j.o.u.RepositoryUpgrade: Updating indexes      \_/\_/

12.02.2018 17:08:23.886 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #170000 /libs/dam/gui/coral/components/admin/schemaforms/formbuilder/formfields/referencefield/referencefield.jsp

12.02.2018 17:08:24.045 INFO   o.a.j.o.p.i.IndexUpdate: /oak:index/uuid => Indexed 20000 nodes in 3.354 s ...

12.02.2018 17:08:24.908 INFO   o.a.j.o.p.i.IndexUpdate: Reindexing Traversed #180000 /libs/granite/security/content/sslConfig/jcr:content/body/items/form/items/wizard/items/step2/items/columns/items/container/items/certificatewell/items/certificatefiletextcontainer

12.02.2018 17:08:25.050 INFO   o.a.j.o.p.i.IndexUpdate: Indexing report

    - /oak:index/uuid*(22164)

12.02.2018 17:08:25.086 INFO   o.a.j.o.u.RepositoryUpgrade: Commit hook EditorHook : (CompositeEditorProvider : ([TypeEditorProvider, IndexEditorProvider])) processed commit in 9.515 s

12.02.2018 17:08:25.087 INFO   o.a.j.o.u.RepositoryUpgrade: Processing commit hooks completed in 9s (9.614 s)

12.02.2018 17:08:25.239 INFO   o.a.j.o.s.f.FileStore: TarMK closed: /opt/aem/publish/crx-quickstart/repository/segmentstore

12.02.2018 17:08:25.239 INFO   o.a.j.c.RepositoryImpl: Shutting down repository...

12.02.2018 17:08:25.241 INFO   o.a.j.c.q.l.SearchIndex: Index closed: /opt/cq5.track1/current/crx-quickstart/repository/repository/index

12.02.2018 17:08:25.242 INFO   o.a.j.c.RepositoryImpl: shutting down workspace 'crx.default'...

12.02.2018 17:08:25.242 INFO   o.a.j.c.o.ObservationDispatcher: Notification of EventListeners stopped.

12.02.2018 17:08:25.242 INFO   o.a.j.c.q.l.SearchIndex: Index closed: /opt/cq5.track1/current/crx-quickstart/repository/workspaces/crx.default/index

12.02.2018 17:08:25.247 INFO   c.d.c.p.t.ClusterTarSet: close /opt/cq5.track1/v6.1.0/crx-quickstart/repository crx.default

12.02.2018 17:08:25.248 INFO   c.d.c.p.t.ClusterTarSet: deactivate while master /opt/cq5.track1/v6.1.0/crx-quickstart/repository crx.default

12.02.2018 17:08:25.273 INFO   o.a.j.c.RepositoryImpl: workspace 'crx.default' has been shutdown

12.02.2018 17:08:25.273 INFO   c.d.c.p.t.ClusterTarSet: close /opt/cq5.track1/v6.1.0/crx-quickstart/repository version

12.02.2018 17:08:25.273 INFO   c.d.c.p.t.ClusterTarSet: deactivate while master /opt/cq5.track1/v6.1.0/crx-quickstart/repository version

12.02.2018 17:08:25.276 INFO   c.d.c.p.t.ClusterTarSet: close /opt/cq5.track1/v6.1.0/crx-quickstart/repository tarJournal

12.02.2018 17:08:25.280 INFO   c.d.c.p.t.ClusterTarSet: deactivate while master /opt/cq5.track1/v6.1.0/crx-quickstart/repository tarJournal

12.02.2018 17:08:25.294 INFO   o.a.j.c.RepositoryImpl: Repository has been shutdown

12.02.2018 17:08:25.557 INFO   c.a.g.c.e.MigrationEngine: Finished migration in 13 seconds.

12.02.2018 17:08:25.558 INFO   c.a.g.c.e.MigrationRunner: migration completed

__   __         __        ___ ___  ___  __

/  ` /  \  |\/| |__) |    |__   |  |__  |  \

\__, \__/  |  | |    |___ |___  |  |___ |__/

I looked at many posts in this forum and differents blogs, but didn't found any help to resolve my problem.

Any help would be appreciated.

Regards,

Eric

Replies

Highlighted

Avatar

Avatar

smacdonald2008

Total Posts

(val/1000)?string[".0"]}K

Likes

(val/1000)?string[".0"]}K

Correct Answer

(val/1000)?string[".0"]}K

Avatar

smacdonald2008

Total Posts

(val/1000)?string[".0"]}K

Likes

(val/1000)?string[".0"]}K

Correct Answer

(val/1000)?string[".0"]}K
smacdonald2008

12-02-2018

This is all documented here -- Using the CRX2Oak Migration Tool

Also watch this GEMS session on this subject -- Deep dive into AEM upgrade process

This tool has been used by a lot of AEM users to do exactly this use case.

Highlighted

Avatar

Avatar

ericw36931598

Avatar

ericw36931598

ericw36931598

12-02-2018

Thanks for your response.

I already readed the documentation and the gems you provided, but without success.

I also activated trace mode, but nothing useful in the few added logs to understand what is happening.

Highlighted

Avatar

Avatar

ericw36931598

Avatar

ericw36931598

ericw36931598

15-02-2018

OK, seems I had a typo in my script. I'm now able to run it.

Following page was also a great help: Things to Look Out for When Upgrading to AEM 6.3

But I'm not at the end of the tunnel. Copying content from SegmentStore seems OK. I was able to copy all pages of one of my websites.

However copy of DAM is not working. Here is the error :

15.02.2018 ERROR  o.a.j.c.d.AbstractDataStore: Failed to hash identifier using MAC (Message Authentication Code) algorithm.

org.apache.jackrabbit.core.data.DataStoreException: Unable to access reference key file /opt/cq5.track1/v6.1.0/crx-quickstart/repository/repository/datastore/reference.key

        at org.apache.jackrabbit.core.data.FileDataStore.getOrCreateReferenceKey(FileDataStore.java:451)

        at org.apache.jackrabbit.oak.plugins.blob.datastore.OakFileDataStore.getOrCreateReferenceKey(OakFileDataStore.java:94)

        at org.apache.jackrabbit.core.data.AbstractDataStore.getReferenceKey(AbstractDataStore.java:141)

        at org.apache.jackrabbit.core.data.AbstractDataStore.getReferenceFromIdentifier(AbstractDataStore.java:100)

        at org.apache.jackrabbit.core.data.AbstractDataRecord.getReference(AbstractDataRecord.java:60)

        at org.apache.jackrabbit.oak.plugins.blob.datastore.DataStoreBlobStore.getReference(DataStoreBlobStore.java:306)

        at org.apache.jackrabbit.oak.plugins.segment.SegmentBlob.getReference(SegmentBlob.java:132)

        at org.apache.jackrabbit.oak.segment.SegmentWriter$SegmentWriteOperation.writeBlob(SegmentWriter.java:748)

The reference.key file is effectively missing in the source datastore. And I looked on all our instances in Production and the file is missing everywhere.

Is it a (simple ?) way to create this file ?

Highlighted

Avatar

Avatar

ericw36931598

Avatar

ericw36931598

ericw36931598

16-02-2018

Hi,

I should have paid more attention to the stack trace: FileDataStore.getOrCreateReferenceKey

The method name shows that the reference key file should have been created if not existing. That was not the case.

The problem was that my AEM 6.3 instance is installed and run under "aem" user when my 6.1 is installed and run under "root".

As I launch crx2oak under "aem" too, it does not had permissions to create the reference.key file in the datastore folder (owned by root with 775 permissions).

Then I changed permissions of the folder to 777 and then, the reference.key file has been created and the migration script runned succesfully.

Highlighted

Avatar

Avatar

smacdonald2008

Total Posts

(val/1000)?string[".0"]}K

Likes

(val/1000)?string[".0"]}K

Correct Answer

(val/1000)?string[".0"]}K

Avatar

smacdonald2008

Total Posts

(val/1000)?string[".0"]}K

Likes

(val/1000)?string[".0"]}K

Correct Answer

(val/1000)?string[".0"]}K
smacdonald2008

16-02-2018

Thank you for posting solution!

Highlighted

Avatar

Avatar

ericw36931598

Avatar

ericw36931598

ericw36931598

16-02-2018

And here is my script for crx2oak (adapt path on file system and repository) :

#!/bin/bash

#

# Migration script from 6.1 to 6.3 repository.

# Must be runned with aem user.

#

if [ "$(whoami)" != "aem" ]; then

    echo "Script must be run as user: aem"

    exit -1

fi

ROOT_61="/opt/cq5.track1/v6.1.0"

ROOT_63="/opt/aem/publish"

INCLUDES="/content/SVG,/content/dam/SVG"

JAVA_HOME="/opt/java1.8/jdk1.8.0_131"

JAVA_CMD="$JAVA_HOME/bin/java"

JVM_OPTS="-Xmx4G -Dlogback.configurationFile=$PWD/logback.xml"

CRX2OAK_JAR="crx2oak-1.6.10-all-in-one.jar"

SRC_REPO="$ROOT_61/crx-quickstart/repository"

DEST_REPO="$ROOT_63/crx-quickstart/repository"

SRC_DS="$ROOT_61/crx-quickstart/repository/repository/datastore"

DEST_DS="$ROOT_63/crx-quickstart/repository/datastore"

if [ ! -d "$SRC_REPO" ]

then

    echo "SRC_REPO Directory $SRC_REPO does not exist."

    exit 1

fi

if [ ! -d "$DEST_REPO" ]

then

    echo "DEST_REPO Directory $DEST_REPO does not exist."

    exit 1

fi

if [ ! -d "$SRC_DS" ]

then

    echo "SRC_DS Directory $SRC_DS does not exist."

    exit 1

fi

if [ ! -d "$DEST_DS" ]

then

    echo "DEST_DS Directory $DEST_DS does not exist."

    exit 1

fi

CRX2OAK_OPTS="--include-paths=$INCLUDES --merge-paths=$INCLUDES --copy-versions=false --copy-orphaned-versions=false --skip-init"

CRX2OAK_OPTS="$CRX2OAK_OPTS --copy-binaries --src-datastore=$SRC_DS --datastore=$DEST_DS"

echo AEM repository 6.1 to 6.3 migration...

echo

echo Start of migration : $(date +%H:%M:%S)

echo =============================

$JAVA_CMD $JVM_OPTS -jar $CRX2OAK_JAR $CRX2OAK_OPTS segment-old:$SRC_REPO $DEST_REPO

echo =============================

echo End of migration : $(date +%H:%M:%S)