Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[orion-dev] Pushing new version of Orion server metadata storage to master today

Hi Team,

I am pushing the changes to master today that will bring the Orion metadata storage to a new version. The motivation is described in Bugzilla 439732 [1] but to summarize:

a) Maintaining multiple version of metadata storage was painful. Starting with Orion 7.0 and going forward, we will have one version of the metadata storage format.

b) The migration process in previous versions of the Orion metadata storage was to backup the server, toggle the server properties in the orion.conf and run the migration. This process required more than one second of server downtime, both to do a proper backup, update a configuration file and to run the migration. We determined that this process is not acceptable. The latest version of the Orion metadata storage (version 7) now has a live migration that updates each user as they log in to the latest format. Users are also updated as they are accessed offline, like during indexing. Bottom line is that when the server restarts, the metadata is migrated and users can immediately login. The time to update one user is about 10ms, unnoticeable.

The logs will include full details of every aspect that was changed during migration:

Migration: Start migrating user anthony to the latest (version 7)
Migration: Updated Orion version from version 4 to version 7 in metadata file: /workspace/foo/an/anthony/OrionContent/Project.json
Migration: Updated the ContentLocation in metadata file: /workspace/foo/an/anthony/OrionContent/Project.json
Migration: Old project metadata file /workspace/foo/an/anthony/OrionContent/Project.json has been moved to /workspace/foo/an/anthony/Project.json
Migration: Updated Orion version from version 4 to version 7 in metadata file: /workspace/foo/an/anthony/OrionContent/ahunter-orion.github.com.json
Migration: Updated the ContentLocation in metadata file: /workspace/foo/an/anthony/OrionContent/ahunter-orion.github.com.json
Migration: Old project metadata file /workspace/foo/an/anthony/OrionContent/ahunter-orion.github.com.json has been moved to /workspace/foo/an/anthony/ahunter-orion.github.com.json
Migration: Updated Orion version from version 4 to version 7 in metadata file: /workspace/foo/an/anthony/OrionContent/workspace.json
Migration: Old workspace metadata file /workspace/foo/an/anthony/OrionContent/workspace.json has been moved to /workspace/foo/an/anthony/anthony-OrionContent.json
Migration: Updated Orion version from version 4 to version 7 in metadata file: /workspace/foo/an/anthony/user.json
Migration: Finished migrating user anthony

If you encounter any issues please let us know.

[1] https://bugs.eclipse.org/bugs/show_bug.cgi?id=439732 Remove simple/simple2 and have only one version of the the server metadata

Cheers...
Anthony

Back to the top