StorageExceptionConsistency: 0 Inconsistent timestamp of file 4281: 1754277183772000000 <= 1754277183772000000

[zambrovski]

Environment Details

• EclipseStore Version: 1.4.0, 3.0.0
• JDK version: 17
• OS: linux
• Used frameworks: Spring, Spring-Boot, Axon-Framework, JobRunR

Describe the bug

I restarted a working instance of an application (without any changes on code) and recieve:

Caused by: org.eclipse.store.storage.exceptions.StorageException: Problem in channel #0
	at org.eclipse.store.storage.types.StorageChannelTask$Abstract.checkForProblems(StorageChannelTask.java:106)
	at org.eclipse.store.storage.types.StorageChannelTask$Abstract.waitOnCompletion(StorageChannelTask.java:168)
	at org.eclipse.store.storage.types.StorageSystem$Default.startThreads(StorageSystem.java:332)
	at org.eclipse.store.storage.types.StorageSystem$Default.internalStartUp(StorageSystem.java:515)
	at org.eclipse.store.storage.types.StorageSystem$Default.start(StorageSystem.java:601)
	at org.eclipse.store.storage.types.StorageSystem$Default.start(StorageSystem.java:71)
	at org.eclipse.store.storage.embedded.types.EmbeddedStorageManager$Default.start(EmbeddedStorageManager.java:247)
	at org.eclipse.store.storage.embedded.types.EmbeddedStorageManager$Default.start(EmbeddedStorageManager.java:95)
	at org.eclipse.store.integrations.spring.boot.types.factories.EmbeddedStorageManagerFactory.createStorage(EmbeddedStorageManagerFactory.java:41)
	at org.eclipse.store.integrations.spring.boot.types.DefaultEclipseStoreConfiguration.defaultStorageManager(DefaultEclipseStoreConfiguration.java:88)
	at org.eclipse.store.integrations.spring.boot.types.DefaultEclipseStoreConfiguration$$SpringCGLIB$$0.CGLIB$defaultStorageManager$2(<generated>)
	at org.eclipse.store.integrations.spring.boot.types.DefaultEclipseStoreConfiguration$$SpringCGLIB$$FastClass$$1.invoke(<generated>)
	at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:258)
	at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:348)
	at org.eclipse.store.integrations.spring.boot.types.DefaultEclipseStoreConfiguration$$SpringCGLIB$$0.defaultStorageManager(<generated>)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:146)
	... 83 common frames omitted
Caused by: org.eclipse.store.storage.exceptions.StorageException: null
	at org.eclipse.store.storage.types.StorageFileManager$Default.readTransactionsFile(StorageFileManager.java:730)
	at org.eclipse.store.storage.types.StorageFileManager$Default.readStorage(StorageFileManager.java:695)
	at org.eclipse.store.storage.types.StorageChannel$Default.readStorage(StorageChannel.java:772)
	at org.eclipse.store.storage.types.StorageChannelTaskInitialize$Default.internalProcessBy(StorageChannelTaskInitialize.java:192)
	at org.eclipse.store.storage.types.StorageChannelTaskInitialize$Default.internalProcessBy(StorageChannelTaskInitialize.java:34)
	at org.eclipse.store.storage.types.StorageChannelTask$Abstract.processBy(StorageChannelTask.java:244)
	at org.eclipse.store.storage.types.StorageChannel$Default.work(StorageChannel.java:453)
	at org.eclipse.store.storage.types.StorageChannel$Default.run(StorageChannel.java:536)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.eclipse.store.storage.exceptions.StorageExceptionConsistency: 0 Inconsistent timestamp of file 4281: 1754277183772000000 <= 1754277183772000000
	at org.eclipse.store.storage.types.StorageTransactionsAnalysis$EntryAggregator.handleEntryStore(StorageTransactionsAnalysis.java:785)
	at org.eclipse.store.storage.types.StorageTransactionsAnalysis$EntryAggregator.accept(StorageTransactionsAnalysis.java:701)
	at org.eclipse.store.storage.types.StorageTransactionsAnalysis$Logic.processBufferedEntities(StorageTransactionsAnalysis.java:378)
	at org.eclipse.store.storage.types.StorageTransactionsAnalysis$Logic.processInputFile(StorageTransactionsAnalysis.java:340)
	at org.eclipse.store.storage.types.StorageTransactionsAnalysis$Logic.processInputFile(StorageTransactionsAnalysis.java:298)
	at org.eclipse.store.storage.types.StorageLiveTransactionsFile$Default.processBy(StorageLiveTransactionsFile.java:86)
	at org.eclipse.store.storage.types.StorageFileManager$Default.readTransactionsFile(StorageFileManager.java:724)
	... 8 common frames omitted

To Reproduce

No idea.

Expected behavior

Eclipse store initializes again.

[zambrovski]

I upgraded to Eclipse Store 3.0.0 and the problems with existing data still exists.
I restored the backup data - problem was still there.
I had to drop the entire store to be able to start the application...

(I still have the backup of the data).

Are there any explanation to this behaviour?
Is there something I can do next time in order not to loose my data?

[zambrovski]

Any comments on this one?

[hg-ms]

This might be related to #423 which has been fixed in version 3.0.0.

If you delete the transaction log files (in all channel directory) the storage will try to start without checking them and create new log files.