LUC070-156 multithread deletes - implemented with integration and uni…

[davidhay]

Adding code to allow for Delete Task in worker to delete each archive chunk in parallel.

TODO

• control the sending of DeletedChunk events from Worker via property in Broker (sent in Delete Task Props).
• investigate the clean shut down of other parallel tasks when one parallel task encounters error and ends the Worker Task which releases the Worker to accept another Task.
• investigate the clean shutdown of TSM Device since it uses unix processes to interact with actual TSM
• investigate the unix exit codes returned from TSM when deleting archive that does not exist - it's a warning not an error but we are treating it like one
• write code and tests to ensure that DeletedChunk events are being stored against deposit/job correctly

DONE

Multi-Thread Deletes Implementation

Supported Scenarios:

• No Chunk / Single Location archives
• Multi-Chunk / Single Location archives
• No Chunk / Multi-Location archives
• Multi-Chunk / Multi-Location archives

when a chunk or non-chunk archive file is deleted - a DeletedChunk event will be sent to the Broker - it has the following:

• archiveType
• the archiveStoreId
• the chunkNumber
• number Of Chunks
• location

written deposit-then-delete integration tests:

ChunkingType	ArchiveType	description"
no chunks	single location archives	uses LocalFileSystemArchive for tests
multi-chunk	single location archives	uses LocalFileSystemArchive for tests
no chunks	multi location archives	uses MultiLocalFileSystemArchive for tests
multi-chunk	multi location archives	uses MultiLocalFileSystemArchive for tests

written deposit-unit-tests to help simulate and test errors at random chunks. These all use test-specific ArchiveStore test device to control when error occurs

ChunkingType	ArchiveType
no chunks	single location archives
multi-chunk	single location archives
no chunks	multi location archives
multi-chunk	multi location archives

[davidhay]

Just pushed a fix - moved duplicated Delete Deposit code into AdminDepositService