[spike] Enable data files from the same sequencing library to be collected as a logical unit

[kbergin]

This ticket represents the work to spike on implementation for this theme. An RFC will be the end result.

For the theme:
User Story
A consumer can download a uniformly processed matrix file which reflects all the data processing results from one sequencing library such as all sequencing lane replicates for a high coverage 10x experiment being processed together

Demoable Criteria
Process a dataset with a multi lane/machine sequencing strategy for a single library and confirm our results are comparable to the outputs produced by the submitting lab.

Success Metric
We can detect and correctly process data sets where the libraries are found in multiple sequencing lanes.

[justincc]

Depending on the output for the spike this may have a dependency on #414

[justincc]

@malloryfreeberg, @barkasn already mentioned this to me at the F2F but when you're drafting the RFC, if it looks like there may be significant ingest work could you dial in myself and @aaclan-ebi in as soon as makes sense? I'd like to have the heads up sooner rather than later.

[malloryfreeberg]

@justincc sure thing. I'm working on this in the current sprint, so I'll reach out soon as it's necessary.

[brianraymor]

Is there a design document or RFC that can be linked into this Spike to help track progress and state?

[kbergin]

Nick's RFC here

[justincc]

@malloryfreeberg's library entity RFC here which overlaps. I believe these RFCs will get reconciled once @barkasn is back.