NCBI datasets updates do not account for key removal

[ccaio]

Issue description:
The pipeline to update ncbi datasets currently does not account for removal of refseq_category key from assemblies that had the "refseq"status moved to a different assembly.

Example for Capra ibex
The refseq_category information is being kept in both old entries and newly assigned RefSeq:
Here both assemblies are reference:

-- On today's dataset output, only one has a RefSeq ID:

capra.json

[rjchallis]

This was an issue with caching data to avoid the expense of fetching sequence reports on every run.

Fixed in 537c6b6 by making caching less aggressive so only sequence report data are cached and all other values come from the latest NCBI datasets output only.

Will check in tomorrow's release to verify

[rjchallis]

Have fixed this again in 07756b4 - hopefully more successful this time

[rjchallis]

Looks like it has worked this time.

Will wait on the next scheduled release before closing