Writing CASes to a zip archive

[daxenberger]

Originally reported on Google Code with ID 135

DKPro-Core 1.6.1. will support writing to ZIP archives using e.g. BinaryCasWriter. We
should make use of this feature:

[PreprocessingTask]

AnalysisEngineDescription writer = createEngineDescription(BinaryCasWriter.class,
BinaryCasWriter.PARAM_TARGET_LOCATION, "jar:file:" + root + "/archive.zip", 
BinaryCasWriter.PARAM_TYPE_SYSTEM_LOCATION, root + "/typesystem.bin",
BinaryCasWriter.PARAM_FORMAT, "6");

and likewise for the Meta- and FeatureExtractionTasks.

One problem remains: I am not sure whether this makes sense for the BatchTaskCrossValidation,
where we (currently) need to split the overall set of files into various folds (file
sets), that need to be retrieved individually in each fold.

Reported by daxenberger.j on 2014-05-28 12:41:02

[daxenberger]

"root" points to the path on the file system. Unless you have a strong reason to store
the type system outside the ZIP, I suggest you remove the "root" from PARAM_TYPE_SYSTEM_LOCATION
and just set it to "typesystem.bin" (no slash). Relative type system locations are
placed inside the ZIP - absolute locations are placed directly on the file system.

Reported by richard.eckart on 2014-05-28 12:42:45

[daxenberger]

Thanks for the hint. I don't see a reason to store the typesystem outside the ZIP, so
the location should be relative.

Reported by daxenberger.j on 2014-05-28 12:47:58

[daxenberger]

Reported by daxenberger.j on 2014-06-04 16:09:40

• Labels added: Milestone-Release0.7.0

[daxenberger]

I wonder, didn't we plan to do this in 0.6.0? 

Reported by richard.eckart on 2014-06-25 15:04:57

[daxenberger]

Because of the problem mentioned in the first post: I'm not sure how to integrate this
with the current Crossvalidation BatchTask.

Reported by daxenberger.j on 2014-06-25 15:09:46

[daxenberger]

Ah, I see. It shouldn't be a big problem but it is probably too much for the 0.6.0 release.


The basic principle should remain the same. We'd just need some extra code to extract
the file names for the folds from the ZIP instead of scanning them from the file system.

Reported by richard.eckart on 2014-06-25 15:11:57

[daxenberger]

Reported by daxenberger.j on 2015-01-06 11:40:17

• Labels added: Milestone-Release0.8.0
• Labels removed: Milestone-Release0.7.0