Skip to content

Code Refactoring & Model update - #7

Open
YMParkEPA wants to merge 4 commits into
mainfrom
ymp_update_2607
Open

Code Refactoring & Model update#7
YMParkEPA wants to merge 4 commits into
mainfrom
ymp_update_2607

Conversation

@YMParkEPA

Copy link
Copy Markdown
Collaborator

This PR contains two contents.

The first is code refactoring for the integrated interface of the image feature extractors.

The second is model file updates—specifically, the result of retraining the model based on data generated in mupdf version 1.28.x.

The results of the quantitative evaluation are as follows.

DoclayNet_val (IoU >= 0.60)

Class Precision Recall F1 GT Count Det Count TP Count FP Count FN Count
caption 0.91 0.7975 0.8501 1763 1545 1406 139 357
footnote 0.7391 0.6538 0.6939 312 276 204 72 108
formula 0.7393 0.7186 0.7288 1894 1841 1361 480 533
list-item 0.8518 0.8394 0.8456 13320 13126 11181 1945 2139
page-footer 0.8914 0.9045 0.8979 5571 5653 5039 614 532
page-header 0.8577 0.8646 0.8611 6683 6737 5778 959 905
picture 0.4046 0.2032 0.2706 2775 1394 564 830 2211
section-header 0.9062 0.859 0.882 15744 14924 13524 1400 2220
table 0.8729 0.7721 0.8195 2269 2007 1752 255 517
text 0.866 0.8717 0.8688 49186 49511 42875 6636 6311
title 0.8792 0.6087 0.7194 299 207 182 25 117
overall 0.8626 0.8402 0.8513 99816 97221 83866 13355 15950

Refactoring to integrate the call interface for the ImageFeature V1 model and the ImageFeature V2 model
Code update for YF features, but no impact on actual inference (experimental)
Retrained model after 1.28.x bug fixes - Updated model file
Using refactored image feature class interface
- DoclayNet_val (IoU >= 0.60)

Class	Precision	Recall	F1	GT Count	Det Count	TP Count	FP Count	FN Count
caption	0.91	0.7975	0.8501	1763	1545	1406	139	357
footnote	0.7391	0.6538	0.6939	312	276	204	72	108
formula	0.7393	0.7186	0.7288	1894	1841	1361	480	533
list-item	0.8518	0.8394	0.8456	13320	13126	11181	1945	2139
page-footer	0.8914	0.9045	0.8979	5571	5653	5039	614	532
page-header	0.8577	0.8646	0.8611	6683	6737	5778	959	905
picture	0.4046	0.2032	0.2706	2775	1394	564	830	2211
section-header	0.9062	0.859	0.882	15744	14924	13524	1400	2220
table	0.8729	0.7721	0.8195	2269	2007	1752	255	517
text	0.866	0.8717	0.8688	49186	49511	42875	6636	6311
title	0.8792	0.6087	0.7194	299	207	182	25	117
overall	0.8626	0.8402	0.8513	99816	97221	83866	13355	15950
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants