Files are not indexed automatically on External Storage

[whirlfire]

How to use GitHub

• Please use the 👍 reaction to show that you are affected by the same issue.
• Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
• Subscribe to receive notifications on status change and new comments.

Steps to reproduce

1. Add external storage (type Local)
2. put PDF in there with OCR-data
3. search for a word in there

Expected behavior

File gets indexed and can be found

Actual behavior

File is not found.
If I run "php occ fulltextsearch:index" inside the nextcloud-aio-nextcloud container, IT WORKS. But it wont index on its own.
In the Settings interface, it is shown that the cronjob is running every few minutes.

Host OS

ubuntu server 22.04

Nextcloud AIO version

Nextcloud AIO v2.0.4

Current channel

latest

Other valuable info

im happy to give you more information!

[szaimen]

Hi, did you enable this option?

I fear apart from that there is nothing we can do in AIO to improve the situation as we already run fulltextsearch:index once: https://github.com/nextcloud/all-in-one/blob/0397f30bb553b242a26f72b9c2ec848b06d73e39/Containers/nextcloud/entrypoint.sh#L492

So let me move this to the correct repository to improve the behaviour with external storage.

[whirlfire]

thanks for your answer.
Yes, it is activated. Also php occ fulltextsearch:live does NOT pick up the files.

Only php occ fulltextsearch:index seems to pick it up, and runs without errors.
Maybe it has something to do with it being an external storage of type "LOCAL"? It seems that it picks up files I copy into an internal folder like "Documents". Like it doesnt pick up that there is a new file in that external storage.

[whirlfire]

Just an addition (this is NOT a fix, but a workaround until it is fixed)
I added a cronjob on my host, which triggers indexing every night:
0 2 * * * docker exec -it -u 33 nextcloud-aio-nextcloud php occ fulltextsearch:index -n -q 2>&1

this is for sure not optimal, but at least it works in some way...

im happy to give more infos!

[Zoey2936]

@szaimen I think the problem is that AIO needs to run the indexing in cron or on a similar way

[szaimen]

No, I talked with @ArtificialOwl about this and he said that a cronjob is automatically scheduled by the app. So this sounds like an issue with the app together with external storage...

[whirlfire]

Any update on this? Full text search is quite an important feature...

[szaimen]

Pinging @ArtificialOwl on this

[rasos]

This may be related to poor error handling when accessing external files - maybe we try to improve logging and error handling so that you can see what really happens like I did here in FilesService.php #347