Storage

[milesroper]

Hi, im using birdnet-pipy on a raspberrypi/home assistant, with a micro SD card. Currently birdnet fills up the disk to 85% before it starts cycling out the recordings. Ideally i would like to customize this, but as its in a container, i dont think i can do this directly, either by manually clearing it out, or doing a script. Can this capability please be added to the software, my preference would be to set it to how many days recordings i would want to keep (for me, 1 week would be enough).

[Suncuss]

Hi! you can manually tweak the clean up relate settings in the config file located at data\config\user_settings.json and there is a storage section

[milesroper]

Sorry, dumb question alert, thanks, that file path doesnt exist on the raspberry pi. Is it in the hacs container? I dont think i can edit that (correct me if im wrong)

[milesroper]

Found it, is in /addon_configs/db21ed7f_birdnet-pipy/data/config, obviously will need to change each time you release an upgrade i assume

[Suncuss]

sorry! my bad, the path i gave is for native installation.
and yes! you found the right file for the home assistant addon version of BirdNET-PiPy.
and no, this config file is not override during upgrade, it is persistant, and it can either be modify by clciking or typing on the settings page web UI, or you can also manually edit it (which gives you some more options to tweak with, like the auto clean up threshold)

[milesroper]

Thanks, i updated it, but it doesnt seem to be clawing back the room. Txt copy of the settings part in scripted. Its still sitting on 80%, but the change ive made is showing that 70% is the max, its not going through and removing the extra.

Storage

Disk Usage
80%
44.1GB used
11.3GB free of 57.8GB
Auto-cleanup removes oldest recordings when usage exceeds 70%.

I found where the audio files sit, there is 1.6gig worth at the moment, around 9000 files. Given its only 1.6gig, 70% obviously means it would free it all?

"storage": {
"auto_cleanup_enabled": true,
"trigger_percent": 70,
"target_percent": 65,
"keep_per_species": 20,
"keep_recent_per_species": 10,
"check_interval_minutes": 30

Doing a grep for silvereye, i get 2174 files. So I dont think the settings above are being respected unless I misunderstand how it works (entirely likely btw) :-)

[Suncuss]

can you go to Management section on the Settings page and open System Logs, select service main and type the search keyword storage. do you see lines like [main]Storage cleanup completed - candidates exhausted

[milesroper]

06:07:00 WARNING [main]Storage cleanup completed - target NOT reached (disk full with non-BirdNET data) | bytes_freed_gb=0 | files_deleted=0 | skipped_missing=11110 | target_reached=false
06:07:00 INFO [main]Starting storage cleanup | bytes_to_free_gb=6.52 | candidate_count=11110 | current_percent=76.3 | keep_per_species=20 | keep_recent_per_species=10 | target_percent=65

[Suncuss]

it looks like it exhusted the candidates to free. it will keep some audio and spectrogram files becuase these two settings:

"keep_per_species": 20,
"keep_recent_per_species": 10,

that will make sure at least 20 of the highest confidence and most rencet 10 detections of a species is kept.

It looks like from the log, it determined from the dabase lookup that 11110 records (candidate_count=11110) can be freed (if they still exist), and then skipped_missing=11110 tells us those files were already deleted in the previous round, there is nothing more to be deleted.

[milesroper]

Don’t understand though, so there is 9000 files of audio recordings, if I’m keeping 30 recordings per species, and I have around 10 species, shouldn’t that mean the file count should be around 300?

[Suncuss]

thanks for the context! investigating.

[milesroper]

Just adding to this, when every i upgrade HA now, the raspberry seems to struggle, it takes ages. I do wonder if its having to check or something all those files, hence we i want to drop it down a bit. Can I just remove them manually or will that break things?