starred/audiobookshelf
1
0
Fork 0
mirror of https://github.com/advplyr/audiobookshelf.git synced 2026-05-30 23:40:40 +02:00
Code Issues 1.0k Packages Projects Releases 10 Wiki Activity

[Bug]: Audiobookshelf keeps blowing out all user edited metadata and covers #1422

New Issue
Closed
opened 2026-04-24 23:44:37 +02:00 by adam · 10 comments
adam commented 2026-04-24 23:44:37 +02:00
Owner
Copy Link
Copy Source

Originally created by @Nitrousoxide on GitHub (Sep 28, 2023).

Describe the issue

Every few days I come back to my audiobookshelf docker install to find that it has reverted the entire audiobook database to an unedited state after doing a scan. I believe the "watcher" scan is reverting all book states to whatever metadata can be gleaned from the directory path and any covers that are in the audiobook directory rather than the metadata fields in the database. I have reverted back to a previous database state and turned off the watcher so I guess we'll see if it still repeats.

I'm not sure what the best way to handle this is. I could obviously disable the watcher, and that's probably fine. I'm not trying to initialize a new audiobook instance anymore from existing directory. But if the intention of the watcher is to overwrite existing metadata with file paths info and the content of the actual file directory you probably want flag that toggle with a warning saying it can be destructive to your audiobook library's metadata.

For me this was pretty destructive since it blew out 300+ audiobooks' metadata. Luckily I keep good backups via dupliciti so I could restore a previous day's state before hours of my work managing the metadata were blown out.

Before the metadata was nuked
image

Here's a snippet of the log as it destroyed it:

"timestamp":"2023-09-28T00:01:45.237Z","message":"setChapters: Using embedded chapters in first audio file /audiobooks/Mike Duncan/The Storm Before the Storm/The Storm Before the Stormê	 The Beginning of the End of the Roman Republic [B0747WH1RK].m4b","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.272Z","message":"Success saving abmetadata to \"/metadata/items/be7e76fd-2554-4005-95a9-4971ed2f181a/metadata.abs\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.272Z","message":"Library item \"Brandon Sanderson/Yumi and the Nightmare Painter\" key \"ino\" changed from \"15689227\" to \"18315371\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.273Z","message":"Library item \"Brandon Sanderson/Yumi and the Nightmare Painter\" changed: [ino,size,lastScan]","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.507Z","message":"setChapters: Using embedded chapters in first audio file /audiobooks/Brandon Sanderson/Yumi and the Nightmare Painter/Yumi_and_the_Nightmare_Painter_by_Brandon_Sanderson.m4b","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.528Z","message":"Success saving abmetadata to \"/metadata/items/ce123821-1593-45c5-8263-4ddd51d8cb18/metadata.abs\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.528Z","message":"Library item \"Pirateabe/The Wandering Inn/The Wind Runner\" key \"ino\" changed from \"15690702\" to \"18313943\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.528Z","message":"Library item \"Pirateabe/The Wandering Inn/The Wind Runner\" changed: [ino,size,lastScan]","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.886Z","message":"setChapters: Using embedded chapters in first audio file /audiobooks/Pirateabe/The Wandering Inn/The Wind Runner/The Wind Runner꞉ The Wandering Inn, Book 10 [B0C82TS539].m4b","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.886Z","message":"Updating book description \"The floodwaters have receded, and the war is over. A ruler has fallen. The Wind Runner lives, missing yet not forgotten. The world is changing, growing larger. After the horrors of war and the loss of spring comes the renewal of summer, a chance for a new beginning. Ryoka Griffin has reappeared in Izril's north. The Quarass is dead, yet the King of Destruction's war continues. In the jungles of Baleros, Geneva and her friends fall under the shadow of the Titan of Baleros. Amidst it all, Erin Solstice grieves for the dead and pulls her family close. Yet there is always a door leading her onwards to a magical future...\" => \"The world is changing, growing larger. After the horrors of war and the loss of spring comes the renewal of summer, a chance for a new beginning. Ryoka Griffin has reappeared in Izril's north. The Quarass is dead, yet the King of Destruction's war continues. In the jungles of Baleros, Geneva and her friends fall under the shadow of the Titan of Baleros. Amidst it all, Erin Solstice grieves for the dead and pulls her family close. Yet there is always a door leading her onwards to a magical future...\" for book \"The Wind Runner\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.886Z","message":"Updating book genres \"Science Fiction & Fantasy\" => \"Action & Adventure, Epic, Paranormal\" for book \"The Wind Runner\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.908Z","message":"Updating book \"The Wind Runner\" added author \"Pirateabe\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.925Z","message":"Updating book \"The Wind Runner\" removed author \"pirateaba\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.955Z","message":"Success saving abmetadata to \"/metadata/items/1378482e-0542-452d-af65-b51d53a815f3/metadata.abs\"","levelName":"DEBUG","level":1}
{"timestamp":"2023-09-28T00:01:45.972Z","message":"Removed 1 authors","levelName":"INFO","level":2}

After everything was nuked
image

The server settings
image

Steps to reproduce the issue

  1. Have a set of audiobooks that you've added to the server
  2. Edit some metadata, such as adding covers or changing names
  3. Enable the "watcher" scanner
  4. Wait for the scanner to run on its normal schedule
  5. Your edited metadata will be overwritten

Audiobookshelf version

2.4.3

How are you running audiobookshelf?

Docker

Originally created by @Nitrousoxide on GitHub (Sep 28, 2023). ### Describe the issue Every few days I come back to my audiobookshelf docker install to find that it has reverted the entire audiobook database to an unedited state after doing a scan. I believe the "watcher" scan is reverting all book states to whatever metadata can be gleaned from the directory path and any covers that are in the audiobook directory rather than the metadata fields in the database. I have reverted back to a previous database state and turned off the watcher so I guess we'll see if it still repeats. I'm not sure what the best way to handle this is. I could obviously disable the watcher, and that's probably fine. I'm not trying to initialize a new audiobook instance anymore from existing directory. But if the intention of the watcher is to overwrite existing metadata with file paths info and the content of the actual file directory you probably want flag that toggle with a warning saying it can be destructive to your audiobook library's metadata. For me this was pretty destructive since it blew out 300+ audiobooks' metadata. Luckily I keep good backups via dupliciti so I could restore a previous day's state before hours of my work managing the metadata were blown out. Before the metadata was nuked ![image](https://github.com/advplyr/audiobookshelf/assets/1363931/ec847fbb-72fd-42ac-ab9d-25cb2244873b) Here's a snippet of the log as it destroyed it: ``` "timestamp":"2023-09-28T00:01:45.237Z","message":"setChapters: Using embedded chapters in first audio file /audiobooks/Mike Duncan/The Storm Before the Storm/The Storm Before the Stormê The Beginning of the End of the Roman Republic [B0747WH1RK].m4b","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.272Z","message":"Success saving abmetadata to \"/metadata/items/be7e76fd-2554-4005-95a9-4971ed2f181a/metadata.abs\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.272Z","message":"Library item \"Brandon Sanderson/Yumi and the Nightmare Painter\" key \"ino\" changed from \"15689227\" to \"18315371\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.273Z","message":"Library item \"Brandon Sanderson/Yumi and the Nightmare Painter\" changed: [ino,size,lastScan]","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.507Z","message":"setChapters: Using embedded chapters in first audio file /audiobooks/Brandon Sanderson/Yumi and the Nightmare Painter/Yumi_and_the_Nightmare_Painter_by_Brandon_Sanderson.m4b","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.528Z","message":"Success saving abmetadata to \"/metadata/items/ce123821-1593-45c5-8263-4ddd51d8cb18/metadata.abs\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.528Z","message":"Library item \"Pirateabe/The Wandering Inn/The Wind Runner\" key \"ino\" changed from \"15690702\" to \"18313943\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.528Z","message":"Library item \"Pirateabe/The Wandering Inn/The Wind Runner\" changed: [ino,size,lastScan]","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.886Z","message":"setChapters: Using embedded chapters in first audio file /audiobooks/Pirateabe/The Wandering Inn/The Wind Runner/The Wind Runner꞉ The Wandering Inn, Book 10 [B0C82TS539].m4b","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.886Z","message":"Updating book description \"The floodwaters have receded, and the war is over. A ruler has fallen. The Wind Runner lives, missing yet not forgotten. The world is changing, growing larger. After the horrors of war and the loss of spring comes the renewal of summer, a chance for a new beginning. Ryoka Griffin has reappeared in Izril's north. The Quarass is dead, yet the King of Destruction's war continues. In the jungles of Baleros, Geneva and her friends fall under the shadow of the Titan of Baleros. Amidst it all, Erin Solstice grieves for the dead and pulls her family close. Yet there is always a door leading her onwards to a magical future...\" => \"The world is changing, growing larger. After the horrors of war and the loss of spring comes the renewal of summer, a chance for a new beginning. Ryoka Griffin has reappeared in Izril's north. The Quarass is dead, yet the King of Destruction's war continues. In the jungles of Baleros, Geneva and her friends fall under the shadow of the Titan of Baleros. Amidst it all, Erin Solstice grieves for the dead and pulls her family close. Yet there is always a door leading her onwards to a magical future...\" for book \"The Wind Runner\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.886Z","message":"Updating book genres \"Science Fiction & Fantasy\" => \"Action & Adventure, Epic, Paranormal\" for book \"The Wind Runner\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.908Z","message":"Updating book \"The Wind Runner\" added author \"Pirateabe\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.925Z","message":"Updating book \"The Wind Runner\" removed author \"pirateaba\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.955Z","message":"Success saving abmetadata to \"/metadata/items/1378482e-0542-452d-af65-b51d53a815f3/metadata.abs\"","levelName":"DEBUG","level":1} {"timestamp":"2023-09-28T00:01:45.972Z","message":"Removed 1 authors","levelName":"INFO","level":2} ``` After everything was nuked ![image](https://github.com/advplyr/audiobookshelf/assets/1363931/d3923ede-7388-4023-bd57-edd068214730) The server settings ![image](https://github.com/advplyr/audiobookshelf/assets/1363931/4dc1ba38-9405-4d7c-bc97-ba274b52b37d) ### Steps to reproduce the issue 1. Have a set of audiobooks that you've added to the server 2. Edit some metadata, such as adding covers or changing names 3. Enable the "watcher" scanner 4. Wait for the scanner to run on its normal schedule 5. Your edited metadata will be overwritten ### Audiobookshelf version 2.4.3 ### How are you running audiobookshelf? Docker
adam added the bug label 2026-04-24 23:44:37 +02:00
adam closed this issue 2026-04-24 23:44:37 +02:00
adam commented 2026-04-24 23:44:40 +02:00
Author
Owner
Copy Link
Copy Source

@advplyr commented on GitHub (Sep 28, 2023):

Metadata should not be getting overwritten (with your server settings) unless you have a metadata.json or metadata.abs file inside the same folder of your books.
The watcher doesn't run on a schedule, it will only get triggered when it detects a file has been added or removed from a library folder. Then it will only run the scan on the existing book or new book.

There is an issue relating to covers getting re-extracted from audio files on scans which will explain why covers would be reverted https://github.com/advplyr/audiobookshelf/issues/2110. I've already fixed that for the next release.
I'm not aware of any other details getting overwritten

@advplyr commented on GitHub (Sep 28, 2023): Metadata should not be getting overwritten (with your server settings) unless you have a `metadata.json` or `metadata.abs` file inside the same folder of your books. The watcher doesn't run on a schedule, it will only get triggered when it detects a file has been added or removed from a library folder. Then it will only run the scan on the existing book or new book. There is an issue relating to covers getting re-extracted from audio files on scans which will explain why covers would be reverted https://github.com/advplyr/audiobookshelf/issues/2110. I've already fixed that for the next release. I'm not aware of any other details getting overwritten
adam commented 2026-04-24 23:44:41 +02:00
Author
Owner
Copy Link
Copy Source

@advplyr commented on GitHub (Sep 28, 2023):

I just looked through your logs and it appears you are having an issue with your files changing their inode values. Can you share what OS and file system you are using for your books?

Related issue on inodes https://github.com/advplyr/audiobookshelf/issues/1447 but not the same since those are short inodes having collisions

@advplyr commented on GitHub (Sep 28, 2023): I just looked through your logs and it appears you are having an issue with your files changing their inode values. Can you share what OS and file system you are using for your books? Related issue on inodes https://github.com/advplyr/audiobookshelf/issues/1447 but not the same since those are short inodes having collisions
adam commented 2026-04-24 23:44:41 +02:00
Author
Owner
Copy Link
Copy Source

@Nitrousoxide commented on GitHub (Sep 28, 2023):

The container itself is using docker, so whatever base OS that uses.

I have a remote smb/cifs share mounted to the container

volumes:
  - /srv/remotemount/Media/Media/Audiobooks:/audiobooks

which points to a Synology network share (and thus is on a BTRFS file system)

@Nitrousoxide commented on GitHub (Sep 28, 2023): The container itself is using docker, so whatever base OS that uses. I have a remote smb/cifs share mounted to the container volumes: - /srv/remotemount/Media/Media/Audiobooks:/audiobooks which points to a Synology network share (and thus is on a BTRFS file system)
adam commented 2026-04-24 23:44:42 +02:00
Author
Owner
Copy Link
Copy Source

@advplyr commented on GitHub (Sep 28, 2023):

Do you have scheduled library scans enabled? When pressing edit on a library and going to schedule

@advplyr commented on GitHub (Sep 28, 2023): Do you have scheduled library scans enabled? When pressing edit on a library and going to schedule
adam commented 2026-04-24 23:44:47 +02:00
Author
Owner
Copy Link
Copy Source

@Nitrousoxide commented on GitHub (Sep 28, 2023):

Do you have scheduled library scans enabled? When pressing edit on a library and going to schedule

Yep

image
@Nitrousoxide commented on GitHub (Sep 28, 2023): > Do you have scheduled library scans enabled? When pressing edit on a library and going to schedule Yep <img width="999" alt="image" src="https://github.com/advplyr/audiobookshelf/assets/1363931/78d97e0c-2fda-470d-9160-05ef05f017ce">
adam commented 2026-04-24 23:44:48 +02:00
Author
Owner
Copy Link
Copy Source

@Nitrousoxide commented on GitHub (Sep 28, 2023):

I just changed my scan schedule to run now as opposed to midnight and it did nuke all my metadata again. So I think it's that not the watcher. I exported my log out too if you want to see it.
2023-09-28_6cb590d6-567f-4f4d-8f88-9f772f630783.txt

@Nitrousoxide commented on GitHub (Sep 28, 2023): I just changed my scan schedule to run now as opposed to midnight and it did nuke all my metadata again. So I think it's that not the watcher. I exported my log out too if you want to see it. [2023-09-28_6cb590d6-567f-4f4d-8f88-9f772f630783.txt](https://github.com/advplyr/audiobookshelf/files/12751101/2023-09-28_6cb590d6-567f-4f4d-8f88-9f772f630783.txt)
adam commented 2026-04-24 23:44:49 +02:00
Author
Owner
Copy Link
Copy Source

@advplyr commented on GitHub (Sep 29, 2023):

I found and fixed the issue here. This is specific to not storing the metadata file with the item and the reason you were running up against it with all of your media is because your file system is changing the inode value. I'll release the patch for the this over the weekend.

This will resolve the issue of metadata being overwritten but the scanner will still report that all of your media got updated because of that inode change. I don't know much about your specific setup but maybe you can configure some setting so that the inode values don't keep changing?

As a side note, the watcher probably won't work for you because of the network file system. That is why scheduled library scans were added so it's normal, just giving an fyi

@advplyr commented on GitHub (Sep 29, 2023): I found and fixed the issue here. This is specific to not storing the metadata file with the item and the reason you were running up against it with all of your media is because your file system is changing the inode value. I'll release the patch for the this over the weekend. This will resolve the issue of metadata being overwritten but the scanner will still report that all of your media got updated because of that inode change. I don't know much about your specific setup but maybe you can configure some setting so that the inode values don't keep changing? As a side note, the watcher probably won't work for you because of the network file system. That is why scheduled library scans were added so it's normal, just giving an fyi
adam commented 2026-04-24 23:44:50 +02:00
Author
Owner
Copy Link
Copy Source

@Nitrousoxide commented on GitHub (Sep 29, 2023):

Is there a way for the user to switch to storing the metadata with the item? I did try flipping that, but it didn't seem to do anything (at least immediately) so I assume it only does it for new items going forward? If it writes the metadata to the /audiobook file from /metadata at a scheduled time a note in the mouseover might be a good addition. If not bringing up a popup to start the migration might be a good addition.

In my case the faster storage is on the local drive rather than the network share, so I'll probably keep the metadata local to the server for better performance.

I'll turn off scans for the library for now until this update is pushed, and I update for now as a workaround.

@Nitrousoxide commented on GitHub (Sep 29, 2023): Is there a way for the user to switch to storing the metadata with the item? I did try flipping that, but it didn't seem to do anything (at least immediately) so I assume it only does it for new items going forward? If it writes the metadata to the /audiobook file from /metadata at a scheduled time a note in the mouseover might be a good addition. If not bringing up a popup to start the migration might be a good addition. In my case the faster storage is on the local drive rather than the network share, so I'll probably keep the metadata local to the server for better performance. I'll turn off scans for the library for now until this update is pushed, and I update for now as a workaround.
adam commented 2026-04-24 23:44:50 +02:00
Author
Owner
Copy Link
Copy Source

@advplyr commented on GitHub (Sep 29, 2023):

The metadata file is written to the new location the next time the details are updated for that book. There is a feature request open I believe for automatically moving everything over. With the upcoming patch it won't matter whether you store it with the items or not so probably best to keep it as you had.

@advplyr commented on GitHub (Sep 29, 2023): The metadata file is written to the new location the next time the details are updated for that book. There is a feature request open I believe for automatically moving everything over. With the upcoming patch it won't matter whether you store it with the items or not so probably best to keep it as you had.
adam commented 2026-04-24 23:44:51 +02:00
Author
Owner
Copy Link
Copy Source

@advplyr commented on GitHub (Sep 30, 2023):

Fixed in v2.4.4

@advplyr commented on GitHub (Sep 30, 2023): Fixed in [v2.4.4](https://github.com/advplyr/audiobookshelf/releases/tag/v2.4.4)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
authentication
backlog
bug
chapter editor
config-issue
ebooks
encoding/embedding
enhancement
help wanted
listening sessions & progress
planned
possible plugin
progress sync
pull-request
Mirrored from GitHub Pull Request
 sorting/filtering/searching
unable to reproduce
upload
users & permissions
waiting
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
adam (Adam Melkus)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/audiobookshelf#1422
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?