mirror of
https://github.com/advplyr/audiobookshelf.git
synced 2026-05-30 23:40:40 +02:00
Race condition when adding new books to library #189
Closed
opened 2026-04-24 23:00:39 +02:00 by adam
·
3 comments
No Branch/Tag Specified
master
book_tags_genres_dedupe
episode_download_fallback
Issue-4540-SortBy-StartedDate-and-FinishedDate
episode_meta_tagging
fix_authorize_race_condition
redirect_transcode_requests
progress_updated_sort
fix_ereader_socket_event
fix_change_empty_root_password
fix_podcast_session_track_index
fix_set_token
session_modal_user
localize_durations
fix_oidc_create_user
jwt_auth_refactor
fix_scanner_deleting_single_file_books
fix_mediaprogress_updatedat_2
experimental_next_client
podcast_episode_duration
episode-timestamps-clickable
book_author_secondary_sort_title
podcast_useragents
pathexists_user_access
fix_pathexists_join
book_author_secondary_sort
clean_duplicate_mediaprogress
sanitize_html_description
trix_prevent_attachments
check_path_api_fix
fix_mediaprogress_updatedat
increase_express_json_limit
fix_dockerfile_nunicode
search_episodes
audiobook_tools_update
episode_secondary_sorts
hls_stream_url_update
new_session_track_endpoint
audiobook_tools_enhancements
watcher_rescans_update
player_track_tooltip
fix_exclude_prefixes_crash
socket_item_events
fix_podcast_episode_scanner_promise
new_stats_controller
count_cache_for_userpermissions
parsing-opf-v3
validate_migration_files
fix-quick-match-all-crash
fix-chapter-end-sleep-timer
stringify_sequelize_query
remove-col-ambiguity
fix_next_prev_edit_description
details_trim_whitespace
fix_content_url_basepath
fix_logger_fatal
progress_bar_visibility
batch-edit-populate-map-details
feed_generator_updates
bookmark-modal-updates
migrate-library-item-in-scanner
migrate-new-library-items
migrate-podcasts-new-library-item-2
migrate-podcasts-new-library-item
fix-remove-episode-from-playlist
playback-session-use-new-library-item
refactor-library-item
fix-heatmap-caption
feed-episodes-upsert
share-media-player-media-session-api
remove-old-playlist
remove_old_collection_object
plugin-implementation-demo
feed_migration
refactor-feeds-from-item
fix_remove_authors_no_books
v2.17.3-fk-constraints-migration
migrations-first-upgrade
sqlite_2
feature/nuxt-target-server
waveform
sqlite
playlists
video
v2.35.1
v2.35.0
v2.34.0
v2.33.2
v2.33.1
v2.33.0
v2.32.1
v2.32.0
v2.31.0
v2.30.0
v2.29.0
v2.28.0
v2.27.0
v2.26.3
v2.26.2
v2.26.1
v2.26.0
v2.25.1
v2.25.0
v2.24.0
v2.23.0
v2.22.0
v2.21.0
v2.20.0
v2.19.5
v2.19.4
v2.19.3
v2.19.2
v2.19.1
v2.19.0
v2.18.1
v2.18.0
v2.17.7
v2.17.6
v2.17.5
v2.17.4
v2.17.3
v2.17.2
v2.17.1
v2.17.0
v2.16.2
v2.16.1
v2.16.0
v2.15.1
v2.15.0
v2.14.0
v2.13.4
v2.13.3
v2.13.2
v2.13.1
v2.13.0
v2.12.3
v2.12.2
v2.12.1
v2.12.0
v2.11.0
v2.10.1
v2.10.0
v2.9.0
v2.8.1
v2.8.0
v2.7.2
v2.7.1
v2.7.0
v2.6.0
v2.5.0
v2.4.4
v2.4.3
v2.4.2
v2.4.1
v2.4.0
v2.3.5
v2.3.4
v2.3.3
v2.3.2
v2.3.1
v2.3.0
v2.2.23
v2.2.22
v2.2.21
v2.2.20
v2.2.19
v2.2.18
v2.2.17
v2.2.16
v2.2.15
v2.2.14
v2.2.13
v2.2.12
v2.2.11
v2.2.10
v2.2.9
v2.2.8
v2.2.7
v2.2.6
v2.2.5
v2.2.4
v2.2.3
v2.2.2
v2.2.1
v2.2.0
v2.1.5
v2.1.4
v2.1.3
v2.1.2
v2.1.1
v2.1.0
v2.0.24
v2.0.23
v2.0.22
v2.0.21
v2.0.20
v2.0.19
v2.0.18
v2.0.17
v2.0.16
v2.0.15
v2.0.14
v2.0.13
v2.0.12
v2.0.11
v2.0.10
v2.0.9
v2.0.8
v2.0.7
v2.0.6
v2.0.5
v2.0.4
v2.0.3
v2.0.2
v2.0.1
v1.7.2
v1.7.1
v1.7.0
v1.6.0
v1.5.5
v1.5.0
v1.4.11
v1.4.9
v1.4.7
v1.4.6
v1.4.4
v1.4.2
v1.4.0
v1.4.1
v1.3.4
v1.3.3
v1.3.1
v1.2.8
v1.2.6
v1.2.5
v1.2.4
v1.2.1
v1.1.15
v1.1.14
v1.1.13
v1.1.12
v1.1.11
v1.1.10
v1.1.9
v1.1.8
v1.0.0
0.9.61-beta.0
0.9.61-beta
Labels
Clear labels
authentication
backlog
bug
chapter editor
config-issue
ebooks
encoding/embedding
enhancement
help wanted
listening sessions & progress
planned
possible plugin
progress sync
pull-request
sorting/filtering/searching
unable to reproduce
upload
users & permissions
waiting
Mirrored from GitHub Pull Request
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
adam (Adam Melkus)
Clear assignees
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: starred/audiobookshelf#189
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @wtanksleyjr on GitHub (Jan 28, 2022).
This is a situation I find myself in all the time: I add a folder, copy an OPF in, and then put the MP3s in. But when I look at the book in Audiobookshelf, I find that it's only loaded the title, since it did that as soon as it saw the folder and before I put any files in it.
There are two interesting "race conditions" here: first, it's loading books even when there's nothing to load. Second, once it triggers the load, it doesn't reload when new files are added, even when the OPF should override the folder metadata. Worse, this decision cannot apparently be fixed: clicking reload metadata only looks at the folder, ignoring the OPF. The only way around that is to move the folder (so the system thinks it's a new book) and delete the old book (since it's now invalid).
@advplyr commented on GitHub (Jan 28, 2022):
Pressing re-scan on the individual audiobook modal OR pressing the force re-scan for the library should both be parsing the OPF file again. There could be a bug there I will test out.
The watcher can be improved. Right now once it detects an update in the library it adds it to an array and waits 4 seconds until no more updates are made. For a new audiobook it should only create the audiobook in abs if there is an audio file or ebook file inside the folder, so just creating the folder won't add the audiobook.
Can you confirm that all the files are showing up in audiobookshelf? Can you give me more specific steps to reproduce the issue?
@wtanksleyjr commented on GitHub (Jan 28, 2022):
Oof! Well, I'm going to have to do some more work... I'd already cleaned up
the mess from before. It involved (first) many books that seemed to be
loaded in the middle of copying MP3s into them, which were marked as
broken; many "missing" books that were actually just husks of a book that
I'd moved somewhere else (because I changed my naming conventions to be
more audiobookshelf-friendly).
There's one I can report on right now, although not with as much detail as
I'd like.
I'd loaded a book and had gotten an error (the files were all there but
it'd flagged it for some reason, I don't remember right now but it was my
fault), so I fixed the error and put its OPF file in. Once I did that, I
clicked "rescan" while on that book's webpage. The book didn't change
except to change from its old error message to "Missing" (and all of the
files vanished from the bottom half of the screen). I searched for the
title, and found both the same "Missing" book and a new book with all the
correct files and correct metadata. It seems that the "bad" book wasn't
updated with new information; instead a new book was created and populated,
and the old bad book was left in place.
Oh, I remember one more problem that might actually be reproducible. Some
of my "books" are actually podcasts, and for some reason podcasts are
HORRIBLE about providing metadata, episode numbers almost never appear
anywhere including the titles. I rename the episodes with sortable episode
numbers as much as I can. I actually like how you flag books when I miss
one or two episodes. Anyhow, when I see you flag one of those, I go into
the command line and rename the bad episodes; I then go back to the book's
page and click "reload metadata." Ooops! This always fails; what actually
happens is that audiobookshelf keeps its record of the old filenames, but
marks them as "missing"; it then adds all of the new filenames as "other
files" (i.e. not as part of the audiobook!). The only solution is to delete
the book and completely reload it, and honestly I haven't found a way to do
that without nuking everything and starting over.
On Fri, Jan 28, 2022 at 6:49 AM advplyr @.***> wrote:
@advplyr commented on GitHub (Jan 29, 2022):
Abs stores the inode value for each file so that it doesn't add the same file or audiobook folder twice. It sounds like that inode value is changing which is causing the duplicates.
Can you share your setup? What OS you are on, abs server version, if you are using a remote file system, symlinks, etc.