starred/audiobookshelf
1
0
Fork 0
mirror of https://github.com/advplyr/audiobookshelf.git synced 2026-05-30 23:40:40 +02:00
Code Issues 1.0k Packages Projects Releases 10 Wiki Activity

[Bug]: Library fails to scan (hangs indefinitely) #1727

New Issue
Closed
opened 2026-04-24 23:56:07 +02:00 by adam · 8 comments
adam commented 2026-04-24 23:56:07 +02:00
Owner
Copy Link
Copy Source

Originally created by @mikehoyle on GitHub (Feb 12, 2024).

Describe the issue

I have been unable to scan my Audiobooks library recently (new issue, after using Audiobookshelf for a few years). This started repro-ing after I manually deleted the metadata in-app for a few books in order to change their folder structure and re-scan them for better matching.

Now, when I press "Scan" the Task spinner appears, but hangs indefinitely. After a minute or two, I get a "socket disconnected" message (note I am accessing via localhost, no network issues possible). I have let the spinner go for hours, but the scan never completes. There seems to be no log created for the scan attempt in the logs/scans folder. The main program log doesn't seem particularly insightful:

{"timestamp":"2024-02-11 18:00:00.268","source":"Logger.js:105","message":"[LibraryScanner] Starting library scan fc7e64b6-be2f-4d94-9bdf-1cf96ee967c6 for Audiobooks","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:01:27.758","source":"Logger.js:105","message":"[SocketAuthority] Socket Connected U2tDWigjW6_AmlCcAAAJ","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:01:28.224","source":"Logger.js:105","message":"[SocketAuthority] Socket 5u70Ch1gDCp4WBNjAAAD disconnected from client \"root\" after 11383264ms (Reason: transport error)","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:01:28.313","source":"Logger.js:105","message":"[SocketAuthority] Socket Connected 9M8r7UeML-PQdVPGAAAL","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:01:37.340","source":"Logger.js:105","message":"[SocketAuthority] Socket 8Q8VIwqrfleIHmpiAAAB disconnected from client \"root\" after 11393278ms (Reason: ping timeout)","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:03:05.295","source":"Logger.js:105","message":"=== Starting Server ===","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:03:05.296","source":"Logger.js:105","message":"[Server] Init v2.7.2","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:03:05.302","source":"Logger.js:105","message":"[Database] Initializing db at \"/config/absdatabase.sqlite\"","levelName":"INFO","level":2}
{"timestamp":"2024-02-11 18:03:05.347","source":"Logger.js:105","message":"[Database] Db connection was successful","levelName":"INFO","level":2}
// NOTE: other normal healthy startup logs follow this

It does reveal that the server may be crashing and restarting itself on the scan attempt (this isn't obvious from the web view), but no crash details are given.

Note also that attempting to cancel the scan task also hangs indefinitely. The spinner with "Cancelling" state never goes away. In all cases, the spinner disappears as if no task was running if the page is hard-reloaded (Ctrl-R).

I have no issues streaming content or using the app in any other way.

Steps to reproduce the issue

  1. In web client, click "gear" icon in top right, navigate to "Libraries" and click "Scan" on the primary Audiobook library.
  2. Observe the task seems to start via a spinner in the toolbar, but never completes.
  3. Observe "Socket disconnected" shortly after.

I unfortunately am not aware of the setup required to get an app in this state, but the deletion of a few library items before may or may not be relevant.

Audiobookshelf version

v2.7.2

How are you running audiobookshelf?

Docker

Originally created by @mikehoyle on GitHub (Feb 12, 2024). ### Describe the issue I have been unable to scan my Audiobooks library recently (new issue, after using Audiobookshelf for a few years). This started repro-ing after I manually deleted the metadata in-app for a few books in order to change their folder structure and re-scan them for better matching. Now, when I press "Scan" the Task spinner appears, but hangs indefinitely. After a minute or two, I get a "socket disconnected" message (note I am accessing via localhost, no network issues possible). I have let the spinner go for hours, but the scan never completes. There seems to be no log created for the scan attempt in the logs/scans folder. The main program log doesn't seem particularly insightful: ``` {"timestamp":"2024-02-11 18:00:00.268","source":"Logger.js:105","message":"[LibraryScanner] Starting library scan fc7e64b6-be2f-4d94-9bdf-1cf96ee967c6 for Audiobooks","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:01:27.758","source":"Logger.js:105","message":"[SocketAuthority] Socket Connected U2tDWigjW6_AmlCcAAAJ","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:01:28.224","source":"Logger.js:105","message":"[SocketAuthority] Socket 5u70Ch1gDCp4WBNjAAAD disconnected from client \"root\" after 11383264ms (Reason: transport error)","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:01:28.313","source":"Logger.js:105","message":"[SocketAuthority] Socket Connected 9M8r7UeML-PQdVPGAAAL","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:01:37.340","source":"Logger.js:105","message":"[SocketAuthority] Socket 8Q8VIwqrfleIHmpiAAAB disconnected from client \"root\" after 11393278ms (Reason: ping timeout)","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:03:05.295","source":"Logger.js:105","message":"=== Starting Server ===","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:03:05.296","source":"Logger.js:105","message":"[Server] Init v2.7.2","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:03:05.302","source":"Logger.js:105","message":"[Database] Initializing db at \"/config/absdatabase.sqlite\"","levelName":"INFO","level":2} {"timestamp":"2024-02-11 18:03:05.347","source":"Logger.js:105","message":"[Database] Db connection was successful","levelName":"INFO","level":2} // NOTE: other normal healthy startup logs follow this ``` It does reveal that the server may be crashing and restarting itself on the scan attempt (this isn't obvious from the web view), but no crash details are given. Note also that attempting to cancel the scan task also hangs indefinitely. The spinner with "Cancelling" state never goes away. In all cases, the spinner disappears as if no task was running if the page is hard-reloaded (Ctrl-R). I have no issues streaming content or using the app in any other way. ### Steps to reproduce the issue 1. In web client, click "gear" icon in top right, navigate to "Libraries" and click "Scan" on the primary Audiobook library. 2. Observe the task seems to start via a spinner in the toolbar, but never completes. 3. Observe "Socket disconnected" shortly after. I unfortunately am not aware of the setup required to get an app in this state, but the deletion of a few library items before may or may not be relevant. ### Audiobookshelf version v2.7.2 ### How are you running audiobookshelf? Docker
adam added the bug label 2026-04-24 23:56:07 +02:00
adam closed this issue 2026-04-24 23:56:07 +02:00
adam commented 2026-04-24 23:56:08 +02:00
Author
Owner
Copy Link
Copy Source

@mikehoyle commented on GitHub (Feb 12, 2024):

Also noting attempted (and failed) remediation attempts:

  • Upgrading to latest (was reproducible on v2.7.0, still reproducible on v2.7.2).
  • Restarting Audiobookshelf server.
@mikehoyle commented on GitHub (Feb 12, 2024): Also noting attempted (and failed) remediation attempts: - Upgrading to latest (was reproducible on v2.7.0, still reproducible on v2.7.2). - Restarting Audiobookshelf server.
adam commented 2026-04-24 23:56:08 +02:00
Author
Owner
Copy Link
Copy Source

@nichwall commented on GitHub (Feb 12, 2024):

Your server is crashing during the scan, and then docker restarts the container automatically so you see "socket disconnected" for a minute. You likely added a corrupt file or have a file that is crashing ABS (there have been some issues with some ebook files since 2.7.0).

Take a look at the docker logs to see what file is giving you issues, since the crash won't show up in the ABS logs since it can't write to the log file if it's no longer running.

@nichwall commented on GitHub (Feb 12, 2024): Your server is crashing during the scan, and then docker restarts the container automatically so you see "socket disconnected" for a minute. You likely added a corrupt file or have a file that is crashing ABS (there have been some issues with some ebook files since 2.7.0). Take a look at the docker logs to see what file is giving you issues, since the crash won't show up in the ABS logs since it can't write to the log file if it's no longer running.
adam commented 2026-04-24 23:56:09 +02:00
Author
Owner
Copy Link
Copy Source

@mikehoyle commented on GitHub (Feb 12, 2024):

Ah thanks for the tip. Here's the error from the docker logs:

/node_modules/socket.io-parser/build/cjs/index.js:78
            str += JSON.stringify(obj.data, this.replacer);
                        ^

RangeError: Invalid string length
    at JSON.stringify (<anonymous>)
    at Encoder.encodeAsString (/node_modules/socket.io-parser/build/cjs/index.js:78:25)
    at Encoder.encode (/node_modules/socket.io-parser/build/cjs/index.js:54:22)
    at Client._packet (/node_modules/socket.io/dist/client.js:159:28)
    at Socket.packet (/node_modules/socket.io/dist/socket.js:279:21)
    at Socket.emit (/node_modules/socket.io/dist/socket.js:156:14)
    at SocketAuthority.emitter (/server/SocketAuthority.js:49:39)
    at LibraryScanner.scanLibrary (/server/scanner/LibraryScanner.js:207:25)
    at async LibraryScanner.scan (/server/scanner/LibraryScanner.js:82:22)
Config /config /metadata
@mikehoyle commented on GitHub (Feb 12, 2024): Ah thanks for the tip. Here's the error from the docker logs: ``` /node_modules/socket.io-parser/build/cjs/index.js:78 str += JSON.stringify(obj.data, this.replacer); ^ RangeError: Invalid string length at JSON.stringify (<anonymous>) at Encoder.encodeAsString (/node_modules/socket.io-parser/build/cjs/index.js:78:25) at Encoder.encode (/node_modules/socket.io-parser/build/cjs/index.js:54:22) at Client._packet (/node_modules/socket.io/dist/client.js:159:28) at Socket.packet (/node_modules/socket.io/dist/socket.js:279:21) at Socket.emit (/node_modules/socket.io/dist/socket.js:156:14) at SocketAuthority.emitter (/server/SocketAuthority.js:49:39) at LibraryScanner.scanLibrary (/server/scanner/LibraryScanner.js:207:25) at async LibraryScanner.scan (/server/scanner/LibraryScanner.js:82:22) Config /config /metadata ```
adam commented 2026-04-24 23:56:10 +02:00
Author
Owner
Copy Link
Copy Source

@nichwall commented on GitHub (Feb 12, 2024):

Glad you found that, the actual error is a bit more useful. :)

Can you change your server log level to Debug and then get the logs from the crash? That should help narrow down which file is causing the crash, either due to the file being corrupt or fixing how ABS parses that specific data.

@nichwall commented on GitHub (Feb 12, 2024): Glad you found that, the actual error is a bit more useful. :) Can you change your server log level to Debug and then get the logs from the crash? That should help narrow down which file is causing the crash, either due to the file being corrupt or fixing how ABS parses that specific data.
adam commented 2026-04-24 23:56:10 +02:00
Author
Owner
Copy Link
Copy Source

@mikehoyle commented on GitHub (Feb 12, 2024):

Here's the debug logs:

[2024-02-12 09:51:35.962] DEBUG: [LibraryScan] "Audiobooks": New library file found with path "/audiobooks/Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br/9-111 DW29 t111.mp3" for library item "Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br" (LibraryScan.js:131)
[2024-02-12 09:51:35.993] DEBUG: [LibraryScan] "Audiobooks": Library item "Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br" changed: [size,lastScan] (LibraryScan.js:131)
[2024-02-12 09:51:36.306] DEBUG: [ApiCacheManager] libraryItem.afterUpdate: Clearing cache (ApiCacheManager.js:21)
[2024-02-12 09:51:50.533] DEBUG: [AudioFileScanner] Smart track order for "Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br" using disc key discNumFromMeta and track key trackNumFromMeta (AudioFileScanner.js:87)
[2024-02-12 09:51:50.583] DEBUG: [LibraryScan] "Audiobooks": "Discworld 29_ Night Watch (Isis Audio Books) 128br" Getting metadata with precedence [folderStructure, audioMetatags, txtFiles, opfFile, absMetadata] (LibraryScan.js:131)
[2024-02-12 09:51:50.617] DEBUG: [LibraryScan] "Audiobooks": Found metadata file "/metadata/items/0d203fcb-f52b-418b-b599-65719a76fddf/metadata.json" (LibraryScan.js:131)
[2024-02-12 09:51:51.412] DEBUG: [ApiCacheManager] book.afterUpdate: Clearing cache (ApiCacheManager.js:21)
[2024-02-12 09:51:51.428] DEBUG: [LibraryScan] "Audiobooks": Success saving abmetadata to "/metadata/items/0d203fcb-f52b-418b-b599-65719a76fddf/metadata.json" (LibraryScan.js:131)
/node_modules/socket.io-parser/build/cjs/index.js:78
            str += JSON.stringify(obj.data, this.replacer);
                        ^

RangeError: Invalid string length
    at JSON.stringify (<anonymous>)
    at Encoder.encodeAsString (/node_modules/socket.io-parser/build/cjs/index.js:78:25)
    at Encoder.encode (/node_modules/socket.io-parser/build/cjs/index.js:54:22)
    at Client._packet (/node_modules/socket.io/dist/client.js:159:28)
    at Socket.packet (/node_modules/socket.io/dist/socket.js:279:21)
    at Socket.emit (/node_modules/socket.io/dist/socket.js:156:14)
    at SocketAuthority.emitter (/server/SocketAuthority.js:49:39)
    at LibraryScanner.scanLibrary (/server/scanner/LibraryScanner.js:207:25)
    at async LibraryScanner.scan (/server/scanner/LibraryScanner.js:82:22)
    at async ApiRouter.scan (/server/controllers/LibraryController.js:810:5)
Config /config /metadata

Not terribly insightful, but indicates the particular media item that may be causing problems. For what it's worth, it's indicating this is a "New audio file" even though I definitely haven't touched it in at least a year.

@mikehoyle commented on GitHub (Feb 12, 2024): Here's the debug logs: ``` [2024-02-12 09:51:35.962] DEBUG: [LibraryScan] "Audiobooks": New library file found with path "/audiobooks/Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br/9-111 DW29 t111.mp3" for library item "Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br" (LibraryScan.js:131) [2024-02-12 09:51:35.993] DEBUG: [LibraryScan] "Audiobooks": Library item "Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br" changed: [size,lastScan] (LibraryScan.js:131) [2024-02-12 09:51:36.306] DEBUG: [ApiCacheManager] libraryItem.afterUpdate: Clearing cache (ApiCacheManager.js:21) [2024-02-12 09:51:50.533] DEBUG: [AudioFileScanner] Smart track order for "Terry Pratchett/Terry Pratchett - Discworld Audiobooks/Discworld 29_ Night Watch (Isis Audio Books) 128br" using disc key discNumFromMeta and track key trackNumFromMeta (AudioFileScanner.js:87) [2024-02-12 09:51:50.583] DEBUG: [LibraryScan] "Audiobooks": "Discworld 29_ Night Watch (Isis Audio Books) 128br" Getting metadata with precedence [folderStructure, audioMetatags, txtFiles, opfFile, absMetadata] (LibraryScan.js:131) [2024-02-12 09:51:50.617] DEBUG: [LibraryScan] "Audiobooks": Found metadata file "/metadata/items/0d203fcb-f52b-418b-b599-65719a76fddf/metadata.json" (LibraryScan.js:131) [2024-02-12 09:51:51.412] DEBUG: [ApiCacheManager] book.afterUpdate: Clearing cache (ApiCacheManager.js:21) [2024-02-12 09:51:51.428] DEBUG: [LibraryScan] "Audiobooks": Success saving abmetadata to "/metadata/items/0d203fcb-f52b-418b-b599-65719a76fddf/metadata.json" (LibraryScan.js:131) /node_modules/socket.io-parser/build/cjs/index.js:78 str += JSON.stringify(obj.data, this.replacer); ^ RangeError: Invalid string length at JSON.stringify (<anonymous>) at Encoder.encodeAsString (/node_modules/socket.io-parser/build/cjs/index.js:78:25) at Encoder.encode (/node_modules/socket.io-parser/build/cjs/index.js:54:22) at Client._packet (/node_modules/socket.io/dist/client.js:159:28) at Socket.packet (/node_modules/socket.io/dist/socket.js:279:21) at Socket.emit (/node_modules/socket.io/dist/socket.js:156:14) at SocketAuthority.emitter (/server/SocketAuthority.js:49:39) at LibraryScanner.scanLibrary (/server/scanner/LibraryScanner.js:207:25) at async LibraryScanner.scan (/server/scanner/LibraryScanner.js:82:22) at async ApiRouter.scan (/server/controllers/LibraryController.js:810:5) Config /config /metadata ``` Not terribly insightful, but indicates the particular media item that may be causing problems. For what it's worth, it's indicating this is a "New audio file" even though I definitely haven't touched it in at least a year.
adam commented 2026-04-24 23:56:11 +02:00
Author
Owner
Copy Link
Copy Source

@nichwall commented on GitHub (Feb 12, 2024):

You may be running into an inode issue similar to the linked issue, which is why it's showing up as a new item.

https://github.com/advplyr/audiobookshelf/issues/2509

@nichwall commented on GitHub (Feb 12, 2024): You may be running into an inode issue similar to the linked issue, which is why it's showing up as a new item. https://github.com/advplyr/audiobookshelf/issues/2509
adam commented 2026-04-24 23:56:12 +02:00
Author
Owner
Copy Link
Copy Source

@mikehoyle commented on GitHub (Feb 13, 2024):

I must've had a corrupted library item or something along those lines.. I've resolved the situation now. For posterity, here's what I did to resolve the situation:

  • Turn on debug logging (Web GUI, Logs, Log Level dropdown)
  • Repro the crash and see what was scanning at that time.
  • Remove the item (in my case, the entire author), from my library files.
  • Manually query the sqllite table to delete all from libraryItems & books table that match the offender.
  • Restart and re-scan.

It was a process, but we're stable again! Thanks @nichwall for the help.

@mikehoyle commented on GitHub (Feb 13, 2024): I must've had a corrupted library item or something along those lines.. I've resolved the situation now. For posterity, here's what I did to resolve the situation: - Turn on debug logging (Web GUI, Logs, Log Level dropdown) - Repro the crash and see what was scanning at that time. - Remove the item (in my case, the entire author), from my library files. - Manually query the sqllite table to delete all from libraryItems & books table that match the offender. - Restart and re-scan. It was a process, but we're stable again! Thanks @nichwall for the help.
adam commented 2026-04-24 23:56:12 +02:00
Author
Owner
Copy Link
Copy Source

@SmokeGSU commented on GitHub (Jul 29, 2024):

@mikehoyle just wanted to add 5 months later that your directions on getting to the debug log saved me from a bunch of headaches. I had near identical problems and had no clue what was causing my scan to crash after a few seconds of starting. I'd previously set up the library and then went to rebuild it after I was finding that certain files weren't found even after I'd successfully uploaded them. Never had any issues until now, but your instructions helped me find several metadata.json files that were causing "incompatible chapter title" issues - opening one of them, it seemed that while the metadata was indicating chapter timestamps it wasn't providing a name for the chapters. Deleting those particular .json files got me back up and running after following your instructions.

@SmokeGSU commented on GitHub (Jul 29, 2024): @mikehoyle just wanted to add 5 months later that your directions on getting to the debug log saved me from a bunch of headaches. I had near identical problems and had no clue what was causing my scan to crash after a few seconds of starting. I'd previously set up the library and then went to rebuild it after I was finding that certain files weren't found even after I'd successfully uploaded them. Never had any issues until now, but your instructions helped me find several metadata.json files that were causing "incompatible chapter title" issues - opening one of them, it seemed that while the metadata was indicating chapter timestamps it wasn't providing a name for the chapters. Deleting those particular .json files got me back up and running after following your instructions.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
authentication
backlog
bug
chapter editor
config-issue
ebooks
encoding/embedding
enhancement
help wanted
listening sessions & progress
planned
possible plugin
progress sync
pull-request
Mirrored from GitHub Pull Request
 sorting/filtering/searching
unable to reproduce
upload
users & permissions
waiting
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
adam (Adam Melkus)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/audiobookshelf#1727
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?