Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Synology NAS] CWA not currently working on Synology Devices #55

Closed
bootnihil opened this issue Aug 29, 2024 · 55 comments
Closed

[Synology NAS] CWA not currently working on Synology Devices #55

bootnihil opened this issue Aug 29, 2024 · 55 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@bootnihil
Copy link

After upgrading to v2.0.1, books seem to be ingested and are deleted from the ingest folder as expected, but they are not moved to the library. This functionality was working in v1.2.2. Any help would be greatly appreciated!

Dockerfile:

---
services:
  calibre-web-automated:
    image: crocodilestick/calibre-web-automated:latest
    container_name: calibre-web-automated
    restart: unless-stopped
    environment:
      - PUID=1000 
      - PGID=100
      - TZ=UTC
      - /DockerConfig/Calibre-web-Automated:/config
      - /DockerData/CWA-Lib-Ingest:/cwa-book-ingest
      - /DockerData/CWA-Lib:/calibre-library
    ports:
      - 38064:8083 

Log:

2024-08-29T18:54:51.748867155Z [books-to-process]: New files detected - /cwa-book-ingest/Backlash - Thor, Brad.epub
2024-08-29T18:54:51.858521070Z [new-book-detector]: New file detected: /app/calibre-web-automated/cwa-import/Backlash - Thor, Brad.epub
2024-08-29T18:54:51.859197654Z ./run: line 22: /usr/bin/calibredb: No such file or directory
2024-08-29T18:54:51.862769388Z find: cannot delete ‘/cwa-book-ingest/’: Device or resource busy
2024-08-29T18:54:51.862888727Z [new-book-detector] Added /app/calibre-web-automated/cwa-import/Backlash - Thor, Brad.epub to Calibre database
2024-08-29T18:54:51.862905182Z [new-book-detector]: Removing /app/calibre-web-automated/cwa-import/Backlash - Thor, Brad.epub from import folder...
2024-08-29T18:54:51.862922135Z 
2024-08-29T18:54:51.862930415Z [new-book-processor]: Found  epub file in ingest folder.
2024-08-29T18:54:51.862941364Z [new-book-processor]: Moving epub file to the CWA import folder...
2024-08-29T18:54:51.862952909Z 
2024-08-29T18:54:51.862961338Z [new-book-processor]: Moving /cwa-book-ingest/Backlash - Thor, Brad.epub...
2024-08-29T18:54:51.866740629Z [new-book-detector]: /app/calibre-web-automated/cwa-import/Backlash - Thor, Brad.epub successfully moved/converted, the Ingest Folder has been emptied and is ready
2024-08-29T18:54:51.873035136Z [books-to-process]: New files successfully moved/converted, the Ingest Folder has been emptied and is ready to go again.
@crocodilestick
Copy link
Owner

crocodilestick commented Aug 29, 2024

Could you please ls -l the containers root directory and post it here?

Also make sure you're using the new docker compose:

   ---
    services:
      calibre-web-automated:
        image: crocodilestick/calibre-web-automated:latest
        container_name: calibre-web-automated
        environment:
          - PUID=1000
          - PGID=100
          - TZ=UTC
          - DOCKER_MODS=linuxserver/mods:universal-calibre
        volumes:
          - /path/to/config/folder:/config
          - /path/to/the/folder/you/want/to/use/for/book/ingest:/cwa-book-ingest
          - /path/to/your/calibre/library:/calibre-library
          #- /path/to/where/you/keep/your/books:/books #Optional
          #- /path/to/your/gmail/credentials.json:/app/calibre-web/gmail.json #Optional
        ports:
          - 8084:8083 # Change the first number to change the port you want to access the Web UI, not the second
        restart: unless-stopped

@iroQuai
Copy link

iroQuai commented Aug 29, 2024

I have the same problem! Had it with the RC too, not with 1.2.2 but then the permissions were the problem afterwards (I'm very happy that's fixed!!)

I checked My root folder within the container, its empty...

@bootnihil
Copy link
Author

Could you please ls -l the containers root directory and post it here?

Also make sure you're using the new docker compose:

   ---
    services:
      calibre-web-automated:
        image: crocodilestick/calibre-web-automated:latest
        container_name: calibre-web-automated
        environment:
          - PUID=1000
          - PGID=100
          - TZ=UTC
          - DOCKER_MODS=linuxserver/mods:universal-calibre
        volumes:
          - /path/to/config/folder:/config
          - /path/to/the/folder/you/want/to/use/for/book/ingest:/cwa-book-ingest
          - /path/to/your/calibre/library:/calibre-library
          #- /path/to/where/you/keep/your/books:/books #Optional
          #- /path/to/your/gmail/credentials.json:/app/calibre-web/gmail.json #Optional
        ports:
          - 8084:8083 # Change the first number to change the port you want to access the Web UI, not the second
        restart: unless-stopped

It seems the only issue I had with my docker compose setup was the missing DOCKER_MODS environment variable. Before adding it, the root directory was empty. Now, it looks like this:

drwx------ 1 root root 4096 Aug 30 09:38 ./
drwxr-xr-x 1 root root 4096 Aug 30 09:38 ../
-rw-r--r-- 1 root root 3470 Aug 29 17:49 .bashrc
drwxr-xr-x 2 root root 4096 Aug 30 09:38 .config/
-rw-r--r-- 1 root root  161 Jul  9  2019 .profile

After making this change, everything seems to be functioning properly again - books placed in the ingest folder are now added to the library and appear in the web UI.

Looking back at the v2.0.0 announcement, I realized that, at least for me, it would have been helpful to more clearly emphasize the two breaking changes for existing setups: the change in the library path from /calibre-main/Calibre Library to /calibre-library and the need for the DOCKER_MODS variable.

Great project!

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

Did a system prune (incl volumes) and installed everything from scratch just to rule out errors... still the same problem; the book seems digested fine but doesn't show up in the web ui.

ls -l gives me nothing, but ls -a gives me the same as the user above: .. .bashrc .config .profile

@crocodilestick
Copy link
Owner

Did a system prune (incl volumes) and installed everything from scratch just to rule out errors... still the same problem; the book seems digested fine but doesn't show up in the web ui.

ls -l gives me nothing, but ls -a gives me the same as the user above: .. .bashrc .config .profile

Are you sure DOCKER_MODS=linuxserver/mods:universal-calibre is in the environment section of your docker compose?

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

Yup, this is the full compose file:

services:
  calibre-web-automated:
    image: crocodilestick/calibre-web-automated:latest
    container_name: calibre-web-automated
    environment:
      - PGID=65536
      - PUID=1028
      - TZ=Europe/Amsterdam
      - DOCKER_MODS=linuxserver/mods:universal-calibre
    volumes:
      - ./config:/config
      - ./cwa-book-ingest:/cwa-book-ingest
      - /volume1/media/boeken:/calibre-library
      - ./config/gmail.json:/app/calibre-web/gmail.json #Optional
    #- /path/to/where/you/keep/your/books:/books #Optional
    ports:
      - 8082:8083 # Change the first number to change the port you want to access the Web UI, not the second
    restart: unless-stopped
networks: {}

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

Maybe it's relevant info that I'm on a Synology DS220+? The PGID/PUID is from a seperate docker user that has read/write rights to all the relevant folders.

@crocodilestick
Copy link
Owner

Maybe it's relevant info that I'm on a Synology DS220+? The PGID/PUID is from a seperate docker user that has read/write rights to all the relevant folders.

Ah that does make a difference, if you use the default PUID 1000 & PGID 100 does it also not work?

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

1000:100 doesn't seem to have access to the library folder! I never use those PGID/PUID, I don't even know what account they link to. I'll try next with my regular admin account numbers...

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

The PGID/PUID of my regular admin account gives even stranger logs...

calibre-web-automated  | Failed to import PyQt module: PyQt6.QtCore with error: libQt6Core.so.6: cannot open shared object file: No such file or directory
calibre-web-automated  | Traceback (most recent call last):
calibre-web-automated  |   File "runpy.py", line 198, in _run_module_as_main
calibre-web-automated  |   File "runpy.py", line 88, in _run_code
calibre-web-automated  |   File "site.py", line 47, in <module>
calibre-web-automated  | [custom-init] No custom files found, skipping...
calibre-web-automated  | [cwa-set-perms] Recursively setting ownership of everything in /config, /calibre-library, /app/calibre-web-automated to abc:abc...
calibre-web-automated  | [cwa-set-perms] Successfully set permissions for '/config'!
calibre-web-automated  | [cwa-set-perms] Successfully set permissions for '/calibre-library'!
calibre-web-automated  | [cwa-set-perms] Successfully set permissions for '/app/calibre-web-automated'!
calibre-web-automated  | [cwa-set-perms] Ending service...
calibre-web-automated  | [auto-library]: Existing library found at /calibre-library, mounting now...
calibre-web-automated  | [auto-library] Updating dirs.json with new library location...
calibre-web-automated  | [auto-library]: Updating Settings Database with library location...
calibre-web-automated  | ========== STARTING BOOKS-TO-PROCESS DETECTOR ==========
calibre-web-automated  | ========== STARTING METADATA CHANGE DETECTOR ===========
calibre-web-automated  | [metadata-change-detector]: Watching folder: /app/calibre-web-automated/metadata_change_logs
calibre-web-automated  | ============== STARTING NEW BOOK DETECTOR ==============
calibre-web-automated  | Setting up watches.
calibre-web-automated  | Failed to watch /app/calibre-web-automated/metadata_change_logs; upper limit on inotify watches reached!
calibre-web-automated  | [books-to-process]: Watching folder: /cwa-book-ingest
calibre-web-automated  | [new-book-detector]: Watching folder: /app/calibre-web-automated/cwa-import
calibre-web-automated  | Setting up watches.  Beware: since -r was given, this may take a while!
calibre-web-automated  | Failed to watch /cwa-book-ingest; upper limit on inotify watches reached!
calibre-web-automated  | Please increase the amount of inotify watches allowed per user via `/proc/sys/fs/inotify/max_user_watches'.
calibre-web-automated  | Setting up watches.  Beware: since -r was given, this may take a while!
calibre-web-automated  | Failed to watch /app/calibre-web-automated/cwa-import; upper limit on inotify watches reached!
calibre-web-automated  | Please increase the amount of inotify watches allowed per user via `/proc/sys/fs/inotify/max_user_watches'.
calibre-web-automated  | ========== STARTING METADATA CHANGE DETECTOR ===========
calibre-web-automated  | [metadata-change-detector]: Watching folder: /app/calibre-web-automated/metadata_change_logs
calibre-web-automated  | Setting up watches.
calibre-web-automated  | Failed to watch /app/calibre-web-automated/metadata_change_logs; upper limit on inotify watches reached!
calibre-web-automated  | Please increase the amount of inotify watches allowed per user via `/proc/sys/fs/inotify/max_user_watches'.
calibre-web-automated  | ========== STARTING BOOKS-TO-PROCESS DETECTOR ==========
calibre-web-automated  | [books-to-process]: Watching folder: /cwa-book-ingest
calibre-web-automated  | Setting up watches.  Beware: since -r was given, this may take a while!
calibre-web-automated  | ============== STARTING NEW BOOK DETECTOR ==============
calibre-web-automated  | Failed to watch /cwa-book-ingest; upper limit on inotify watches reached!
calibre-web-automated  | Please increase the amount of inotify watches allowed per user via `/proc/sys/fs/inotify/max_user_watches'.
calibre-web-automated  | [new-book-detector]: Watching folder: /app/calibre-web-automated/cwa-import
calibre-web-automated  | Setting up watches.  Beware: since -r was given, this may take a while!
calibre-web-automated  | Failed to watch /app/calibre-web-automated/cwa-import; upper limit on inotify watches reached!
calibre-web-automated  | ========== STARTING METADATA CHANGE DETECTOR ===========
(...)

I removed a lot of clutter after this log part; its a never ending repeating error log with those three headings

At this point, the PGID/PUID i normaly use for docker containers seems to give the most functioning option by far.

@crocodilestick
Copy link
Owner

Very odd, do try 1000:100 in the docker compose though if you haven't already, they're pretty much only used to set the permissions to abc:abc for the directories and files that CWA needs to function, including the library during init.

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

I've tried almost all options I could think of, but the PGID/PUID i always use for docker containers (a dedicated docker user with the right permissions) is the only one that works as it should! except for the digesting of new files via watch folder, but other than that it's perfect!

For now I'll just accept this part not functioning. I can upload files via the UI anyway. Only downside is manualy scraping metadata afterwards, but that's not a big problem for me.

Anyway, thanks a lot for creating this fork! it gives me so much more use out of CW

@crocodilestick
Copy link
Owner

crocodilestick commented Aug 30, 2024

I've tried almost all options I could think of, but the PGID/PUID i always use for docker containers (a dedicated docker user with the right permissions) is the only one that works as it should! except for the digesting of new files via watch folder, but other than that it's perfect!

For now I'll just accept this part not functioning. I can upload files via the UI anyway. Only downside is manualy scraping metadata afterwards, but that's not a big problem for me.

Anyway, thanks a lot for creating this fork! it gives me so much more use out of CW

Hey @iroQuai , so someone in the Discord was facing similar issues to you with a NAS based system. He found a fix where if the temp folder used internally for imported processed files is mounted in the same system as the ingest folder, everything works as intended.

The temp folder to mount is at /app/calibre-web-automated/cwa-import

If you can also confirm this works, I can start work on a fix where the temp folder is no longer needed for ingest and it should improve compatibility across the board.

@iroQuai
Copy link

iroQuai commented Aug 30, 2024

I added - ./cwa-temp:/app/calibre-web-automated/cwa-import to volumes.
First thing I noticed was even better terminal updates! Explaining more steps in the process.

I tried to use the ingest folder again. Same result, sadly. But a new error message, maybe it gives a lead?
calibre-web-automated | ./run: line 22: /usr/bin/calibredb: No such file or directory

These are the last lines of the terminal logs:

calibre-web-automated  | [ls.io-init] done.
calibre-web-automated  | [books-to-process]: New files detected - /cwa-book-ingest/Mees Kees - op Kamp (Mirjam_ (Z-Library).epub
calibre-web-automated  | [new-book-detector]: New file detected: /app/calibre-web-automated/cwa-import/Mees Kees - op Kamp (Mirjam_ (Z-Library).epub
calibre-web-automated  | [new-book-detector] Added /app/calibre-web-automated/cwa-import/Mees Kees - op Kamp (Mirjam_ (Z-Library).epub to Calibre database
calibre-web-automated  | [new-book-detector]: Removing /app/calibre-web-automated/cwa-import/Mees Kees - op Kamp (Mirjam_ (Z-Library).epub from import folder...
calibre-web-automated  | 
calibre-web-automated  | [new-book-processor]: Found  epub file in ingest folder.
calibre-web-automated  | [new-book-processor]: Moving epub file to the CWA import folder...
calibre-web-automated  | 
calibre-web-automated  | [new-book-processor]: Moving /cwa-book-ingest/Mees Kees - op Kamp (Mirjam_ (Z-Library).epub...
calibre-web-automated  | ./run: line 22: /usr/bin/calibredb: No such file or directory
calibre-web-automated  | find: cannot delete ‘/cwa-book-ingest/’: Device or resource busy
calibre-web-automated  | [books-to-process]: New files successfully moved/converted, the Ingest Folder has been emptied and is ready to go again.
calibre-web-automated  | [new-book-detector]: /app/calibre-web-automated/cwa-import/Mees Kees - op Kamp (Mirjam_ (Z-Library).epub successfully moved/converted, the Ingest Folder has been emptied and is ready

@techdixie
Copy link

techdixie commented Aug 31, 2024

I just wanted to add on here, new user as of tonight. I'm using a synology NAS and when I drop in an epub it just disappears with nothing being loaded into the program.

calibre-web-automated  | [new-book-detector]: New file detected: /app/calibre-web-automated/cwa-import/Nettle  Bone (T. Kingfisher) (Z-Library).epub
calibre-web-automated  | ./run: line 22: /usr/bin/calibredb: No such file or directory
calibre-web-automated  | [new-book-detector] Added /app/calibre-web-automated/cwa-import/Nettle  Bone (T. Kingfisher) (Z-Library).epub to Calibre database
calibre-web-automated  | find: cannot delete ‘/cwa-book-ingest/’: Device or resource busy
calibre-web-automated  | 
calibre-web-automated  | [new-book-processor]: Found  epub file in ingest folder.
calibre-web-automated  | [new-book-processor]: Moving epub file to the CWA import folder...
calibre-web-automated  | 
calibre-web-automated  | [books-to-process]: New files successfully moved/converted, the Ingest Folder has been emptied and is ready to go again.
calibre-web-automated  | [new-book-detector]: /app/calibre-web-automated/cwa-import/Nettle  Bone (T. Kingfisher) (Z-Library).epub successfully moved/converted, the Ingest Folder has been emptied and is ready

services:
  calibre-web-automated:
    image: crocodilestick/calibre-web-automated:latest
    container_name: calibre-web-automated
    environment:
      - PUID=1027
      - PGID=65536
      - TZ=EST
      - DOCKER_MODS=linuxserver/mods:universal-calibre
    volumes:
      - /volume1/docker/calibre-web-automated/config:/config
      - /volume1/data/import_books/ingest:/cwa-book-ingest
      - /volume1/docker/calibre-web-automated/library:/calibre-library
      - /volume1/data/media/books:/books #Optional
      - /volume1/data/import_books/temp:/cwa-import
      #- /path/to/your/gmail/credentials.json:/app/calibre-web/gmail.json #Optional
    ports:
      - 8084:8083 # Change the first number to change the port you want to access the Web UI, not the second
    restart: unless-stopped
networks:
  synobridge:
    external: true

@crocodilestick crocodilestick changed the title Books appear to be ingested, but not moved to the library [NAS-Based Systems] Books appear to be ingested, but not moved to the library Aug 31, 2024
@crocodilestick crocodilestick changed the title [NAS-Based Systems] Books appear to be ingested, but not moved to the library [Synology NAS] Books appear to be ingested, but not moved to the library Aug 31, 2024
@crocodilestick
Copy link
Owner

crocodilestick commented Aug 31, 2024

./run: line 22: /usr/bin/calibredb: No such file or directory

@techdixie @@iroQuai But that would mean that even though the Calibre docker mod is in both of your docker composes, somehow the Calibre binaries aren't in your containers?? o_O

Could one of you please navigate to /usr/bin within the container and post the list of binaries there?

@iroQuai
Copy link

iroQuai commented Aug 31, 2024

Looking for anything specific? That folder is really filled!

@iroQuai
Copy link

iroQuai commented Aug 31, 2024

There isn't a calibre folder in there btw

@iroQuai
Copy link

iroQuai commented Aug 31, 2024

Alright I'm not at home atm so not everything works as it should, but I checked the install logs and found two more errors! Maybe this gives some clarification?

For some reason copy text is impossible now so I took screenshots:

pixlr_20240831113735956

@crocodilestick
Copy link
Owner

Looking for anything specific? That folder is really filled!

There should be a bunch of binaries in there:

calibre
calibre-customize
calibredb
calibre-debug
calibre-parallel
calibre-server
calibre-smtp
calibre-uninstall
ebook-convert
ebook-device
ebook-edit
ebook-meta
ebook-polish
ebook-viewer

If those aren't there that's the issue and I have no idea why they aren't there when they come with the image

@iroQuai
Copy link

iroQuai commented Aug 31, 2024

Those files aren't in /usr/bin/, but I do find them in /app/calibre/!

@vazer7070
Copy link

I have the same problem on Unraid, CWA ingest books but they not appear in Calibre or in CWA GUI, they are simply...i don't know where.
i think CWA delete but not move the epub, (the chmod are 777 for test)

@Malek-GHub
Copy link

Malek-GHub commented Sep 1, 2024

Hello!
Thanks for making this!
Unfortunately I'm having the same issue as the others on my synology NAS

I also feel like the issue is the third line in the logs, when fetching the book.
calibre-web | ./run: line 22: /usr/bin/calibredb: No such file or directory

As @iroQuai said, the calibre binaries are not in /usr/bin but in app/calibre,
when it starts up it looks like it loaded well, but on import we get that failure line in the logs


calibre-web  | [cwa-set-perms] Recursively setting ownership of everything in /config, /calibre-library, /app/calibre-web-automated to abc:abc...
calibre-web  | [cwa-set-perms] Successfully set permissions for '/config'!
calibre-web  | [cwa-set-perms] Successfully set permissions for '/calibre-library'!
calibre-web  | [cwa-set-perms] Successfully set permissions for '/app/calibre-web-automated'!
calibre-web  | [cwa-set-perms] Ending service...
calibre-web  | [auto-library]: Existing library found at /calibre-library, mounting now...
calibre-web  | [auto-library] Updating dirs.json with new library location...
calibre-web  | [auto-library]: Updating Settings Database with library location...
calibre-web  | [auto-library] Library location successfully set to: /calibre-library
calibre-web  | ============== STARTING NEW BOOK DETECTOR ==============
calibre-web  | [new-book-detector]: Watching folder: /app/calibre-web-automated/cwa-import
calibre-web  | ========== STARTING METADATA CHANGE DETECTOR ===========
calibre-web  | [metadata-change-detector]: Watching folder: /app/calibre-web-automated/metadata_change_logs
calibre-web  | Setting up watches.  Beware: since -r was given, this may take a while!
calibre-web  | Watches established.
calibre-web  | ========== STARTING BOOKS-TO-PROCESS DETECTOR ==========
calibre-web  | Setting up watches.
calibre-web  | Watches established.
calibre-web  | [books-to-process]: Watching folder: /cwa-book-ingest
calibre-web  | Setting up watches.  Beware: since -r was given, this may take a while!
calibre-web  | Watches established.
calibre-web  | [ls.io-init] done.

calibre-web  | [books-to-process]: New files detected - /cwa-book-ingest/Terry Pratchett - [Discworld 01] - The Colour of Magic(v5.2).epub
calibre-web  | [new-book-detector]: New file detected: /app/calibre-web-automated/cwa-import/Terry Pratchett - [Discworld 01] - The Colour of Magic(v5.2).epub
calibre-web  | ./run: line 22: /usr/bin/calibredb: No such file or directory
calibre-web  | [new-book-detector] Added /app/calibre-web-automated/cwa-import/Terry Pratchett - [Discworld 01] - The Colour of Magic(v5.2).epub to Calibre database
calibre-web  | [new-book-detector]: Removing /app/calibre-web-automated/cwa-import/Terry Pratchett - [Discworld 01] - The Colour of Magic(v5.2).epub from import folder...
calibre-web  | find: cannot delete ‘/cwa-book-ingest/’: Device or resource busy
calibre-web  | 
calibre-web  | [new-book-processor]: Found  epub file in ingest folder.
calibre-web  | [new-book-processor]: Moving epub file to the CWA import folder...
calibre-web  | 
calibre-web  | [new-book-processor]: Moving /cwa-book-ingest/Terry Pratchett - [Discworld 01] - The Colour of Magic(v5.2).epub...
calibre-web  | [books-to-process]: New files successfully moved/converted, the Ingest Folder has been emptied and is ready to go again.
calibre-web  | [new-book-detector]: /app/calibre-web-automated/cwa-import/Terry Pratchett - [Discworld 01] - The Colour of Magic(v5.2).epub successfully moved/converted, the Ingest Folder has been emptied and is ready


root@0affe9e00c27:/app/calibre# ls -ltrh
total 336K
drwxr-xr-x 1 root root  450 Aug 23 04:03 plugins
drwxr-xr-x 1 root root   38 Aug 23 04:04 translations
drwxr-xr-x 1 root root 1.8K Aug 23 04:04 resources
-rwxr-xr-x 1 root root  15K Aug 23 04:04 ebook-device
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre_postinstall
-rwxr-xr-x 1 root root  15K Aug 23 04:04 ebook-convert
-rwxr-xr-x 1 root root  15K Aug 23 04:04 lrs2lrf
-rwxr-xr-x 1 root root  15K Aug 23 04:04 ebook-polish
-rwxr-xr-x 1 root root  15K Aug 23 04:04 lrfviewer
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre-customize
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibredb
-rwxr-xr-x 1 root root  15K Aug 23 04:04 ebook-edit
-rwxr-xr-x 1 root root  15K Aug 23 04:04 ebook-viewer
-rwxr-xr-x 1 root root  15K Aug 23 04:04 ebook-meta
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre-smtp
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre-complete
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre-parallel
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre-server
-rwxr-xr-x 1 root root  15K Aug 23 04:04 markdown-calibre
-rwxr-xr-x 1 root root  15K Aug 23 04:04 lrf2lrs
-rwxr-xr-x 1 root root  15K Aug 23 04:04 web2disk
-rwxr-xr-x 1 root root  15K Aug 23 04:04 fetch-ebook-metadata
-rwxr-xr-x 1 root root  15K Aug 23 04:04 calibre-debug
drwxr-xr-x 1 root root   36 Aug 23 04:04 libexec
drwxr-xr-x 1 root root  652 Aug 23 04:04 bin
drwxr-xr-x 1 root root 2.8K Aug 23 04:04 lib
root@0affe9e00c27:/app/calibre# 

im pretty sure my compose file is configured properly but I'm including it as well just in case

  calibre-web:
    image: crocodilestick/calibre-web-automated:latest
    container_name: calibre-web
    restart: unless-stopped    
    environment:
      - PUID=1027
      - PGID=65539
      - TZ=Europe/Madrid
      - DOCKER_MODS=linuxserver/mods:universal-calibre      
    volumes:
      - /volume2/docker/malbooks/volumes/calibre/config:/config
      - /volume2/docker/malbooks/volumes/calibre:/calibre-library      
      - /volume1/MALNAS/Downloads/books:/cwa-book-ingest
      - /volume1/MALNAS/Downloads/temp:/app/calibre-web-automated/cwa-import
      - /volume1/MALNAS/Media/Books:/books      
    ports:
      - 8084:8083

The database also hasn't grown or changed.. I hope this helps figure out whats wrong!!

@crocodilestick
Copy link
Owner

@iroQuai @Malek-GHub Okay wierd, I have no idea why the binaries would be end up in a seperate folder on synology machines.

Could one of you please try the following commands in the containers command line?

  • Running ebook-convert in the CLI should give you both nothing, and running /app/calibre/ebook-convert should display the usage infomation for ebook-convert
  • Same with calibredb

If running /app/calibre/ before those commands presents you with the usage for both, and trying to run each command without just gives you an error, this should be an easy quick fix for repointing CWA's usage of these commands to the /app/calibre directory.

@Malek-GHub
Copy link

Malek-GHub commented Sep 2, 2024

Hello @crocodilestick
Thanks for getting back so soon....
Confirmed.
Those commands only run under app/calibre

malmeser@MalNAS:/volume2/docker/malbooks$ docker exec -it 0affe9e00c27 bash
root@0affe9e00c27:/# ebook-convert
bash: ebook-convert: command not found
root@0affe9e00c27:/# /app/calibre/ebook-convert
Usage: ebook-convert input_file output_file [options]

Convert an e-book from one format to another.

input_file is the input and output_file is the output. Both must be specified as the first two arguments to the command.

etc.....

oot@0affe9e00c27:/# calibredb
bash: calibredb: command not found
root@0affe9e00c27:/# /app/calibre/calibredb
Failed to import PyQt module: PyQt6.QtCore with error: libQt6Core.so.6: cannot open shared object file: No such file or directory
Traceback (most recent call last):

etc.....

@iroQuai
Copy link

iroQuai commented Sep 2, 2024

Same results as @Malek-GHub here!

@crocodilestick is there something we can do to help test? Or is this enough info for you to create some kind of a fix?

@crocodilestick
Copy link
Owner

@iroQuai @Malek-GHub working on a fix now, it worries me that calibredb still doesn't work even when called directly though.

Could you both try running the command pip install PyQt6 and then see if /app/calibre/calibredb then produces usage info instead of an error?

@iroQuai
Copy link

iroQuai commented Sep 3, 2024

Maybe it's an idea to post the issue here? https://github.com/linuxserver/docker-mods

@gerryhendrickx
Copy link

I can confirm the same issue on my Synology DS920+ with DSM 7.2.1-69057 Update 5 using the following config for docker:

docker run -d --name=calibre-web-automated
-p 8085:8083
-e PUID=1026
-e PGID=101
-e TZ=Europe/Brussels
-e DOCKER_MODS=linuxserver/mods:universal-calibre
-v /volume1/Media/Books/cwa-book-ingest:/cwa-book-ingest
-v /volume1/docker/calibrewebautomated:/config
-v /volume1/Media/Books/calibre:/books
--restart always
crocodilestick/calibre-web-automated:latest

@netvyper
Copy link

Ran into this issue, both with plain Calibre web & this container. Found the following:
linuxserver/docker-calibre-web#306
I am certainly running an old kernel on this particular box, will try moving to something newer for my use. That won't help Synology folks though, sorry.

@Malek-GHub
Copy link

Malek-GHub commented Sep 10, 2024

I’d be more than happy to have a remote session on my Synology and test with somebody, if anyone is interested….

@vazer7070
Copy link

any fix soon.?

@netvyper
Copy link

Ran into this issue, both with plain Calibre web & this container. Found the following: linuxserver/docker-calibre-web#306 I am certainly running an old kernel on this particular box, will try moving to something newer for my use. That won't help Synology folks though, sorry.

So, I did move my instance from an older CentOS7 box (3.10 kernel?) to a new Ubunutu 24.04 box - it just works(tm).
No config changes, no library changes, it just runs flawlessly.

@crocodilestick crocodilestick added the help wanted Extra attention is needed label Sep 11, 2024
@crocodilestick crocodilestick changed the title [Synology NAS] Books appear to be ingested, but not moved to the library [Synology NAS] CWA not currently working on Synology Devices Sep 11, 2024
@crocodilestick crocodilestick pinned this issue Sep 11, 2024
@jmarmstrong1207
Copy link
Contributor

Could anyone with a Synology server provide the logs of the docker container right when it gets created from scratch?

should be in docker logs *containername*

@vazer7070
Copy link

@crocodilestick this isn't only with synology, with unraid's docker you can't too

@netvyper
Copy link

Here's the docker logs from my container on centos7 that was experiencing the same issue.
centos7-cwa-docker-log.txt
Hopefully synology/unraid folks can follow up with similar

@iroQuai
Copy link

iroQuai commented Sep 12, 2024

Here are my logs
12sept24.log

I'm on a Synology DS220+ with the latest DSM


Edit: @crocodilestick current title isn't completely true! CWA is on Synology does work, and is still the better alternative even without the automatic bulk import! The fact I can edit the epub metadata from the webGUI is a big plus!

@inkanyamba
Copy link

inkanyamba commented Sep 15, 2024

Ran into this issue, both with plain Calibre web & this container. Found the following: linuxserver/docker-calibre-web#306 I am certainly running an old kernel on this particular box, will try moving to something newer for my use. That won't help Synology folks though, sorry.

So, I did move my instance from an older CentOS7 box (3.10 kernel?) to a new Ubunutu 24.04 box - it just works(tm). No config changes, no library changes, it just runs flawlessly.

Just for folks who are in the same boat and running on an older linux kernel like synology. The fix is mentioned at the bottom of the link and I'll repost it here: use DOCKER_MODS=lscr.io/linuxserver/mods:universal-calibre-v7.16.0.

No idea how this will affect things moving forward but it seems to fix the issue in the short term.

@vazer7070
Copy link

Ran into this issue, both with plain Calibre web & this container. Found the following: linuxserver/docker-calibre-web#306 I am certainly running an old kernel on this particular box, will try moving to something newer for my use. That won't help Synology folks though, sorry.

So, I did move my instance from an older CentOS7 box (3.10 kernel?) to a new Ubunutu 24.04 box - it just works(tm). No config changes, no library changes, it just runs flawlessly.

Just for folks who are in the same boat and running on an older linux kernel like synology. The fix is mentioned at the bottom of the link and I'll repost it here: use DOCKER_MODS=lscr.io/linuxserver/mods:universal-calibre-v7.16.0.

No idea how this will affect things moving forward but it seems to fix the issue in the short term.

Not functionnal on Unraid

@gerryhendrickx
Copy link

Ran into this issue, both with plain Calibre web & this container. Found the following: linuxserver/docker-calibre-web#306 I am certainly running an old kernel on this particular box, will try moving to something newer for my use. That won't help Synology folks though, sorry.

So, I did move my instance from an older CentOS7 box (3.10 kernel?) to a new Ubunutu 24.04 box - it just works(tm). No config changes, no library changes, it just runs flawlessly.

Just for folks who are in the same boat and running on an older linux kernel like synology. The fix is mentioned at the bottom of the link and I'll repost it here: use DOCKER_MODS=lscr.io/linuxserver/mods:universal-calibre-v7.16.0.

No idea how this will affect things moving forward but it seems to fix the issue in the short term.

Can confirm this works on Synology! Thank you!

@iroQuai
Copy link

iroQuai commented Sep 15, 2024

Holy crap it does work! thanks a lot. This is great!!

(Synology ds220+ latest DSM)

@Wit4r7
Copy link

Wit4r7 commented Sep 15, 2024

For me, it is not working.
Running am 270+ with DSM 7.2.1-69057 Update 5.

---
services:
  calibre-web-automated:
    image: crocodilestick/calibre-web-automated:latest
    container_name: calibre-web-automated
    environment:
      - PUID=1028
      - PGID=911
      - TZ=Europe/Berlin
      - DOCKER_MODS=lscr.io/linuxserver/mods:universal-calibre-v7.16.0.
    volumes:
      - /volume1/docker/calibreauto:/config
      - /volume1/books/calibre:/calibre-library
      - /volume1/books/AutoImport:/cwa-book-ingest
    ports:
      - 8083:8083
    restart: unless-stopped

But when starting I get

[mod-init] Running Docker Modification Logic
[mod-init] Adding linuxserver/mods:universal-calibre-v7.16.0. to container
[mod-init] (ERROR) linuxserver/mods:universal-calibre-v7.16.0. digest could not be fetched from lscr.io

@iroQuai
Copy link

iroQuai commented Sep 15, 2024

I didn't copy the last . In the docker mod URL. Maybe try that?

- DOCKER_MODS=lscr.io/linuxserver/mods:universal-calibre-v7.16.0

@Wit4r7
Copy link

Wit4r7 commented Sep 15, 2024

Thanks. Sometimes a dot changes a lot :)
Can also confirm that it works now.

@vazer7070
Copy link

vazer7070 commented Sep 15, 2024

it's functionnal but now all book go to /var/lib/docker/volumes/fc0aecf70610b14ac58152771ea7e6259fdde12437f5482d2898dd42da75c6f6/_data instead calibre library when CWA ingest them.
in setting, i have correctly set library path but CWA don't understand

@Malek-GHub
Copy link

It works!! Although it cant find any book covers and when I mass dumped a bunch of books it stopped at 26 and wont do the rest, even after I refreshed the library...
I'm going to restart the docker and see if that helps. In the meantime, is there any way to get the book covers?

@iroQuai
Copy link

iroQuai commented Sep 16, 2024

Choose the edit metadata option after selecting a book. There you can add a cover manually or retrieve one when grabbing all metadata from a source.

@mcqweb
Copy link

mcqweb commented Sep 16, 2024

Not working for me on Unraid, even with the versioned Docker Mod, the binaries don't get installed. Is there anyway to install them manually for now?

EDIT
I found a temporary solution that seems to be working for me:

I used the v7.16.0 mod (Not sure if that was needed)
I ran these commands in the Docker terminal

apt update
apt install wget -y
apt install libegl1 -y
apt install libopengl0 -y
apt install libxcb-cursor0 -y
apt install xz-utils -y
apt install qt6-base-dev -y
wget -nv -O- https://download.calibre-ebook.com/linux-installer.sh | sh /dev/stdin install_dir=/app

Finally updated the path to binaries to /app/calibre and restarted docker

@crocodilestick
Copy link
Owner

Ran into this issue, both with plain Calibre web & this container. Found the following: linuxserver/docker-calibre-web#306 I am certainly running an old kernel on this particular box, will try moving to something newer for my use. That won't help Synology folks though, sorry.

So, I did move my instance from an older CentOS7 box (3.10 kernel?) to a new Ubunutu 24.04 box - it just works(tm). No config changes, no library changes, it just runs flawlessly.

Just for folks who are in the same boat and running on an older linux kernel like synology. The fix is mentioned at the bottom of the link and I'll repost it here: use DOCKER_MODS=lscr.io/linuxserver/mods:universal-calibre-v7.16.0.

No idea how this will affect things moving forward but it seems to fix the issue in the short term.

@iroQuai @inkanyamba @Malek-GHub This is amazing! I'm so glad you guys managed to find a fix! I've updated the README and the docker-compose.yml to now use version 7.16 of the universal calibre mod by default going forward baring and issues that might arise in the future. Thank you all for being so great to each other and I#m now marking this issue as closed!

@crocodilestick crocodilestick unpinned this issue Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests