Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make it possible to import backup from Tachiyomi #301

Open
1 task done
kyoyacchi opened this issue Jan 26, 2023 · 21 comments
Open
1 task done

Make it possible to import backup from Tachiyomi #301

kyoyacchi opened this issue Jan 26, 2023 · 21 comments

Comments

@kyoyacchi
Copy link

Describe your suggested feature

I'd like to be able to import my manga and categories from Tachiyomi to Kotatsu. Is it even possible?

Acknowledgements

  • I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open issue.
@Sadwhy
Copy link

Sadwhy commented Jun 27, 2023

I had the blood curling task of migrating every single manga I had from manganato to tachiyom. It took me three days to complete it, one by one. Now that I have found a better app. I don't want to do that again.

@ztimms73
Copy link
Member

It seems to me that it is not advisable to maintain backups from Tachiyomi

@ztimms73 ztimms73 mentioned this issue Jul 5, 2023
1 task
@ztimms73 ztimms73 added the question Further information is requested label Jul 5, 2023
@ztimms73
Copy link
Member

https://kotatsu.app/manuals/faq/general/#can-i-restore-my-tachiyomi

@ztimms73 ztimms73 closed this as not planned Won't fix, can't repro, duplicate, stale Nov 19, 2023
@ztimms73 ztimms73 removed the question Further information is requested label Nov 19, 2023
@kyoyacchi
Copy link
Author

😭😭 I see....

@mariodac
Copy link

we need this, now that tachiyomi has ended how are we going to migrate to kotatsu?

@Axeraider
Copy link

we need this, now that tachiyomi has ended how are we going to migrate to kotatsu?

He's right. Didnt even know ablut kotatsu till tachiyomi died

@Axeraider
Copy link

At least an option to make tachiyomi backup files compatible with the kotatsu backup restoration system would be appreciated. Can't code yet, but if yall need the help. . .

@KraXen72
Copy link

KraXen72 commented Jan 14, 2024

I think this could be feasible.
Kotatsu does not support the amount of sources tachi does, but there is a fair overlap of supported sources.
Tachiyomi backup restore functionality could be done in several waves of functionality (over multiple updates).

  1. Allow reading tachiyomi backups
    • Kotatsu checks the source the manga is from, and if it's supported adds it (prompts user to enable the source beforehand if needed)
    • Displays a list of manga that could not be restored from the backup (for screenshot, possibly txt download)
    • Adds tracking information to manga found in the backups
  2. Suggest alternatives
    • probably best after Manga Migration #660 is implemetned, but it would suggest all manga that couldn't be imported to be searched & added from other sources. Then, the progress (read chapter, tracking) would be added to them.

I understand this is a lot of work, but with tachiyomi dying, many users will be looking for another manga app while having a tachiyomi backup file. It would save many people a lot of time, especially those with large libraries, from having to add all manga manually.
Please re-consider implementing this feature, atleast the first part.
Thanks a ton!!!

@Axeraider
Copy link

I think this could be feasible. Kotatsu does not support the amount of sources tachi does, but there is a fair overlap of supported sources. Tachiyomi backup restore functionality could be done in several waves of functionality (over multiple updates).

  1. Allow reading tachiyomi backups

    • Kotatsu checks the source the manga is from, and if it's supported adds it (prompts user to enable the source beforehand if needed)
    • Displays a list of manga that could not be restored from the backup (for screenshot, possibly txt download)
    • Adds tracking information to manga found in the backups
  2. Suggest alternatives

    • probably best after Manga Migration #660 is implemetned, but it would suggest all manga that couldn't be imported to be searched & added from other sources. Then, the progress (read chapter, tracking) would be added to them.

I understand this is a lot of work, but with tachiyomi dying, many users will be looking for another manga app while having a tachiyomi backup file. It would save many people a lot of time, especially those with large libraries, from having to add all manga manually. Please re-consider implementing this feature, atleast the first part. Thanks a ton!!!

My thoughts exactly. With the massive influx of tachi users the app will would make a lot of very happy new customers to be able to port over their data with that that level of simplicity?
And all they said was that tachiyomi couldn't be developed anymore, there's no reason that developers from over there can't come beef up the completely different app kotatsu.
Just sayin'. . .

@ztimms73 ztimms73 reopened this Jan 14, 2024
@LilithMorningstar666
Copy link

https://kotatsu.app/manuals/faq/general/#can-i-restore-my-tachiyomi

But all my tachiyomi sources are already present on kotstu, so all my library items can be found on kotstu. Migrate data it's not possible but what about read Tachiyomi library backup structure, get manga names and do a hidden search on all enable kotatsu sources and add it to favourites.

@ztimms73
Copy link
Member

it's not as simple as you think

@ztimms73
Copy link
Member

ztimms73 commented Jan 15, 2024

and this method with searching for manga and automatically adding to favorites will not be used

@ztimms73
Copy link
Member

ztimms73 commented Jan 15, 2024

I need to dig around and look at the Tachiyomi backup and correlate all the IDs of the Tachiyomi extensions (and there are more than 1000 of them) with the Kotatsu parsers (there are also about 1000 of them)

@ztimms73
Copy link
Member

and this is a very difficult job. and whether it will be worth it, I'm not sure
but I'll try

@LilithMorningstar666
Copy link

I need to dig around and look at the Tachiyomi backup and correlate all the IDs of the Tachiyomi extensions (and there are more than 1000 of them) with the Kotatsu parsers (there are also about 1000 of them)

And with global Search, most of people only use their language sources and if add other language sources it's because they know more of 1 language, maybe can be more easy if get manga name, do a global search on kotatsu then compare first search result and if both names are exactly the same, add the first found result to the favourites sections. All mangas that can't be found can be saved on a log file to allow the user to search it manually and library categories can be created and organised again by the users.
What do you think?

@LilithMorningstar666
Copy link

I need to dig around and look at the Tachiyomi backup and correlate all the IDs of the Tachiyomi extensions (and there are more than 1000 of them) with the Kotatsu parsers (there are also about 1000 of them)

And with global Search, most of people only use their language sources and if add other language sources it's because they know more of 1 language, maybe can be more easy if get manga name, do a global search on kotatsu then compare first search result and if both names are exactly the same, add the first found result to the favourites sections. All mangas that can't be found can be saved on a log file to allow the user to search it manually and library categories can be created and organised again by the users.
What do you think?

Limitations:

  1. Library categories and organization won't be restored.
  2. Some mangas maybe can't be restored.
  3. Preferably it's recommended to use your native language srouces.

The good part:

1)Probably most of your library can be restored, it's the hard work if you have a lot of saved content.
2) Not restored items will be saved on a log file and can be restored if you found it manually.

It's much better than nothing.

@ztimms73 ztimms73 mentioned this issue Jan 17, 2024
1 task
@Rabcor
Copy link

Rabcor commented Jan 20, 2024

Thankfully i had only been using tachiyomi for about a year, so it only took me a few hours to ferry everything over to kotatsu by hand (it was probably around a 100 manga overall).

I got into a rhythm, open it in tachiyomi, check the total number of chapters and my progress, hold finger on title to copy, switch to kotatsu, paste to search through all sources, find the best one based on chaptercount, add to library, set progress, delete from tachiyomi (just to keep track of what i've added and what not), repeat.

It was worth the effort though, because i'm finding that kotatsu is quite simply a superior app. the performance is way better, it's more obedient about actually scrolling the way you tell it to, and i love the page view, oh my god, to be able to preview a manga and see if it looks worth reading is 👌 amazing.

I think my favorite reason is probably that kotatsu doesn't do that extension bullshit, tachiyomi's extensions where you install like 50 apps, one for each source is a gigantic, enormous, gaping security hole. You have no idea if you can trust all these extensions unless you dig through the code of each and every one, it's a nightmare. In kotatsu you only have to trust kotatsu, just install 1 app and it's done.

But to anyone who simply cannot imagine doing this by hand (which i can understand, it was a pain in the ass, worth it, but pain in the ass), you could just use mihon instead, it's a tachiyomi fork where you can restore a backup from tachiyomi and be done with it, but extensions still work with mihon, unlike tachiyomi itself.

To be honest I hope the kotatsu devs put priority on this issue though, tachiyomi just basically committed suicide, it's a great opportunity to snatch the majority of the userbase (and you'd honestly be doing them all a favor by doing it, cuz it's a way better experience than tachiyomi in the first place over here).


Honestly I do have one idea of how this could be relatively simply implemented. Not a minor feature mind you, but not complicated.

It doesn't have to be a perfect one click thing.

Just make it a process something like this

  1. Read from tachiyomi backup and scrub names, sourcenames, progress and category from all entries, then add these to kotatsu (but as non-functional entries within functional categories, the only data here is name and progress and the name of the source used in tachiyomi)
  2. Make a semi-automatic step (user confirmation required) to auto-add sources in kotatsu that have names that match very closely (maybe just same name but not case-sensitive or something) as the ones found in the list.
  3. Make a semi-automatic step (user initiation and confirmation required, give the user time to add more sources between step 2 and this step), auto-search for manga by name and source for those who have known sources, and just by name across all sources when there isn't a known source, then auto-apply the progress and update the entries to be now kotatsu compatible. Also optionally this step could require user confirmation for each entry (e.g. it pops up a thumbnail, sourcename and chapter count and asks the user to confirm that this looks right to them, and if they say no that entry gets skipped)
  4. For entries that couldn't be found/were skipped, the user can click them in their library and hit a button which takes them to search for the title through all sources, and if they then click something they find, they see the chapter count and are asked to confirm if they want to update the entry. Which if they do, it gets updated and progress is applied.

That's about it for my idea. It should be at least workable, and the main point here is to save time, you don't have to save people all the time they would spend on porting their library over from tachiyomi to kotatsu, but if you save them 9 out of 10 hours, that's great.

@Axeraider
Copy link

Axeraider commented Jan 20, 2024 via email

@kyoyacchi
Copy link
Author

Maybe check out #800?

@LilithMorningstar666
Copy link

Maybe check out #800?

It's an excellent tool but only support English srouces.

@PhantomShift
Copy link

Wasn't aware this issue existed, but the process mentioned by Rabcor (specifically steps 1 and 2) has been implemented in nekotatsu to a certain extent if you'd like something to reference if you decide to implement this feature. The general overview is

  1. Get a list of Tachiyomi extensions (there are lots of repositories you could pull from)
  2. Get a list of Kotatsu parsers
    This should be simpler on Kotatsu's end, my implementation scrapes the kotatsu-parsers source code since I don't have a way of interfacing with Kotatsu directly
  3. Map extensions to parser implementations by comparing source names and source urls

In fact, the main problem with the implementation present in nekotatsu is that I'm scraping the parser definitions from the kotatsu-parsers source code, which has complications due to all the different implementations. I'm of the opinion that this is an otherwise trivial process as the actual conversion of a Tachiyomi manga to a Kotatsu manga is fairly easy. Too bad I have zero Java/Kotlin experience

@ztimms73 ztimms73 mentioned this issue Jul 31, 2024
1 task
@wolfkin wolfkin mentioned this issue Aug 15, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

9 participants