Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about processing caption_sharegtpvideo_300k #217

Open
yxsysu opened this issue Aug 8, 2024 · 0 comments
Open

question about processing caption_sharegtpvideo_300k #217

yxsysu opened this issue Aug 8, 2024 · 0 comments

Comments

@yxsysu
Copy link

yxsysu commented Aug 8, 2024

Hi authors, thanks for your great work.
When using the codes for stage3 training, it seems the codes cannot process the catpion_sharegptvideo_300k dataset.

The "img" item in the following config (instruction_data.py) seems make no difference.

   caption_sharegptvideo_300k=[
        f"{my_path}/video/caption/sharegptvideo/train_300k.json", 
        "{my_path}/shareGPTVideo/train_video_and_instruction/train_300k/videos",
        "video",
        "img", # read from image
    ],

Thanks for your reply.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant