Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add copy-data stage #4202

Open
karol-kokoszka opened this issue Jan 13, 2025 · 0 comments
Open

Add copy-data stage #4202

karol-kokoszka opened this issue Jan 13, 2025 · 0 comments
Assignees
@VAveryanov8
Milestone
1-1 Restore

Comments

@karol-kokoszka
Copy link
Collaborator

After validation, Scylla Manager must copy SSTables of the source node to the corresponding /keyspace/column_family/upload data directory on the destination node.

If the corresponding /keyspace/column_family/upload data directory doesn't exist, it means that schema is not restored.
Service must stop the restore with the meaningful error message.

To download files from the backup location, SM is using RClone.
It's OK to copy all the data from the source_node node/keyspace/column_family location with one call and then monitor the rclone job progress.
@karol-kokoszka karol-kokoszka added this to the 1-1 Restore milestone Jan 13, 2025
@VAveryanov8 VAveryanov8 self-assigned this Jan 27, 2025
This was referenced Jan 30, 2025
Open
Merged
VAveryanov8 added a commit that referenced this issue Feb 18, 2025
@VAveryanov8
feat(1-1-restore): adds copy data stage + loadSStables call (#4235)
0337f41 
feat(1-1-restore): adds copy data stage + loadSStables call

This adds copy data stage for the 1-1-restore with simple integration
test. Data is copied by each node, table by table and after each table
loadSStables is called.
Note: integration tests with TABLETS=enabled will be skipped as 1-1-restore should only
work with v-nodes.

Refs:  #4202 #4203
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@VAveryanov8 VAveryanov8

Labels
None yet
Projects
None yet
Milestone
1-1 Restore
Development

No branches or pull requests
2 participants
@VAveryanov8 @karol-kokoszka