3.0-dev-0.20220811.9ad2186d6

Changelog

• 9ad2186 rclone: reduce info logs on delete actions
• 7e8df61 ci: disable gci linter in golangci-lint
• ef60249 make: set /bin/bash as default shell
• 77d86a5 server: setup signals handling before db migration starts
• cb29a4f server: syscall.Exit() instead of os.Exit()
• a443e40 dist: scylla-manager.service, set LimitNOFILE
• 720a280 service/backup: purger, limit nr. of dirs processed in parallel
• 3513f4f scyllaclient: DefaultTransport, configure IdleConns per host
• e066acb readme: update after removing run-server from start-dev-env target
• e769a42 ci: include integration-tests check
• 824a75c ci: fix failing TestCronInDifferentLocations
• 88a8420 service/repair: integration-tests, fix temporary network outage test
• 2a6e694 service/healthcheck: integration-tests, fix randomly failing context timeout test
• a95f33a make: refresh scylla-manager container on every run of pkg-integration-test
• a7ac8c4 .golangci.yml: upgraded golangci-lint from v1.43.0 to v1.46.2
• 498e67d scheduler: changed key to generic and properties to interface
• a2deef7 upgraded go from 1.17 to 1.18
• 0ca8c73 gh: add mod/go.sum to cache key for bin dir
• 0d9f63a dist/licenses: Update 3rd party licenses
• 953caa3 pkg/testutils: Add check for golden file name creator
• 7e41f31 pkg/scheduler: Rename subtests of TestWindowParse
• 4203a4d service/backup: integration test, fix TestPurgeTemporaryManifestsIntegration
• 4c5ed0c service/repair: integration test, fix integration tests
• 74046b2 service/repair: integration test, change log level to info
• 3b4a1b2 makefile: run-server, mount /tmp for rw access
• 6933761 ansible/restore: use --dump-manifest and jq to list keyspace and table
• 4dc88be service/backup: load manifest index to local file
• 024c198 vendor: add json-iterator
• 7bab264 service/backup: use jsoniter to stream manifest indexes
• 10ae40a command/suspend: improve error message for startTask
• a7f5d6f service/scheduler: needsOneShotRun use multiline layout
• b16e761 rclone/{operations,rcserver}: check location, s3 return status code 500 for not service level errors
• 8248c8c rclone/operations: add AWSError
• 9fef405 docs: update docs to 3.0
• e3f35da service/repair: join ranges when fully replicated small table
• 4c749f6 service/cluster: fix broken integration test
• 96e5e4d docs: remove link checker
• 4892615 service/backup: improve error for nonexistent bucket
• b2bb08e scyllaclient: check metric values for nils
• 7c67bc8 service/backup: iteratively load manifest indexes
• 205788b util/jsonutil: add decoder wrapper with seeker
• 7597358 backup/purger: merge manifest and foreachdir
• 28ebfa6 mocks: fix mock generatin for updated versioning
• 219bf8b ci: align release tag pattern
• 74c7ba4 service/cluster: fix broken integration test
• 399804e Revert "service/backup: allow path in backup location"
• 005b279 Revert "service/backup: allow underscores in backup paths"
• 94f76c3 command/info: add cause flag and limit error field
• dabaaa8 service/backup: allow underscores in backup paths
• 5021492 scyllaclient: expose config to config file
• 156cffe schema: move task deleted migration to 3.1
• 0fbe347 Fix version command sctool version output
• 9a47bab docs: link checker skip vendor dir
• 2bc469f docs: add anchor to options
• c75b0ae docs: regenerate
• 1ab31a8 Revert "command: replace `` with '"
• 9afdd3d docs: add note to deprecated flags
• ce317c7 docs: update deprecated cli examples
• 5d99168 docs: create generic upgrade page
• d0d84c5 docs: port upgrade docs
• 660630e scyllaclient: increase default timeout to 30s
• 3cbe62b service/backup: differentiate between log msgs
• 939da92 make fmt
• d93a09e service/scheduler: unit test fix
• 7b0249f config: set timeout to 1s
• fcee6cc dist: change Scylla memory allocation to 250M
• 94f1ce6 cmd/scylla-manager: gocql configuration hardening
• 479a54f testing: fix starting of agents
• 04ec6b5 testing: bump scylla version to 4.6.1
• 98496ef restapi: don't allow updating resume task
• 77033f9 service/scheduler: validate suspend properties
• 68c99a6 go.mod: update versioning to use v3
• cc2853a restapi/task: validate task on update and create
• 5fc3312 managerclient: don't limit status column
• 8ae4dd5 service/backup: allow path in backup location
• e001ce7 service/scheduler: schedule one off tasks on resume
• bbdd12d scheduler/window: Account for DST changes
• 9316528 docs: update theme 1.2.1
• 79107c2 CI: add release workflow using goreleaser
• 9136698 scyllaclient: fix return of nil body on err != nil
• 4e3d8cf restapi: add recoverer to router
• fa46b73 config: update go-log and add log encoding config
• 0cb2e57 command/cluster: update example to use 3.0 command
• c2fa5ec scyllaclient: update ShowModTime comment
• bd08511 managerclient: add host to repair progress details
• f0f8e6b rclone: update rclone dependency to reduce logs
• f93a328 docs: document MinIO bucket creation for docker
• 91f9778 docs: fix wrong status description
• 767693f service/backup: use RcloneListDirIter
• 96a9fb9 scyllaclient: t/o per batch on RcloneListDirIter
• 11a7e26 service/scheduler: remove deleted task from resolver
• d7f7ca3 dist: goreleaser, replace empty_folders with dst type dir
• 22242f8 dist: useradd, do not create homedir
• 2ffbc84 Revert "dist: goreleaser, remove empty_folders directive"
• e9a8615 install-dependencies.sh: fix goreleaser installation
• c1707ce mod: bump goreleaser version to 1.5.0
• 63b985f rclone: use server mod time by default
• dea020e scyllaclient: timeout, add support for timeout while streaming response body
• 465f714 Revert "scyllaclient: timeout, report timeout if ctx.Err() == context.DeadlineExceeded"
• eaea97e misc: fix imports
• 062f09f scyllaclient: rclone, change RcloneListDirOpts to use better defaults
• 279419c swagger: add missing noMimeType
• bb9cb54 metrics: add last success
• e591451 ansible/restore: Use upload directory to upload SStables
• 2b19555 ansible/restore: restore.yaml: a full rework
• 2461431 service/backup: use timeutc for purger
• 57186d5 scyllaclient: timeout, report timeout if ctx.Err() == context.DeadlineExceeded
• f82cd68 dist: goreleaser, remove empty_folders directive
• 8feb104 docs: collapse inherited options
• cccdcd1 Add a prerequisite and a note to teh restore procedure
• b20a187 docs: split tasks commands
• 021790a scheduler/trigger: fix cron test
• dc13378 util/cfgutil: overwrite zero config structs with default
• 2ff71da service/backup: add retention days
• a868249 docs: update theme 1.1
• e93e875 docs: fix typo in restore
• 4ecbbc2 docs: update restore procedure
• 03287fc dist: useradd replace -d flag with -b
• e49be58 scyllaclient: retry increase t/o bugfix
• 5c0c420 testing: docker, adjust to changed naming scheme
• 29e8207 restapi: unescape URL encoded cluster name
• 6123826 service/scheduler: backoff, set max interval to 3h
• 01d9ecc command: dry-run describe cron
• f2225f1 cmd/sctool: format tests
• e181de2 managerclient: properties add dot
• 1098fe6 managerclient: task runs remove end time
• a4a30c7 managerclient: task runs add cause if available
• ba0a2af cmd/sctool: add test to printing all commands
• d5c3a88 command/tasks: add --show-ids flag to force task UUID display
• a634713 command/suspend: if no parameters are passed just run suspend and do not schedule suspend task
• 85f7d80 service/scheduler: fix newDisabledResumeTask make task disabled
• 04e9971 managerclient: tasks, show next as duration relative to now
• 60c6262 docs: sctool, update partials
• 7e1bbc5 command/suspend: convert suspend to command
• f7f905c service/scheduler: list, set suspend indicator based on activation time
• 3ecb14c service/scheduler: fix load task bug
• 18e12ff service/scheduler: suspend, suspend task
• 23d1b76 service/scheduler: suspend, extract the suspend code to a separate file
• 35a8ea9 docs: autogenerate cli reference docs
• 998860f dist: update license
• 2584e27 command: info, show indicator on no data
• b0785d0 managerclient: remove CmdRenderer
• 197b915 managerclient: TaskInfo rendering of task schedule and properties
• 6858037 go mod add github.com/lnquy/cron
• cdda335 service/scheduler: fix backoff no wait for retry no. over 1
• 9b689ea command/flag: add 3 retries by default
• 87dd689 command/repair: add missing parameters handling
• bddfde7 sctool tasks remake
• e932be6 service/scheduler: schedule, add timezone
• e544523 command/flag: add timezone flag to common task flags
• e7ed469 testing: add tzdata to scylla-manager container
• 6bd0f61 service/scheduler: window, JSON fix handling empty windows
• 41b2222 Revert "scheduler/trigger: cron, use UTC timezone"
• 85716b4 docs: bump stable version to 2.6
• 81c14d2 sctool/partials: regenerate
• 2ad5c94 command: replace `` with '
• 6d7fac4 command/flag: add --window to common task parameters
• b2c5239 scheduler/trigger: cron, use UTC timezone
• 7245b67 managerclient: replace TaskJoin with TaskID
• 0892241 command: update, do nothing when there are no changes
• 6da3705 service/scheduler: misc, small fixes
• 719f7ec command/flag: add retry-wait to task
• 32b9416 service/scheduler: schedule, rename retryInitialInterval to RetryWait
• 5cdbc1e command/flag: do not send start-time if not set
• 92bfc68 command/flag: add Cron type for faster validation
• 948d86e sctool: change bash script to soft link
• 1067502 managerclient: CmdRenderer, add support for cron
• 10e6c1a service/scheduler: listener, add "in" to Schedule log line
• 27bfa5d scheduler/trigger: cron make seconds optional
• 35f3d14 service/scheduler: add cron to Schedule
• 0a30a7c service/scheduler: add Cron type
• 0aeedd9 command/flag: add cron to task flags
• abb48ff command/flag: deprecate interval and start-date flags
• 6efd843 schema/table: regenerate table models
• 9b6dd87 testing: expose Scylla API and CQL ports to localhost
• 38b98c4 testutils: CreateSession satisfy migration callback validation
• ba69ba0 schema/migrate: migrate existing healthcheck_X tasks to healthcheck with mode
• 99af841 schema/migrate: port code to gocqlx CallbackRegister
• 113960c go mod update github.com/scylladb/gocqlx
• 171cf73 scheduler: unify health check tasks to one type
• 3ef2fda makefile: add target to generate sctool partials
• 1e41002 docs: update docs for task id or name usage
• 27dd896 cmd/scylla-manager: add name to default repair task
• 2932cc4 dist/license: update
• 3de8557 managerclient: TaskSplit, support use of task name
• e35a139 go mod add github.com/hbollon/go-edlib
• b3cf20d go mod tidy
• 16f81b4 service/scheduler: validate task name on put
• a66e5ff service/scheduler: move suspended check to schedule
• 3636e52 service/scheduler: resolver, dumbify resolver
• c472467 managerclient: use task name instead of ID if available
• 1de753f command/flag: TaskBase, fix flag initialization
• 4ccaafa command/flag: do not require providing flags with defaults
• bf328be env: add default SCYLLA_MANAGER_CLUSTER=xxx
• b75c813 command: flag, add name to common fields
• edbbf60 managerclient: use sizesuffix to parse and format size strings
• 8cf365c managerclient: add sizesuffix from rclone
• 01327a6 managerclient: cmdrenderer, use common task type constants
• 6dcdfa3 cmd/agent: require auth-token to start
• f0b52c6 service/healthcheck: rest, report status error if rtt=0
• 0eb9bad command/status: remove printing version
• 8057947 service/scheduler: move task start date in the past tolerance to put flow
• 0e9094b Revert "scheduler: legacy, add nowThreshold"
• d2dce13 service/repair: disable small tables optimisation if --small-table-threshold is set to 0
• d40fcc1 scyllaclient: metrics, support 'memory_total_memory' as gauge
• 402d7e6 service/schedule: compress health-check DONE streaks
• 5cdb293 util/uuid: add time based constructor NewFromTime
• 5fb433f service/repair: worker, add trace_id to worker logs
• 92faaae command/info: render full command args
• d778c27 dist/license: regenerate license
• 1e61e6c cmd/sctool: move base url code from config/server and get rid of config/server dependency completely
• 4024172 util/cfgutil: add PermissiveParseYAML to enable parsing parts of a file
• 4bdb304 config: extract server config to separate package
• 5cce4d7 config: extract agent config to separate package
• 3cc0d73 managerclient: drop service/backup/backupspec dependency
• 198224f managerclient: drop service/scheduler dependency
• c5b2e81 docs: sctool, update partials
• 22d64ee command: fix update commands
• beb05a7 command: backup validate add update
• 68081b3 env: add bash completion
• 040871d docs: sctool, add generated yaml files
• 13fb460 sctool: doc, add output flag
• be68bf7 scyllaclient: retry, add http retries
• 030a360 scyllaclient: retry, refactoring to enable extension to http.Request
• cf9d2a5 scyllaclient: replace direct transport usage with http.Client Do
• f3e430c scyllaclient: RclonePut expect body to be passed as bytes.Buffer not as a reader
• 99f16f8 managerclient: add options in NewClient
• a2ae0bf sctool: completion, fix
• 174015c makefile: integration tests run in docker
• 04b26b1 github: remove go test cache
• f44c477 github: go, fix cache key for tools in bin
• de1d7ba makefile: run-server, run in a docker container
• 81139dc testing: upgrade Minio and Prometheus
• b9b3fb0 testing: upgrade Scylla to 4.6
• 0372b48 testing: add SCYLLA_IMAGE
• d32da81 testing: improve formatting when waiting for connection
• 00630c6 linux: add missing imports in files with linux build tags
• ab4f865 downloader: adjust unit test to non linux OS
• f47c604 golangci: adjust code to v1.43.0
• 0a1fde8 go: bump go version to 1.17.4
• 8c20f30 dist/license: regenerate licenses
• 8bde183 install-dependencies.sh: move to mod managed dependencies installed from source
• f5d80ef install-dependencies.sh: unify system packages
• c7e6e76 cmd/agent: add Linux build constraint
• c63cef3 util/cpuset: Add Linux build constraint
• 9c54d1a Revert "Update dockerfile with missing packages"
• 44c8d4f managerclient: add default dial timeout
• 6f6e395 command: migrate to client.TaskSplit
• b904633 command/progress: migrate to client.TaskSplit
• 64a4ecc managerclient: add client TaskSplit
• b484334 managerclient: util, change TaskSplit so that it accept task type without ID
• da3a9d6 restapi: tasks, add short flag
• a52bf2c swagger: tasks, add short flag
• 211a666 cmd/scylla-manager: use short flag for task listing in delete cluster
• 9d3d7d4 service/scheduler: list, add short filter flag to only return basic information
• 32bd6d1 service/scheduler: list, add omitempty json tag to fields of Task
• 4b61f65 service/scheduler: list, add omitempty json tag to all fields of TaskListItem
• 5b5ede1 command: get rid of service/scheduler dependency
• 473b8b0 managerclient: add scheduler task type constants
• d20f6f2 dist/Makefile: modify dev version
• 5eeb9af goreleaser:set arch in tar.gz file to match os
• 0ae2ed4 Update dockerfile with missing packages