Storing or Retrieving Job Previous Runtime

[rover-wagnar]

Hello,

I'm looking into creating a custom schedule for a job that prevents queuing jobs when an instance is already running, something like this:

@schedule(job=my_job, cron_schedule="* * * * *")
def my_schedule(context):
    # Find runs of the same job that are currently running
    run_records = context.instance.get_run_records(
        RunsFilter(job_name="my_job", statuses=[DagsterRunStatus.STARTED])
    )

    # Kick off a run only if no other runs of the same job are running
    if len(run_records) == 0:
        yield RunRequest(...)

However, to guarantee this job process all the data it needs to, I need to be able to determine when the previous run for a job completed. Is there a way to either retrieve previous job runtime from dagster or to store metadata like this between runs for a custom schedule? I would then want to pass this information to the RunRequest.

P.S.: As a workaround for this, I think I can use a state file in S3 to track the job's runtimes and then pass that into a model as a DBT variable. I'm just wondering if there's a fully dagster way to accomplish this without tracking state externally.