Service and sandbox orchestrator

[jenniferjiangkells]

What is the purpose of this PR?

This PR adds the sandbox and service orchestration layer through the use of decorators @api and @sandbox.

Users can decorate their function with the @api decorator to mark it as the primary A/LLM processing function of their service. The decorator will mark the function as a route to a FastAPI app and mount it to the correct endpoint as defined in the UseCase.

The @sandbox decorator marks the entire class as a sandbox orchestrator. It will set up the client and service with the configurations defined in Service, Client, and UseCase. The class must be derived from BaseUseCase, i.e. inherit fromClinicalDecisionSupport. Typically, The @ehr function will define the synthetic data the users want to test with, and @api function will be where the actual processing logic lies. .start_sabdbox() will then start the service and client on separate async threads.

Example use:

@sandbox
class myCDS(ClinicalDecisionSupport):
        def __init__(self) -> None:
            self.data_generator = DataGenerator()

        @ehr(workflow="encounter-discharge", num=3)
        def load_data(self):
            data = self.data_generator.generate()
            return data

        @api
        def llm(self, text: str):
            chain = prompt | llm | JsonOutputParser()
            result = chain.invoke(text)
            return result

cds = myCDS()
cds.start_sandbox()
print(cds.responses)

Next steps

Integrating with actual data generator (it needs to also include meta data for the CDSRequest)
Export request/responses to a directory, or visualise through a streamlit dashboard

[adamkells]

I feel like I need a refresher on how exactly all this code fits together but overall LGTM.

[adamkells]

I don't understand the use case where func is None. When would this come up?

[jenniferjiangkells]

Just means when the decorator is called on its own it doesn't throw an error. I don't know when it would come up either 🤷‍♀️

[adamkells]

Do we need any additional check regarding the form of arg if we are going to use it as service_config?

[adamkells]

This is a bit heavily nested. Ideally, I'd prefer to use a list comprehension to work out what should go in the for loop and avoid the nested if.
called_attrs= [getattr(self, name) for name in dir(self) if callable(getattr(self, name)]
But this isn't essential.