Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

185 demo #187

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

185 demo #187

wants to merge 7 commits into from

Conversation

jrob93
Copy link
Collaborator

@jrob93 jrob93 commented Jan 6, 2025

Testing adler framework for a single night of the survey, using the RSP.

I've updated the adler cli slightly:

  • option -np (--no_plot) to avoid creating any figures
  • log files are written to a log_files directory to keep them out of the way

Review Checklist for Source Code Changes

  • Does pip install still work?
  • Have you written a unit test for any new functions?
  • Do all the units tests run successfully?
  • Does adler run successfully on a test set of input files/databases?
  • Have you used black on the files you have updated to confirm python programming style guide enforcement?

@jrob93 jrob93 linked an issue Jan 6, 2025 that may be closed by this pull request
@jrob93
Copy link
Collaborator Author

jrob93 commented Jan 7, 2025

The demo notebook notebooks/adler_demo_rsp/adler_demo_rsp.ipynb queries all object detected on a given night of DP0.3. It determines a DP0.3-like phase curve using only data available before the test night, rather than the full 10yrs of data used in the SSObject table. This simulates roughly what parameters should be distributed in an alert by RSP. It then uses the adler CLI to produce an AdlerData database file - this approximately simulates the Adler day time operations.

Then we simulate the Adler night time operations by querying RSP for any detections on the night. This uses construct_from_RSP which dominates the processing time, ingesting the alert(s) from a kafka stream should be much faster. Simple outlier detection is run on the observations and any ssObjectIds with outliers are logged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Continuing the demo
1 participant