Skip to content

Yamlfying OSDI 20-24 and ATC 21-24, and simplifying SOSP 21/23 and SC21 #110

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

Conversation

vahldiek
Copy link
Collaborator

@vahldiek vahldiek commented Mar 11, 2025

Initial results pages of OSDI and ATC are based on markdown tables. These tables are inherently hard to parse with code.

This PR changes the format from markdown to yaml + code to generating the tables. This allows tooling to automatically scan this repository for the information in the result pages. The suggested yaml format is relatively simple:

artifacts:
  - title: "title"
    doi: "paper DOI"
    badges: "list of badges, e.g., available, functional, reproducible"
    repository_url: "url to git repo"
    artifact_url: "url/doi to artifact in long-term storage"
    award: "name of the award"

SOSP21-23/SC21 has followed a more complex format with several different repository, github, bitbucket, gitlab, zenodo, scripts, data and other URLs. I've simplified the format to match the repository/artifact_url from above and allow additional_urls to link to an arbitrary list of URLs. This allows to keep all the additional links.

The hope is that all current year result pages include the yaml format which leads to future artifact evaluations to adopt the format. Ideally, the maintainers ensure that the format doesn't change to drastically without good reason. This allows to keep the data minable.

The result of these commits can be viewed in my github.io page: https://vahldiek.github.io/sysartifacts.github.io

@vahldiek vahldiek requested a review from ricci March 11, 2025 22:45
@cesar-stuardo
Copy link

Hi Anjo,

Some comments on ATC 24:

  1. SlimArchive: A Lightweight Architecture for Ethereum Archive Nodes is marked as Available and functional, but it should be functional and reproduced.
  2. DeepVisor: Effective Operator Graph Instantiation for Deep Learning by Execution State Monitoring has the right badges, but the string that described the badges and the repo are combined into one.
  3. SimEnc: A High-Performance Similarity-Preserving Encryption Approach for Deduplication of Encrypted Docker Images should be marked as available and functional, not reproduced.
  4. Balancing Analysis Time and Bug Detection: Daily Development-friendly Bug Detection in Linux should have the 3 badges, currently there are none.

@cesar-stuardo
Copy link

cesar-stuardo commented Mar 14, 2025

Hi Anjo,

Again for ATC 24, regarding repos, I noticed:

  1. HiP4-UPF: Towards High-Performance Comprehensive 5G User Plane Function on P4 Programmable Switches repo is missing. It should be https://github.com/CyberSecurityScience/HiP4-UPF
  2. RL-Watchdog: A Fast and Predictable SSD Liveness Watchdog on Storage Systems is available at https://github.com/ATC24-RLW/RLW.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants