The SIGOPS Blog

Editors:
Tianyin Xu, Akshitha Sriraman, Zhaoguo Wang, and Baris Kasikci

Artifacts

Artifact evaluation, theory and practice

Previously on the SIGOPS blog, we discussed the current status of artifact evaluation (AE) and how to improve it. At HotOS’23, we took another step in this direction: attendees discussed artifact evaluation in a panel led by Shriram Krishnamurthi (Brown), Margo Seltzer (UBC), and Neeraja Yadwadkar (UT Austin), and organized by Roberta De Viti (MPI-SWS),

Read More »
Blog

Systems Trivia: Behind The Scenes

Editor’s note: Since HotOS ’21, Systems Trivia has become systems researchers’ favorite activity – it’s always incredibly fun and educational. Systems Trivia was created by Roberta De Viti and Vaastav Anand who have then been successfully running it at HotOS ’21, SOSP ’21, and HotOS ’23. In this article, We invite Roberta and Vaastav to

Read More »
Blog

Artifact evaluation, present and future

Science should be transparent and reproducible. In computer science, this means code and data should be publicly available and anyone should be able to validate a paper’s claims given reasonable hardware. Dedicated scientists have made their code and data public for decades, but until recently, this was done in a decentralized fashion. Groups had their

Read More »
Blog

Should conferences have a rebuttal phase?

Many CS systems and architecture conferences have a rebuttal phase or an author response period, where authors can respond to the questions asked by reviewers, and correct misunderstandings by reviewers. We discuss the pros and cons of this phase, and whether it is a net positive or negative for the community.  The author response phase

Read More »
Cross-posted from SIGARCH

Response to Change in the ASPLOS Conference Submission Process

In late November, the ASPLOS Steering Committee published a proposal to change the paper submission process for ASPLOS by introducing three deadlines per year and the possibility of resubmitting a paper. The Steering Committee asked the ASPLOS community for its opinion of the changes and suggestions for improvement.  64 people responded, and an overwhelming majority strongly

Read More »
Artifacts

Reproducible Experiments for Useful Internet Systems

Editor’s note: This is 3rd episode of the “How Are Award-winning Systems Research Artifacts Prepared” series. We invited Frank Cangialosi and Akshay Narayan to write about their practices of developing research artifacts for Internet systems and maintaining its reproducibility despite the dynamics of the Internet. Their artifacts won the Best Artifact Award at EuroSys 2021

Read More »