Write a Blog >>
ICSE 2022
Sun 8 - Fri 27 May 2022
Mon 9 May 2022 21:20 - 21:25 at ICSE room 2-odd hours - Reliability and Safety 4 Chair(s): Jonathan Sillito
Fri 13 May 2022 11:25 - 11:30 at ICSE room 1-odd hours - Reliability and Safety 6 Chair(s): Pasqualina Potena
Wed 25 May 2022 09:55 - 10:00 at Room 304+305 - Papers 3: Reliability and Safety Chair(s): Cristian Cadar

Testing is widely recognized as an important stage of the software development lifecycle. Effective software testing can provide benefits such as bug finding, preventing regressions, and documentation. In terms of documentation, unit tests express a unit’s intended functionality, as conceived by the developer. A test oracle, typically expressed as an condition, documents the intended behavior of a unit under a given test prefix. Synthesizing a functional test oracle is a challenging problem, as it must capture the intended functionality rather than the implemented functionality.

In this paper, we propose TOGA (a neural method for Test Oracle GenerAtion), a unified transformer-based neural approach to infer both exceptional and assertion test oracles based on the context of the focal method. Our approach can handle units with ambiguous or missing documentation, and even units with a missing implementation. We evaluate our approach on both oracle inference accuracy and functional bug-finding. Our technique improves accuracy by 33% over existing oracle inference approaches, achieving 96% overall accuracy on a held out test dataset. Furthermore, we show that when integrated with a automated test generation tool (EvoSuite), our approach finds 57 real world bugs in large-scale Java programs, including 30 bugs that are not found by any other automated testing method in our evaluation.

Mon 9 May

Displayed time zone: Eastern Time (US & Canada) change

21:00 - 22:00
21:00
5m
Talk
Are We Training with The Right Data? Evaluating Collective Confidence in Training Data using Dempster Shafer Theory
NIER - New Ideas and Emerging Results
Sangeeta Dey Ajou University, Seok-Won Lee Ajou University
Pre-print Media Attached
21:05
5m
Talk
Automating Staged Rollout with Reinforcement Learning
NIER - New Ideas and Emerging Results
Shadow Pritchard University of Tulsa, Vidhyashree Nagaraju University of Tulsa, Lance Fiondella University of Massachusetts Dartmouth
Pre-print File Attached
21:10
5m
Talk
An Empirical Study on Quality Issues of eBay's Big Data SQL Analytics Platform
SEIP - Software Engineering in Practice
Feng Zhu ebay.Inc, Lijie Xu Institute of Software, Chinese Academy of Sciences, Gang Ma ebay.Inc, Shuping Ji University of Toronto, Jie Wang Peking University, China / Ant Group, China / Alibaba Group, China, Gang Wang ebay.Inc, Hongyi Zhang ebay.Inc, Kun Wan ebay.Inc, Mingming Wang ebay.Inc, Xingchao Zhang ebay.Inc, Yuming Wang ebay.Inc, Jingpin Li ebay.Inc
DOI Pre-print
21:15
5m
Talk
PerfSig: Extracting Performance Bug Signatures via Multi-modality Causal Analysis
Technical Track
Jingzhu He ShanghaiTech University, Yuhang Lin North Carolina State University, Xiaohui Gu North Carolina State University, Chin-Chia Michael Yeh Visa Research, Zhongfang Zhuang Visa Research
DOI Pre-print Media Attached
21:20
5m
Talk
TOGA: A Neural Method for Test Oracle GenerationDistinguished Paper Award
Technical Track
Elizabeth Dinella , Gabriel Ryan Columbia University, USA, Todd Mytkowicz Microsoft Research, Shuvendu K. Lahiri Microsoft Research
DOI Pre-print Media Attached
21:25
5m
Talk
Towards Practical Robustness Analysis for DNNs based on PAC-Model Learning
Technical Track
Renjue Li Institute of Software at Chinese Academy of Sciences, China, Pengfei Yang Institute of Software at Chinese Academy of Sciences, China, Cheng-Chao Huang Nanjing Institute of Software Technology, ISCAS, Youcheng Sun The University of Manchester, Bai Xue Institute of Software at Chinese Academy of Sciences, China, Lijun Zhang Institute of Software, Chinese Academy of Sciences
Pre-print Media Attached

Fri 13 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:00
11:00
5m
Talk
Automating Staged Rollout with Reinforcement Learning
NIER - New Ideas and Emerging Results
Shadow Pritchard University of Tulsa, Vidhyashree Nagaraju University of Tulsa, Lance Fiondella University of Massachusetts Dartmouth
Pre-print File Attached
11:05
5m
Talk
An Empirical Study on Quality Issues of eBay's Big Data SQL Analytics Platform
SEIP - Software Engineering in Practice
Feng Zhu ebay.Inc, Lijie Xu Institute of Software, Chinese Academy of Sciences, Gang Ma ebay.Inc, Shuping Ji University of Toronto, Jie Wang Peking University, China / Ant Group, China / Alibaba Group, China, Gang Wang ebay.Inc, Hongyi Zhang ebay.Inc, Kun Wan ebay.Inc, Mingming Wang ebay.Inc, Xingchao Zhang ebay.Inc, Yuming Wang ebay.Inc, Jingpin Li ebay.Inc
DOI Pre-print
11:10
5m
Talk
PReach: A Heuristic for Probabilistic Reachability to Identify Hard to Reach Statements
Technical Track
Seemanta Saha University of California Santa Barbara, Mara Downing University of California, Santa Barbara, Tegan Brennan , Tevfik Bultan University of California, Santa Barbara
Pre-print Media Attached
11:15
5m
Talk
DeepStability: A Study of Unstable Numerical Methods and Their Solutions in Deep Learning
Technical Track
Eliska Kloberdanz Iowa State University, Kyle Kloberdanz Cape Privacy, Wei Le Iowa State University
Pre-print Media Attached
11:20
5m
Talk
If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components
Technical Track
Boyue Caroline Hu University of Toronto, Lina Marsso University of Toronto, Krzysztof Czarnecki University of Waterloo, Canada, Rick Salay University of Toronto, Huakun Shen University of Toronto, Marsha Chechik University of Toronto
DOI Pre-print Media Attached
11:25
5m
Talk
TOGA: A Neural Method for Test Oracle GenerationDistinguished Paper Award
Technical Track
Elizabeth Dinella , Gabriel Ryan Columbia University, USA, Todd Mytkowicz Microsoft Research, Shuvendu K. Lahiri Microsoft Research
DOI Pre-print Media Attached

Wed 25 May

Displayed time zone: Eastern Time (US & Canada) change

09:30 - 10:30
Papers 3: Reliability and SafetyTechnical Track / NIER - New Ideas and Emerging Results at Room 304+305
Chair(s): Cristian Cadar Imperial College London, UK
09:30
5m
Talk
Repairing Brain-Computer Interfaces with Fault-based Data Acquisition
Technical Track
Cailin Winston University of Washington, Caleb Winston University of Washington, Chloe N Winston University of Washington, Claris Winston University of Washington, Cleah Winston , Rajesh PN Rao University of Washington, René Just University of Washington
Pre-print Media Attached
09:35
5m
Talk
Automating Staged Rollout with Reinforcement Learning
NIER - New Ideas and Emerging Results
Shadow Pritchard University of Tulsa, Vidhyashree Nagaraju University of Tulsa, Lance Fiondella University of Massachusetts Dartmouth
Pre-print File Attached
09:40
5m
Talk
PReach: A Heuristic for Probabilistic Reachability to Identify Hard to Reach Statements
Technical Track
Seemanta Saha University of California Santa Barbara, Mara Downing University of California, Santa Barbara, Tegan Brennan , Tevfik Bultan University of California, Santa Barbara
Pre-print Media Attached
09:45
5m
Talk
DeepStability: A Study of Unstable Numerical Methods and Their Solutions in Deep Learning
Technical Track
Eliska Kloberdanz Iowa State University, Kyle Kloberdanz Cape Privacy, Wei Le Iowa State University
Pre-print Media Attached
09:50
5m
Talk
If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components
Technical Track
Boyue Caroline Hu University of Toronto, Lina Marsso University of Toronto, Krzysztof Czarnecki University of Waterloo, Canada, Rick Salay University of Toronto, Huakun Shen University of Toronto, Marsha Chechik University of Toronto
DOI Pre-print Media Attached
09:55
5m
Talk
TOGA: A Neural Method for Test Oracle GenerationDistinguished Paper Award
Technical Track
Elizabeth Dinella , Gabriel Ryan Columbia University, USA, Todd Mytkowicz Microsoft Research, Shuvendu K. Lahiri Microsoft Research
DOI Pre-print Media Attached
Hide past events

Information for Participants
Mon 9 May 2022 21:00 - 22:00 at ICSE room 2-odd hours - Reliability and Safety 4 Chair(s): Jonathan Sillito
Info for room ICSE room 2-odd hours:

Click here to go to the room on Midspace

Fri 13 May 2022 11:00 - 12:00 at ICSE room 1-odd hours - Reliability and Safety 6 Chair(s): Pasqualina Potena
Info for room ICSE room 1-odd hours:

Click here to go to the room on Midspace