Parallel Program Generation for Hybrid Tabular-Textual Question Answering
Wenke Yang, Zihan Yang, Liuyi Chen, Ruiqing Yan, Zhengyi Yang*, Linhan Zhang, Yifu Tang
RAIDS Lab Authors
Details
Research Area
Tags
Resources
Abstract
Hybrid tabular-textual question answering (HTQA) involves tapping into a mosaic of data sources, traditionally managed through LSTM-based step-by-step reasoning, which has been vulnerable to exposure bias and subsequent error accumulation. This paper introduces an innovative parallel program generation method, ConcurGen, aiming to transform this paradigm by simultaneously formulating comprehensive program constructs that seamlessly blend operations and values. This approach not only rectifies the inherent pitfalls of sequential methodologies but also infuses efficiency into the process. When subjected to rigorous evaluation on benchmarks like the ConvFinQA and MultiHiertt datasets, our methodology showcased significant superiority over prevalent models such as FinQANet and MT2Net. This was evidenced by enhancements in various performance metrics, effectively raising the bar for what's deemed state-of-the-art. Notably, beyond setting these commendable benchmarks, our method facilitates a striking acceleration in program creation, achieving speeds nearly 21 times faster. Additionally, a salient feature of our approach becomes evident when numerical reasoning steps escalate: unlike traditional models, our system sustains its robust performance, emphasizing its adaptability and resilience in complex scenarios.
Author Affiliations
BibTeX
@inproceedings{yang2024parallel,
title = {Parallel Program Generation for Hybrid Tabular-Textual Question Answering},
author = {Yang, Wenke and Yang, Zihan and Chen, Liuyi and Yan, Ruiqing and Yang, Zhengyi and Zhang, Linhan and Tang, Yifu},
editor = {Zhang, Wenjie and Tung, Anthony and Zheng, Zhonglong and Yang, Zhengyi and Wang, Xiaoyang and Guo, Hongjie},
booktitle = {Web and Big Data},
year = {2024},
publisher = {Springer Nature Singapore},
address = {Singapore},
pages = {121--137},
isbn = {978-981-97-7232-2}
}