Awesome-Reasoning-Foundation-Models

overview

survey.pdf | A curated list of awesome large AI models, or foundation models, for reasoning.

We organize the current foundation models into three categories: language foundation models, vision foundation models, and multimodal foundation models. Further, we elaborate the foundation models in reasoning tasks, including commonsense, mathematical, logical, causal, visual, audio, multimodal, agent reasoning, etc. Reasoning techniques, including pre-training, fine-tuning, alignment training, mixture of experts, in-context learning, and autonomous agent, are also summarized.

We welcome contributions to this repository to add more resources. Please submit a pull request if you want to contribute! See CONTRIBUTING.

table of contents

0 Survey
1 Relevant Surveys
2 Foundation Models

- 2.1 Language Foundation Models - 2.2 Vision Foundation Models - 2.3 Multimodal Foundation Models - 2.4 Reasoning Applications

3 Reasoning Tasks

- 3.1 Commonsense Reasoning - 3.2 Mathematical Reasoning - 3.3 Logical Reasoning - 3.4 Causal Reasoning - 3.5 Visual Reasoning - 3.6 Audio Reasoning - 3.7 Multimodal Reasoning - 3.8 Agent Reasoning - 3.9 Other Tasks and Applications

4 Reasoning Techniques

- 4.1 Pre-Training - 4.2 Fine-Tuning - 4.3 Alignment Training - 4.4 Mixture of Experts (MoE) - 4.5 In-Context Learning - 4.6 Autonomous Agent

0 Survey

overview

This repository is primarily based on the following paper:

>A Survey of Reasoning with Foundation Models: Concepts, Methodologies, and Outlook
>

[Paper][ArXiv]

[Jiankai Sun](),

Chuanyang Zheng, Enze Xie, Zhengying Liu, [Ruihang Chu](), [Jianing Qiu](), [Jiaqi Xu](), [Mingyu Ding](), Hongyang Li, [Mengzhe Geng](), [Yue Wu](), Wenhai Wang, [Junsong Chen](), [Zhangyue Yin](), [Xiaozhe Ren](), Jie Fu, Junxian He, Wu Yuan, Qi Liu, Xihui Liu, Yu Li, Hao Dong, Yu Cheng, Ming Zhang, Pheng Ann Heng, Jifeng Dai, Ping Luo, Jingdong Wang, Ji-Rong Wen, Xipeng Qiu, Yike Guo, Hui Xiong, Qun Liu, and Zhenguo Li

If you find this repository helpful, please consider citing:

@article{sun2025survey,
  author = {Sun, Jiankai and Zheng, Chuanyang and Xie, Enze and Liu, Zhengying and Chu, Ruihang and Qiu, Jianing and Xu, Jiaqi and Ding, Mingyu and Li, Hongyang and Geng, Mengzhe and Wu, Yue and Wang, Wenhai and Chen, Junsong and Yin, Zhangyue and Ren, Xiaozhe and Fu, Jie and He, Junxian and Wu, Yuan and Liu, Qi and Liu, Xihui and Li, Yu and Dong, Hao and Cheng, Yu and Zhang, Ming and Heng, Pheng Ann and Dai, Jifeng and Luo, Ping and Wang, Jingdong and Wen, Ji-Rong and Qiu, Xipeng and Guo, Yike and Xiong, Hui and Liu, Qun and Li, Zhenguo},
  title = {A Survey of Reasoning with Foundation Models: Concepts, Methodologies, and Outlook},
  year = {2025},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  issn = {0360-0300},
  url = {https://doi.org/10.1145/3729218},
  doi = {10.1145/3729218},
  abstract = {Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation. It serves as a fundamental methodology in the field of Artificial General Intelligence (AGI). With the ongoing development of foundation models, there is a growing interest in exploring their abilities in reasoning tasks. In this paper, we introduce seminal foundation models proposed or adaptable for reasoning, highlighting the latest advancements in various reasoning tasks, methods, and benchmarks. We then delve into the potential future directions behind the emergence of reasoning abilities within foundation models. We also discuss the relevance of multimodal learning, autonomous agents, and super alignment in the context of reasoning. By discussing these future research directions, we hope to inspire researchers in their exploration of this field, stimulate further advancements in reasoning with foundation models, e.g. Large Language Models (LLMs), and contribute to the development of AGI.},
  journal = {ACM Comput. Surv.},
  month = apr,
  keywords = {Reasoning, Foundation Models, Multimodal, AI Agent, Artificial General Intelligence, LLM}
}