Research on Development of LLMs and Manual Comparison of Applications

This paper provides a systematic analysis of the real-world applications of large language models (LLMs) in human-computer interaction, emphasizing their performance and effectiveness. In recent years, the advanced capabilities of LLMs have revolutionized this field, leading to widespread adoption across both academic and practical domains. However, the lack of comprehensive assessments of the practical performance of these models has hindered researchers and practitioners from distinguishing between their capabilities and performance differences. This study examines how LLMs are applied in reasoning tasks within natural language processing, offering a detailed perspective that enhances the understanding and application of these models for both researchers and practitioners. It assesses the performance of leading open-source LLMs using the Moss dataset, focusing on their effectiveness, reliability, and applicability in real-world scenarios. Through meticulous manual comparison and evaluation across eleven key performance metrics, this research reveals performance disparities among these models in practical tasks. By shedding light on these comparative analyses, this study aims to guide future investigations toward a nuanced comprehension of LLM capabilities and limitations, addressing the evolving needs of academia and industry. Future endeavors will expand this analysis to encompass a broader spectrum of models and tasks, providing deeper insights and actionable recommendations for both the research and practical communities. © 2024 IEEE.