Evening Session B
| Wednesday – February 25, 2026 5:30 PM – 8:30 PM PT |
|
| Sharing Experiences Using LLMs for Software Development and Evaluation Instructor: Mark Sherman, Software Engineering Institute, Carnegie Mellon University ♦ (bio) |
|
| This session dovetails with the plenary session on “An Update on Using LLMs for creating and Evaluating Software.” The session provides a forum for interested participants to share their experiences with using LLMs in their software development practice. It also provides participants who are considering using LLMs with the lessons learned by other practitioners. This area of research is evolving rapidly with extreme positions being articulated in the press but with relatively little replicable data. Because a lot of the experience is still anecdotal, forums like this session offer an opportunity to share and exchange information that otherwise is not formally written up and published.
The session starts with the lead providing an overview of the claims, issues and scenarios for using LLMs in software development and evaluation. The leader recently led a webinar on the topic of using LLMs in software development, which resulted in over 100 questions generated by the attendees. As needed, these questions can be used to organize the discussion into areas of high interest and impact. |