Towards Safe Agentic AI Performance Engineering
- Dan Williams
- Milo Craun
- et al.
- 2025
- SOSP 2025
Workshop paper
Publications
89 results for AI Testing
The NorthPole Validator: A Cycle-Accurate Simulator for HW/SW Codesign of a Prescheduled Neural Inference Accelerator
- Alexander Andreopoulos
- Michael V. Debole
- et al.
- 2025
- HPEC 2025
Conference paperCan Large Reasoning Models do Analogical Reasoning under Perceptual Uncertainty?
- Giacomo Camposampiero
- Michael Hersche
- et al.
- 2025
- NeSy 2025
Conference paperStructText: A Synthetic Table-to-Text Approach for Benchmark Generation with Multi-Dimensional Evaluation
- 2025
- VLDB 2025
Workshop paperBenchmarking GenAI Like a Pro: Scaling Experiments, Predicting Performance and Keeping Your Sanity
- 2025
- AIDEV 2025
TalkEvaluating LLM-based Agents: Foundations, Best Practices and Open Challenges
- Roy Bar-Haim
- Arman Cohan
- et al.
- 2025
- IJCAI 2025
TutorialAutomated Testing of COBOL to Java Transformation
- Sandeep Hans
- Atul Kumar
- et al.
- 2025
- FSE 2025
Conference paperThink Again! The Effect of Test-Time Compute on Preferences, Opinions, and Beliefs of Large Language Models
- George Kour
- Itay Nakash
- et al.
- 2025
- ACL 2025
Conference paperJuStRank: Benchmarking LLM Judges for System Ranking
- Ariel Gera
- Odellia Boni
- et al.
- 2025
- ACL 2025
Conference paperGEM2 Workshop: Generation, Evaluation & Metrics
- Ofir Arviv
- Miruna Clinciu
- et al.
- 2025
- ACL 2025
Workshop