Recent advances in agentic frameworks have enabled AI agents to perform complex reasoning and decision-making. However, evidence comparing their reasoning performance, efficiency, and practical suitability remains limited. To address this gap, we empirically evaluate 22 widely used agentic frameworks across three reasoning benchmarks: BBH, GSM8K, and ARC. The frameworks were selected from 1,200 GitHub repositories collected between January 2023 and July 2025 and organized into a taxonomy based on architectural design. We evaluated them under a unified setting, measuring reasoning accuracy, execution time, computational cost, and cross-benchmark consistency. Our results show that 19 of the 22 frameworks completed all three benchmarks. Among these, 12 showed stable performance, with mean accuracy of 74.6-75.9%, execution time of 4-6 seconds per task, and cost of 0.14-0.18 cents per task. Poorer results were mainly caused by orchestration problems rather than reasoning limits. For example, Camel failed to complete BBH after 11 days because of uncontrolled context growth, while Upsonic consumed USD 1,434 in one day because repeated extraction failures triggered costly retries. AutoGen and Mastra also exhausted API quotas through iterative interactions that increased prompt length without improving results. We also found a sharp drop in mathematical reasoning. Mean accuracy on GSM8K was 44.35%, compared with 89.80% on BBH and 89.56% on ARC. Overall, this study provides the first large-scale empirical comparison of agentic frameworks for reasoning-intensive software engineering tasks and shows that framework selection should prioritize orchestration quality, especially memory control, failure handling, and cost management.
Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al.· arXiv.org· 1 citation
Large Language Models (LLM) and Generative Pre-trained Transformers (GPT), are reshaping the field of Software Engineering (SE). They enable innovative methods for executing many software engineering tasks, including automated code generation, debugging, maintenance, etc. However, only a limited number of existing works have thoroughly explored the potential of GPT agents in SE. This vision paper inquires about the role of GPT-based agents in SE. Our vision is to leverage the capabilities of multiple GPT agents to contribute to SE tasks and to propose an initial road map for future work. We argue that multiple GPT agents can perform creative and demanding tasks far beyond coding and debugging. GPT agents can also do project planning, requirements engineering, and software design. These can be done through high-level descriptions given by the human developer. We have shown in our initial experimental analysis for simple software (e.g., Snake Game, Tic-Tac-Toe, Notepad) that multiple GPT agents can produce high-quality code and document it carefully. We argue that it shows a promise of unforeseen efficiency and will dramatically reduce lead-times. To this end, we intend to expand our efforts to understand how we can scale these autonomous capabilities further.
Z. Rasheed, Muhammad Waseem, Kai-Kristian Kemell et al.· XP Workshops· 35 citations· ⚡2
The growing domain of liquidity in computing extends its boundaries to include advancements like liquid artificial intelligence (AI). Liquid AI leverages liquid software using isomorphic Internet of Things (IoT) architecture to enhance computation at the edge. This innovation unveils vast opportunities yet also introduces significant challenges, particularly around privacy and trust. We explore the vulnerabilities that might hinder the progression of this technological fusion toward achieving trustworthy AI. Through an intensive examination of the literature, this research highlights the heightened threats to data integrity and stakeholder trust in these evolving ecosystems. Four main challenges: Data collection, Data storage and Access, Data utilization and sharing, and Surveillance and profiling were identified and examined under privacy, and two, Algorithms and decision-making and Security of IoT infrastructure under trust. The concerns are further categorized to highlight their impact on the development of trustworthy AI. The study acknowledges the early state of the field. Consequently, this research navigates through the limited available literature, initiating a pioneering discourse emphasizing fostering a foundation for developing secure and trustworthy Liquid AI environments.
M. Agbese, Niko Mäkitalo, Muhammad Waseem et al.· IoT· 6 citations· ⚡1
The rapid adoption of Generative AI (GenAI) in the software development life cycle (SDLC) increases computational demand, which can raise the carbon footprint of development activities. At the same time, organizations are increasingly embedding governance mechanisms into GenAI-assisted development to support trust, transparency, and accountability. However, these governance mechanisms introduce additional computational workloads, including repeated inference, regeneration cycles, and expanded validation pipelines, increasing energy use and the carbon footprint of GenAI-assisted development. This paper proposes Carbon-Aware Governance Gates (CAGG), an architectural extension that embeds carbon budgets, energy provenance, and sustainability-aware validation orchestration into human-AI governance layers. CAGG comprises three components: (i) an Energy and Carbon Provenance Ledger, (ii) a Carbon Budget Manager, and (iii) a Green Validation Orchestrator, operationalized through governance policies and reusable design patterns.
M. Abbasi, T. Mikkonen, Petri Ihantola et al.· 2026 IEEE 23rd International...· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Tree-based algorithms, such as XGBOOST – an open source implementation of Gradient Boosted Decision Trees (GBDT) – are ubiquitous for many Machine Learning (ML) tasks, especially when dealing with tabular/structured data and requir- ing explainability. As dataset size continues to grow, training ensembles of trees (random forest, XGBOOST, CatBoost, Light- GBM) has been parallelized on multi-core systems, accelerated on GPUs, and distributed on computer clusters. However, FPGA acceleration targeting the training of tree-based ML remains underexplored. Analyzing the tree structure of trained GBDT models, we observe a significant overlap of the features used as nodes at the top levels of the ensemble. Guided by this insight, we modify the training algorithm of GBDT to harness the computational redundancy associated with the top nodes, as well as to create a novel accelerator architecture, FaGBM. For training, FaGBM reduces end-to-end GBDT training latency by up to 2× speedup over NVIDIA Jetson Thor with XGBOOST, LightGBM, and Cat- Boost. Moreover, for GBDT, FaGBM employs a novel adaptive approximate division to compute the split gain, which reduces LUT usage by up to 40K. For Decision Trees training, this paper investigates bit-wise approximate logarithms, resulting in an 87% reduction in DSP usage in FPGAs compared to a fixed- point implementation. The experiments further demonstrate that FaGBM preserves model accuracy while achieving significant energy efficiency over optimized multi-core and GPU baselines.
Ali Emre Oztas, Mahir Demir, Can Erim Karsal et al.· Research Explorer (The Unive...· 0 citations
Rapid urbanization has significantly increased pressure on transportation systems, healthcare, energy distribution, environmental monitoring, waste management, public safety, and other municipal services. Traditional city management approaches are increasingly unable to process the enormous volume of heterogeneous data generated by modern urban environments. The integration of the Internet of Things (IoT) with cloud computing provides an effective solution for developing scalable smart city platforms capable of supporting real-time monitoring, intelligent decision-making, and efficient resource management. This paper presents a scalable cloud-enabled smart city architecture that integrates IoT sensing devices, edge gateways, cloud infrastructure, big data analytics, and artificial intelligence to support multiple smart city services within a unified platform. The proposed architecture employs a layered framework consisting of perception, communication, edge computing, cloud services, data analytics, application, and security layers to improve scalability, interoperability, reliability, and service availability. The study critically reviews recent advances in IoT cloud integration, identifies major challenges including security, privacy, latency, interoperability, and energy efficiency, and proposes practical strategies for addressing these limitations through containerization, micro services,edge cloud collaboration, and AI-driven resource orchestration. The proposed framework demonstrates how cloud computing can dynamically allocate computational resources to accommodate growing IoT deployments while maintaining quality of service. The paper concludes that scalable IoT-cloud platforms represent the foundation for next-generation smart cities and recommends future integration with digital twins, federated learning, block chain, and 6G communication technologies for improved sustainability and resilience.
1*Mustapha Malami Idina, 2Abubakar Jibo Magayaki, 3Mubarak Jibril Yeldu· Zenodo (CERN European Organi...· 0 citations
Rapid urbanization has significantly increased pressure on transportation systems, healthcare, energy distribution, environmental monitoring, waste management, public safety, and other municipal services. Traditional city management approaches are increasingly unable to process the enormous volume of heterogeneous data generated by modern urban environments. The integration of the Internet of Things (IoT) with cloud computing provides an effective solution for developing scalable smart city platforms capable of supporting real-time monitoring, intelligent decision-making, and efficient resource management. This paper presents a scalable cloud-enabled smart city architecture that integrates IoT sensing devices, edge gateways, cloud infrastructure, big data analytics, and artificial intelligence to support multiple smart city services within a unified platform. The proposed architecture employs a layered framework consisting of perception, communication, edge computing, cloud services, data analytics, application, and security layers to improve scalability, interoperability, reliability, and service availability. The study critically reviews recent advances in IoT cloud integration, identifies major challenges including security, privacy, latency, interoperability, and energy efficiency, and proposes practical strategies for addressing these limitations through containerization, micro services,edge cloud collaboration, and AI-driven resource orchestration. The proposed framework demonstrates how cloud computing can dynamically allocate computational resources to accommodate growing IoT deployments while maintaining quality of service. The paper concludes that scalable IoT-cloud platforms represent the foundation for next-generation smart cities and recommends future integration with digital twins, federated learning, block chain, and 6G communication technologies for improved sustainability and resilience.
1*Mustapha Malami Idina, 2Abubakar Jibo Magayaki, 3Mubarak Jibril Yeldu· Zenodo (CERN European Organi...· 0 citations
Literature and practice has established that the lack of management commitment has been one of the top reasons for a failed SPI (software process improvement) initiative. The paper reports results from an ongoing study aimed at clarifying the role and the meaning of management commitment in SPI initiatives. Results from five focused interviews with SPI professionals are reported together with results from 12 SPI initiatives where the level of management commitment (in terms of concrete signs) was measured in order to test whether it would correlate with the level of success of an SPI initiative. In contrast with the evidence from the literature, the results show that none of the signs of management commitment correlated significantly with the success of the SPI initiatives. It is suggested that the concept of champion may have explained the SPI project success better than management commitment. The paper concludes that many of the SPI initiatives do not require management commitment beyond obtaining the resources needed.
P. Abrahamsson· Proceedings of the 26th Euro...· 27 citations· ⚡2
What if pathology foundation models could do more with less? GigaPath-Flash and GigaTIME-Flash cut computational demands while maintaining strong performance, opening the door to larger studies and broader exploration. The post GigaPath-Flash and GigaTIME-Flash: Toward population-scale discovery with efficient pathology foundation models appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduAug 31, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.
MIT News · Artificial Intelligence· news.mit.eduAug 27, 2026
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.