IEEE

3D-CIMlet: A Chiplet Co-Design Framework for Heterogeneous In-Memory Acceleration of Edge LLM Inference and Continual Learning

Abstract: The design space for edge AI hardware supporting large language model (LLM) inference and continual learning is underexplored. We present 3D-CIMlet, a thermal-aware modeling and co-design ...
GitHub

OntoMem: The Self-Consolidating Memory

OntoMem is built on the concept of Ontology Memory—structured, coherent knowledge representation for AI systems. Give your AI agent a "coherent" memory, not just "fragmented" retrieval. Traditional ...
IEEE

H2O: Heterogeneity-Aware Hierarchical Orchestration for Memory-Efficient on-Device LLM Inference

Abstract: On-device Large Language Model (LLM) inference enables private, personalized AI but faces memory constraints. Despite memory optimization efforts, scaling laws continue to increase model ...
unite

2026 Predictions: From LLM Commoditization to the Age of Agentic Memory

At the start of 2025, I predicted the commoditization of large language models. As token prices collapsed and enterprises moved from experimentation to production, that prediction quickly became ...