Overcoming the Limitations of Accelerator-Centric Architectures with Memoization-Driven Specialization