I will address the question “What do historians of mathematics do?” by turning to another: “What is algebra?” In answering this second question, and surveying the way that the answer changes as we move through the centuries, I will highlight some of the problems that face historians of mathematics when it comes to interpreting historical mathematics, and give a flavour of what it means to study the history of mathematics.