The toxicity is caused by the cyanide ion, which halts cellular respiration by acting as a non-competitive inhibitor for an enzyme in mitochondria called cytochrome c oxidase.
Despite not interacting with the active site, non-competitive inhibitors do reduce the rate of the reaction because they cause the enzyme to change shape.