The operating system may manage the page table in such a way that a reference to a page that has been previously swapped out to disk causes a page fault.
If the pages containing these pointers or the code that they invoke were pageable, interrupt-handling would become far more complex and time-consuming, particularly in the case of page fault interruptions.