I imagine the family grew quite rich from doing so, and the castle has a lot of niceties, including a "solar" at the top with larger windows of very high quality. They also apparently had a dovecot built into one turret to provide a regular supply of eggs. This is about as nice as living in such towers got.