Correct because right now the man gets no authority. Even when abortion was legal a man had no say if they didnt want their child aborted (not saying this is a wrong legal thing, just that it is fact). If what the man wants has no effect on the outcome then neither should thepenalty.
Are you suggesting that a woman should only be allowed to have an abortion if the man approves?