Looks like FRONTPANEL_MISO is on PB4 which defaults to NJTRST. And I guess it's floating low.Adding a pullup FPGA side should fix this.