It's worth checking out the recent exposé on LG TVs which showed they are doing exactly that. Recording all voices in the living room, flicking the data back to base and using keywords to send you related marketing crap. This happens even when the TV is in standby mode.