The government is also working on how it would respond to a serious incident involving autonomous AI agents.