The prime minister did not say what evidence lay behind the answer, and a pro-Brexit group criticised the comments.