The son of the president told reporters outside the U.S. Capitol that he will only speak in public.