With organisers planning to decide on the matter by the end of the month, the survey showed 77 per cent of respondents were against allowing foreign fans to attend, versus just 18 per cent in favour.
Organisers have also said they would decide on maximum capacity for spectators in general in April.
In the Yomiuri poll, 48 per cent said they were against allowing any spectators into venues and 45 per cent were in favour.
The Olympics, postponed by a year because of the pandemic, are scheduled for July 23 to Aug. 8 and the Paralympics from Aug. 24 to Sept. 5.
REUTERS