Anthony Albanese has rejected opposition calls to personally apologise to Japan's prime minister over controversial comments made on a podcast.

In an appearance on the Bush Deep podcast which aired in July, the prime minister mentioned two crown melons gifted to him by his Japanese counterpart Sanae Takaichi.

When asked by host Nikki Osborne about how the melons were brought in to Australia, Mr Albanese said he didn't know, while making hand gestures near his chest.

"She brought two? She just came in looking like Pamela Anderson," Ms Osborne said.

"She brought two, and they're beautiful," Mr Albanese replied.

The podcast comments came under fire again after former Japanese ambassador Shingo Yamagami accused the prime minister of failing to understand the cultural significance of the melons.

Crown melons are highly prized as gifts because of their intense sweetness and are cultivated through a one tree, one fruit farming method where each plant produces just one melon.

The former ambassador also said Mr Albanese's remarks put at risk bilateral ties between Australia and Japan.

When asked by coalition MPs during Question Time on Tuesday whether he would personally apologise to Ms Takaichi, Mr Albanese rejected claims the comments were disrespectful to women.

"I reject the assertion of the question," he told parliament.

"Australia and Japan have never been closer or more strategically aligned, and my government has taken our special strategic partnership to new heights.

"During the recent visit by Prime Minister Takaichi, we announced substantial outcomes, including a joint declaration on economic security cooperation, signalling our resolve to support each other in the face of economic coercion."

During the same podcast interview, Mr Albanese also came under fire for playing a game of shag, marry or date between Kylie Minogue, Rhonda Burchmore and Nicole Kidman.

"Oh, Kylie, clearly ... all of the above," Mr Albanese said.

The prime minister later apologised for the comments.