Chrome don't work that way. It keeps active connection with site, while you 'pause'. Did you tried disconnect internet & resume?

if it works fine, the reporting plugin for issue.