Calls to remove asbestos from schools are ‘understandable’ but ‘not practical’, according to a health and safety adviser.