Calls for asbestos to be removed from schools are understandable but not practical, according to a health and safety adviser.