Why X-rays do not tell the whole story