I don't think we do know that the Speaker is human. Have you read his grimoire card? I see nothing about being a human. In fact all it does it make him seem even more mysterious and less understood than we thought.