Removed from elementary school libraries is different from being removed from elementary school (or, given the depth of the topic, perhaps middle school) curricula.

The former gives young kids access to the material without any adult guidance about the context and content, allowing them to take these dehumanizing texts on board without any critical countermeasures. The latter gives an opportunity to critique and examine the text both within its time period and through contemporary lenses.

I have absolutely no problem with a school librarian saying "this is not a book that kids under age 11 are going to have access to read without supervision" based upon content. That's a school librarian's job. Just as graphic erotic content isn't on an elementary library's shelves, there's no reason why graphically racist content needs to be either.