Fix Coverity issues caused by commit 250378c2.

Since you can no longer get into the code without there being a buffer there is
no reason to check it.