Move fsync_and_close() to common/fd.[ch].

No functional changes to fsync_and_close(), but tag the file_type as
const and clean up some minor style issues while moving this.

Add include for fd.h header where needed as well.

Bug 7146.