Use bool for return types in hashtable functions

Many hashtable functions return 1 or 0 as an int. This was done before we started allowing bool. We should probably change them all to bool. (A separate PR at some point.)

_Originally posted by @zuiderkwast in https://github.com/valkey-io/valkey/pull/2089#discussion_r2203523634_
            