Remove single user from AcceptMessagesOnlyFrom attribute

get-mailbox -identity “Username” | Set-Mailbox -AcceptMessagesOnlyFromSendersOrMembers “add all users except the user you want to remove seperated by Comma”