How do I hide the default context menu of the TextBox?

Simply set the ContextMenu property to null as follows:

<TextBox ContextMenu='{x:Null}'>Testing</TextBox>