"Red Bull is a pretty toxic environment right now," claims Brown