The amygdala is indeed crucial for monitoring our environment and deciding what's worth getting worked up over. Once the amygdala determines this, however, it merely trips another circuit to actually produce the panic.