It's also worth noting that the dove is a longstanding symbol of the Holy Spirit, which I have always assumed to be feminine.

I have a different take on the turtle, which I have always taken to be a symbol of God in his/her wholeness, rather than the feminine.