Is it normal for this to happen in a relationship?

welcome to a healthy relationship. you're gonna not always be all lovey-dovey all the time. bickering is just a part of life from time to time. just don't let it get hold of you and control you.