Solved Weird spacing issue after removing borders

I've been using 1px borders on all my sections and rows to be consistent in my spacing (it just helps). I fiddled with the height of my header section before deciding to do it another way, did it and then removed the border since I had no use for it anymore. And now there's a blank space around the top and bottom of my section and my section is stuck at the same height as the row inside. I've added margins around my row but it only make the blank space bigger, however adding just 1px of padding inside the section seems to fix the problem.

I just want to understand what causes it ? I only used Divi's built-in modules with no custom CSS. I've attached a picture of what it looks like in case someone experienced the same thing.