It matters in the NET but it should matter, it's not the same. Now maybe the NET should have a semi-away semi-home distinction like KenPom does, but there's still a huge difference between playing in your home arena and playing somewhere else.
The comfort/routine of your home locker room, the student section, sometimes even the ball itself can be an advantage/disadvantage.