Yes, you lose little bit each time. There is also a video about always starting with a clean edge. It does make sense but I don't stress over it either.
A favorite.
https://www.youtube.com/watch?v=XfvKE0Y6npk
A second one.
https://www.youtube.com/watch?v=9bkJKQwq4FI