I just realized this a year ago. It just weakens your writing. It’s just like explaining yourself as you are explaining yourself. You should just be more sure when you speak.
“I am just going to the mall” vs. “I am going to the mall”
“I was just cleaning” vs. “I am cleaning”
“I was just shopping” vs. “I was shopping”
It just leaves room for doubt.