I could not find anything about this issue. I noticed files named "1" appearing in each folder starting roughly on 12th of August. They contain the shell history for that folder in z-shell format. Disabling the autojump plugin fixed it.
Maybe a missing $ somewhere ($1)?