So those paper figures are usually a form of Shikigami or summoned spirits that are often associated with yokai (supernatural spirit monsters). They appear in many different anime like InuYasha, Spirited Away, Natsme's Book of Friends, Kamisama Hajimemashita, and several others.
https://inuyasha.fandom.com/wiki/Shikigami